19 Commits

Author SHA1 Message Date
ae160942bb welp 2022-05-01 02:44:54 +00:00
5b76339e40 add mastodon test 2022-01-01 05:16:08 +00:00
ddb93ee852 add a test for FeedSource 2022-01-01 01:00:34 +00:00
ad7a1edaf1 fix FeedSource item sorting
we were sorting by strings instead of parsed dates and it was getting
confused by RFC1123 dates that looked like

    Thu, 02 Dec 2021 00:00:00 -0700
    Mon, 20 Sep 2021 00:00:00 -0600
    Mon, 06 Sep 2021 00:00:00 -0600
    Thu, 02 Sep 2021 00:00:00 -0600
    Sun, 22 Aug 2021 00:00:00 -0600

which of course sort like

    Thu, 02 Sep 2021 00:00:00 -0600
    Thu, 02 Dec 2021 00:00:00 -0700
    Sun, 22 Aug 2021 00:00:00 -0600
    Mon, 20 Sep 2021 00:00:00 -0600
    Mon, 06 Sep 2021 00:00:00 -0600
2022-01-01 00:55:54 +00:00
2f3ae0c09b use the Source, interface 2022-01-01 00:52:03 +00:00
4017f94b56 move MaxBytesReader to another file 2022-01-01 00:51:10 +00:00
a606a15903 sprinkle some First()s 2021-12-31 22:29:06 +00:00
df2ebd5b6a show boosts 2021-12-31 22:28:06 +00:00
2182e4e739 ignore script tags and such when extracting text 2021-12-31 22:26:28 +00:00
ab1da46096 use NewRequestWithContext 2021-12-31 22:25:30 +00:00
ac5bfa7ad7 limit response bodies 2021-12-31 22:24:58 +00:00
808cc164f1 use a real context w/ deadline 2021-12-31 09:03:45 +00:00
c305e96334 huh not sure why go.sum hadn't been added 2021-12-31 08:48:36 +00:00
9221cf8ec8 better mastodon text formatting 2021-12-31 08:48:18 +00:00
2e195e36a6 stub out a mastodon feed source 2021-12-31 08:46:49 +00:00
6a8856c170 fetch the url ourself
makes way for caching the response

also clear src.Error on success
2021-12-31 06:22:08 +00:00
d260db550d remove feedurls variable 2021-12-31 06:20:09 +00:00
ce9960c06a let's fetch some feeds 2021-11-15 03:32:24 +00:00
cb8d99214a Initial commit 2021-09-30 00:23:50 +00:00