Albert S.
6a9849fe09
README.md: Minor improvements
2020-08-20 18:47:25 +02:00
Albert S.
7667d32191
simplify and fix fetching chrome version after some wikipedia format change
2019-11-10 09:50:31 +01:00
Albert S.
39e724dc90
updated README
2019-08-27 13:42:10 +02:00
Albert S.
52df5c69e4
fetchers: update browser version automatically. updated headers to look more like recent versions
2019-08-27 13:12:40 +02:00
Albert S.
62983d7ddd
Improve README (spelling and clarifications)
2017-08-17 10:34:35 +02:00
Albert S.
95f4964f1f
renamed README -> README.md
2017-08-16 21:17:08 +02:00
Albert S.
16c40f305d
README updated
2017-08-16 21:17:01 +02:00
Albert S.
d51b3d752a
update/correct user agent
2017-08-11 17:49:45 +02:00
Albert S.
b01b396783
allow feed configs to overwrite proxy command
2017-08-11 16:42:37 +02:00
Albert S.
7d664e4752
when reading feed file names from feed directory, randomize them
2017-08-11 13:42:29 +02:00
Albert S.
cb1a4c743c
Use per-file config for feeds; allow to hard code fetcher for feed
...
More flexible and easier to handle than reading from the input file.
2017-08-11 13:14:39 +02:00
Albert S.
3a723b9440
Added fetchers concept: seperate scripts to fetch the feeds
...
Fetchers claim to be a certain client. They try to send the same
headers as the original client. That's better than a simple curl request
with a fake user agent, because curl doesn't send the other headers like
the original client and therefore its traffic stands out.
2017-08-11 12:57:30 +02:00
Albert S.
8a80aa0d6d
syncnow support added
2017-06-21 12:23:53 +02:00
Albert S.
b148780344
exit if input file does not exist
2017-06-21 12:14:34 +02:00
Albert S.
0cd4d3b927
added paragraph on network containers
2017-04-16 21:00:34 +02:00
Albert S.
3dc43fb109
fixed typo, updated todo
2017-04-15 18:19:26 +02:00
Albert S.
d53b17d189
print when we fail to fetch a url
2017-04-15 16:33:48 +02:00
Albert S.
c257c13816
init
2017-04-15 16:24:28 +02:00
Albert S.