4 Commits

Author	SHA1	Message	Date
Albert S.	7667d32191	simplify and fix fetching chrome version after some wikipedia format change	2019-11-10 09:50:31 +01:00
Albert S.	52df5c69e4	fetchers: update browser version automatically. updated headers to look more like recent versions	2019-08-27 13:12:40 +02:00
Albert S.	d51b3d752a	update/correct user agent	2017-08-11 17:49:45 +02:00
Albert S.	3a723b9440	Added fetchers concept: seperate scripts to fetch the feeds ... Fetchers claim to be a certain client. They try to send the same headers as the original client. That's better than a simple curl request with a fake user agent, because curl doesn't send the other headers like the original client and therefore its traffic stands out.	2017-08-11 12:57:30 +02:00