Added fetchers concept: seperate scripts to fetch the feeds
Fetchers claim to be a certain client. They try to send the same headers as the original client. That's better than a simple curl request with a fake user agent, because curl doesn't send the other headers like the original client and therefore its traffic stands out.
Šī revīzija ir iekļauta:
2
fetchers/firefox_agents
Parasts fails
2
fetchers/firefox_agents
Parasts fails
@ -0,0 +1,2 @@
|
||||
Mozilla/5.0 (X11; Linux x86_64; rv:55.0) Gecko/20100101 Firefox/55.0
|
||||
Mozilla/5.0 (Windows NT 10.0; WOW64; rv:55.0) Gecko/20100101 Firefox/55.0
|
Atsaukties uz šo jaunā problēmā
Block a user