Trac is very slow since a few days

[GerdP]

Might also be https://josm.openstreetmap.de
Maybe this is related to the recent OS changes?
Or maybe the scripts for #16944 are running on this machine?

[stoecker]

There is a massive site scraping robot active in the last time called "facebookexternalhit/1.1". Together with all the other load that's probably to much ATM.

[stoecker]

Actually is should not be a site scraper according to ​http://www.facebook.com/externalhit_uatext.php but it does access LOTS of pages which no user would link manually.

[GerdP]

Is it possible to deny access? Would that help?

[stoecker]

Replying to GerdP:

Is it possible to deny access? Would that help?

They are still following the rules (although they are doing 25% of all page accesses ATM). We're in process of renewing server anyway, so I didn't want to do a harsh reaction until situation is solved or becomes unbearable.

[GerdP]

I think it is unbearable. Sometimes I wait a minute to get a refresh. Maybe you can limit the robot somehow?

[stoecker]

Hmm, checked it again. They do NOT follow the rules. They grab much too fast. Blocked now :-)

[GerdP]

Thanks, seems to work better again.