I manage an external archive of We Are All Pokémon Trainers, and I decided that with the new style I'd completely refresh the archive for more consistent styling. But with the thread being 17,781 pages as of this post… that's a lot of requests my script was sending to the site. The script kept stopping and now I'm getting anywhere from 50% to 75% packet loss when I ping tvtropes.org from my VPS. 199.180.255.162 is the IP address of the machine running the script.
And sorry for being an idiot trying to download almost eighteen thousand pages in one go >_>
Edit: After having waited for a bit it seems that it's working properly again. I know now to break up requests for large numbers of pages over time.
I manage an external archive of We Are All Pokémon Trainers, and I decided that with the new style I'd completely refresh the archive for more consistent styling. But with the thread being 17,781 pages as of this post… that's a lot of requests my script was sending to the site. The script kept stopping and now I'm getting anywhere from 50% to 75% packet loss when I ping tvtropes.org from my VPS. 199.180.255.162 is the IP address of the machine running the script.
And sorry for being an idiot trying to download almost eighteen thousand pages in one go >_>
Edit: After having waited for a bit it seems that it's working properly again. I know now to break up requests for large numbers of pages over time.
edited 10th Feb '15 9:44:47 PM by Sixthhokage1