nutballs

lol. steps to build an infinity fast scraper...

1) build a scraper which saves sentences to a database, or a file for that matter.
2) deploy that to a shared host where you can run dozens of sites, and only EACH site is monitored for abuse, not your whole account. install as many times as you want. run at a scrape speed below whatever threshold might get you in trouble.
3) build a home base manager to pull down sentences from the scraper nodes.
4) laugh when you look at your database 20 minutes later and have a quarter million sentences without even raising a blip on anyones radar.

ahh the tubes are a giggle when you know how to boink em.

vsloathe

Boinking Tubes Since 1996.

nutballs

its not so much that I couldnt do it fast before, and actually i was doing it like this. I just realized that frankly there is no speed limit. in may case there is no real need for this since i dont need to rip that much that fast.

vsloathe

I was just proposing a slogan for those of us who boink the tubes.

nutballs

lol true.


Perkiset's Place Home   Politics @ Perkiset's