
![]() |
nutballs
lol. steps to build an infinity fast scraper...
1) build a scraper which saves sentences to a database, or a file for that matter. 2) deploy that to a shared host where you can run dozens of sites, and only EACH site is monitored for abuse, not your whole account. install as many times as you want. run at a scrape speed below whatever threshold might get you in trouble. 3) build a home base manager to pull down sentences from the scraper nodes. 4) laugh when you look at your database 20 minutes later and have a quarter million sentences without even raising a blip on anyones radar. ahh the tubes are a giggle when you know how to boink em. vsloathe
Boinking Tubes Since 1996.
nutballs
its not so much that I couldnt do it fast before, and actually i was doing it like this. I just realized that frankly there is no speed limit. in may case there is no real need for this since i dont need to rip that much that fast.
vsloathe
I was just proposing a slogan for those of us who boink the tubes.
nutballs
lol true.
|

Thread Categories

![]() |
![]() |
Best of The Cache Home |
![]() |
![]() |
Search The Cache |
- Ajax
- Apache & mod_rewrite
- BlackHat SEO & Web Stuff
- C/++/#, Pascal etc.
- Database Stuff
- General & Non-Technical Discussion
- General programming, learning to code
- Javascript Discussions & Code
- Linux Related
- Mac, iPhone & OS-X Stuff
- Miscellaneous
- MS Windows Related
- PERL & Python Related
- PHP: Questions & Discussion
- PHP: Techniques, Classes & Examples
- Regular Expressions
- Uncategorized Threads