The Cache: Technology Expert's Forum
 
*
Welcome, Guest. Please login or register. September 16, 2019, 09:09:11 PM

Login with username, password and session length


Pages: [1]
  Print  
Author Topic: A book for those learning to scrape  (Read 2846 times)
Fatty
Rookie
**
Offline Offline

Posts: 11


View Profile
« on: May 06, 2007, 08:33:32 AM »

Webbots, Spiders, and Screen Scrapers (http://www.schrenk.com/nostarch/webbots/index.php) was recently released, I read through it, it's fairly good.

It's a good introduction to cURL and scraping.  If you're a PHP guy and are completely new to scraping this would be a good book, it has a set of libraries that make things easier, also helps you learn how to extract information out of a web page and do stuff with it.  The chapters take you through the commands, putting them together into the author's library, and then some minor projects to make use of them.  It also has some chapters on integrating with POP/NNTP/SMTP which may or may not be interesting to you.

If you're a Perl guy and have an understanding of WWW::Mechanize or LWP you might find this a bit primitive, especially if you've done work with HTML::TreeBuilder and HTML::TokeParser.  In that case, O'Reilly's "LWP & Perl"  would be a better bet to learn the advanced ways of scraping with TreeBuilder and TokeParser.  "Spidering Hacks" is another good one, it's a lot lighter on the technical stuff but has a lot of good information and examples to work from, especially using WWW::Mechanize.

Fatty
Logged

No links in signatures please
nop_90
Global Moderator
Lifer
*****
Offline Offline

Posts: 2203


View Profile
« Reply #1 on: May 06, 2007, 03:56:16 PM »

cool Smiley
Logged
piratescurvy
Rookie
**
Offline Offline

Posts: 16


View Profile
« Reply #2 on: May 09, 2007, 10:08:59 AM »

I bought it, I'm a sucker.  Nerd
Logged

No links in signatures please
perkiset
Olde World Hacker
Administrator
Lifer
*****
Offline Offline

Posts: 10096



View Profile
« Reply #3 on: May 09, 2007, 10:32:24 AM »

Review please!
Logged

It is now believed, that after having lived in one compound with 3 wives and never leaving the house for 5 years, Bin Laden called the U.S. Navy Seals himself.
Pages: [1]
  Print  
 
Jump to:  

Perkiset's Place Home   Best of The Cache   phpMyIDE: MySQL Stored Procedures, Functions & Triggers
Politics @ Perkiset's   Pinkhat's Perspective   
cache
mart
coder
programmers
ajax
php
javascript
Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks


Valid XHTML 1.0! Valid CSS!