next »

[svakanda]

Does anyone have a perl/php compatible regex for picking up http urls?  I'd love to get my hands on one...been able to code about half of it.  But i keep getting lost. 

[nop_90]

regex sucks shit for that sort of stuff
use the mechanize module with perl
http://search.cpan.org/dist/WWW-Mechanize/lib/WWW/Mechanize.pm

[vsloathe]

Yeah, sucks so much shit...LOL

For only links to external sites:

Code:

'/a href=\"?(http:\/\/.+)\"?/'

For links both internally and externally:

Code:

'/a href=\"?([^\"\>\<]+)\"?/'

Tried to keep them as tight as I could for you.

[thedarkness]

More fodder, had these lying around in a regex test script where I leave old regexs in case I need 'em. Look over them carefully coz they may not be (probably aren't?) suitable. They may serve as a teaching resource, they may not 

Code:

//$regex = "@<\s*a\s+[^>]*href\s*=\s*[\"'](http|https|ftp)://(.*?)[\"'/]@is";
//
//$regex = "@(http:\/\/w{3}\.[^.]+?\.[a-z]{3})@i";
//
//$regex = "@(https?:\/\/[A-Z0-9.-]+)@i";

Cheers,
td

[Bompa]

Does anyone have a perl/php compatible regex for picking up http urls?  I'd love to get my hands on one...been able to code about half of it.  But i keep getting lost. 

hey sva,  any urls or just hyperlinks?

[svakanda]

Hey!!! thankyou guys for all the great input!

I can't really use mechanize I don't think as I'm using php. 

@vsloathe, those look great, I think that will work precisely for what I need.  I spent so much time trying to define the url starting with http.....that I never even considered using href as a base...and that means you can make MUCH simpler regexs.   Vundabar!

@Bompa, I'm not certain.  Probably just hyperlinks.  I don't think I need url/uri  like ftp or nonesuch.  It's just for a web spider.

thankyou everyone!

/svakanda out

[vsloathe]

No worries. Your mileage may vary on the

Code:

\"?

part.

The original HTML spec says you don't absolutely have to have quotes for anchor tags, but I'd say maybe .1% of the sites on the web don't.

[svakanda]

no worries, thanks for the input!

[thedarkness]

I'd prolly be inclined to use [\'\"] as in my first example because you can use single quotes too.

Cheers,
td

edit: Maybe [\'\"\s] ?