The Cache: Technology Expert's Forum
 
*
Welcome, Guest. Please login or register. September 18, 2019, 12:40:16 PM

Login with username, password and session length


Pages: [1]
  Print  
Author Topic: Some useful Python libraries  (Read 7218 times)
arms
Expert
****
Offline Offline

Posts: 235



View Profile
« on: July 28, 2007, 08:46:14 PM »

python has basically become my weapon of choice lately. here are a few python libraries that i've found useful and a few i haven't used but look useful.

urllib2
urlib2 is a python module for fetching urls. supports simple GETs and POSTing to forms. a nice howto: http://www.voidspace.org.uk/python/articles/urllib2.shtml

mechanize
easy to fill and submit forms without using regex. maintains client state with cookies automatically. kinda like using a browser. based on the perl module of the same name.
http://wwwsearch.sourceforge.net/mechanize/

Universal Feed Parser
haven't used this one yet but probably will soon. parses feed like the name says. i like that it doesn't involve DOM traversal.
http://feedparser.org/

PyRSS2Gen
for creating rss programatically. again, no DOMs. haven't tried it yet either.
http://www.dalkescientific.com/Python/PyRSS2Gen.html

Beautiful Soup
parses html/xml. useful for scraping because it handles broken html.
http://www.crummy.com/software/BeautifulSoup/

pycurl
for the curl people
http://pycurl.sourceforge.net/
Logged
nop_90
Global Moderator
Lifer
*****
Offline Offline

Posts: 2203


View Profile
« Reply #1 on: July 28, 2007, 09:26:20 PM »

thanx for adding those
Logged
Dbyt3r
Rookie
**
Offline Offline

Posts: 19


View Profile
« Reply #2 on: August 15, 2007, 04:16:15 AM »

Don't forget PIL (python imaging library) , MysqlDb, and the threading module (i know its default but you mentioned urllib2 Smiley)
Logged

No links in signatures please
krustee
Rookie
**
Offline Offline

Posts: 33


View Profile
« Reply #3 on: April 30, 2010, 04:29:21 AM »

Threading and queue module come in very handy.
Logged
krustee
Rookie
**
Offline Offline

Posts: 33


View Profile
« Reply #4 on: June 11, 2011, 09:26:46 AM »

Gevent, most useful library I have ever used.
Logged
Pages: [1]
  Print  
 
Jump to:  

Perkiset's Place Home   Best of The Cache   phpMyIDE: MySQL Stored Procedures, Functions & Triggers
Politics @ Perkiset's   Pinkhat's Perspective   
cache
mart
coder
programmers
ajax
php
javascript
Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks


Valid XHTML 1.0! Valid CSS!