Search Scripts - Web Scripts Directory

Search Scripts - Web Development Scripts Directory

New Script Listings
New Scripts
Popular Scripts
Popular Scripts
Top Rated Scripts
Top Rated
Scripts Directory Search Engine
Search Scripts
Link to Scripts Directory
Link to Us
Search-Scripts Sitemap
PHP, AJAX, JavaScript, Perl, ASP Scripts Directory
Script Search Engine for Webmasters & Developers  
Search Scripts Home | Search Script Listings Become Sponsor | Information For Advertisers | Members Login Submit Script | Glossary of Scripts Glossary | About Search Scripts Directory About Search Scripts | Contact Us Contact Us | Sign Up Sign Up
Left Tab Right Tab
Listing Title Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL  

A quick search of the Internet shows that there are not a lot of recent books written on Web bots, especially on designing them, so this book fills the gap nicely. It is well written, has lots of practical examples and does not ignore the larger ethical and legal issues, recommended. While the expression "Web bot" might bring to mind some kind of shady software to some readers, this book explains that they are, when used properly, just another, possibly profitable, way of using the Internet. Readers should be aware that it requires the cURL extension, that is not always part of default PHP installs. Those without it might want to explore the Zend Framework's HTTP class or PEAR's own.


The first section explains what Web bots are and what kind of things you might do with them. For a technical book, there is also a fair amount of talk of business applications for Web bots, which is good to see. Also, readers will notice that most of the development is done with Windows in mind, since, early on the author mentions putting older PCs to work running Web bots, this makes sense. This book explains what (are Web bots), ideas for projects, how to download a Web page using PHP and cURL, parsing, form submission and managing large amounts of data. A note here, except for the early examples, most of the examples use the cURL extension. Its installation is briefly covered. As well, a lot of the code depends on a set of libraries provided at the book's Web site that hides a lot of low-level work.


The second section is about projects. Some of the projects demonstrated are: a price monitoring Web bots, image capture Web bots, link verification Web bots, anonymous browsing, search ranking, aggregation Web bots, FTP bots, NNTP bots, and bots that read and send e-mail. As the author stated in the introduction, he has been writing Web bots for years, and here you get to see his range of experience.


Part three, "Advanced technical considerations", builds on the projects, covering spiders, procurement Web bots and snipers, Web bots and cryptography, authentication, advanced cookie management, scheduling Web bots and spiders.


The forth part, larger considerations, is the chapter that some readers might skip. However, since Web bots and spiders operate "in the wild", this is an important chapter.

Scripts Directory
Specifications Visit View Demo | Download Download
Platform(s) Linux
Database(s) None
Version 1593270000
File Size < 100KB
Date Added Saturday, February, 23rd 2008
Last Updated Saturday, February, 23rd 2008
License Information
License Type Commercial
License Information Author: Michael Schrenk
Price 26.37 USD
Resource Posted by: Archana Chadha. This script listing has been viewed 5048 times so far.
Search Scripts Disclaimer - Please be aware accepts no responsibility for the scripts, components & software you are downloading. The same applies to the information provided about the Web Scripts, Tutorials & Software Products listed, as the producer can modify it without notifying us. Even if we try to check the files for viruses ourselves, we cannot guarantee 100% that they are clean. For your own protection always check downloaded files for viruses.
Click Here to view all the scripts in Books category.
Rate it User Rating Chart
Rate Listing
Member Ratings - Chart
1 rating one (0)
2 rating two (0)
3 rating three (0)
4 rating four (0)
5 rating five (0)
Visitor Ratings - Chart
(0) (0) (0) (0) (1)
rating one rating two rating three rating four rating five
1 2 3 4 5
Review it Member Reviews
There are no user reviews for this Resource Listing. Be the first to post a comment. Click Here
Related Scripts Related Scripts
  1. Elgg Social Networking
  2. Customize and Extend SugarCRM with new Guide for Developers
  3. MediaWiki Skins Design
  4. Guide to PHP Design Patterns
  5. PHP Programming with PEAR
  6. Smarty PHP Template Programming and Applications
  7. Learn to Create Professional Quality Joomla Templates
  8. Mastering Joomla 1.5 Extension and Framework Development
  9. PHP Programming Solutions
  10. Object-Oriented Programming with PHP5
  11. The Zend PHP 4 Certification Practice Book
  12. Learning PHP Data Objects
  13. Joomla Cash
  14. PHP Oracle Web Development
  15. Mobile Web Development - Book
  16. AJAX and PHP: Building Responsive Web Applications
  17. PHP and MySQL by Example
  18. No Nonsense XML Web Development With PHP
  19. Create Drupal 5 Themes
  20. CakePHP Application Development
  21. osCommerce Webmaster's Guide to Selling Online
  22. Create Drupal 6 Modules with New Book
  23. Building Websites with Joomla 1.5 Beta
  24. Create Professional WordPress Themes
  25. Joomla 1.5 Template Design Book - 2nd Edition
  26. PHP6 MySQL Programming for the Absolute Beginner
  27. Learning Facebook Application Development
  28. PHP: Step by Step guide for beginners on how to learn PHP and MYSQL Programming
  29. Joomla Accessibility
  30. Selling Online with Drupal e-Commerce
  31. PHP 6 Fast and Easy Web Development
  32. PHP Phrasebook
  33. Managing eZ Publish Web Content Management Projects
  34. PHP 5 CMS Framework Development
  35. Building Powerful and Robust Websites with Drupal 6
  36. PHP 5 Unleashed
  37. Core Web Application Development with PHP and MySQL
  38. IT Inventory and Resource Management with OCS Inventory
  39. iJoomla Magazine
  40. Just Enough Web Programming with XHTML, PHP, and MySQL
  41. Building Websites with Joomla 1.5
  42. Learn to Build Robust Efficient and Secure PHP Oracle Solutions
  43. Securing PHP Web Applications
  44. Expert PHP and MySQL
  45. PHP: The Good Parts
  46. PHP Solutions: Dynamic Web Design Made Easy
  47. Beginning Google Maps Applications with PHP and Ajax
  48. Pro PHP and jQuery
  49. Plug-In PHP: 100 Power Solutions
Script Listing Information Additional Information
Script Number: 1093
Rating: 5 out of 5 from 1 votes
Rating Bar: 5 Stars
Script Listing Options Script Options
Print Script Print this Script Listing
Email Script Suggest to Friend by Email
Bookmark Script Listing Bookmark Bookmark
Report for listing Report Listing
Search Scripts Search Scripts Directory
Partner Links
PHPKB Knowledge Base Software
Article Diary
Webmaster Resources