PHP Developer's Network : Network Member Forums

Class: Crawler


  Search   All class groups   Latest entries   Top 10 charts   Newsletter   Blog   Forums   Help FAQ  
  Login   Register  
Recommend this page to a friend! Trackback URL: http://www.phpclasses.org/trackback/browse/package/4441.html
      Classes of Md. Shaiful islam  > 
Crawler
  >  Download  >  Support forum Support forum  >  RSS 1.0 feed RSS 2.0 feed Latest changes  >  Stumble It! Stumble It!  >  Bookmark in del.icio.us Bookmark in del.icio.us  
  Supplied by   Group folder image Groups   Detailed description  
  Rate classes User ratings   Trackback   Applications   Files Files  

  • Supplied by:

    • Picture of Md. Shaiful islam
    Name: Md. Shaiful islam is available for providing paid consulting. Contact Md. Shaiful islam .
    Published packages: 1
    Country: Bangladesh Bangladesh - PHP jobs in Bangladesh
    Home page: http://www.shaiful.110mb.com/
    Age: 25
    All time rank: 1214
    Week rank: 245

    Browse this author's classes

  • Innovation Award:

    • PHP Programming Innovation award nominee
    March 2008
    Number 7
    		 Retrieving Web pages from remote sites is a relatively easy task in PHP.

    If you want to crawl a site to search for something in its pages, you only need to retrieve the site pages, use some regular expressions to extract the site links, and retrieve the linked pages until all pages were followed.

    However, if some pages can only be accessed by authenticated users, the problem is no longer so simple.

    This package provides a more complete solution to the problem of crawling site pages by automatically authenticating, so it can access all pages restricted to logged users.

    Manuel Lemos

  • Groups:

    • Group folder image
    HTML generation and processing
    		 View top rated classes
    Group folder image
    Web data clipping, SOAP or XML-RPC clients and servers
    		 View top rated classes

  • Detailed description:

    • This class can be used to extract links and images from remote Web pages.

    It can access Web pages, parse the pages HTML and extract the URLs of the links and the images.

    If necessary, the class may access a login page and emulate the submission of a login form to subsequent accesses can be done on behalf of the logged user.

  • User ratings:

    • Ratings
    Utility
    Consistency
    Documentation
    Examples
    Tests
    Videos
    Overall
    Rank
    All time:
    Sufficient (62.5%)
    Not sure (56.3%)
    -
    Sufficient (68.8%)
    -
    -
    Not sure (43.8%)
    1376
    Month:
    Not yet rated by the users

  • Trackback links:

    • Link Description
    SEO Tool: Search Engine position checker
    I’ve just finished developing a stable release of quite an advanced SEO tool, I called it “position checker”...
    Latest blog trackback links Latest blog trackback links

  • Applications that use this class:

    • No application links were specified for this class.
    Add link image If you know an application of this package, send a message to the author to add a link here.

  • Files:

    • File Role Description
    Plain text file Crawler.php Class
    The Class
    Plain text file ExampleCrawlImage.php Example
    Crawl Image form http://www.phpclasses.org/ site
    Plain text file ExampleCrawlLink.php Example
    Crawl links form http://www.phpclasses.org/ site
    Plain text file ExampleLoginCrawlLink.php Example
    Login and CrawlLink from a site
    Download all files: crawler.tar.gz crawler.zip
    NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.

 
  Advertise on this site   Site map   Statistics   Site tips   Privacy policy   Contact  
For more information send a message to :
info at phpclasses dot org.
Copyright (c) Icontem 1999-2008 PHP Classes - PHP Class Scripts
  PHP Book Reviews - Reviews of books and other products