PHP Classes

MegaSpider: Crawl a Web site and retrieve all links addresses

Recommend this page to a friend!
  Info   Screenshots   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 47%Total: 3,006 All time: 1,225 This week: 560Up
Version License Categories
megaspider 1.0GNU Lesser Genera...Searching
Description 

Author

This class can crawl the pages of Web site recursively to retrieve the URLs of links and e-mail addresses that are found in the pages.

It uses regular expressions to retrieve the links found in each page and follows the links URLs and until all linked pages are visited.

Picture of Marcin Sznyra
Name: Marcin Sznyra <contact>
Classes: 2 packages by
Country: Poland Poland
Age: 43
All time rank: 69318 in Poland Poland
Week rank: 216 Up4 in Poland Poland Up

Screenshots (1)  
  • screen
  Files folder image Files (17)  
File Role Description
Files folder imagedocs (6 files, 3 directories)
Plain text file example.php Example Example of usage
Plain text file spider.class.php Class MegaSpider Class

  Files folder image Files (17)  /  docs  
File Role Description
Files folder imagemedia (3 files)
Files folder imageMegaSpider (3 files)
Files folder image__filesource (2 files)
  HTML file classtrees_MegaSpider.html Doc. documentation
  HTML file elementindex.html Doc. documentation
  HTML file elementindex_MegaSpider.html Doc. documentation
  HTML file index.html Doc. documentation
  HTML file li_MegaSpider.html Doc. documentation
  HTML file todolist.html Doc. documentation

  Files folder image Files (17)  /  docs  /  media  
File Role Description
  Image file background.png Data documentation
  Image file empty.png Data documentation
  Plain text file style.css Data documentation

  Files folder image Files (17)  /  docs  /  MegaSpider  
File Role Description
  HTML file MegaSpider.html Doc. documentation
  HTML file _spider_example_php.html Doc. documentation
  HTML file _spider_spider_class_php.html Doc. documentation

  Files folder image Files (17)  /  docs  /  __filesource  
File Role Description
  HTML file fsource_MegaSpider__example.php.html Doc. Documentation
  HTML file fsource_MegaSpider...ider.class.php.html Doc. documentation

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
 Version Control Unique User Downloads Download Rankings  
 0%
Total:3,006
This week:0
All time:1,225
This week:560Up
 User Ratings  
 
 All time
Utility:60%StarStarStarStar
Consistency:53%StarStarStar
Documentation:53%StarStarStar
Examples:64%StarStarStarStar
Tests:-
Videos:-
Overall:47%StarStarStar
Rank:3098