umpirsky/centipede-crawler

Crawls all unique links.

Maintainers

Details

github.com/umpirsky/centipede-crawler

Source

Issues

Installs: 449

Dependents: 1

Suggesters: 0

Security: 0

Stars: 42

Watchers: 5

Forks: 6

Open Issues: 3

0.1.2 2016-06-13 10:09 UTC

Requires

Requires (Dev)

MIT a9a94e4d958488ed3d6e3678dbefc1148be5d136

  • Saša Stamenković <umpirsky.woop@gmail.com>

This package is not auto-updated.

Last update: 2024-11-09 17:30:05 UTC

README

symfony upgrade fixer • twig gettext extractor • wisdom • centipede • permissions handler • extraload • gravatar • locurro • country list • transliterator

Centipede Crawler Build Status

Crawls all unique links.

Usage

$urls = (new Centipede\Crawler('http://dev.umpirsky.com'))->crawl();

Asynchronous

(new Centipede\Crawler('http://dev.umpirsky.com'))->crawl(function ($url, GuzzleHttp\Message\FutureResponse $response) {
    printf('(%d) %s', $response->getStatusCode(), $url);
});