scrape Archives - The Friendly Developer

Scrape the web with Goutte

2014-02-202017-05-02 by John Cooper

A month ago’s adventures including building a web scraper. Working to a tight schedule, I poked around the tubes and decided to give Goutte a whirl. Goutte is a simple wrapper around Guzzle and a bunch of Symfony components (such as BrowserKit and DomCrawler). In theory this makes grabbing a webpage as simple as:

use Goutte\Client;

$client = new Client();
$crawler = $client->request('GET', 'http://www.symfony.com/blog/');
$titles = $crawler->filter('h2.post > a')->each(function ($node) {
    return $node->text();
});

use Goutte\Client;

$client = new Client();

$crawler = $client->request('GET', 'http://www.symfony.com/blog/');

$titles = $crawler->filter('h2.post > a')->each(function ($node) {

return $node->text();

});