Legacy Crawler

Articles about our legacy product - Crawler. Not recommended for new users.

Jakub Balada avatar Jan Čurn avatar Jakub Drobník avatar +2
19 articles in this collection
Written by Jakub Balada, Jan Čurn, Jakub Drobník and 2 others

Log in to website using Apify - getting started

Allow your crawler to access data available only after login
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Getting started

Creating your first crawler
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Log in to website by transferring cookies from web browser

How to transfer cookies from your web browser to a crawler
Jan Čurn avatar
Written by Jan Čurn
Updated over a week ago

Keboola integration

How to easily push data from Apify actors and crawlers to Keboola
Jakub Drobník avatar
Written by Jakub Drobník
Updated over a week ago

Using Apify API from PHP

Start crawlers and fetch results from a PHP application
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Importing a list of URLs from an external source

Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

First data

Creating your first crawler
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

How to pass data from crawler to actor

Post-processing crawler data in an Apify actor
Lukáš Křivka avatar
Written by Lukáš Křivka
Updated over a week ago

Save images inside pageFunction as base64

Save whole images when crawling
Lukáš Křivka avatar
Written by Lukáš Křivka
Updated over a week ago

Scraping full page content

Creating your first crawler
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Crawling multiple pages

Creating your first crawler
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Waiting for dynamic content

Code to wait for dynamic content to load
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Debugging your Page Function in browser's console

Test your Page Function's code directly in your browser's console
Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Zapier: Run Crawler with Custom Start URL

This example shows how you can process start URL from Zapier Zap to Apify Crawler.
Jakub Drobník avatar
Written by Jakub Drobník
Updated over a week ago

Start crawler and get results using API

Basic Apify crawler workflow - run crawler and fetch results
Lukáš Křivka avatar
Written by Lukáš Křivka
Updated over a week ago

Zapier integration

Jakub Balada avatar
Written by Jakub Balada
Updated over a week ago

Using key-value store from crawlers

Sharing or persisting data for future crawler runs
Petr Čermák avatar
Written by Petr Čermák
Updated over a week ago

Processing the same page multiple times with different setups

Solving a common problem with crawler features such as customData, enqueuePage, interceptRequest function and interceptRequestData.
Petr Čermák avatar
Written by Petr Čermák
Updated over a week ago

Submitting forms on .ASPX pages

How to handle pages created with ASP.NET - with bonus community crawler template
Jakub Drobník avatar
Written by Jakub Drobník
Updated over a week ago