crawlee
Index
Classes
- AutoscaledPool
- BasicCrawler
- BeautifulSoupCrawler
- BrowserPool
- ContextPipeline
- CurlImpersonateHttpClient
- Dataset
- EventManager
- HeaderGenerator
- HttpCrawler
- HttpxHttpClient
- KeyValueStore
- LocalEventManager
- MemoryStorageClient
- ParselCrawler
- PlaywrightBrowserController
- PlaywrightBrowserPlugin
- PlaywrightCrawler
- ProxyConfiguration
- RequestList
- RequestManagerTandem
- RequestQueue
- Router
- ServiceLocator
- SessionPool
- Snapshotter
- Statistics
- SystemStatus
Abstract classes
Data structures
- BasicCrawlerOptions
- BasicCrawlingContext
- BatchRequestsOperationResponse
- BeautifulSoupCrawlingContext
- BlockedInfo
- ConcurrencySettings
- Configuration
- DatasetItemsListPage
- DatasetListPage
- DatasetMetadata
- EnqueueStrategy
- FinalStatistics
- HttpCrawlerOptions
- HttpCrawlingContext
- HttpCrawlingResult
- HttpResponse
- KeyValueStoreKeyInfo
- KeyValueStoreListKeysPage
- KeyValueStoreListPage
- KeyValueStoreMetadata
- KeyValueStoreRecord
- KeyValueStoreRecordMetadata
- ParsedHttpCrawlingContext
- ParselCrawlingContext
- PlaywrightCrawlingContext
- PlaywrightPreNavCrawlingContext
- ProcessedRequest
- ProlongRequestLockResponse
- ProxyInfo
- Request
- RequestQueueHead
- RequestQueueHeadState
- RequestQueueHeadWithLocks
- RequestQueueListPage
- RequestQueueMetadata
- Session
- StatisticsPersistedState
- StatisticsState
- UnprocessedRequest