Skip to main content

GetDataFunction

crawlee.basic_crawler.types.GetDataFunction

Type of a function for getting data from the dataset.

This helper method simplifies the process of retrieving data from a dataset. It opens the specified dataset and then retrieves the data based on the provided parameters.

Index

Methods

Methods

__call__

  • __call__(dataset_id, dataset_name, kwargs): Coroutine[None, None, DatasetItemsListPage]
  • Parameters

    • dataset_id: str | None = None
    • dataset_name: str | None = None
    • kwargs: Unpack[GetDataKwargs]

    Returns Coroutine[None, None, DatasetItemsListPage]