Skip to main content

DatasetCollectionClient

crawlee.memory_storage_client.dataset_collection_client.DatasetCollectionClient

Subclient for manipulating datasets.

Index

Constructors

Methods

Constructors

__init__

  • __init__(*, memory_storage_client): None
  • Parameters

    • memory_storage_client: MemoryStorageClientkeyword-only

    Returns None

Methods

get_or_create

  • async get_or_create(*, name, schema, id): DatasetMetadata
  • Parameters

    • name: str | None = Nonekeyword-only
    • schema: dict | None = Nonekeyword-only
    • id: str | None = Nonekeyword-only

    Returns DatasetMetadata

list

  • async list(*, unnamed, limit, offset, desc): DatasetListPage
  • Parameters

    • unnamed: bool = Falsekeyword-only
    • limit: int | None = Nonekeyword-only
    • offset: int | None = Nonekeyword-only
    • desc: bool = Falsekeyword-only

    Returns DatasetListPage