MemoryStorageOptions

Index

Properties

• localDataDirectory
• persistStorage
• writeMetadata

Properties

optionallocalDataDirectory

localDataDirectory?: string = process.env.CRAWLEE_STORAGE_DIR ?? ‘./storage’

Path to directory where the data will also be saved.

optionalpersistStorage

persistStorage?: boolean = true

Whether the memory storage should also write its stored content to the disk.

You can also disable this by setting the CRAWLEE_PERSIST_STORAGE environment variable to false.

optionalwriteMetadata

writeMetadata?: boolean = process.env.DEBUG?.includes(‘*’) ?? process.env.DEBUG?.includes(‘crawlee:memory-storage’) ?? false

Whether to also write optional metadata files when storing to disk.