StatisticPersistedState

Format of the persisted stats.

The nulls are Infinity on the way out - JSON has no infinity, so a record written before anything finished or failed carries a null in its place.

Hierarchy

• Omit<StatisticState, statsPersistedAt | crawlerStartedAt | crawlerFinishedAt | requestMinDurationMillis | requestsFailedPerMinute | requestsFinishedPerMinute | requestRetryHistogram | instanceStart>
  • StatisticPersistedState

Index

Properties

• crawlerFinishedAt
• crawlerLastStartTimestamp
• crawlerRuntimeMillis
• crawlerStartedAt
• errors
• requestAvgFailedDurationMillis
• requestAvgFinishedDurationMillis
• requestMaxDurationMillis
• requestMinDurationMillis
• requestRetryHistogram
• requestsFailed
• requestsFailedPerMinute
• requestsFinished
• requestsFinishedPerMinute
• requestsRetries
• requestsTotal
• requestsWithStatusCode
• requestTotalDurationMillis
• requestTotalFailedDurationMillis
• requestTotalFinishedDurationMillis
• retryErrors
• statsId
• statsPersistedAt

Properties

crawlerFinishedAt

crawlerFinishedAt: null | string

crawlerLastStartTimestamp

crawlerLastStartTimestamp: number

StatisticState.instanceStart of the run that wrote the record.

inheritedcrawlerRuntimeMillis

crawlerRuntimeMillis: number

Inherited from Omit.crawlerRuntimeMillis

crawlerStartedAt

crawlerStartedAt: null | string

ISO strings - the live state keeps these as Dates.

inheritederrors

errors: Record<string, unknown>

Inherited from Omit.errors

requestAvgFailedDurationMillis

requestAvgFailedDurationMillis: null | number

requestAvgFinishedDurationMillis

requestAvgFinishedDurationMillis: null | number

inheritedrequestMaxDurationMillis

requestMaxDurationMillis: number

Inherited from Omit.requestMaxDurationMillis

requestMinDurationMillis

requestMinDurationMillis: null | number

requestRetryHistogram

requestRetryHistogram: (null | number)[]

A retry count that no request ever reached leaves a null here.

inheritedrequestsFailed

requestsFailed: number

Inherited from Omit.requestsFailed

requestsFailedPerMinute

requestsFailedPerMinute: null | number

inheritedrequestsFinished

requestsFinished: number

Inherited from Omit.requestsFinished

requestsFinishedPerMinute

requestsFinishedPerMinute: null | number

inheritedrequestsRetries

requestsRetries: number

Inherited from Omit.requestsRetries

requestsTotal

requestsTotal: number

inheritedrequestsWithStatusCode

requestsWithStatusCode: Record<string, number>

Inherited from Omit.requestsWithStatusCode

requestTotalDurationMillis

requestTotalDurationMillis: number

inheritedrequestTotalFailedDurationMillis

requestTotalFailedDurationMillis: number

Inherited from Omit.requestTotalFailedDurationMillis

inheritedrequestTotalFinishedDurationMillis

requestTotalFinishedDurationMillis: number

Inherited from Omit.requestTotalFinishedDurationMillis

inheritedretryErrors

retryErrors: Record<string, unknown>

Inherited from Omit.retryErrors

statsId

statsId: string

statsPersistedAt

statsPersistedAt: string