DefaultRenderingTypePredictor

Stores rendering type for previously crawled URLs and predicts the rendering type for unvisited urls.

RenderingTypePredictor implementation based on logistic regression: https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html

Hierarchy

• RenderingTypePredictor
  • DefaultRenderingTypePredictor

Index

Methods

• __init__
• predict
• store_result

Methods

__init__

• __init__(detection_ratio): None

• A default constructor.

  ---

  Parameters

  • optionaldetection_ratio: float = 0.1

    A number between 0 and 1 that determines the desired ratio of rendering type detections.

  Returns None

predict

• predict(request): RenderingTypePrediction

• Overrides RenderingTypePredictor.predict

  Get RenderingTypePrediction based on the input request.

  ---

  Parameters

  • request: Request

    Request instance for which the prediction is made.

  Returns RenderingTypePrediction

store_result

• store_result(request, rendering_type): None

• Overrides RenderingTypePredictor.store_result

  Store prediction results and retrain the model.

  ---

  Parameters

  • request: Request

    Used Request instance.

  • rendering_type: RenderingType

    Known suitable RenderingType for the used Request instance.

  Returns None