Skip to main content
Version: 3.9

Changelog

All notable changes to this project will be documented in this file. See Conventional Commits for commit guidelines.

3.12.0 (2024-11-04)

Bug Fixes​

3.11.5 (2024-10-04)​

Bug Fixes​

  • core: accept UInt8Array in KVS.setValue() (#2682) (8ef0e60)

3.11.4 (2024-09-23)​

Note: Version bump only for package @crawlee/playwright

3.11.3 (2024-09-03)​

Note: Version bump only for package @crawlee/playwright

3.11.2 (2024-08-28)​

Note: Version bump only for package @crawlee/playwright

3.11.1 (2024-07-24)​

Note: Version bump only for package @crawlee/playwright

3.11.0 (2024-07-09)

Features​

  • add iframe expansion to parseWithCheerio in browsers (#2542) (328d085), closes #2507
  • add ignoreIframes opt-out from the Cheerio iframe expansion (#2562) (474a8dc)

3.10.5 (2024-06-12)​

Bug Fixes​

  • allow creating new adaptive crawler instance without any parameters (9b7f595)
  • fix detection of HTTP site when using the useState in adaptive crawler (#2530) (7e195c1)
  • mark context.request.loadedUrl and id as required inside the request handler (#2531) (2b54660)

3.10.4 (2024-06-11)​

Bug Fixes​

  • playwright: allow passing new context options in launchOptions on type level (0519d40), closes #1849

3.10.3 (2024-06-07)​

Bug Fixes​

  • adaptive-crawler: log only once for the committed request handler execution (#2524) (533bd3f)
  • respect implicit router when no requestHandler is provided in AdaptiveCrawler (#2518) (31083aa)

Features​

  • add waitForSelector context helper + parseWithCheerio in adaptive crawler (#2522) (6f88e73)

3.10.2 (2024-06-03)​

Note: Version bump only for package @crawlee/playwright

3.10.1 (2024-05-23)​

Note: Version bump only for package @crawlee/playwright

3.10.0 (2024-05-16)

Bug Fixes​

  • do not drop statistics on migration/resurrection/resume (#2462) (8ce7dd4)

3.9.2 (2024-04-17)​

Note: Version bump only for package @crawlee/playwright

3.9.1 (2024-04-11)​

Note: Version bump only for package @crawlee/playwright

3.9.0 (2024-04-10)

Features​

  • createAdaptivePlaywrightRouter utility (#2415) (cee4778), closes #2407
  • expand #shadow-root elements automatically in parseWithCheerio helper (#2396) (a05b3a9)

3.8.2 (2024-03-21)​

Features​

  • implement global storage access checking and use it to prevent unwanted side effects in adaptive crawler (#2371) (fb3b7da), closes #2364

3.8.1 (2024-02-22)​

Note: Version bump only for package @crawlee/playwright

3.8.0 (2024-02-21)

Features​

3.7.3 (2024-01-30)​

Note: Version bump only for package @crawlee/playwright

3.7.2 (2024-01-09)​

Note: Version bump only for package @crawlee/playwright

3.7.1 (2024-01-02)​

Note: Version bump only for package @crawlee/playwright

3.7.0 (2023-12-21)

Note: Version bump only for package @crawlee/playwright

3.6.2 (2023-11-26)​

Note: Version bump only for package @crawlee/playwright

3.6.1 (2023-11-15)​

Features​

3.6.0 (2023-11-15)

Bug Fixes​

  • add skipNavigation option to enqueueLinks (#2153) (118515d)

3.5.8 (2023-10-17)​

Note: Version bump only for package @crawlee/playwright

3.5.7 (2023-10-05)​

Note: Version bump only for package @crawlee/playwright

3.5.6 (2023-10-04)​

Note: Version bump only for package @crawlee/playwright

3.5.5 (2023-10-02)​

Bug Fixes​

  • allow to use any version of puppeteer or playwright (#2102) (0cafceb), closes #2101

Features​

3.5.4 (2023-09-11)​

Bug Fixes​

  • various helpers opening KVS now respect Configuration (#2071) (59dbb16)

3.5.3 (2023-08-31)​

Bug Fixes​

3.5.2 (2023-08-21)​

Note: Version bump only for package @crawlee/playwright

3.5.1 (2023-08-16)​

Note: Version bump only for package @crawlee/playwright

3.5.0 (2023-07-31)

Features​

  • add closeCookieModals context helper for Playwright and Puppeteer (#1927) (98d93bb)
  • core: use RequestQueue.addBatchedRequests() in enqueueLinks helper (4d61ca9), closes #1995

3.4.2 (2023-07-19)​

Note: Version bump only for package @crawlee/playwright

3.4.1 (2023-07-13)​

Note: Version bump only for package @crawlee/playwright

3.4.0 (2023-06-12)

Features​

  • infiniteScroll has maxScrollHeight limit (#1945) (44997bb)

3.3.3 (2023-05-31)​

Note: Version bump only for package @crawlee/playwright

3.3.2 (2023-05-11)​

Features​

3.3.1 (2023-04-11)​

Bug Fixes​

  • infiniteScroll() not working in Firefox (#1826) (4286c5d), closes #1821
  • jsdom: delay closing of the window and add some polyfills (2e81618)

3.3.0 (2023-03-09)

Note: Version bump only for package @crawlee/playwright

3.2.2 (2023-02-08)​

Note: Version bump only for package @crawlee/playwright

3.2.1 (2023-02-07)​

Note: Version bump only for package @crawlee/playwright

3.2.0 (2023-02-07)

Bug Fixes​

  • allow userData option in enqueueLinksByClickingElements (#1749) (736f85d), closes #1617
  • declare missing dependency on tslib (27e96c8), closes #1747
  • update playwright to 1.29.2 and make peer dep. less strict (#1735) (c654fcd), closes #1723

Features​

3.1.4 (2022-12-14)​

Note: Version bump only for package @crawlee/playwright

3.1.3 (2022-12-07)​

Note: Version bump only for package @crawlee/playwright

3.1.2 (2022-11-15)​

Note: Version bump only for package @crawlee/playwright

3.1.1 (2022-11-07)​

Note: Version bump only for package @crawlee/playwright

3.1.0 (2022-10-13)

Note: Version bump only for package @crawlee/playwright

3.0.4 (2022-08-22)​

Features​

Page Options