Ray
12/22/2024, 10:59 PMfoxt141
12/23/2024, 2:43 PMPlaywrightCrawler
](https://crawlee.dev/docs/examples/playwright-crawler).
If it doesn't work I would attempt to use PuppeteerCrawler
- some websites are able to detect playwright, but fail with puppeteer.
Also, refer to [this](https://crawlee.dev/docs/guides/avoid-blocking) guide
If it still doesn't help, disabling headless
might be necessary - from my experience some websites with advanced web-scraping protection will indeed have scripts that are able to determine that.Ray
12/23/2024, 3:24 PM