Checking on this page, Crawlee Playwright is detected as bot due to CDP. https://www.browserscan.net/bot-detection This is a known issue, also discussed on: https://github.com/berstend/puppeteer-extra/issues/899 Wondering if Crawlee can come up with a solution?

message has been deleted

@Jeno just advanced to level 2! Thanks for your contributions! 🎉

checking with team and getting back to you.

Hi @Jeno We are working on solution that will not use Playwright and should be more unblockable. Meanwhile you can checkout these tips https://docs.apify.com/academy/anti-scraping#quick-start

That's exciting news!

Very interesting, @Jeno pls look at this screenshot. As far as i understand: "Normal" = "Nothing detected", right? Code: Playwright+Crawlee+Firefox+rotating proxies. And exactly same program is detected on another site, see here: https://discord.com/channels/801163717915574323/1296398744870457394 https://cdn.discordapp.com/attachments/1293244368249032895/1296408973024690247/www.browserscan.detect.png?ex=67122e71&is=6710dcf1&hm=60bccb5384065250b6b1efef21f2245d14e6395ec4505a970c6320759141e64a&

I wanna know that too. It is a great feature .👏

👀

👀

👀

I wonder, is this an issue with [fingerprint-suite](https://github.com/apify/fingerprint-suite) or the PlaywrightCrawler implementation?

It's a lot of things. I have read somewhere that CF can detect the synthetic mouse actions by Playwright and Puppeteer. The only solution I had success with was Puppeteer Real Browser. It passes CF easily.

How can we use real browsers at scale?

Crawlee silently added Camoufox and it's amazing! Real browser was a pain to use. I am using Camoufox with simple datacenter proxies and easily passing everything. It is available as a template. Make sure you use socks5 to avoid some edge cases.

haha its still in beta 🙂 we are about to post it on social media this week! glad you liked it 😄