message has been deleted

Because Chrome has a concurrency limit for the same domain name, which seems to be 6 concurrent instances, I want to open more browser instances, but this is not effective. How should I set it up. Because I am using CDP, I currently only want to use Chrome https://cdn.discordapp.com/attachments/1476833747574849536/1476833748023771156/image.png?ex=69a2901b&is=69a13e9b&hm=a3c144d2ac564614bf70b761ff03fce8e443fbb9a907dccd77e4d27e3a69cbc2&

Hi @hhq-001 I am not sure whether you have already solved your problem on your own, but I see a few issues with your image: the highlighted line creates an array with 5 references to the same plugin - you probably need to create 5 separate objects. Additionally you have

maxOpenPagesPerBrowser

set to 50, so you probably need to have at least 51 concurrent requests to spawn a new browser and since you use crawlee browser pool, it will probably limit the concurrency based on the system load.

hey @hhq-001 see docs for Launching multiple browsers. Should be useful. https://crawlee.dev/js/api/browser-pool#launching-multiple-browsers

You can use multiple chrome Instances. Since chrome limits connections to a maximum of 6 per instance per domain, you must run multiple Chrome browsers to distribute the workload. If you connect 6 times per browser simultaneously, you can handle 60 concurrent requests for example, if you have 10 browsers open. I hope this helps.

I had this same issue

@dorcis just advanced to level 1! Thanks for your contributions! 🎉