This is the forum of the developer community of Apify. 

Find answers to pre-existing questions about Crawlee, Apify, and our other open-source projects here.

Apify

Will Impit become a part of Crawlee and replace GotScraping?

Hi <@801190591026954251> Yes, there is a plan to replace GotScraping with Impit and you can already use it by installing `@crawlee/impit-client` and passing the `new ImpitHttpClient()` as the `httpClient` crawler constructor option.

<@1071044435376345098> what about cheerioCrawler?

I my case gotScraping starts to 'struggle' with websites 🤔

```import { ImpitHttpClient } from '@crawlee/impit-client';
import { CheerioCrawler } from 'crawlee';
const crawler = new CheerioCrawler({
    // Pass the ImpitHttpClient as the httpClient option
    httpClient: new ImpitHttpClient({
        // Optional: you can specify browser impersonation
        // browser: 'chrome', // or 'firefox'
    }),
    
    // ... your other options
    proxyConfiguration,
    maxConcurrency,
    requestHandler: router,
    // etc.
});```

<@1071044435376345098> something like that, I guess cheerioCralwe uses or extends HttpCrawler?

Hi <@156328480747814912> Yes, the plan and also the approach that I proposed and that you can do now is meant to use with CheerioCrawler.
Your example looks good to me.

also can you give any best practices and is there any 'example' page for @crawlee/impit-client?

and it is quite faster <@1071044435376345098> 🙂

https://www.npmjs.com/package/@crawlee/impit-client readme.md needs some  updates?

<@156328480747814912> You may check the configuration options at https://apify.github.io/impit/js/interfaces/ImpitOptions.html 
It is true, that there are not many examples for usage with crawlee. I will ping our doc team about it, thanks!

thank you <@1071044435376345098> and you saved my day today mate 🙂