This is the forum of the developer community of Apify. 

Find answers to pre-existing questions about Crawlee, Apify, and our other open-source projects here.

Apify

I’m using a Cheerio scraper to crawl data from https://pypi.org/, but it does not return any data.Someone pls help me
https://cdn.discordapp.com/attachments/1206131794261315594/1451499183641989171/image.png?ex=69466574&is=694513f4&hm=87366e86efeb5aefcf4791dbc7715efe5cc2bbd5ff7ebf320e0ccd079109b17d&

Can you please share more information about your run? Your log screenshot, or even your input would be useful.

Hello <@1451488071861403711>, I checked out your run and it seems like https://pypi.org/ has defined [robots.txt](https://www.cloudflare.com/learning/bots/what-is-robots-txt/) file which prohibits crawling search URLs. The Cheerio Scraper Actor respects the `robots.txt` file by default. If you wish to scrape that URL regardless you can instruct the Actor to ignore `robots.txt` in the input.