with Python

I just started my LLM Engineering journey and for my first SLM fine-tuning I want to gather some data

You can use existing scrapers from Apify store: https://apify.com/store, or you can develop your own: https://docs.apify.com/platform/actors/development. Let me know, if you have any questions.

Guys what's the rough cap on IG scraping

possible to scrape someone whos got 1m followers?

Hi everyone, happe to be here:)

Hi Devis It's very nice to connect!

Jst came across Apify when I was searching for a** reliable Instagram Reels scraper**. looks very interesting. Can somebody pls clarify my doubt regarding how this works? https://apify.com/apify/instagram-reel-scraper Let's say i have a list of 500 IG Reels URLs. I want to get the # of Likes and comments for these URLs. When i check the above IG scraper, it is asking me to enter IG username or profile name. but these URLs might be from 500 different users. How can i make this work?

https://console.apify.com/actors/Bs72sDKr8fGe3d5Ti/information/latest/readme For the google play review scraper, is it possible to scrape just the reviews in the Nigerian store?

I can help you with that because I have build a X tweets scraper and I have also a script to scrap comments from insta ... I build bots not Apify actors

i need to find shein product scraper

Hi I'm a business developer and I would like to scrappe Clutch.co any recommendations there is a lot of clutch scrapper on Apify so I don't really know wich one to choose Have a nice day

What data exactly do you need?

@Julian_alnc I have one, dm me

hi everyone, im looking for an expert in scraping facebook groups and posts pls send me a pm

Hello, is there somebody from dojo?

hello

Could you help me understand how to properly use Apify to scrape variable products on 1688 and also add conditions? Conditions, Recognition of Products to Scrape: Can I use artificial intelligence or other methods to identify the correct products? I don't know how to do the first step. When I am on the search bar and search for electric bikes, sometimes there are other products besides electric bikes. Can artificial intelligence or other methods detect these additional products and only scrape the electric bikes? Can visual recognition or artificial intelligence also avoid duplicates, scraping the same products, and add conditions like choosing the cheapest supplier? Or should I only provide the URLs in case I can't use visual recognition? Clicks: In option 1, I mean in the case where I give it a single URL corresponding to a search, not multiple product URLs. The robot will then click on each of the product sheets it has analyzed and scrape the simple and variable products. Does it handle the clicks? If so, when I click on a product page, there is the possibility to send a message to the supplier. Is it capable of doing that? But also changing the message each time? Proper Formatting: To import CSV files of products into Amazon, eBay, etc., the CSVs must all have a different format depending on the platform. Is it possible to manage this as well if I provide the templates? Stock Synchronization: Can it also synchronize stock between marketplaces and also with the supplier's stock? Do I need to use a database? Why is Apify better than crawl4ai or parsehub? What is the difference between asking an LLM to generate an expansion or application for me, using Bolt, Cursor, or Cline locally?

is it possible to skip que request for url in preNavigationHooks ? I don't want to do the request at all in request handler if something occurs in preNavigationHooks. The only thing that worked for me is throwing a NonRetryableError but I think this is not ideal

@André Mácola just advanced to level 2! Thanks for your contributions! 🎉

Is it possible to scrape seconds-minute posts on Facebook?

The natural limit for tweets scraped is 800 tweets

Is there any workaround known?

HEEEEEEEELP MEEEEEEEE

message has been deleted

Hello everyone, I'm joining your community after I found out about Apifys great tools. My use case involves social media profile data, and I already found fitting actors. I'm excited to find more about the necessary knowledge about efficient web scraping. See you around 🙂

https://apify.com/kaitoeasyapi/twitter-x-data-tweet-scraper-pay-per-result-cheapest For the same search criteria, Twitter returns a maximum of 800 to 1200 tweets at a time. Therefore, you need to split your search criteria into multiple parts, specifically by time. Whether you want to search for a person's tweets or tweets containing a keyword, you can add a time filter. For example, if you want to search for tweets from a week or a year, you can perform the search month by month and put your search criteria into an array. You can refer to and use the cheapest and most stable Twitter scraping API actor on apify, and utilize its "search term" field.

@Kaito just advanced to level 5! Thanks for your contributions! 🎉

Hey guys, I have a question about apify google maps scraper, is it possible to alter it in any way so that on a new run of the actor it doesnt output/scrape duplicate results of past runs?

I'm very sorry that I received a prompt when logging in just now: Your account has been disabled. Please contact support@apify.com. I wonder what the reason for this is? But I don't know why. I tried to contact the official, but it was all through AI. I also tried to send an email to support@apify.com, but still didn't receive a valid response. What should I do? I'm a newcomer and I don't know what I triggered to cause this. How can I use it normally?