https://apify.com/ logo
Join Discord
Powered by
Apify Question:
# crawlee-js
a
Does anyone know a good option (preferably free, but I don't mind paying a little if it's good) that can extract data? I'm looking for a tool that can search specific websites (ideally 5 of my choice) for job offers and then forward the results to Make.com, which will handle the rest of the workflow.
a
message has been deleted
a
Does anyone know a good option (preferably free, but I don't mind paying a little if it's good) that can extract data? I'm looking for a tool that can search specific websites (ideally 5 of my choice) for job offers and then forward the results to Make.com, which will handle the rest of the workflow.
w
Depends on what you want to scrape - if there is not too much anti-automation security, you can try with [apify/website-content-crawler](https://console.apify.com/actors/aYG0l9s7dbB7j3gbS). It should be easy to integrate with Make (see [Apifys](https://docs.apify.com/platform/integrations/make) and [Makes](https://apps.make.com/apify) relevant documentation.
a
What if I want to automatically extract job listings for positions like "Warehouse worker" or "dishwasher" (and so on) from several job websites—let's say four different ones—and send the data to Make.com once a week? Where it will then translate and send it to Outlook module.........
w
Looking at different job scraping actors (I just searched "job" on [Apify Store](https://console.apify.com/store) ) it seems like they in general supports searching for something specific like "Warehouse worker". For the integration with Make, you can either use the trigger "Watch Task Runs" and [schedule](https://docs.apify.com/platform/schedules) a [task](https://docs.apify.com/platform/actors/running/tasks), or trigger the runs from make with the "Run a Task" and [schedule you scenario](https://help.make.com/schedule-a-scenario)
a
But schould i still use this "apify/website-content-crawler.", because these Jobs - sites use a lot of anti bot measurers...
w
Probably not no, I'd say that the specific scrapers are more likely work for you 😌
t
specific sites scraper will only work because every website has different layout
a
so you mean i schuld let someone create a Specific seite for me right? with Apify
But how does it exactly work? Can i for axample create this specific Site, and use it without having to pay the Apify - Subscription? Lets say for example i have compleated this Webseite, do i have to make it public, if not, what are the the advanteges of making it public and not making it Public? And do People usally Charge Money on theyre Sites?
t
I can"t understand what you mean by specific site. I think you meant scraper? right
a
yes
yes, thats what i meant
yes, thats what i meant So do you maybe know the Answer: But how does it exactly work? Can i for axample create this specific Scrapper, and use it without having to pay the Apify - Subscription? Lets say for example i have compleated this Scrapper myself, do i have to make it public, if not, what are the the advanteges of making it public and not making it Public? And do People usally Charge Money on theyre Scraper, if not why dont they? Like lets say i compleated this Scrapper, and not want to use it, do i have to like pay a lilte bit money to Apify or can i use my own Scrapper for free? Do you know?
t
yes
So, If you make the scraper public other users can use it and hopefully you can earn.
if your scraping less often then apify free credit can cover.Apify provides resource to host your actor and also for proxy. You can host yourself if you are planning to use for personal needs
a
but does this Option cost me money? I am new to Apify and in scrapping in General. So lets say that i will only Srape once and make this Scrapper for the project, after that i will stop, SO do i still have to pay Apify anything. I didnt quite Understand you Answer...
t
If you dont scrape, it wont cost you money
But only if theres an actor present on apify, if not you would have to either create one or ask someone for it(mostly people would charge for it). hope that helps, if not feel free to ask your doubts
a
But if i scrape four Webseite mayself, for my Private use. Will i then get charged from Apify for basically using thyre Webseite to scrape?
And if lets say i decide to make the scrapper avaliablke for everyone. Will i have to pay then Apify some percentage or pay for like hosting? And another question: Will if effect the maintance, like for example if it will make these Webseite i scrapped add more securty layers? Or so? Do you understand how i mean it.....
t
If you use for private needs its fine but you need to pay apify because you will be using their resourve and platform
If you make it public people can use it and if they are paid plan you will earn through it.
and thiers nothing as website will increase security layer
and thier are lot of spelling mistake which make it hard to understand your context
a
But if I make it public, will I still need to pay for the Apify subscription, or is it free then?
My only question is: do I have to pay in both scenarios? One where I make the scraper public, and the other where I keep it private. That’s all I want to know.
a
@asim549_ just advanced to level 3! Thanks for your contributions! 🎉
a
I dont Understand: and thiers nothing as website will increase security layer
t
Yes, in both scenarios you need to pay, because when you will run the actor it will run on apify infrastructure so thats what you are charged for
a
Hoow much would that cost me in both scenarios?
Do you mabe know?
t
it depends how much resource you use
while running the actor, if proxy used then more and etc
a
What if i scrape 4 differet webseite, , and then i like add it with n8n or Make.com
t
yeah you can integrate make and n8n with apify
a
but how much would that cost? With everything i want to do......
t
are you making the actor on your own?
a
i think, dont know yet
so an estimate for myself
t
I didnt get your point, are you asking how much it would cost to run on apify or to build the actors?
a
both
t
How many actors you want to be built?
a
@thenetaji just advanced to level 7! Thanks for your contributions! 🎉
a
I think four, because I’ll be scraping four JOBS - websites
t
How much you are willing to pay?
a
dont kow, first tell me your estimate
t
depends on site complexity and time required and is it highly protected or not
so can you send me website link to check
a
t
please wait a few minutes, I am checking...
a
Ok
t
hey, looks the site are not much protected, only thing required would be time to build, and format the data in a cleaned version. Can you just tell me your budget, and If you are okay, I will be happy to do this project, if you consider
a
ok, let me think about it, dont know yet...
t
sure, take your time
PreviousNext
Powered by