Thanks for this suggestion. I was thinking somethi...
# đź—Łgeneral-chat
l
Thanks for this suggestion. I was thinking something like that. Have you ran this yourself already? I've also considered storing the output in S3 and then ingesting into databricks with autoloader. One thing I'm unsure about, if I scrape HTML pages, would you store the raw HTML page in S3 or only extract JSON / CSV fields? Any recommended or easy way to output from Apify in S3?