Check out the story of Mage's journey from the man who started it all, @DANGerous: https://www.linkedin.com/posts/dangtommy_a-mage-on-the-heros-journey-a-fantasy-epic-a[…]391965814784-C-j-?utm_source=share&utm_medium=member_desktop

@DANGerous @Thomas Chung

What is wrong in the api call below ?

Mage v0.8.37, running on docker, UI works well

See how Mage can enhance your dbt experience. Thank you @Khuyen Tran for the amazing article and video! ✨ Article: https://mathdatasimplified.com/2023/06/05/dbt-mage-interactively-build-and-orchestrate-data-models/ Video:

hey, i am stuck with running dbt all models. I get success in any case. I checked all possible options, single executions work. if i try to do in terminal, everything works perfectly but in block nope. anyone can help?

^ cool project

Hey, i am trying to understand cron triggers. When i set it up 3 am in the morning daily, after i hit save it starts. Why?

can u post that in #bugs-troubleshoot-questions

Hey all, I am big fun of Mage and i experiment with it in different stuff. One of them was to built a relatively simple ETL to perform a basic analysis on some stock data. You can find the project here:https://github.com/georgezefko/mageai-etl-finance I am open to feedback and ideas ;) It’s a work in progress and i want to include more data sources to the project but it is in a sufficient state to get the idea. Other than Mage I have used DuckDB(aka Poor’s man warehouse :P) and Apache Superset(Visuals).

I am looking to use mage to automate dbt testing. Can anyone guide me from where to start?

I am using PySpark cluster to run spark job in Mage. But I am stuck with one error showing 'RepoConfig' object has no attribute 'project_uuid'.

Hey everyone! Curious what feature stores people are using and how they are working them into their Mage workflows!

Hi everyone, I’m new to here coming from the Delta Lake community 🙂

Hello everyone, I'm currently working the data engineering project with mage and google cloud VM instance.. and i'm stuck in reaching my pipelines from SSH i was done some transformation in the pipeline and suddenly i can't access it, however i set the firewall rule to accept the traffic from port 6789 which is the default port for mage and also grand access for http and https.. so still stuck in the middle and can't access the pipeline!!!! ANY HELP PLEASE..

Hey guys, i am looking to configure an s3 sensor using the s3 template provided in the documentation. I understand that the next pipeline won't run until the sensor returns a positive response. But lets say the first pipeline got delayed due to some reason and the second dependent pipeline didn't run either because the sensor returned a negative response. However, how would the second pipeline know when to try again? Is there some sort of retry settings available at pipeline level?

This is such a cool shoutout. Thank you @Ethan Brown!!! https://www.linkedin.com/posts/ethan-brown-dev_homeoffice-dataengineering-dataops-activity-7087846123184275456-8v2p?utm_source=share&utm_medium=member_ios

Took some time, but my first Mage blog is finally finished. Part 1 goes into the basics, while Part 2 will focus on all the possible add-ons that a block can have, as well as their specific use cases. You can read part 1 here! P.s. feedback is always welcome!!

Just published a blog about running your personal data engineering projects in the cloud for free. Where I'm also using Mage and show you how to run it on Github Actions! https://blog.det.life/zero-cost-cloud-solutions-for-your-personal-projects-127f5b53b6b0

Hi everyone, I found Maze as an alternative for Airflow. It is really promising in a sense that it could replace airflow some day. I was curious about will it be always an open source project or at some point of time it would have a fork with would be for enterprise ?

What's the business model for such an amazing tool ? If someone could help

Hi Everyone, Is there SDK support with Mageai? I want to configure pipeline from AWS Lambda function. How can it be configured? thank you

Hello guys, what kind of vm resources (GCP) would I need while doing integrations of tens of millions of rows?

Hi everyone, I have a couple of basic questions if that's ok? When using Mage from S3 to BigQuery, I need to do the compute on the VM running Mage. But if I subsequently triggered a python transform from one BigQuery table to another, can I make BigQuery do the compute? Would that even be best practice? All the best, Dan

Please upvote 🆙 ☝️ ⏫ if you'd like to start a collaborative leaderboard of the best names you've seen for newly created pipelines and blocks. Is there a humor channel for this?!

Hi, Does Mage have the ability to write output data in different table formats like parquet, delta, iceberg, etc??