I’m liking airbyte, thanks! Do you handle postgis geometry types in postgres?

Hello, I'm trying to compare Airbyte with RudderStack (which seems to be like Segments but can be self-hosted). Is somebody already done this comparison?

Hello everyone, I just want to know if we can run the solution without docker?

👋 Hi everyone! I started digging into the world of airbyte today and was curious on getting involved in helping build a connector for teradata and looking where to start 😬

Is there any plans to develop data models for supported integrations for reporting purposes? Fivetran releases dbt packages for common sources as Stripe (https://hub.getdbt.com/fivetran/stripe/latest/) because the extracted data is usually not suitable for reporting.

We have some users who are really looking forward to log based replication on mssql, any chance we can pair with you guys to push the feature out faster?

Hi all! I have a POC running to replicate some very large databases (30T+ rows). I gave it a good-sized EC2 host, but I see that it is not using many resources and the max batch size is 10k rows. Should I be upping that for performance?

Hello, is there an option to drop the schema name when configuring SQL Server as a source? Would like to remove the

dbo

from each of the table names

Hello. Airbyte is compatible with AWS Aurora (normal version and Serverless) as a destination (PostGres implementation)?

Hi everyone , is it possible to connect snowflake airbyte destination with snowflake custom auth? such as Okta?, My snowflake instance is within okta authentication , and the current connection destination in airbyte does not include the auth field (it currently has the fields host, role, warehouse , etc, but not the authenticator)

Has anyone had any luck getting Airbyte to run on a Docker (non-docker-compose) environment? I'm interested in getting it running on Render, but it seems like it's non-trivial to do (as per https://github.com/airbytehq/airbyte/issues/1415)

👋 👋 Hey everyone! Just shared on HackerNews the deck we used to raise our seed round with Accel in 13 days. Hopefully, this could be helpful to any of you! Would appreciate upvotes :). You can find the post in https://news.ycombinator.com/newest by just searching for “Airbyte” or “deck” We’re also testing if getting 40 upvotes in the 20 first minutes would get us on the front page. So please upvote, and we’ll tell you if it works 🙂.

Hello all, good day, would like to enquire if there is any timeline / roadmap for Incremental - Change Data Capture? This sync mode would really help to solve the issue of having only the most recent data in the destination, and offload querying OLTP databases to querying warehouses

Hi Folks! Are there any plans to support Redshift SUPER type (a la Snowflake VARIANT) as a JSON landing destination instead of the VARCHAR in the current Redshift destination?

Gotcha, good to know. Makes sense that this would be fundamentally incompatible then. Thanks for the details!

Not sure if this has been asked before, but is there a best practice way of maintaining the contents of the airbyte_workspace folder? I see each run of my jobs creating new scripts and log files, which is great, but over time, it's now chewing up all of the disk space on my small instance. I don't want to break something by wiping out the contents of the folder, so wondered if there was a proper way of maintaining the contents of this folder, maybe only allowing airbyte to keep say 7 days worth of logs, or something similar?

hey guys, here is the need we have: I have hand rolled a connector framework in elixir that pulls from various APIs and normalizes data into a postgres db (data warehouse). so we have all this raw data sitting in this db but what we need to do is to create new tables based on the raw tables, i.e. blending data from various tables into a single table which will be pulled into domo for analytical purposes. so we need postgres db -> transformed via sql query or similar -> new table in postgres db is airbyte a match for this use case?

Quick question if you guys happen to have the answer already but for the Postgres destination, do you truncate the table for full refreshes or drop it and recreate it? Wondering if I can modify the table's schema to have an index and have it persist.

👋 Hi everyone! Have any request about add MySQL as a destination in Airbyte?

How to delete source definition ? I dont see any option to do so , tnx

<!channel> Hey everyone 👋! here are the updates for the past week: • Progress on connectors: ◦ New connector: Google Workspace Admin Reports (audit logs) ◦ Bugfix in the base python connector library that caused errors to be silently skipped rather than failing the sync ◦ Exchangeratesapi.io bugfix: to point to the updated API URL ◦ Redshift destination bugfix: quote keywords “DATETIME” and “TIME” when used as identifiers ◦ Github bugfix: syncs failing when a personal repository doesn’t contain collaborators or team streams available ◦ Mixpanel connector: sync at most the last 90 days of data in the annotations stream to adhere to API limits ◦ Oracle DB as a source connector is coming soon, we’re testing it! • Progress on Core (0.19.0):  ◦ New Connections page where you can see the list of all your connections and their statuses.  ◦ New Settings page to update your preferences. ◦ Bugfix where very large schemas caused schema discovery to fail. ◦ CDC for Postgres is coming very soon, currently finalizing it! • We had our first community call last Thursday. Unfortunately, our guest Jins was sick and couldn’t present his caching use case of Airbyte. But we still presented our progress and roadmap. Here’s the

video▾

and the slides we presented. Our 2nd one should take place in the beginning of May. Stay tuned! • New tutorial: How to create a Zoom activity dashboard for your team meetings and webinars, using Airbyte and Tableau • You all know that transparency is very important to us. Here’s our new company handbook where we’re publishing everything about our processes. It will soon be hosted on GitHub, so don’t hesitate to make PRs for improvement suggestions!

Hey everyone 👋, I was reading up on ETL/ELT and how airbyte envisions EL(T) to be the future. Really interesting stuff! One question: One of the cons of ELT(and thereby a pro of ETL) that comes up is that ETL is a more secure approach to remove/mask data to protect the privacy of your clients. ETL essentially allows you to do that in the Transformation step before uploading to the destination, whereas with ELT, you’ll have to upload data first before removing/masking. Seemed like a valid point to me. What is your take on that? How could EL(T) tackle this problem? Also, where do most of Airbyte users push their data? Is it to a self-hosted storage, or to a cloud storage?

Hi, I am just wondering if there is a way to enable multiuser login in airbyte UI. Can anyone please guide me on finding the resource to enable that! Or how do other teams generally handle multi developer scenario in general if that provision isn't there!

@John (Airbyte) is there any option to give a limited user access to airbyte dashboard so user can come & setup their pipeline but can not access other part?

Looks like no one was in the office hours today.

Hello 👋 I was looking at a few of the integrations and noticed that "replicate incremental deletes" is marked at "coming soon". Any more details on this, or is there a ticket I could follow or anything? TIA

Hi, could someone help me to understand the difference between Airbyte and Meltano? Is possible to merge efforts between both projects? It's look like both are doing similar things? Each community has around 900 members in general channel. Will be great to see a kind of union to progress faster together in the number of integrations and creating an standard. Then maybe each project can offer value on top of a common standardization. Hopefully can clarify me to better understand the differences between both projects. I'm a bit confused.

Hello team, what is the status of the dbt integration? various places say 'expected Dec 2020' and 'intend to integrate deeply with DBT'

Hi all!

Hey team! I did a EL process successfully! But I have some question: Can I change the

Cleaned name

? From:

jusprocessodb_live_DATABASECHANGELOG

to

DATABASECHANGELOG