We have a bad date time of '00-00-00 000000' in one of our cloud provider services database. It is causing this appropriate error.

2021-08-13 18:07:02 ERROR () LineGobbler(voidCall):85 - Exception in thread "main" java.lang.RuntimeException: java.sql.SQLException: Zero date value prohibited

Is there anyway to work around this other than fixing it in the database?

Hi, I remember reading somewhere that Airbyte is going to be able to work with Dagster. Is this something being working on, or is there already a workaround?

Hey, not sure if this is the place to share this bug, but had this issue with the website where the “Join slack” pop up is not working properly and I couldn’t close it until I zoomed the page out

hello all 🙂 apologies for the stupid question, but what is temporal used for? is it needed when deploying Airbyte in kubernetes? (DevOps are asking me...)

hello again, in your documentation you are stating Postgres9.4 is required. We are running Postgres 9.7 and when creating the table

AIRBYTE_CONFIGS

we get:

Exception in thread "main" org.jooq.exception.DataAccessException: SQL [-- tables
 CREATE
    TABLE
        IF NOT EXISTS AIRBYTE_CONFIGS(
            id BIGINT GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY,

the keyword

GENERATED

does not exist in versions prior 10

Also, it seems password are logged as plain text sometimes...

Hello all. I've deployed Airbyte in our GKE environment, but cannot access the webapp via

kubectl --proxy

- which is how we access internal-use webpages under our security model. I honestly wasn't sure if this should be a bug or a feature request. I submitted this ticket as a bug since it's affecting our ability to use the product. Please let me know if I can help

Seriously nit-picky feedback: The loading spinner when first loading the Airbyte UI is really hard to see against the background color, and this is maybe the 3rd time I’ve thought the page was broken because it didn’t stand out. Possibly I’m blind, but something higher contrast would be cool

Hi! The Shopify source seems to sync Metafields only for the Shop resource when it should load a lot more owner resources according to the documentation. Is this a misconfiguration on my side? https://shopify.dev/api/admin/rest/reference/metafield

Strange request but does anybody know if there are demo account credentials available for any of the Airbyte sources? I want to play around with some demo data from a few of them but don't have any credentials that I can use.

This message was deleted.

I get unreasonably excited when I see the red dot next to sources in admin 🤣

hi all, is there a way to submit

SET statement_timeout = 6000000;

or any other pre-query statements to database before starting the extraction? (DB is postgres)

probably poor form but request to prioritise issue associated with s3 staging. a few issues popped up which i think are all related to this

Hi, there is an article showing that chargebee is avalable as a connector since 2021-06-30 but I can't find it in the source panel...

Airbyte Team - are you guys planning to present @ https://www.opensourcedatastack.com/ ? Looks to be a decent amount of registrations thus far (I'm 1,000 something)

Hi all, Does Airbyte S3 destination support partitioning? like partitioning by year, month, day etc?

Is there any guides for setting up facebook apps (https://docs.airbyte.io/integrations/sources/facebook-marketing) for cases where you only wish to extract data from facebook without a login interface . Currently using the facebook-marketing data connector ( as fivetran is way to costly for a my two man team ) and as stated in the docs, throttling is a major issue. Also we love the project and have been able to use the google analytics connector with great success.

Suggestion - I'm keen to build some connectors for tools I use but the documentation doesn't fair well with Windows and it's not intuitive enough to just start building. I'd love a video tutorial or some windows support. Thanks!

Hello! Do you know if support for SendGrid email activity will be available any time soon? It’s really the only useful bit of data we need from SendGrid (https://docs.sendgrid.com/api-reference/e-mail-activity/filter-all-messages) which isn’t supported in the source connector. Is this something SendGrid allows us to do (as it looks like it is beta functionality)? Happy to create a PR to add this if possible.

On a Kubernetes deployment, is it possible to specify restrict the nodes that connector pods run on? e.g., connector pods for workspace X run only on nodes for workspace X?

Hello what is the estimated time for ECS deployment to be available?

Is there a way to get access to a recording of Tuan Nguyen’s presentation on deploying Airbyte with Terraform? We are having a couple of issues with getting the database deployed and initialized and this presentation looks like it may help us out.

hello, afaik airbyte have connector to appsflyer. however it has been dropped. can i help develop the connector? as for my current use case, i do need data from appsflyer. thank you

Hi! Maybe someone can help: can you use an IAM role for S3 destination if Airbyte is running on EC2 (without providing access token explicitly)? I've found a workaround (mounting a bucket using s3fs and using the Local CSV (or JSON) connector). But using IAM seems to be a very natural solution... I've found a couple of tickets but they seem to be abandoned.

Hi, I’m a bit new to Airbyte but some feedback so far: 1. I’d love to be able to configure connectors as code/yamls so that I have some sort of “indempotency” on my project rather than having to point and click per rollout. The usecase is that I’m thinking is a multi-client dashboard and I want to be able to deploy a full stack including airbyte per client. Having to point and click to configure each is not very practical. 2.  I would love to see a section for orchestrating dbt jobs (not as source transformations only but the whole shebang). is this in the backlog? 3. I’m fiddling with creating a new connector that can handle a ZIP with multiple CSV files inside. Are you planning support for something similar? Basic question: 4. the CSV File connector generates json inside a column. Is there any way to generate actual columns instead? I was very surprised with this behavior… perhaps some missing config?

Hi folks, How complicated it is to implement an executor for Airbyte to allow running connectors on AWS Lambda (instead of EKS)? (I am asking, because we are using AWS Lambda as our main runtime and it’s been a breeze)

Hey everyone, Would like to use S3 as source for a Sync. We have a bunch of s3 files at a prefix - I am assuming the Sync would iterate over them and write the data to destination. How would Airbyte handle failure in sync of 1 (or more) s3 file?

Hello! I just deployed airbyte in an on-prem kubernetes cluster. I'm excited to use it, but I'm seeing some really long delays and timeouts when setting up connections, in addition to a growing history of pods in the default namespace. Is deploying on kubernetes still too experimental (ie should I use docker compose)?

I think I've opened an issue previous that was closed, but I'm still trying to understand behavior between Airbyte and Stitch for a Stripe source, more in 🧵