I see in the API that when i'm creating a connection

/connections/create

i have to supply

syncMode

at the root object as well as per stream object. I can understand why there's a

syncMode

per stream, but not for the root object. Can someone shed some light on this?

Hey guys, I saw in your Q1 OKRs that you want to have "Seamless OAuth support" can you shed some light on what this means?

FYI, it seems like I am getting some errors from PostgresDestination in v0.13.0…

Just a matter of interest - why don’t we trigger CI only on specific path? So if there are no changes outside of frontend - run build for frontend only? Probably quite the same could be achieved for python and java based connectors or on some other better thought out conditions

For anyone watching our repo, sorry for the release emails!

@here do we have incremental update support for SendGrid?

Interesting, our demo instance ran out of disk space (it has only 8G)

Do we need

docker-compose.dev.yaml

anymore? Doesn’t

VERSION=dev docker-compose

do everything we need now?

Can one of you guys point me in the right direction? All connection tests are successful, and I am able to use this setup to interact through Python.

Hey guys. I'm really excited about this project and tried to get it running yesterday for the first time. Unfortunately, I ran into a normalization error. Hoping someone can suggest a fix. I'm running airbyte on CE and attempting Shopify -> BigQuery. First sync exited with an error. I checked the data and some of the columns that should exist based on the schema do not. For example, the orders table does not contain a line_items column. However, the rows all seem to be there. Below is the relevant section of the logs. Appreciate any help! **EDIT: I see that the expected result would be a separate line_items table, but that doesn't exist either.

When looking at job logs, does anyone else have trouble determining which logs are from the source versus the destination? This seems like it can be hard thing to deduce, but with the right logger configuration could be made not hard.

I’m interested in the raw clickstream data from Google Analytics. We are thinking about updating a fork of the Singer Tap. How would we incorporate that into AirByte?

FYI, I've been working on a airbyte native google analytics connector

is anyone already looking into the build issues?

AcceptanceTests > initializationError FAILED
    java.lang.IllegalStateException: Check failed: Docker environment should have more than 2GB free disk space
        at org.testcontainers.DockerClientFactory.check(DockerClientFactory.java:298)
        at org.testcontainers.DockerClientFactory.checkDiskSpace(DockerClientFactory.java:287)
        at org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:224)
        at org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
        at org.testcontainers.LazyDockerClient.authConfig(LazyDockerClient.java:12)
        at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:310)
        at io.airbyte.test.acceptance.AcceptanceTests.init(AcceptanceTests.java:143)

What are you guys thinking about in terms of your Kube support? I really like the idea of applying the YAMLs individually since Airbyte uses the DB as the coordination layer. Are you thinking Helm in the future or something? I'm not using k8s right now, but I'd like to when you're off alpha there.

hello

Hey guys, what's the preferred way of having two sources with different configurations, e.g.: google analytics from 2 sites ending up in the same destination?

Is anyone looking at the BQ integration test failures? Looks like a permission issue / unexpected error text.

I've collected svg logos for every source that airbyte has, do you guys want me to submit a PR with those? If so, let me know where you want them.

Hello everyone

All builds are broken again. @Jared Rhizor (Airbyte) last time we discussed this, I think we agree that the next step was to remove integration builds from core build. Is that still seem like the right next step?

Do you think all SQL identifiers (at least columns?) should be always quoted (and forced to be case sensitive) or we should try to avoid quotes/case-sensitive as the destination (here snowflake) allows the users to… In Snowflake: • if you quote your columns, they are case-sensitive • if you don’t quote, then they are not case-sensitive (they actually become automatically UPPERCASED) WDYT? https://github.com/airbytehq/airbyte/issues/2128

Hi, can anyone help me understand the workspaces

Hi all, I cloned the repo and used docker-compose to try and replicate Postgres to Snowflake. I ended up selecting all tables in my Postgres source. I tried to kill the sync and that didn’t work. I stopped the containers and deleted the images. however, if I run docker-compose again, it remembers all the tables from before, even though it cannot connect to the database (source or target). This leads me to believe that the config (data) is being persisted somewhere locally. How can I start from a clean & brand new local set-up using Docker. Thanks

Hi , I was a little unclear about this. I tried to use AirByte to transfer Salesforce data to BigQuery, but the table created in BigQuery had two additional columns for AirByte at the top. Is this something that is always added? And, it created a table that I did not intend to create. _airbyte_raw_Salesforce1_Account What is this used for?

Hello Airbyte! I would like to build a custom connector for an ORM platform that my customer is using (https://konnectinsights.com/). I was going through your literature on how to create a sample connector as a starter (https://docs.airbyte.io/tutorials/toy-connector). I could do that successfully. However - there are instructions related to "Incremental Sync" that is going to be useful for while building by custom connector. May I request you to point to the site if these instructions are available and if not - at least a hand written draft (even if it's not very neat) can well be a good starter for me.

I am interested in contributing to the Airbyte core. Pointers to a good first project for getting started would be great 😄

@Michel The session was great!😁

Hey team, how are you guys managing multiple python versions on your local? I’m trying to use

pyenv

, however the gradle plugin seems to be picking up my system python instead (I’ve confirmed pyenv works on the terminal)

Do you know why this change was made with gitbook? it doesn’t look very good on either the docs or directly on github (in markdown viewer) https://github.com/airbytehq/airbyte/commit/8aa97ed8461ba8d115bc9f6a7d327abb439bd8a1#r47737269