Hi Folks, Can data be migrated every time I make modification to the source database using airbyte, rather then just waiting for it to sync every 5mins? Example -                    Source - Postgres Destination - MySQL If I make a change in Postgres - can it be transferred to mysql immediately or do I have to wait for the sync time - which has been set during connections?

Hey you can look at CDC. Here is the documentation https://docs.airbyte.com/understanding-airbyte/cdc

Can the data be transferred from mysql to postgres using API Call?

Nope. I can't run it. I also modified it to the below file.

how is it being called from the .env file?

if you use the syntax like

- AIRBYTE_VERSION=${VERSION}

docker-compose will read those variables from the env

Perfect. Thank you so much

Hey what does the logs show?

any specific logs you want to see -

Can you also check scheduler log?

ok

In the UI when you click on create you will also find a section where you will find logs for that check connection can you share that? Also ensure that docker has enough memory as you are running multiple services it can be a proble,

ok

https://airbytehq-team.slack.com/archives/C01MFR03D5W/p1647430413832259?thread_ts=1645597249.146829&cid=C01MFR03D5W here you have a section below which shows logs

SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jarfile/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jarfile/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-03-16 124320 INFO i.a.i.s.m.MySqlSource(main):206 - starting source: class io.airbyte.integrations.source.mysql.MySqlSource 2022-03-16 124320 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-03-16 124320 INFO i.a.i.b.IntegrationRunner(run):88 - Sentry transaction event: 3dadca48d8814a1ba64dceb24126245e 2022-03-16 124320 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-03-16 124320 INFO i.a.i.b.IntegrationRunner(runInternal):107 - Command: CHECK 2022-03-16 124320 INFO i.a.i.b.IntegrationRunner(runInternal):108 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}

That's it?

yupp

When you click on create source was there a new container created?

hi.

Hey @Marcos Marx (Airbyte) is still in behind timeline he will be online in sometime

I am not sure about that. 😅

Hey no we don't support right now. But I think there is an issue open for it you can follow that

ok. and apart from that how about mariadb

I don't think so. We have our catalog here https://docs.airbyte.com/integrations/sources

the regular connections are even not happening.

Sorry if I missed the file can you share again over DM may be