Andik Achmad02/19/2022, 2:54 AM
George Xing02/19/2022, 6:28 AM
Muhammad Al Ghifari02/19/2022, 6:43 PM
Paul-Matthieu Riolacci02/22/2022, 1:51 PM
matt_innerspaceio02/22/2022, 2:57 PM
support, given their logical replication issue. Strategically, timescale has a managed service which presumably has trouble onboarding larger databases (mine included) because the onboarding strategy requires a pgdump/restore, or code changes on the customer side. I'm sure there is a way to figure it out with them. For context, I'm running a few 3TB postgres/timescale dbs that I'd love to move over to timescale managed services, but there is no way to do it without significant downtime.
James Jefferies02/22/2022, 3:24 PM
Abrar ul farhan Mohammed02/22/2022, 11:44 PM
Clovis Masson02/23/2022, 8:28 AM
files before re-uploading it. Problem here is that these yaml files are getting bigger and bigger (especially
) and it's getting complicated to browse easily each to make my changes. What could be a solution to trim these files safely without causing side effects ? For instance, I would have deleted all inactive connection from files, as well as old job but I don't want to break or to loose my existing data sync. Is there any existing tool/solution for cleaning / trimming these config files ?
Aakash Kumar02/24/2022, 12:23 PM
Tony Hu02/24/2022, 10:27 PM
but changelog in https://docs.airbyte.com/integrations/sources/kafka only has 0.1.3, is it expected? thanks
Huib02/25/2022, 10:54 AM
Imane02/25/2022, 1:51 PM
connector, I found that the
returned in the
stream do not have the right data. Do you know why? I compared it with the values shown in the UI. I created this issue.
VMaldonado02/25/2022, 10:21 PM
Lucas Wiley02/25/2022, 11:02 PM
Lucas Wiley02/25/2022, 11:03 PM
Vikram Bhamidipati02/26/2022, 2:35 AM
. This is not allowed per our security policy, we need to use IAM roles or in case of EKS can use IRSA. Issue # 5282 addresses this in some way. I am wondering if this can be enhanced to use the DefaultCredentialsProvider. This will allow the logging to be more generic and work everywhere irrespective of how the AWS credentials are configured. Q - can I submit changes as a PR to this core functionality or does this need to be handled by the Airbyte Team ?
Saurabh Mathur02/28/2022, 6:56 AM
Anatole Callies02/28/2022, 9:21 AM
William Phillips02/28/2022, 3:17 PM
Vinny Tunnell03/01/2022, 1:11 AM
If multiple output files is not possible, is there any way I can at least see staged data that has been processed so far? My desired output format is Parquet with SNAPPY compression.
... 2022-03-01 01:07:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14455000 2022-03-01 01:07:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14456000 2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14457000 2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14458000 ...
Anatole Callies03/01/2022, 1:31 PM
Remi Salmon03/01/2022, 4:57 PM
Paul Cothenet03/02/2022, 4:27 AM
Sohit Kumar03/02/2022, 6:59 AM
column for this. Is there any workaround if I have tables in bigquery which does not have column which is incremented every-time we update or create record.
Oliver Franz03/02/2022, 7:39 AM
Keren Guz03/02/2022, 10:45 AM
Joaquin Oroño Bugnon03/02/2022, 1:00 PM
hendrik03/02/2022, 9:38 PM
Jin Gong03/02/2022, 10:07 PM
response you need to pass the fields to query param
. I don't think this is supported by Airbytes. Could anyone help with this request? I am happy to contribute but not sure where to get started 🙏