Andik Achmad
02/19/2022, 2:54 AMGeorge Xing
02/19/2022, 6:28 AMMuhammad Al Ghifari
02/19/2022, 6:43 PMPaul-Matthieu Riolacci
02/22/2022, 1:51 PMmatt_innerspaceio
02/22/2022, 2:57 PMtimescaledb
support, given their logical replication issue.
Strategically, timescale has a managed service which presumably has trouble onboarding larger databases (mine included) because the onboarding strategy requires a pgdump/restore, or code changes on the customer side. I'm sure there is a way to figure it out with them.
For context, I'm running a few 3TB postgres/timescale dbs that I'd love to move over to timescale managed services, but there is no way to do it without significant downtime.James Jefferies
02/22/2022, 3:24 PMAbrar ul farhan Mohammed
02/22/2022, 11:44 PMClovis Masson
02/23/2022, 8:28 AM.yaml
files before re-uploading it.
Problem here is that these yaml files are getting bigger and bigger (especially JOBS.yaml
and ATTEMPTS.yaml
) and it's getting complicated to browse easily each to make my changes. What could be a solution to trim these files safely without causing side effects ? For instance, I would have deleted all inactive connection from files, as well as old job but I don't want to break or to loose my existing data sync.
Is there any existing tool/solution for cleaning / trimming these config files ?Aakash Kumar
02/24/2022, 12:23 PMAndy Yeo (Airbyte)
02/24/2022, 1:22 PMTony Hu
02/24/2022, 10:27 PM0.1.4
but changelog in https://docs.airbyte.com/integrations/sources/kafka only has 0.1.3, is it expected? thanksHuib
02/25/2022, 10:54 AMImane
02/25/2022, 1:51 PMgoogle_ads
connector, I found that the labels
returned in the campaigns
and in ad_group_ads
stream do not have the right data. Do you know why? I compared it with the values shown in the UI.
I created this issue.VMaldonado
02/25/2022, 10:21 PMLucas Wiley
02/25/2022, 11:02 PM_0.35.36-alpha_
on an AWS Linux machine. I created a pull request referencing @ethan's suggestion here.Lucas Wiley
02/25/2022, 11:03 PM<http://account.snowflakecomputing.com|account.snowflakecomputing.com>
Vikram Bhamidipati
02/26/2022, 2:35 AMAwsBasicCredentials
. This is not allowed per our security policy, we need to use IAM roles or in case of EKS can use IRSA. Issue # 5282 addresses this in some way. I am wondering if this can be enhanced to use the DefaultCredentialsProvider. This will allow the logging to be more generic and work everywhere irrespective of how the AWS credentials are configured. Q - can I submit changes as a PR to this core functionality or does this need to be handled by the Airbyte Team ?Saurabh Mathur
02/28/2022, 6:56 AMAnatole Callies
02/28/2022, 9:21 AMWilliam Phillips
02/28/2022, 3:17 PMVinny Tunnell
03/01/2022, 1:11 AM...
2022-03-01 01:07:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14455000
2022-03-01 01:07:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14456000
2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14457000
2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14458000
...
If multiple output files is not possible, is there any way I can at least see staged data that has been processed so far?
My desired output format is Parquet with SNAPPY compression.Anatole Callies
03/01/2022, 1:31 PMRemi Salmon
03/01/2022, 4:57 PMPaul Cothenet
03/02/2022, 4:27 AMstreams
definitionSohit Kumar
03/02/2022, 6:59 AMcursor
column for this. Is there any workaround if I have tables in bigquery which does not have column which is incremented every-time we update or create record.Oliver Franz
03/02/2022, 7:39 AMKeren Guz
03/02/2022, 10:45 AMJoaquin Oroño Bugnon
03/02/2022, 1:00 PMhendrik
03/02/2022, 9:38 PMJin Gong
03/02/2022, 10:07 PMregistrant_id
in report_meeting_participants
response you need to pass the fields to query param include_fields
. I don't think this is supported by Airbytes. Could anyone help with this request? I am happy to contribute but not sure where to get started 🙏