Shyngys Nurzhan
04/15/2022, 4:11 AMKeshav Agarwal
04/15/2022, 12:54 PMGoffredo Lepori
04/15/2022, 2:29 PMHarsh Vardhan
04/15/2022, 6:40 PMjijo
04/16/2022, 12:21 AMMikhail Masyagin
04/16/2022, 3:21 AMZendesk Support
and it runs extremely slow. It fails to fetch 1-years data of ticket_auditc
, failing on 2-months with back-off. Also it has too many duplicates in data. The company, which I connect with Zendesk Support
is really small, so I don't think, that it produces gigabytes of data each month.
What to do with Zendesk Support
ticket audits
??? Does anybody has this bug too?
Everything is ok with Zendesk Support
satisfaction ratings
.Taufiq Wahyu Ibrahim
04/16/2022, 12:34 PMdecimal
columns.
Exception in thread "main" tech.allegro.schema.json2avro.converter.AvroConversionException: Failed to convert JSON to Avro: Could not evaluate union, field amount is expected to be one of these: NULL, DOUBLE. If this is a complex type, check if offending field: amount adheres to schema.
mysql> describe payment;
+--------------+-------------------+------+-----+-------------------+-----------------------------------------------+
| Field | Type | Null | Key | Default | Extra |
+--------------+-------------------+------+-----+-------------------+-----------------------------------------------+
| payment_id | smallint unsigned | NO | PRI | NULL | auto_increment |
| customer_id | smallint unsigned | NO | MUL | NULL | |
| staff_id | tinyint unsigned | NO | MUL | NULL | |
| rental_id | int | YES | MUL | NULL | |
| amount | decimal(5,2) | NO | | NULL | |
| payment_date | datetime | NO | | NULL | |
| last_update | timestamp | YES | | CURRENT_TIMESTAMP | DEFAULT_GENERATED on update CURRENT_TIMESTAMP |
+--------------+-------------------+------+-----+-------------------+-----------------------------------------------+
The connection is working fine when I only replicate tables without decimal
column.
ThanksSami RIAHI
04/16/2022, 1:53 PMSami RIAHI
04/16/2022, 1:54 PMShanhui Bono
04/17/2022, 7:06 PMEnrico Tuvera Jr.
04/18/2022, 4:58 AMmodules.yml
and module-settings.yml
? or is that something elseAditya Tripathi
04/18/2022, 8:44 AMRamansh Sangal
04/18/2022, 10:59 AMRamansh Sangal
04/18/2022, 11:01 AMRamansh Sangal
04/18/2022, 11:01 AMHarsh Vardhan
04/18/2022, 12:37 PMKev Daly
04/18/2022, 1:06 PMSahar Zelonagora
04/18/2022, 4:42 PMSiva Kowsika
04/19/2022, 2:01 AMNarender Kumar
04/19/2022, 3:20 AMDmitry Parpura
04/19/2022, 7:13 AMcurl: (6) Could not resolve host:
What the problem? How to solve it ?Ashwini R
04/19/2022, 7:16 AMAshwini R
04/19/2022, 7:19 AMDmitry Parpura
04/19/2022, 9:01 AMAshwini R
04/19/2022, 10:04 AMAshwini R
04/19/2022, 10:05 AMShah Newaz Khan
04/19/2022, 1:20 PMminio
from the gke k8s airbyte
deployment and only use gcs
for logging. When I remove the aws/s3
specific envars from the worker pod I get the following error:
Appender java.lang.IllegalStateException: No factory method found for class com.van.logging.log4j2.Log4j2Appender
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.findFactoryMethod(PluginBuilder.java:234)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:134
As far as I can tell, this is due to the the logging plugin unable to find the directory to log in, are there any other envar I need to set? These are the ones I removed from the worker.yaml envars
- name: S3_LOG_BUCKET
valueFrom:
configMapKeyRef:
name: airbyte-env
key: S3_LOG_BUCKET
- name: S3_LOG_BUCKET_REGION
valueFrom:
configMapKeyRef:
name: airbyte-env
key: S3_LOG_BUCKET_REGION
- name: AWS_ACCESS_KEY_ID
valueFrom:
secretKeyRef:
name: airbyte-secrets
key: AWS_ACCESS_KEY_ID
- name: AWS_SECRET_ACCESS_KEY
valueFrom:
secretKeyRef:
name: airbyte-secrets
key: AWS_SECRET_ACCESS_KEY
- name: S3_MINIO_ENDPOINT
valueFrom:
configMapKeyRef:
name: airbyte-env
key: S3_MINIO_ENDPOINT
- name: S3_PATH_STYLE_ACCESS
valueFrom:
configMapKeyRef:
name: airbyte-env
key: S3_PATH_STYLE_ACCESS
Adit Modi
04/19/2022, 1:32 PMEliot Salant
04/19/2022, 2:59 PMecho '{"type": "RECORD", "record": {"stream": "testing", "data": {"DOB": "01/02/1988", "First Name": "John", "Last NAME": "Jones"}, "emitted_at": 1650284493000}}' | docker run -v /Users/eliot/temp:/tmp airbyte/destination-csv write --catalog /tmp/airbyte_catalog.txt --config /tmp/airbyte_write.json
2022-04-19 14:47:36 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=/tmp/airbyte_catalog.txt, write=null, config=/tmp/airbyte_write.json}
2022-04-19 14:47:36 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.csv.CsvDestination
2022-04-19 14:47:36 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Command: WRITE
2022-04-19 14:47:36 INFO i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=WRITE, configPath='/tmp/airbyte_write.json', catalogPath='/tmp/airbyte_catalog.txt', statePath='null'}
2022-04-19 14:47:36 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
Romain LOPEZ
04/19/2022, 5:40 PM