Anand
02/16/2022, 3:48 PMKyle
02/16/2022, 8:22 PMAnand
02/17/2022, 7:10 AMVadim
02/17/2022, 9:26 PMMadhu Prabhakara
02/17/2022, 10:33 PMCompleted with 1 error and 0 warnings:
normalization - 2022-02-17 22:21:53 INFO () LineGobbler(voidCall):82 -
normalization - 2022-02-17 22:21:53 INFO () LineGobbler(voidCall):82 - Database Error in model small_business___impact_data (models/generated/airbyte_tables/enhanced_capital_701/small_business___impact_data.sql)
normalization - 2022-02-17 22:21:53 INFO () LineGobbler(voidCall):82 - invalid input syntax for type date: "1.0"
normalization - 2022-02-17 22:21:53 INFO () LineGobbler(voidCall):82 - compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_tables/enhanced_capital_701/small_business___impact_data.sql
Arasdan
02/18/2022, 1:00 AMsyncing stream
process from the source, it seems idle/waiting something. I tried multiple times and in different environment also showing the same result. why does it take 40 mins to start syncing stream
process ?
2022-02-05 10:16:53 destination > 2022-02-05 10:16:53 INFO i.a.i.d.s.SnowflakeInternalStagingConsumerFactory(lambda$onStartFunction$1):122 - Preparing stages in destination completed AIRBYTE_SCHEMA_AIRBYTE_RAW_TEAMS
2022-02-05 10:16:53 destination > 2022-02-05 10:16:53 INFO i.a.i.d.s.SnowflakeInternalStagingConsumerFactory(lambda$onStartFunction$1):125 - Preparing tables in destination completed.
2022-02-05 10:56:30 source > Syncing stream: repositories
2022-02-05 10:56:33 source > Read 566 records from repositories stream
2022-02-05 10:56:33 source > Finished syncing SourceGithub
Tomislav Najdovski
02/18/2022, 1:50 AMTomislav Najdovski
02/18/2022, 1:53 AMMuhammad Imtiaz
02/18/2022, 10:40 AMAlessandro Pietrobon
02/18/2022, 12:43 PMSSH Tunnel Method defaults to No Tunnel (meaning a direct connection). If you want to use an SSH Tunnel choose SSH Key Authentication or Password Authentication.
Choose Key Authentication if you will be using an RSA Private as your secrets for establishing the SSH Tunnel (see below for more information on generating this key).
Choose Password Authentication if you will be using a password as your secret for establishing the SSH Tunnel.
Thoughts? cc @Emmanuel TarusMateo
02/18/2022, 3:56 PMJakub Jablonski
02/18/2022, 9:47 PMMatheus Guinezi
02/18/2022, 9:52 PMOz Marom
02/21/2022, 9:32 AMOfek Katriel
02/21/2022, 1:20 PM# - name: airbyte
# version: "?.?.?"
# repository: "https://???-???.???.???.???/"
# condition: airbyte.enabled
Andrew Morrison
02/21/2022, 3:48 PMAffects the size limit of an individual Redshift table. Optional. Increase this if syncing tables larger than 100GB. Files are streamed to S3 in parts. This determines the size of each part, in MBs. As S3 has a limit of 10,000 parts per file, part size affects the table size. This is 10MB by default, resulting in a default table limit of 100GB. Note, a larger part size will result in larger memory requirements. A rule of thumb is to multiply the part size by 10 to get the memory requirement. Modify this with care.
• I see that the default value is '5' in my local build, though the documentation says '10MB'. Is this just a typo, or am I missing something?
• I want to try syncing a ~1TB table using this method, which would mean that I should increase the part size to ~100MB, correct?
• Which container does the memory requirement rule of thumb apply to? I am working in Kubernetes and want to get my resource limits right.Ofek Katriel
02/21/2022, 4:49 PMInternal Server Error: Error creating S3 log client to Minio
and in the worker logs:
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Malformed escape pair at index 21: <http://minio-service>:%!d(<nil>)
or if I insert 9000:
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Malformed escape pair at index 21: <http://minio-service>:%!d(float64=9000)
as you can see it is not parsing well the minio port, even when I insert:
9000
or
'9000'
or
"9000"
or nothing which is this error.
here’s my values.yaml file:
``````Tomislav Najdovski
02/21/2022, 9:49 PMRicki Chandra Hidayatullah
02/22/2022, 10:05 AMFelipe Abello
02/22/2022, 7:33 PMAnand
02/22/2022, 7:47 PMFelipe Abello
02/22/2022, 8:31 PMMadara Ranawake
02/22/2022, 8:33 PMMatt Shipley
02/23/2022, 2:53 AMAnand
02/23/2022, 5:13 AMRicki Chandra Hidayatullah
02/23/2022, 10:53 AMPreetam Balijepalli
02/23/2022, 11:10 AMShubham Pinjwani
02/24/2022, 7:06 AMJesse van Evert
02/24/2022, 9:06 AMAkshay Sapra
02/24/2022, 5:05 PM