https://linen.dev logo
Join Slack
Powered by
# ask-community-for-troubleshooting
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/07/2023, 2:07 PM
    Hi im having issues in setting up postgresSQL as the destination locally using airbyte any reference video you might suggest?
    k
    • 2
    • 2
  • s

    Slackbot

    06/07/2023, 2:09 PM
    This message was deleted.
    k
    • 2
    • 1
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/07/2023, 2:12 PM
    Hi im having issues in setting up postgresSQL as the destination locally using airbyte any reference video and docs?
    k
    • 2
    • 2
  • a

    Ashley Pace

    06/07/2023, 3:04 PM
    Hey everyone. I'm looking for a tad bit of help. I've created a test connection from Azure SQL Server to Snowflake that is supposed to run every 5 minutes but it's not running at all. Not sure what is wrong with it. The schedule is a cron schedule: 0 /5 0 * * ?
    k
    • 2
    • 3
  • u

    ujjawal

    06/07/2023, 3:44 PM
    Hi Team , Airbyte is really cool , but they create lots of prefix junk table , any idea how to put in one place or clean all prefix/junk table ?
    k
    u
    e
    • 4
    • 4
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/07/2023, 4:02 PM
    Configuration check failed Could not connect with provided configuration. net.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver encountered communication error. Message: HTTP status=403.
    k
    • 2
    • 2
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/07/2023, 4:14 PM
    Configuration check failed State code: 08001; Message: Connection to localhost:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
    k
    • 2
    • 2
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/07/2023, 4:17 PM
    Configuration check failed State code: 28000; Message: FATAL: no pg_hba.conf entry for host "172.25.240.1", user "postgres", database "airbyte", no encryption
    k
    • 2
    • 2
  • j

    Jesus Rivero

    06/07/2023, 5:14 PM
    Hi all, i would like to know how often does it run the proccess that cleanup the logs.
    k
    • 2
    • 8
  • f

    Francisco Ortega

    06/07/2023, 5:30 PM
    Good morning all, I am getting the following error when attempting to setup a second destination source to BigQuery. All GCP configurations for BigQuery and Google Coud Storage have been setup. We have an existing connector from Google Analytics to BigQuery that is working properly. Below is the error code we get when testing BigQuery destination. Error: Configuration check failed State code: NoSuchKey; Message: The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: null; S3 Extended Request ID: null; Proxy: null)
    k
    • 2
    • 2
  • o

    Octavia Squidington III

    06/07/2023, 7:45 PM
    🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #C045VK5AF54 octavia loves At 1PM PDT click here to join us on Zoom!
  • s

    Scott Sung

    06/07/2023, 10:51 PM
    Hello, I am dealing with an issue with the Amazon Seller Partner connector. It may be an issue on the Seller Partner account side but I hope someone here may have had similar issue and success solving it. Essentially I have set up a successful connection to my Amazon Seller Partner account but performing data replication for 'Orders' table for example will return a 403: forbidden error. I have followed the tutorial for seller partner credentials several times and still seeing this issue. Open to any suggestions. Thank you.
    f93f68b5_70cd_4101_9490_b27571a228ca_logs_1479_txt
  • i

    Ismail Tigrek

    06/07/2023, 11:36 PM
    I have Salesforce connections with incremental deduped history as the sync mode and a custom cursor field. Previously, the data was coming out correctly (deduped on the custom cursor field). However, I recently recreated the pipelines (due to updates in the source schemas), and the data is no longer coming out deduped even though I can clearly see in the UI that the custom cursor is set correctly. I urgently need help as to why this is happening! One theory is that the "airbyte_emitted_at" field is now adding random milliseconds to the time, and thus each row ends up being unique, preventing duplicated rows from being removed? If so, is this a bug on Airbyte's end?
    k
    • 2
    • 3
  • a

    Antoine FB

    06/08/2023, 4:11 AM
    Hey there, I saw many issues about the Facebook Marketing connector, any chance to have an update? We do still wait for SDK update from Facebook? https://github.com/airbytehq/airbyte/pull/13251
    🙏 2
    • 1
    • 1
  • c

    Christopher Wu

    06/08/2023, 4:34 AM
    In Airbyte v0.50.0, it seems like extra record columns are deleted before records are sent to the destination, even though the stream schema has additionalProperties set to true. Is this a new intentional behavior?
    k
    m
    • 3
    • 5
  • s

    Sivakumar Ramaswamy

    06/08/2023, 4:44 AM
    Hi Team, Could someone review my PR ? it has been pending more than 4 months and many airbyte customer are impacted and waiting for update. i would appreciate it. https://github.com/airbytehq/airbyte/pull/24206
    k
    • 2
    • 2
  • a

    Aishwarya K

    06/08/2023, 5:40 AM
    👋 Hello, team!
    k
    • 2
    • 3
  • s

    Svatopluk Chalupa

    06/08/2023, 6:31 AM
    Hi, we've got some user defined data types on postgres source, which are numbers in fact. Airbyte changes them to text implicitely. How can I get data types back to numbers on destination output?
    k
    • 2
    • 18
  • s

    Shiraj Gagneja

    06/08/2023, 6:38 AM
    Hi Team, I observe that Airbyte Helm Charts are not working directly on AWS EKS (Version > 1.22). So I have setup the EBS CSI Driver to make the Charts compatible with EKS above v1.22. Can anyone confirm, if this is the correct approach for longer run, or I need to add few more additional changes to make it fully compatible. cc: @Mehak Kapoor @Vijaya Kotwani
    k
    • 2
    • 2
  • j

    Joey Taleño

    06/08/2023, 7:26 AM
    Hi Team, Hope all is well. Is everything ok with LinkedIn Connector? We are getting this error.
  • m

    Madhav

    06/08/2023, 8:21 AM
    Hi team, I am getting connection is not available error while setting up postgres destination.
  • a

    Amit Jain

    06/08/2023, 9:11 AM
    how can we have OIDC configured for airbytes, how can we add the same OIDC in Airbyte so that only authorized users can access it. with docker-compose file of airbyte
    k
    • 2
    • 4
  • a

    Amit Jain

    06/08/2023, 9:23 AM
    i want to use oidc with airbyte with azure
    k
    • 2
    • 3
  • s

    Svatopluk Chalupa

    06/08/2023, 10:02 AM
    Hi, Airbyte full refresh sync drops all privileges to destination tables in postgres, even we have the default privileges set for schema. Any idea why is this so and how to solve it?
    k
    • 2
    • 2
  • s

    Svatopluk Chalupa

    06/08/2023, 11:33 AM
    Hi, is there a way how to "step back" in incremental load? I can alter tables on postgres destination using the timestamp "_airbyte_emitted_at", but I suppose the incremental append source stream holds the last synced max id in metadata?
    k
    • 2
    • 2
  • o

    Octavia Squidington III

    06/08/2023, 1:45 PM
    🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #C045VK5AF54 octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom octavia loves
  • a

    Aishwarya K

    06/08/2023, 2:04 PM
    hello
    k
    m
    • 3
    • 6
  • h

    Hugo Vandernotte

    06/08/2023, 3:04 PM
    Hey, I am facing issues with Marketo source (for some campaigns it seems that Airbyte skips all events). Asking for help to Marketo support they asked me to provide the api calls we are doing... => Is there a way to log the exact api calls made by Airbyte? (open source Airbyte deployed)
    k
    e
    • 3
    • 8
  • r

    Roman Voronin

    06/08/2023, 3:10 PM
    Hello! I got a problem while writing data to Clickhouse Caused by: java.sql.SQLException: Connection refused, server ClickHouseNode [uri=http://clickhouse-clickhouse-cluster.clickhouse.svc.cluster.local:8123/default, options={socket_timeout=3000000}]. Network connectivity is not a reason because it is the same overlay network within one k8s cluster. What else I can check?
    k
    • 2
    • 2
  • j

    John Olinger

    06/08/2023, 6:26 PM
    Google Directory to mysql - normalization failure I've configured a Google Directory to Local File connection, and it works fine. I really would prefer this to be put into mysql, but when I sync, the normalization fails. Log is attached. I've had normalization success with another source of json to mysql. Any guidance/assistance is appreciated.
    b19d0480_d7ba_4b12_95b1_45479c6e23c3_logs_87_txt.txt
    ❓ 1
1...200201202...245Latest