https://linen.dev logo
Join Slack
Powered by
# ask-community-for-troubleshooting
  • h

    Heine Bodekær

    03/15/2023, 2:10 PM
    Hi, I'm getting this issue with the worker container. It's deployed on EC2 using Cloudwatch for logs. Anyone have experience on this type of error?
    Copy code
    Error starting Micronaut server: Error instantiating bean of type
  • s

    Salman Khan

    03/15/2023, 3:05 PM
    I tried to up compose but it has been running for two hours
  • s

    Salman Khan

    03/15/2023, 3:12 PM
    Also I created a new instance and run this command on it (sudo yum install -y docker-compose-plugin) but it keeps getting this error.
    r
    n
    • 3
    • 4
  • v

    Viswadeep Veguru

    03/15/2023, 3:30 PM
    Hello, I am trying to setup AirByte in my local
    kind
    is there any documentation that i can quickly use it, I tried the one from docs and
    helm install
    is failing.
  • m

    Madison Mae

    03/15/2023, 4:51 PM
    Hi all, I selected "normalize tabular data" when setting up my connector however the json object is still a json object in the final destination. It says it has been normalized but according to the documentation it seems like the items in this object should be formatted into their own columns, is this correct?
    w
    • 2
    • 2
  • p

    Pierre CORBEL

    03/15/2023, 5:02 PM
    Partial Success mechanism
    Hello there 👋, I got a question about partial successes 🙋‍♂️ • I have a custom source that use a timestamp as a state value for an incremental stream • I use the Snowflake destination For now, I only emit state at the end of the whole sync (which could take days because I have big datasources). And in case of failure, the whole sync have to start again (and it's very frustrating). From what I understand, I can emit state every X records with the timestamp and Airbyte will save it automatically only, and only if, the Snowflake destination has really committed and loaded the data, right? Or do I have anything else to implement on my side? Thanks a lot and have a nice day ☀️
  • t

    Timothy Kovacs

    03/15/2023, 5:53 PM
    Regarding the Facebook Marketing component (v. 0.2.85) integration with Snowflake …
    l
    • 2
    • 4
  • a

    Arvind Iyengar

    03/15/2023, 6:03 PM
    Hi team, I m trying to perform a PoC with open source offering. Quick question, is there a way I can disable sending logs to S3 bucket. Currently I can see that it’s going to airbyte default S3
  • g

    god830

    03/15/2023, 6:14 PM
    https://github.com/airbytehq/airbyte/issues/23864 Please help, HubSpot is down, and it's a GA connector
    n
    • 2
    • 2
  • a

    Anchit

    03/15/2023, 6:16 PM
    Hi team, working with the Salesloft connector and need some help with auth. Couple of questions • Airbyte Salesloft connector only supports OAuth authentication. Is there a plan to support API Key authentication for this source? • Salesloft OAuth requires a Redirect URI/Callback URI but looks like Airbyte is handling this internally? Whom can I connect with on Salesloft connector debugging?
    g
    e
    • 3
    • 5
  • s

    SJ Park

    03/15/2023, 6:41 PM
    Hello, I am trying to set up a custom connector to an API, and that endpoint requires that I submit an array of JSON objects as part of the request body. Is this possible in Airbyte? I tried setting up a user input of type
    array
    , but anything I put in that array is getting parsed as a string instead of an object
  • a

    Annika Maybin

    03/15/2023, 7:24 PM
    Hi! I just updated Airbyte to v42.0 and our MySQL connector to v2.0.2. Now, my sync from MySQL to Redshift stopped running and now all information in tables that are set to Fill Refresh | Overwrite is gone and other tables don't update of course. All of our reporting is relying on that data. The error it is throwing me is
    Copy code
    2023-03-15 18:50:21 - Additional Failure Information: java.lang.NullPointerException: Cannot invoke "com.fasterxml.jackson.databind.JsonNode.asText()" because the return value of "com.fasterxml.jackson.databind.JsonNode.get(String)" is null
    Details in the thread. I was able to resync a single table in the Full Refresh Overwrite mode, but Incremental Refresh Deduped fails with that error. It is also indicating to have non-breaking schema updates discovered, but when I click on review changes, it says no changes detected. Thanks for the help in advance.
    s
    • 2
    • 3
  • j

    Jake Vernon

    03/15/2023, 8:07 PM
    Has anyone pulled data from Constant Contact? I see an integration with MailChimp so figured id ask
    u
    • 2
    • 2
  • l

    Layth Al-Ani

    03/15/2023, 8:39 PM
    Where should the external database secretName and secretValue store?
  • m

    Malik

    03/15/2023, 10:27 PM
    I deployed airbyte helm chart on EKS. I want to use Octavia CLI to set up connections. However, there are a number of different airbyte pods, and I am not sure which one to run the Octavia commands in. Which pod's shell should I use?
    a
    • 2
    • 6
  • m

    Matheus Barbosa

    03/15/2023, 11:28 PM
    Does anyone here knows how can I get the custom conversion insights from Facebook Ads?
    n
    • 2
    • 1
  • v

    Vicente Bobadilla Riquelme

    03/16/2023, 2:45 AM
    Hi everyone, I am using the snowflake connector 0.1.3 and whenever I try to do an incremental sync I get the following error message.
    The following tables have invalid columns selected as cursor, please select a column with a well-defined ordering with no null values as a cursor... {cursorColumnName='END_TIME', cursorSqlType=TIMESTAMP_WITH_TIMEZONE, cause=Unsupported cursor type}
    . I was under the impression that
    TIMESTAMP_WITH_TIMEZONE
    was a valid cursor type for snowflake. Is this a bug?
    ✅ 1
    s
    f
    k
    • 4
    • 10
  • v

    VISHAL B

    03/16/2023, 5:05 AM
    Hello team, I have a error while ingesting data from Mysql(1.0.18) to Bigquery(1.2.9) While automapping occurs json format is typecasted to string I have been asking this for a while and i’m tired of asking this and explaining about my versions other than that no updates i’m getting from your side I need to fix this issue soon please do check this My airbyte version is 0.40.28 and i hope upgrading my airbyte version alone won’t fix this issue
    r
    м
    • 3
    • 4
  • a

    Arvind Iyengar

    03/16/2023, 5:51 AM
    Hi team, I m trying to perform a PoC with open source offering. Quick question, is there a way I can disable sending logs to S3 bucket. Currently I can see that it’s going to airbyte default S3
    n
    • 2
    • 1
  • n

    Nancy Wang

    03/16/2023, 6:12 AM
    Hi team, i'm trying to create a connector, connect mysql source(1.0.21) with s3 destination(0.1.30). but get the error "View 'db1.view_account_info' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them", It seems the user have no privilege to execute "show create view on db1.view_account_info"; Actually, i'm care about the view. Is there any way here to select a specific table when creating the connection.
    n
    • 2
    • 1
  • r

    Raghavendra

    03/16/2023, 6:43 AM
    Hello.. I am new to Airbyte.. exploring .. can someone please help me out in understanding.. how can we move the pipelines between environments , like I did in my staging.. now, I want to move it to production.. how can I do it? do I have to build the pipeline again in Production or I can export from staging? as far as I explored , I could not find any.. hence requesting here.. any help is much appreciated
    a
    a
    • 3
    • 3
  • b

    bennis Hajar

    03/16/2023, 6:51 AM
    ♦️hello , i am new to Airbyte , i want to know how i can configure creating Source connector or destination by default ; this is means i don't want to add them manually in the UI ; i need to put their information in place where airbyte stocks the metadata for example ( i have deployed airbyte on K8S + using helm chart ) thank youu
  • r

    Robin

    03/16/2023, 7:59 AM
    Hi Sometimes the Airbye webapp gives me cannnot reach server and then after a reload it works fine, it happends randomly running on k8s version 0.40.18
  • r

    Robin

    03/16/2023, 7:59 AM
    what could this be? Should I spin up more server replicas?
  • a

    Akhil Chouhan

    03/16/2023, 8:26 AM
    team, does anyone know what is this __airbyte__tmp_ tables created in clickhouse? can i delete those?
    a
    n
    • 3
    • 3
  • v

    Vivek PG

    03/16/2023, 10:48 AM
    Hi I have created some custom sources and added them through the Airbyte UI
    settings >> Sources >> New connector
    Can I include them via Octavia CLI? or any other way without using UI
  • j

    Joost Stessens

    03/16/2023, 11:19 AM
    Hi Airbyte! 🙂 I was wondering whether you can provide some more information on when we could expect our PR regarding a new destination connector (to Cumul.io) to be reviewed and possibly merged? I've created this PR about a month ago and don't see any status updates, so I'm wondering whether I might have missed something important? Let me know if I can be of any help to speed things up, we're very excited to get this connector to be part of your awesome tool!
  • j

    Johannes Müller

    03/16/2023, 11:32 AM
    Hi, Is it possible to run dbt tests as part of an airbyte connection? I set up a custom transformation and have
    schema.yml
    with
    unique
    checks that I can run via
    dbt test
    like this:
    Copy code
    version: 2
    models:
      - name: my_table
        columns:
          - name: id
            tests:
              - unique
  • k

    Kushal Halder

    03/16/2023, 12:21 PM
    Hi Folks, while onboarding a Destination, can we define the schema for the tables ourselves?
    j
    v
    • 3
    • 20
  • s

    Salman Khan

    03/16/2023, 2:02 PM
    service "bootloader" didn't complete successfully: exit 255 -- Issue showing unable to run my airbyte. I tried upgrade docker composer and airbyte
1...163164165...245Latest