https://linen.dev logo
Join Slack
Powered by
# ask-community-for-troubleshooting
  • m

    Mark Ma

    05/26/2022, 7:44 PM
    Hi I’m very new to Airbyte. I was able to get the docker containers up and running on my laptop but I don’t see a way to create multiple users on the webapp, is it possible to have multiple accounts for airbyte web app?
    m
    • 2
    • 2
  • r

    Rakshith Nagaraj

    05/27/2022, 5:51 AM
    Hi All, I am new to Airbyte cloud. We wanted to ingest data into Postgres which is coming from Kafka. Cant i consume kafka message from Airbyte?
    m
    • 2
    • 6
  • p

    puneet jindal

    05/27/2022, 7:28 AM
    Hi All , i am new to Airbyte cloud does incremental sync mode would handle data delete in case of Facebook Marketing Source for Campaign Stream
    m
    • 2
    • 1
  • j

    Jackie Li

    05/27/2022, 8:36 AM
    Hi @airbyteers, Love what you guys do. While going through your website & github repo, I found a few broken links. Filed an issue at: https://github.com/airbytehq/airbyte/issues/13222
    m
    • 2
    • 1
  • u

    404 Roy

    05/27/2022, 9:39 AM
    Anyone else get this error when trying to build
    m
    • 2
    • 2
  • i

    Ismail

    05/27/2022, 11:31 AM
    How can I have the Airbyte only pull the latest CSV from an S3 bucket?
    • 1
    • 1
  • r

    Rahul Patel

    05/27/2022, 3:40 PM
    Team, Do we have option to delete connector? by mistake, my custom source connector was added 3 times.
    m
    • 2
    • 10
  • k

    Kirill

    05/29/2022, 9:35 AM
    Hi, if I just want to get my clients ad spend using Facebook Marketing Open Source Airbyte I can't do it? Because they won't give me advanced access to the rights I need, according to the documentation? Thanks
    m
    • 2
    • 1
  • b

    Ben Nicole

    05/29/2022, 6:24 PM
    Hi, I am based in Southeast Asia. Is it wise to use Airbyte cloud if my data located in Asia? I read on the web, the cloud service is only available in the US now. Kindly advice.
    a
    • 2
    • 2
  • n

    Nahal Khalkhali

    05/30/2022, 4:59 AM
    Hi, I am not sure if this is the right location to ask this question so I apologize if not. My teammates and I are working on a class project and trying to change the frontend of airbytes specifically the source Delighted. We have come to the conclusion its the spec.json file we need to edit but every time we make a change, then build, and rerun docker the change does not show. Any advice is appreciated! Thank you!
  • k

    Keshav Agarwal

    05/30/2022, 1:08 PM
    Can I use MySQL source for MariaDB?
    m
    • 2
    • 2
  • n

    Nigel Ainscoe

    05/30/2022, 3:11 PM
    Hi, I'm implementing Airbyte and the QA team want to know if it's possible to do any sort of automated testing of Airbyte? Does anyone have any experience of this?
  • k

    KK

    05/31/2022, 3:19 AM
    Hi, does airbyte store both raw and transformed data in the destination? Like we need to plan 2x amount of storage in the destination?
  • c

    Calvin Lam

    05/31/2022, 7:30 AM
    Hi, has anyone run into this issue before? Suddenly the list of sources I can see (and create) is really short. I am running v0.39.5 hosted on our own machine.
    a
    • 2
    • 2
  • m

    Martin Carlsson

    05/31/2022, 8:03 AM
    How do use local csv files as a source? There is something called
    File
    , but that require an URL.
    m
    • 2
    • 3
  • a

    Alexis Charrier

    05/31/2022, 8:34 AM
    Hi everyone ! I'm discovering airbyte and can't wait to go further with this tool. I'm facing an issue while importing a new connector. I'm trying to import this connector. The import seems to work properly (I don't get any error) and in logs i got a 200 answer code. However the connector don't show in the list after refreshing the page 🤔 (I tried with other docker image and same result). Am I missing something ? Conf: Airbyte running on GCP compute engine
    m
    • 2
    • 2
  • m

    Mayank Dubey

    05/31/2022, 10:35 AM
    Hello, I am having issue with S3. It i showing that free storage is full however I am not using AWS. Please help setting it up to GCP. Deployed airbyte on GKE cluster. I have already set up logs path to GCS. I am not sure how to remove S3 configurations in .env and in .secret file.
    m
    • 2
    • 2
  • a

    Ami Ne

    05/31/2022, 12:02 PM
    Hello guys! I'm new here, I just found this amazing product yesterday 🤩 I'm building an app where we collect user data to apply events and track users (something similar to segment). I'm wondering if we can use Aitbyte connectors API for this purpose ?
    m
    • 2
    • 11
  • s

    Srijan Chakraborty

    05/31/2022, 12:02 PM
    Hello, wonderful people of Airbyte. I am a new user of the platform. I tried to set up an integration for Google Ads and that worked. Over at google side I was able to get a developer token, client ID, secret id and the refresh ID. Now i want to create an integration for Google Analytics. My question is, will the same configuration that I created for Google Ads (over at google side) work for this as well or do I need to do something different?
    m
    • 2
    • 1
  • n

    Nithin B S

    05/31/2022, 12:18 PM
    Hi team we are facing issue with connecting postgres running on a vm to airbyte, for running airbyte with custom postgres db. screenshots attached below. please help
    m
    • 2
    • 1
  • s

    Saif Mahamood

    05/31/2022, 2:57 PM
    hey 👋 , Im having trouble setting up Kinesis as a destination. The error logs is not telling me much. Would anyone be able to let me know what is common.error usually referring to? Also I am assuming the Access key and Private key is the access key and client secret, is that correct?
    m
    • 2
    • 2
  • r

    Robin

    05/31/2022, 7:10 PM
    Hi, is there a number on how many jobs can run simultaneous? I currently have 8 connections setup on a 12 core 64GB machine but jobs sometimes just seem to pause for a very long time waiting for resources or something?
    m
    • 2
    • 9
  • u

    404 Roy

    06/01/2022, 9:32 AM
    Hi , I have mysql version 8.0.29 which supports the "with" keyword. uses Normalized Tabular Data, an import error occurs, can I have a look at the problem
    error.log
    a
    • 2
    • 2
  • i

    Ismail

    06/01/2022, 11:23 AM
    What are the minimum egress and ingress ports required for an airbyte instance to successfully setup sources, destinations, and connections?
    a
    • 2
    • 1
  • p

    Peter Gerald

    06/01/2022, 11:36 AM
    Do we have an option to intergrate airbyte with Hashicorp for encryption/Decryption? Does airbyte encrypt data before it export data from the source and decrypyt before inserting in the target?
  • p

    Peter Gerald

    06/01/2022, 11:37 AM
    What are the maximum data transfer rate possible for airbyte provided there is enough bandwidth?
    a
    • 2
    • 1
  • r

    raphaelauv

    06/01/2022, 12:22 PM
    I'm trying to setup salesforce CDC -> bigquery the salesforce airbyte connector is not compatible with CDC for salesforce is that correct ? thanks
    a
    • 2
    • 1
  • s

    sriramdas sivasai

    06/01/2022, 1:02 PM
    Hello Team, Im exploring to introduce airbyte for one of the CDC usecases, where it gets the updated records from mysql binlog. Got to know that Airbyte internally uses debizium connector, Just wanted to know whether the CDC with airbyte is pull or push based approach. Because while configuring I see schedule run, but we expect to continuosly flow the data as and when it gets updated in mysql. instead of scheduled run. Any idea, how does it work ??
    a
    • 2
    • 1
  • o

    Oluwapelumi Adeosun

    06/01/2022, 1:29 PM
    Hello I run an incremental sync from Postgres DB to a GCS bucket. I recently notice that some of the rows are missing (records that were last updated before 24th, April). I want to do a full refresh of that particular table, but would I still be able to do the incremental sync afterwards?
    a
    • 2
    • 2
  • m

    Marcin Smelkowski

    06/01/2022, 2:04 PM
    Hi, I'm trying to setup a source to Microsoft SQL Server, but it fails with an error: 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - java.lang.IllegalArgumentException: No enum constant io.airbyte.integrations.source.mssql.MssqlCdcHelper.ReplicationMethod.Standard 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at java.lang.Enum.valueOf(Enum.java:273) ~[?:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.source.mssql.MssqlCdcHelper$ReplicationMethod.valueOf(MssqlCdcHelper.java:23) ~[io.airbyte.airbyte-integrations.connectors-source-mssql-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.source.mssql.MssqlCdcHelper.isCdc(MssqlCdcHelper.java:96) ~[io.airbyte.airbyte-integrations.connectors-source-mssql-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.source.mssql.MssqlSource.getCheckOperations(MssqlSource.java:242) ~[io.airbyte.airbyte-integrations.connectors-source-mssql-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.source.relationaldb.AbstractDbSource.check(AbstractDbSource.java:68) ~[io.airbyte.airbyte-integrations.connectors-source-relational-db-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.ssh.SshTunnel.sshWrap(SshTunnel.java:205) [io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.ssh.SshWrappedSource.check(SshWrappedSource.java:40) [io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 135746 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.source.mssql.MssqlSource.main(MssqlSource.java:450) [io.airbyte.airbyte-integrations.connectors-source-mssql-0.39.5-alpha.jar:?]
    🙏 1
1...444546...245Latest