https://linen.dev logo
Join Slack
Powered by
# feedback-and-requests
  • r

    Romain LOPEZ

    08/31/2021, 6:53 PM
    Hi Airbyte folks, Is there a connection in progress to extract data from BoondManager (https://www.boondmanager.com/) Regards
    • 1
    • 2
  • r

    RK

    09/01/2021, 7:16 AM
    Team - does anyone know how I can use APIs to use Login to applications so my users can authenticate from the front end
  • g

    gunu

    09/01/2021, 11:10 AM
    request: being able to add another table to an existing connection without requiring a reset. i feel like there’s an existing request somewhere for this. contest: i’m unable to add a CDC connection: issues with both loading methods - AWS s3 staging (copies the wrong table into the database) and standard loading method (worker dies after 3+ hours). i can get around this by using standard loading and adding one table at a time. but then this requires a
    reset
    with each additional table. which defeats the purpose of this method.
    • 1
    • 3
  • j

    Jeff Crooks

    09/02/2021, 4:31 PM
    is anyone using airflow and airbyte on the same instance? any gotchas to lookout for?
    • 1
    • 7
  • u

    user

    09/03/2021, 4:30 PM
    Hi, what version are you on?
    • 0
    • 7
  • a

    Ander del Valle Castaños

    09/06/2021, 10:18 AM
    Hello, anyone know how to change localCSV route to GoogleDrive route? Thanks🙂
    s
    p
    • 3
    • 46
  • t

    Tino Merl

    09/07/2021, 6:56 AM
    Hey Team, Wanted to know if there's another way of authentication with the Google Analytics Source instead of Service Account or anything planned in that way? We have several Customers using Google Analytics and not always enough permissions to add additional accounts. So is there a possibility to get the data in the future with Oauth2 Client Ids additionally to the service account flow?
    • 1
    • 2
  • s

    Sandeep Devarapalli

    09/07/2021, 11:18 AM
    Hi Team, I wanted to know if there is an opportunity to make it easy for SaaS applications to make use of the AirByte connectors so that their customers can sync data with the SaaS application. Basically, we want to help our B2B customers to be able to share data with us easily.
    • 1
    • 3
  • p

    Peter Petrik

    09/07/2021, 1:15 PM
    I see in the postgresql source logical or “standard” replication. I am not sure what “standard” stand for (tried to look in your docs). Is standard == physical replication?
  • j

    Jeff Crooks

    09/08/2021, 4:32 PM
    some like stripe I am 100% confident I was on latest version before this upgrade
    i
    o
    • 3
    • 31
  • i

    Ivelina Yordanova

    09/09/2021, 9:38 AM
    Hi team, I have a question about AWS auth config - is there a way ,currently or a plan in future, to auth with role instead of key id and access key. I attempted to use both a source and destination requiring access to S3 bucket and they both required providing key id and secret. Thanks
    • 1
    • 2
  • j

    Jonathan Rehn

    09/10/2021, 11:18 AM
    Hello all, Does anyone have experience or insights in using Airbyte for moving data from BigQuery into Salesforce? We already use Airbyte when moving our data into BigQuery, and are trying to figure out whether creating a custom connection for Salesforce is worth it just to keep everything in Airbyte. Any advice is highly appreciated!
    d
    • 2
    • 7
  • d

    Dan Siegel

    09/10/2021, 1:25 PM
    is there a graceful way to handle quota limits on Google Analytics? I tried to sync back to 2019, and I ran into a quota limit. The stream then errored out and didn't load any data, so if I were to restart it, same thing would happen.
    j
    • 2
    • 4
  • d

    Dan D'Orazio

    09/10/2021, 4:24 PM
    Does anyone know how/if you can update a connection’s sync mode in bulk? If that’s not functionality today, where could I make / upvote a request?
  • p

    Philippe Boyd

    09/11/2021, 3:11 AM
    Quick question Is it possible to use special variables in table prefix? like we can in namespace custom format
    l
    • 2
    • 2
  • a

    aash god

    09/12/2021, 2:08 PM
    Hey folks: I am a founder of startup and we are looking to enable our clients through our platform to add connectors (through our platform where they provide credentials but use airbyte behind) so they can bring along their data from 3rd party into our datawarehouse for analytics/visualization. I am not very technical ! I was wondering...does airbyte support such use case
  • l

    Lior Halperin

    09/13/2021, 11:19 AM
    is this your first time deploying Airbyte: No OS Version / Instance: Windows 10 Memory / Disk: 16g Deployment: Docker Airbyte Version: 0.29.13-alpha Source name/version:oracle db Destination name/version:redshift Step: Incremental Sync - Deduped History option Description: does redshift support iIncremental Sync - Deduped History option
  • a

    Alizamin

    09/13/2021, 3:05 PM
    Hi all, wondering if a connector for ssh tunnel is coming soon?
    • 1
    • 2
  • j

    Jonathan Stacks

    09/13/2021, 11:35 PM
    When deploying airbyte on kubernetes, it can be useful to customize how the worker pods are created(annotations for logging, node selectors, tolerations, etc). Would something similar to airflow’s pod_template_file make sense for airbyte?
    • 1
    • 1
  • c

    Christopher Wu

    09/14/2021, 3:42 AM
    Is it possible to upgrade an EC2-based Airbyte deployment with an external Postgres instance to a Kubernetes-based deployment without having to wipe the Postgres?
    • 1
    • 1
  • s

    Sebastien Mamessier

    09/14/2021, 11:18 AM
    Any more precise ETA/roadmap on the declarative interface to Airbyte? Should we start using the contributed CLI project or wait a few more weeks? Thanks a lot for this amazing project btw!
  • j

    Jeff Crooks

    09/14/2021, 5:50 PM
    is bing ads connector no longer?
    • 1
    • 5
  • j

    Joshua Lee

    09/15/2021, 7:35 AM
    Hi Airbytes team, Just a minor feedback. I noticed when setting up the Stripe connector there is a mandatory "Start date" field, but it seems like this start date is not referenced anywhere in the codes. Is it not being used? for me thats kind of a good thing cause i want to sync all of my stripe data. but just wondering why it exist in the first place, if it no longer being used should it be removed?
    • 1
    • 2
  • j

    Jeff Vermeire

    09/16/2021, 5:59 PM
    Ran into something interesting: I’m running AB in GKE, but have the db backend in a Cloud SQL postgres instance. I kept noticing random blips when using airbyte, but it wasn’t until I wanted to dig into the db that I figured out what was going on. My postgres instance has a very low max concurrent connections (25) since it is a micro instance. Airbyte ends up using a lot of connections since PG isn’t very efficient at expiring old connections. When I looked at the server logs, there were a TON of 
    FATAL: remaining connection slots are reserved for non-replication super-users
     errors. To solve this issue, I ended up deploying pgbouncer to my GKE cluster and reconfiguring the airbyte backend to use the pgbouncer instance.
    • 1
    • 1
  • o

    Oliver Meyer

    09/17/2021, 11:05 AM
    Hi 👋 is it correct that a MySQL (or other JDBC) destination with full refresh overwrite will truncate and then insert into the destination table? As opposed to doing something like insert into a tmp table and switch the tables atomically. If it’s correct, does this happen in one or two transactions? Context: I need to export data to MySQL and there’s a strict zero-downtime requirement, which is violated if the connector truncates and inserts in two transactions.
    • 1
    • 2
  • n

    Naveen Sai Patnana

    09/17/2021, 6:23 PM
    Hi, Can we preview the table data on fly when creating the connection, while selecting the source tables?
    • 1
    • 4
  • g

    gunu

    09/20/2021, 3:35 AM
    Hi team, has there been investigation into using parquet (instead of CSV) for AWS S3 Staging COPY e.g. when syncing from source to Snowflake - particularly with respect to compressed storage space as read/write efficiencies
    • 1
    • 2
  • e

    Enrique de Ridder Gil

    09/21/2021, 11:19 AM
    Hi guys, I have problems with some automatized tasks. This tasks don't execute and I need to execute them manually. I tried to restart the service of airbyte and I did new connections with new connectors, I tried everything that I can think off.
    • 1
    • 2
  • j

    Jeff Crooks

    09/22/2021, 1:12 PM
    Attempting to setup Facebook Marketing source, getting this error
    "FacebookAPIException('Error: 2635, (#2635) You are calling a deprecated version of the Ads API. Please update to the latest version: v12.0.')"
    • 1
    • 2
  • m

    Manupriya Logus

    09/23/2021, 6:25 AM
    Hi all . I have set up Airbyte on GKE with airflow. now need to setup DBT can i know what is the best way to set up DBT on GKE tried with several docker images but getting errors
1...456...16Latest