https://linen.dev logo
Join Slack
Powered by
# feedback-and-requests
  • p

    Prashanth Patali

    02/08/2022, 6:12 PM
    The "Check Opening" button on this page https://airbyte.com/about-us navigates to https://jobs.lever.co/airbyte which shows "No job postings currently open. Check back later!". Is this correct?!
    g
    • 2
    • 1
  • d

    Dejan Antonic

    02/08/2022, 7:46 PM
    Hi team, any ETA on when we can expect Salesforce API v53 or above? Looking at https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-salesforce/source_salesforce/api.py#L175 it says current version is v52 and to be able to see some new standard objects we need Salesforce API to be at least v53.
    g
    • 2
    • 2
  • g

    gunu

    02/09/2022, 12:49 AM
    Request for a feature to clone sources (at least via the API, with credentials included)
    • 1
    • 1
  • k

    Kevin Soenandar

    02/10/2022, 5:21 AM
    Hi team, is there an ETA on when this feature will be available https://github.com/airbytehq/airbyte/issues/6912? It's super resource intensive and slow to have to reset every single table everytime one of the tables have additional fields.
    a
    a
    • 3
    • 3
  • j

    Javier Llorente Mañas

    02/10/2022, 10:19 AM
    Hi team! It is there a way to add custom labels to the Airbyte
    source
    and
    destination
    pods?
    t
    • 2
    • 3
  • v

    Valerio Di Tinno

    02/10/2022, 2:08 PM
    Hello Team, I was trying to setup the Facebook Marketing API connector but I get stuck on this error: FacebookAPIException(‘Error: 2635, (#2635) You are calling a deprecated version of the Ads API. Please update to the latest version: v13.0.’) It looks like: https://github.com/airbytehq/airbyte/issues/6337 I need to open an issue? Have a nice day
    t
    d
    +3
    • 6
    • 12
  • t

    Tyler Buth

    02/10/2022, 3:09 PM
    Working with syncing intercom I noticed that after each records read it spams
    Settings state of….
    logs. This makes it very difficult to debug any errors in the log. Is it possible to remove these log entries?
    • 1
    • 2
  • t

    Tyler Buth

    02/10/2022, 3:49 PM
    It seems when syncing MySQL that whenever I want to add a table to a sync job it forces me to reset all my other tables. That doesn’t seem right. It seems like tables shouldn’t need to be reset unless the table structure changed.
    • 1
    • 1
  • j

    Jeffery Powell

    02/10/2022, 10:29 PM
    SSH key pairs generated and provided in the UI for use with source setup that has SSH key authentication. This removes an extra step required when installing a new source connector.
    d
    • 2
    • 2
  • j

    Jeffery Powell

    02/11/2022, 4:17 AM
    Sync Mode Control for the entire DB so I don't have to individually apply the sync mode to 500 tables for each database I connect to.
    • 1
    • 1
  • d

    Dave Lindley

    02/11/2022, 3:15 PM
    Hi all - I am working through a comparison between Airbyte and other vendors (trying to move my company to Airbyte, but have to go through the whole approvals/eval process) is there a more recent version of the comparison sheet: https://docs.google.com/spreadsheets/d/1QKrtBpg6PliPMpcndpmkZpDVIz_o6_Y-LWTTvQ6CfHA/edit#gid=0
    • 1
    • 1
  • m

    Mathieu Austruy

    02/12/2022, 8:00 PM
    Hi everybody, Is there any way to apply a pre filter on data from source (in my case MongoDB) before sending them to destination ?
    a
    • 2
    • 1
  • m

    Mohamed Saleh

    02/13/2022, 2:20 AM
    Hi, First of all, I really appreciate
    Airbyte
    and it being open source, thanks a lot team I have connected
    Appstore
    connector, but as I see that it is only gives back sales & trends but I need some or all data in Apple analytics like app downloads and other stuff, any update or workaround for that, Or do I miss something
    a
    • 2
    • 1
  • a

    Alex Malinovskyi

    02/13/2022, 3:09 AM
    Hi all. I have another question related to tools comparison that is not reflected in the Comparison Sheet. In our project we would like to migrate data from Oracle SQL to PostgreSQL. I suggested to try Airbyte (as both connectors are "certified" level), but our DB Engineer said that he is familiar with another free tool - ora2pg - and he would like to proceed with it. Could you please provide any pros and cons of Airbyte against ora2pg so that I had some strong points in convincing him to try Airbyte? Thank you in advance.
    a
    • 2
    • 4
  • j

    Jeffery Powell

    02/14/2022, 1:29 AM
    When incremental append is selected and there are no new records to add we should have the option of not writing out a file. Right now Airbyte will write out a 0 record avro file to the S3 bucket when syncing on incremental append and no new records exist. There should be an option to prevent file writes to s3 if there is no new data to write.
    a
    • 2
    • 1
  • a

    Arvi

    02/14/2022, 3:31 AM
    How can I log a feature request Feature Request: Ability to have 2 Sync Frequencies for a connection: Context: In the business hours I want to be able to have a near real time sync (every 5 minutes) and in Non Business hours I want to be able to have sync every 2 hours
    • 1
    • 6
  • a

    Arvi

    02/15/2022, 5:23 AM
    Changelog out if sync for connectors: The changelog would be helpful for me/us to understand the fixes/features and also to take a call to upgrade or not straight away. For example: Source Postgres Connector version available to upgrade is 0.4.6 where as in documentation as 0.4.4 with a release date of 2022-01-26 Target BigQuery Connector version available to upgrade is 0.6.8 where as in documentation as 0.6.6 with a release date of 2022-02-01 Can the Aribyte Team have a look at this please?
    • 1
    • 8
  • a

    Anatole Callies

    02/15/2022, 5:14 PM
    Hi, Has anyone already setup the logging of airbyte syncs into a remote log server using remote_syslog2 and could let me know how to do ? my airbyte instance is deployed via docker in AWS
    m
    • 2
    • 1
  • t

    Tony Hu

    02/15/2022, 7:06 PM
    Hi AirByte team, may I get an update on https://github.com/airbytehq/airbyte/issues/1877 about Hive Connector roadmap and timeline? thx
    m
    • 2
    • 2
  • m

    Mayank Malu

    02/15/2022, 7:38 PM
    Hi there, is Airbyte cloud in EU region? Thanks
    • 1
    • 2
  • k

    Kyle Cheung

    02/16/2022, 5:36 PM
    Does anyone know is Airbyte Cloud has the ability to to choose which fields to replicate in a table? And also if updating a schema or bringing in a new table would require the entire connection to be reset?
    • 1
    • 1
  • r

    Raviteja Peri

    02/16/2022, 7:17 PM
    Does airbyte support join transformations for 2 sources? Where can I find the list of transformations that airbyte performs. Thank you
    r
    • 2
    • 1
  • r

    Rytis Zolubas

    02/16/2022, 8:11 PM
    Hello! Is it possible to use the same stream with same scheduling, to export to multiple data destinations? One connection, two different destinations? E.G. Shopify -> S3, Snowflake?
    • 1
    • 2
  • d

    David Beaudway

    02/17/2022, 4:50 AM
    Hello -- I'm just beginning to explore Airbyte and curious about some general usability features. Any plans to add these in -- or am I overlooking something and they're already there? 1. Ability to search/filter connections, sources, and destinations a. After setting up a few connections I don't see any ability to search. We'd likely have hundreds of these in production and scrolling alphabetically would be difficult 2. Ability to "duplicate" an existing connection, source, or destination a. It'd be helpful to duplicate an existing configuration to speed up the process of creating new. In many cases there's only 1 value that differs between configurations, such as File Name. Having the option to use an existing config would be really helpful
    j
    • 2
    • 3
  • o

    Oliver Meyer

    02/17/2022, 9:43 AM
    Hi! Been a while 🙂 I’d like to follow up on unencrypted secrets in Airbyte’s DB. The last thread I can find around this topic is from 6 months ago, which mentions a fix for Airbyte Cloud to be released in September 2021. Has there been an update on the OSS side of things? It’s quite possible that I missed it, sorry if that’s the case. I came across this issue - is this expected to fix things on the OSS version?
    h
    • 2
    • 2
  • h

    Harry Makins

    02/17/2022, 2:10 PM
    Hey all, love the product and is proving useful for dragging large sets of Google Ads and Bing data into big query. My main sticking point and something I think would be really useful would be the ability to set dynamic start dates on sources. For example I use the Google Ads connector to pull data for this year and last year, this is then used to compare yesterdays spend and this months spend vs last years (in data studio). I would use append, but this just seems to duplicate data so I am forced to use full refresh, 2 years data can take 30 mins to sync and I have to go back and change the start date every now and again to keep it as manageable as possible. So yeah an option to select like 2 years worth from today would be useful (this would be a mute point if the append worked by just adding on the next days data and not duplicating anything, but I cant get that to work). On that note, something similar would be the ability to set a specific time for the sync to run. So at say 2am every day, regardless of if a manual pull has been done. Those are just my initial ramblings, hopefully they can be of some use. But yeah other than that and the horror that is 0 auth, this is by far the best thing I have seen for this kind of data movement especially for someone like me who is a marketeer first so thanks!
    j
    • 2
    • 5
  • w

    Walid AZIZ

    02/18/2022, 8:09 AM
    Hi AriByteTeam. I’m a newbie AirByte user. I’m exploring it to complete the stack for my current project. I have a little issue. My source data is on AWS DocumentDB with TLS Enabled. This requires me to specify a tlsCAFile=rds-combined-ca-bundle.pem in the connection string. Is there any way to add this attribute and where should I put the PEM file? Thanks
    d
    m
    • 3
    • 4
  • m

    Muhammad Imtiaz

    02/18/2022, 3:43 PM
    Hey guys, I'm installing airbyte using helmchart. I've disabled default postgres installation & provided details in externaldb section. externaldb-secret doesn't created. Why is so? Can you please share the fix? https://docs.airbyte.com/deploying-airbyte/on-kubernetes#:~:text=planned%20logging%20improvements.-,U[…]0an%20external%20DB,-After%20Issue%20%233605 https://github.com/airbytehq/airbyte/blob/f927dc501d05dc1030d130c3eb5544e5430af6c2/charts/airbyte/values.yaml#L559
    • 1
    • 1
  • d

    Daniel Spence

    02/18/2022, 4:28 PM
    Is there anything on the roadmap to be able to define sources, destinations and syncs in code (json, yaml or via a cdk) so that they can be source controlled?
    • 1
    • 2
  • t

    Tony Hu

    02/19/2022, 1:23 AM
    Hi AirByte team, regarding to https://docs.airbyte.com/understanding-airbyte/jobs worker lifecycle (I am interested about sync worker). so if i have a sync job from mysql -> s3, the data extracted from mysql will first store in AirByte (I install in a EC2 box, so EBS) then load from there to S3, is my my understanding correct or airByte will not store any data but just work more like a job coordinator? thank you
    m
    • 2
    • 1
1...1213141516Latest