Good afternoon everyone, I have a question about the google sheets connector I have sheets that have multiple tabs (other sheets), is it possible to direct the connector only to this tab? Some tabs have the same columns and I keep getting duplicate column error, but I just wanted one tab. Slack Conversation

As I was reworking slides, I had to update some numbers airbyte heart

Hey, does anyone use this library? https://github.com/awslabs/deequ

More coverage & affirmation for the industry in Fortune today

- Fivetran, an Oakland, Calif.-based-based automated data analytics company, raised $565 million Series D funding valuing it at $5.6 billion. Andreessen Horowitz led the round and was joined by investors including General Catalyst, CEAS Investments, Matrix Partners, ICONIQ Capital, D1 Capital Partners, and YC Continuity. It also acquired HVR for $700 million.

Had some time today watching https://russiaos.ru/meetup and airbyte was mentioned there as top 8th fastest growing OSS startup based on ROSS index for the last quarter ( tbh not sure how famous this index is ). Glad to be part of such a great product airbyte rocket Btw, one of the speakers was Clickhouse’s CTO Milovidov

👋 Hello, team!

was just curious

Hi People, I am using Airbyte from past few days and trying to set a facebook page connector in Airbyte. I was able to generate the access token from the graph API and tested the piece in the facebook debugger and also on my local machine. I am able to pull the data from that end point. But when I try to connect via AirByte I am running into an issue of 403 forbidden URL. Can anyone here help me with this issue. Also attaching a copy of log file along this message.

2021-10-21_11-29-06.png

“Wow, my laptop is so fast today!” “Oh, Docker is not turned on..” Anyone else fall into this camp?

has anyone checkout Y42? what they are saying is quite ambitious but easy said than done. I am very curious about real reviews.

Hi I wanted to know if anyone had good reads/opinions on the loading method: • Standard inserts vs GCS staging --> what are the pros and cons of this?

Hello everybody Do I understand correctly that I cant run the client on the ARM?

New assign message

Cool new feature is GDocs: Approvals

Best website this week https://log4jmemes.com/

Hey Guys! I am thinking right now on a Destination for Odoo (ERP, like an Open Source SAP) But I started to realize that I need to keep somewhere some persistent data for Id matching (f.e. Client Id in Shopify to one in Odoo) Does airbyte community has any suggestions (standards) of how this store (state) should be organized? Or may be you think that AirByte is not the right tool for this kind of data migration and I'd be better put everything from Shopify to DB and from there I should write my own service that listen for new db row and move it to Odoo?

the flowchart slack goes through to publish a push notification 🤯

Meanwhile every food delivery app ever [OC]

Happy upcoming Christmas to everyone! As it’s known I and my team are building a no-code visual data transformer and we have got a question to the end of the year (yep, we couldn’t come earlier with it 🙈) For data tools, do you prefer a desktop or a web version of it? 💻 - desktop 🌐 - web thank you )

👋 Hello, team!

Awesome! 🚀

Has anyone had any success using the facebook pages connector ? (https://airbyte.com/connectors/facebook-pages ).

Hi! I was wondering if airbyte is going to have such connectors as LinkedIn Posts, Twitter Ad and Twitter Insights anytime soon? also does Aibyte’s core version cover Facebook Page Metrics, Facebook Posts, Google Search Console , Facebook Ads, Google Ads?

Hi can I do everything which I can do with airbyte UI using these API/s https://airbyte-public-api-docs.s3.us-east-2.amazonaws.com/rapidoc-api-docs.html Warm Regards.

Dear fellow Airbyte, My name is Ishan and I represent Gumlet. My team and I are solving one of the hardest problems with Internet video - streaming it efficiently to millions of users. I invite you to try out two of our products; 1. Video Optimization (https://bit.ly/3ILqajP) - lets you build your custom video infrastructure in minutes (not days). 2. Video Insights (https://bit.ly/33RpKtD) - get interesting insights on how users view videos. Bonus - If you are a startup, we're giving away $10,000 in Gumlet credits. https://bit.ly/3IKxpbH

It has been interesting to find out how much latency (ping) between ingestion machine and the source database affects the full load time. At least with db2 it seems to be fairly linearly following this super naive calculation:

(n * row / qds) * (latency * 3) // 1000

. The n is the row count, row is maximum byte size of the row, qds is the queryDataSize. Maximum value for qds was used (around 260KB). If the latency between ingestion server and db doubles, the time doubles. The fetchSize between 100 and 200 seemed to perform the best. I wonder how a database management system anyways handles full table selects, assuming that a table is selected using a naive “SELECT * FROM table” without any lowerBound/upperBound partitioning on some column (e.g. WHERE partition_column BETWEEN 0 AND 10000). Does it just read the records in the heap file in the order they have been written? Paginated into fetchSize-sized pages? I suppose it has to somehow make sure that the different pages refer to the same version of the whole table - and storing the query result to memory is not realistic with whole tables. I have read the Database Internals book by Alex Petrov (O’Reilly), but it was a lot to take in for a novice like me. Maybe I’ll need to read it again at some point.

Really looking to get access to airbyte cloud! On the waiting list, would love to start kicking the tires so when it goes GA we can potentially recommend it as part of a infra-free solution to clients