Hey everyone 👋 The frustration with the Octavia CLI is known, and we intend to get things back to a better state this year 🙂 @Dayten Sheffar @Eric Schrock The team who owns the Octavia CLI at Airbyte also owns additional critical projects that have been the priority over the last 8 months. This team has not had the capacity to implement fixes or improvements due to other project priorities. This year, Airbyte will get to the point where we do have that capacity. You can look forward to improvements to the CLI coming over the 2nd-half of this year 🙌

Hi @Tyler Bernstein there is an error in the docs: the Trustpilot source documentation is pointing to Zendesk Talk. See https://docs.airbyte.com/integrations/sources/trustpilot/

Is there a way to trigger a job in Airbyte after another job completes?

Setel has joined this channel by invitation from Airbyte.

Hi Team Why the last version of octavia in docker hub is

0.42.1

while airbyte latest version is

0.44.3

?

Hey guys! Great job with the API development! We currently using shipyardapp.com to orchestrate our data pipelines, so we are integrating Airbyte API, we are having some troubles checking the status of the job, according the blueprint documentation in shipyard (https://www.shipyardapp.com/docs/blueprint-library/airbyte/Airbyte-authorization/) the API should return something like this

{
  "jobId": 1234,
  "status": "running",
  "jobType": "sync"
}

But we are getting a different response, something like this

Changing working directory to /home/shipyard

Setting environment variable AIRBYTE_CONNECTION_ID=[XXXX]
Setting environment variable AIRBYTE_API_TOKEN=[XXX]
Downloading file trigger_syc.py ...

2023-05-11 17:04:31,510 - Shipyard - INFO - Airbyte sync successfully triggered

Any thought on that? Thanks!

👋 Hi all, we have an exciting announcement to share! Next week's Daily Airbyte Office Hours will feature Deep Dive Sessions hosted by the one and only @[DEPRECATED] Marcos Marx octavia muscle During the deep-dive sessions, Marcos will explain how Airbyte works, delving into each component in every session and explaining their functions. If you’re curious or want to learn more about Airbyte, these sessions will be truly valuable to you. For the first week we’re diving into the

airbyte-bootloader

and the

airbyte-database

services. The presentation will be 20 min, and we'll dedicate the remaining 25 min to questions about the daily topic or general Q&A. Check out the schedule below 👇 Reminders and updates will be posted in #office-hour 🔥 Deep Dive Sessions: airbyte-bootloader • Monday May 22 - 1pm PDT (zoom link) • Tuesday May 23 - 16:00 CEST / 10am EDT (zoom link) 🔥 Deep Dive Sessions: airbyte-db + Airbyte Database Internals • Wednesday May 24 - 1pm PDT (zoom link) • Thursday May 25 - 16:00 CEST / 10am EDT (zoom link) 🔥 Open Q&A • Friday May 26 - 1pm PDT (zoom link) Hope to see you there! octavia rocket

https://github.com/airbytehq/airbyte/issues/26185 I made PR for octavia.

🔥 Community Office Hours starts in 15 minutes 🔥 Q&A - No topic, ask anything! At 1pm PDT click here to join us on Zoom!

🔥 Community Office Hours starts in 15 minutes 🔥 Deep Dive Sessions: airbyte-bootloader At 1pm PDT click here to join us on Zoom!

🔥 Office Hours starts in 15 minutes 🔥 Deep Dive Sessions: airbyte-bootloader At 16:00 CEST / 10am EDT click here to join us on Zoom!

Hi all, I have some question related octavia CLI

1. Is it possible automate octavia using Python? It means maybe we integrate with our API or only run python script
2. Is it possible to disable connector from Octavia to Connector in Airbyte?
3. Do you know how to save variable service Account JSON for BigQuery? My problem is always error if config variable from VM and run it from Octavia but no problem from Airbyte UI

That's all from me, thank you

Hi, Do we have any documentation on how to implement Octavia for k8s deployments of Airbyte? Does it run inside the airbyte server container itself, if we add this configuration in values.yaml ? I don’t see octavia-cli in the airbyte helm charts.

octavia-cli:
  image: airbyte/octavia-cli:0.42.1
  command: apply --force
  env:
    - <Values from kubernetes secrets>
  volumes:
    - ./octavia-cli/octavia:/home/octavia-project
  depends_on:
    - webapp

Or do we need to create a separate octavia-cli container ?

🔥 Office Hours starts in 15 minutes 🔥 Deep Dive Sessions: airbyte-db + Airbyte Database Internals At 1PM PDT click here to join us on Zoom!

Hi Team, Whenever we get a notification from our Replications (non-breaking and breaking), is it possible for us to set a notification to our Slack channel?

🔥 Office Hours starts in 15 minutes 🔥 Deep Dive Sessions: airbyte-db + Airbyte Database Internals At 16:00 CEST / 10am EDT click here to join us on Zoom octavia loves

🔥 Community Office Hours starts in 15 minutes 🔥 At 1pm PDT click here to join us on Zoom!

🔥 Community Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 1pm PDT click here to join us on Zoom!

🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom!

🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 1PM PDT click here to join us on Zoom!

🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom octavia loves

Hi all, I am trying to get dagster-arbyte running with airbyte cloud. which url do i pass?

🔥 Community Office Hours starts in 15 minutes 🔥 At 1pm PDT click here to join us on Zoom!

🔥 Community Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 1pm PDT click here to join us on Zoom!

Not sure this is the right channel to ask, but I’m going to use Powered by Airbyte, orchestrated by Airflow (using the Airbyte Cloud API) and i’m wondering what would be the simplest way to : trigger syncs which sync stream in incremental refresh mode as primary mode, BUT, offer my customers to manually choose to do full refresh of some streams (for instance, to capture deletes, fix missing data, etc). I would need to create multiple connections right?

I love the proactivity in requesting feedback about the API, but could we get answers to those? - thanks so much in advance 🙏

🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom!

Hello 🙂 ! How can I specify the location of my sources, destinations and connections

configuration.yaml

files to my

octavia apply

command ? I saw the

--file

option but it does not work properly. My folders are like this : • stack ◦ airbyte ▪︎ configs • connections ◦ configuration.yaml • sources ◦ configuration.yaml • destinations ◦ configuration.yaml I usually

cd stack/airbyte/configs && octavia apply

, but I would like to

octavia apply --file stack/airbyte/configs

so it detect all folders containing my

configuration.yaml

files from anywhere I am and apply it Thanks for the help 😄 !

🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #office-hour octavia loves At 1PM PDT click here to join us on Zoom!

🔥 Community Office Hours starts in 15 minutes 🔥 At 1pm PDT click here to join us on Zoom!