Ivan Demabildo
08/05/2025, 9:57 PMArwa A
08/07/2025, 8:36 AMSérgio Marçal
08/07/2025, 11:52 AMSeb J
08/07/2025, 12:11 PM"Could not validate your connector as specified:
An unknown error has occurred"After some research, I found that starting from this version, certain changes are required regarding ingress configuration. Information found here: https://docs.airbyte.com/release_notes/v-1.7#171 And also here: https://docs.airbyte.com/platform/deploying-airbyte/integrations/ingress-1-7 My question is: Am I required to set up an ingress and expose my Airbyte deployment externally, or is there a way to resolve this issue without doing so? Thanks everyone!
Mohit Kumar
08/07/2025, 2:07 PMPablo Morales
08/07/2025, 6:15 PMJonathan Sider
08/08/2025, 4:59 PMTom Holder
08/08/2025, 6:58 PMJay Tavares
08/08/2025, 7:31 PMWill Skelton
08/08/2025, 8:26 PMMengying Li
08/08/2025, 9:07 PM{
"name": "Datadog",
"workspaceId": "xxxxx",
"definitionId": "xxxx",
"configuration": {
"site": "<http://us5.datadoghq.com|us5.datadoghq.com>",
"api_key": "******",
"queries": [
{
"name": "test_metrics",
"query": "sum:api.log_data.num_bytes{env:production} by {org_id}.as_rate()",
"data_source": "metrics"
}
],
"start_date": "2025-08-06T00:00:00Z",
"application_key": "******",
"max_records_per_request": 5000
}
}
Marcin Siudziński
08/11/2025, 9:14 AMDirect-Load Tables
(https://docs.airbyte.com/platform/using-airbyte/core-concepts/direct-load-tables) paradigm is introduced in the BigQuery destination v3. In the documentation (https://docs.airbyte.com/integrations/destinations/bigquery-migrations) there is a note:
If you only interact with the raw tables, make sure that you have the Disable Final Tables option enabled before upgrading. This will automatically enable the Legacy raw tables option after upgrading.
In the GUI the change is straightforward and we can simply flip the switch, but my question is how to add the Legacy raw tables
option into a terraform definition of destination? The terraform documentation (https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/resources/destination_bigquery#nestedatt--configuration) for Airbyte provider does not say anything about how we can configure it. There is a raw_data_dataset
option but it is now defining the Legacy raw tables
option.Yuki Kakegawa
08/11/2025, 4:05 PMexpand[]: items.data.discounts
, but it gives me 400 error every time I tried it. With a curl cmd, I can pass it in like -d "expand[]=items.data.discounts"
and it works just fine. I'd appreciate if anybody has any insights on this!Mengying Li
08/12/2025, 5:57 AMfrom
and to
parameter to work properly after many tries. Would appreciate any pointers on this! The error is and the yaml file is in the comment. The set up in the UI is in the screenshot
Bad request. Please check your request parameters.
'GET' request to '<https://api.us5.datadoghq.com/api/v1/query?query=avg%3Asystem.cpu.idle%7B%2A%7D>' failed with status code '400' and error message: 'The parameter 'from' is required'. Request (body): 'None'. Response (body): '{'errors': ["The parameter 'from' is required"]}'. Response (headers): '{'date': 'Tue, 12 Aug 2025 05:53:56 GMT', 'content-type': 'application/json', 'content-security-policy': "frame-ancestors 'self'; report-uri <https://logs.browser-intake-datadoghq.com/api/v2/logs?dd-api-key=pube4f163c23bbf91c16b8f57f56af9fc58&dd-evp-origin=content-security-policy&ddsource=csp-report&ddtags=site%3Aus5.datadoghq.com>", 'x-frame-options': 'SAMEORIGIN', 'vary': 'Accept-Encoding', 'content-encoding': 'gzip', 'x-content-type-options': 'nosniff', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', 'x-ratelimit-limit': '10', 'x-ratelimit-period': '10', 'x-ratelimit-remaining': '9', 'x-ratelimit-reset': '4', 'x-ratelimit-name': 'batch_query', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000', 'Transfer-Encoding': 'chunked'}'.
Behzad Ahmed
08/12/2025, 7:49 AMMuhammad Hassaan Mustafa
08/12/2025, 8:55 AMworkload-launcher:
extraEnv:
- name: AIRBYTE_ENABLE_UNSAFE_CODE
value: "true"
connector-builder-server:
extraEnv:
- name: AIRBYTE_ENABLE_UNSAFE_CODE
value: "true"
server:
extraEnv:
- name: AIRBYTE_PUBLIC_API_ENABLED
value: "true"
webapp:
extraEnv:
- name: AIRBYTE_PUBLIC_API_ENABLED
value: "true"
Thế Minh Huỳnh
08/12/2025, 11:22 AMSiarhei Karko
08/12/2025, 2:01 PMDiscovering schema failed
The discover catalog failed due to an internal error for source: 30b0e9b8-ad8c-42bf-86fc-04cdc929e45a
Internal message: Unexpected error performing DISCOVER. The exit of the connector was: 0
Failure origin: source
io.airbyte.workers.exception.WorkerException: Unexpected error performing DISCOVER. The exit of the connector was: 0
at io.airbyte.connectorSidecar.ConnectorMessageProcessor.run(ConnectorMessageProcessor.kt:95)
at io.airbyte.connectorSidecar.ConnectorWatcher.processConnectorOutput(ConnectorWatcher.kt:138)
at io.airbyte.connectorSidecar.ConnectorWatcher.run(ConnectorWatcher.kt:79)
at io.airbyte.connectorSidecar.$ConnectorWatcher$Definition.initialize(Unknown Source)
at io.airbyte.connectorSidecar.$ConnectorWatcher$Definition.instantiate(Unknown Source)
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334)
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304)
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316)
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127)
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80)
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029)
at io.micronaut.context.DefaultBeanContext.initializeEagerBean(DefaultBeanContext.java:2702)
at io.micronaut.context.DefaultBeanContext.initializeContext(DefaultBeanContext.java:1994)
at io.micronaut.context.DefaultApplicationContext.initializeContext(DefaultApplicationContext.java:314)
at io.micronaut.context.DefaultBeanContext.configureAndStartContext(DefaultBeanContext.java:3318)
at io.micronaut.context.DefaultBeanContext.start(DefaultBeanContext.java:345)
at io.micronaut.context.DefaultApplicationContext.start(DefaultApplicationContext.java:216)
at io.micronaut.runtime.Micronaut.start(Micronaut.java:75)
at io.airbyte.connectorSidecar.ApplicationKt.main(Application.kt:18)
at io.airbyte.connectorSidecar.ApplicationKt.main(Application.kt)
Caused by: org.openapitools.client.infrastructure.ClientException: Client error : 409 Conflict
I tried creating a fresh Airbyte Cloud trial account and added there my YAML source files, and schema detection worked w/o issues.
What can be the root of the problem for my Self-Hosted Airbyte?Vince Pillinger
08/12/2025, 4:11 PMAbhay Kevat
08/12/2025, 4:20 PMabctl
in Docker)
• Sync mode: Incremental | Append + Deduped
• Final destination usage: MySQL (downstream transformations via DBT)
• Other context: We also collect data from Pinterest, TikTok, Snapchat, and other platforms, so reducing sync time for Facebook is critical to keeping our daily pipelines within schedule.
Thank you for your support.Nicholas Roberts
08/13/2025, 4:40 AMPostgresDestinationStrictEncrypt$Companion(main):73 starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestinationStrictEncrypt
Sudeesh Rajeevan
08/13/2025, 8:30 AMMert Ors
08/13/2025, 9:15 AMMert Ors
08/13/2025, 9:32 AMMert Ors
08/13/2025, 9:32 AMcketch Engli
08/13/2025, 10:00 AMMadhur Gupta
08/13/2025, 11:25 AMAmi Mehta
08/13/2025, 11:49 AMLamartine Santana
08/14/2025, 12:56 PMVince Pillinger
08/14/2025, 3:00 PM