https://linen.dev logo
Join Slack
Powered by
# ask-ai
  • a

    Aviad Deri

    11/10/2025, 6:52 AM
    @kapa.ai i tried to change the user and password of postgres destination connector, but got this: 2025-11-10 084409 info INFO main i.a.c.d.j.JdbcDatabase(execute$lambda$0):50 executing statement: CREATE SCHEMA IF NOT EXISTS airbyte_internal; 2025-11-10 084409 info INFO main i.a.c.d.j.JdbcDatabase(execute$lambda$0):54 statement successfully executed 2025-11-10 084409 info INFO main i.a.c.d.j.JdbcDatabase(execute$lambda$0):50 executing statement: CREATE TABLE IF NOT EXISTS airbyte_internal._airbyte_connection_test_aefcb6164bd24fa587c86ce52e953aee ( _airbyte_raw_id VARCHAR PRIMARY KEY, _airbyte_data JSONB, _airbyte_extracted_at TIMESTAMP WITH TIME ZONE DEFAULT CURRENT_TIMESTAMP, _airbyte_loaded_at TIMESTAMP WITH TIME ZONE DEFAULT NULL, _airbyte_meta JSONB, _airbyte_generation_id BIGINT ); 2025-11-10 084409 info INFO main c.z.h.HikariDataSource(close):349 HikariPool-1 - Shutdown initiated... 2025-11-10 084409 info INFO main c.z.h.HikariDataSource(close):351 HikariPool-1 - Shutdown completed. 2025-11-10 084409 info INFO main i.a.c.i.b.IntegrationRunner(runInternal):224 Completed integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedDestination 2025-11-10 084409 info INFO main i.a.i.d.p.PostgresDestination$Companion(main):231 completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2025-11-10 084409 info Checking for optional control message... 2025-11-10 084409 info Writing output of 25c5221d-dce2-4163-ade9-739ef790f503_1daa479c-3807-4726-99b4-e67f68273ad8_0_check to the doc store 2025-11-10 084409 info Marking workload 25c5221d-dce2-4163-ade9-739ef790f503_1daa479c-3807-4726-99b4-e67f68273ad8_0_check as successful 2025-11-10 084410 info 2025-11-10 084410 info ----- END CHECK ----- 2025-11-10 084410 info 2025-11-10 084410 info Deliberately exiting process with code 0. what is the issue?
    k
    • 2
    • 1
  • r

    Rahul

    11/10/2025, 8:42 AM
    @kapa.ai when this error occurs? Unable to persist the job Output, check the document store credentials.
    k
    • 2
    • 1
  • r

    Rahul

    11/10/2025, 8:43 AM
    @kapa.ai when this error occurs? message='Airbyte could not track the sync progress. Sync process exited without reporting status.', type='io.airbyte.workers.exception.WorkloadMonitorException', nonRetryable=false
    k
    • 2
    • 7
  • a

    Antoine Anicotte

    11/10/2025, 10:50 AM
    @kapa.ai in the Builder how do I set up the "Paginator" section for a response that has this paging logic:
    Copy code
    "paging": {
          "cursors": {
            "after": "xxxxx"
          },
          "next": "<https://graph.facebook.com/v24.0/xxxxx>"
        }
    k
    • 2
    • 10
  • i

    Ilan Gresserman

    11/10/2025, 10:52 AM
    @kapa.ai Can you explain airbyte architecture?
    k
    • 2
    • 1
  • r

    Renu Fulmali

    11/10/2025, 11:28 AM
    @kapa.ai I have setup the airbyte using helm chart and now I wanted to update the noofication uRL how can I able to do that ?
    k
    • 2
    • 7
  • k

    Kaique G. Viana

    11/10/2025, 1:49 PM
    @kapa.ai I have this problem Airbyte is temporarily unavailable. Please try again. (HTTP 502)
    k
    • 2
    • 22
  • s

    sp33dy

    11/10/2025, 3:35 PM
    @kapa.ai I'm getting this error on destination when syncing:
    Copy code
    Not able to generate jsonSchema-info for type: [simple type, class com.fasterxml.jackson.databind.JsonNode] - probably using custom serializer which does not override acceptJsonFormatVisitor
    k
    • 2
    • 13
  • l

    Lucas Segers

    11/10/2025, 3:49 PM
    @kapa.ai after upgrading airbyte from 1.7.2 to 2.0.1, a lot of the custom builders broke with this error ValueError(\nValueError: Only one of field_name or field_path can be provided to RequestOption
    k
    • 2
    • 4
  • s

    sp33dy

    11/10/2025, 4:18 PM
    @kapa.ai I'm getting this error during sync process:
    Copy code
    [dd.trace 2025-11-10 16:16:47:401 +0000] [dd-trace-processor] WARN datadog.trace.agent.common.writer.ddagent.DDAgentApi - Error while sending 2 (size=2KB) traces. Total: 2, Received: 2, Sent: 0, Failed: 2. java.net.ConnectException: Failed to connect to localhost/[0:0:0:0:0:0:0:1]:8126 (Will not log warnings for 5 minutes)
    k
    • 2
    • 13
  • l

    Lucas Segers

    11/10/2025, 5:53 PM
    @kapa.ai I have an async stream that has this status_mapping on the polling request - type: DeclarativeStream name: ativos retriever: type: AsyncRetriever decoder: type: JsonDecoder status_mapping: failed: - FAILED - CANCELED running: - PENDING - PLANNING - QUEUED - EXECUTION_PLANNING - ENGINE_START - METADATA_RETRIEVAL timeout: - NAO_TEM completed: - COMPLETED however, after upgrading to 2.0, the UI seems to break (it shows red on the status mapping field) when trying to execute in the yaml ui, it errors clearly: ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') ValueError('API status
    RUNNING
    is unknown. Contact the connector developer to make sure this status is supported.') AirbyteTracedException("At least one job could not be completed for slice {'start_time': '202506', 'end_time': '202511'}. Job statuses were: {'0db1c262-9587-4ac8-8b0c-9dafae3be76a': <AsyncJobStatus.FAILED: ('FAILED', True)>}. See warning logs for more information.") did the format change?
    k
    • 2
    • 4
  • m

    Mayur Shingare

    11/10/2025, 6:23 PM
    @kapa.ai 2025-11-10 234835 INFO 2025-11-10 234835 info 2025-11-10 234835 INFO 2025-11-10 234835 info Transitioning workload to running state 2025-11-10 234835 INFO 2025-11-10 234835 info ----- START CHECK ----- 2025-11-10 234835 INFO 2025-11-10 234835 info 2025-11-10 234836 INFO 2025-11-10 234836 info Workload successfully transitioned to running state 2025-11-10 234844 INFO 2025-11-10 234844 info Connector exited, processing output 2025-11-10 234844 INFO 2025-11-10 234844 info Output file jobOutput.json found 2025-11-10 234844 INFO 2025-11-10 234844 info Connector exited with exit code 0 2025-11-10 234844 INFO 2025-11-10 234844 info Reading messages from protocol version 0.2.0 2025-11-10 234844 INFO 2025-11-10 234844 info Using concurrent cdk with concurrency level 20 2025-11-10 234844 WARN 2025-11-10 234844 warn The response for
    <https://login.salesforce.com/services/oauth2/token>
    was expected to be a list with at least one element but was
    b'{"error":"invalid_grant","error_description":"expired access/refresh token"}'
    2025-11-10 234844 ERROR 2025-11-10 234844 error 'POST' request to 'https://login.salesforce.com/services/oauth2/token' failed with status code '400' and error message: 'invalid_grant'. Request (body): 'grant_type=refresh_token&client_id=3MVG9l2zHsylwlpT1zPezz7FdUnJ8J9CYM_PM22DQBIGpZy19Wc2di5BvgG12mxeL0Y.8AABgyMXjscVAfIFO&client_secret=****&refresh_token=****'. Response (body): '{'error': 'invalid_grant', 'error_description': 'expired access/refresh token'}'. Response (headers): '{'Date': 'Mon, 10 Nov 2025 181843 GMT', 'Vary': 'Accept-Encoding', 'Set-Cookie': 'CookieConsentPolicy=0:0; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure, LSKey-c$CookieConsentPolicy=0:0; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure, BrowserId=sMdsr75hEfCPdFO-Atmt7A; domain=.salesforce.com; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure; SameSite=None, CookieConsentPolicy=0:0; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure, LSKey-c$CookieConsentPolicy=0:0; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure, BrowserId=sM7ngr5hEfCh9_cWpDmfxQ; domain=.salesforce.com; path=/; expires=Tue, 10-Nov-2026 181843 GMT; Max-Age=31536000; secure; SameSite=None', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=63072000; includeSubDomains', 'Cache-Control': 'no-cache,must-revalidate,max-age=0,no-store,private', 'Expires': 'Thu, 01 Jan 1970 000000 GMT', 'Content-Type': 'application/json;charset=UTF-8', 'Transfer-Encoding': 'chunked'}'. 2025-11-10 234844 INFO 2025-11-10 234844 info Checking for optional control message... 2025-11-10 234844 INFO 2025-11-10 234844 info Optional control message not found. Skipping... 2025-11-10 234844 INFO 2025-11-10 234844 info Writing output of b117307c-14b6-41aa-9422-947e34922962_69a9733b-a58d-419b-8f65-44624bbdf26c_0_check to the doc store 2025-11-10 234915 INFO 2025-11-10 234915 info Marking workload b117307c-14b6-41aa-9422-947e34922962_69a9733b-a58d-419b-8f65-44624bbdf26c_0_check as successful 2025-11-10 234915 INFO 2025-11-10 234915 info Deliberately exiting process with code 0. 2025-11-10 234915 INFO 2025-11-10 234915 info 2025-11-10 234915 INFO 2025-11-10 234915 info ----- END CHECK ----- 2025-11-10 234915 INFO 2025-11-10 234915 info
    k
    • 2
    • 7
  • c

    Chris Bui

    11/11/2025, 12:18 AM
    @kapa.ai I plan on installing Airbyte OSS on a self-managed EKS cluster with Iceberg using AWS Glue Catalog as my destination. The S3 Data Lake connector only gives me the option to authenticate with the AWS Access Key ID and AWS Secret Access Key. Is it possible it instead with an assumed IAM Role using STS?
    k
    • 2
    • 5
  • y

    Yuki Kakegawa

    11/11/2025, 1:57 AM
    Is it recommended to have multiple connections for the same source/destination, but selecting different tables for specific purposes?
    ✅ 1
    k
    • 2
    • 1
  • a

    Akshata Shanbhag

    11/11/2025, 11:18 AM
    @kapa.ai how to get the job stats using the airbyte api
    k
    • 2
    • 7
  • r

    Renu Fulmali

    11/11/2025, 11:28 AM
    @kapa.ai how to setup the slack notification when I have deployed the Airbyte using the helm chart ?
    k
    • 2
    • 4
  • v

    Vishal Garg

    11/11/2025, 11:47 AM
    @kapa.ai Getting below error while trying to setup freshchat as a source : 2025-11-11 171727 INFO 2025-11-11 171727 info 2025-11-11 171727 INFO 2025-11-11 171727 info ----- START CHECK ----- 2025-11-11 171727 INFO 2025-11-11 171727 info 2025-11-11 171728 INFO 2025-11-11 171728 info Connector exited, processing output 2025-11-11 171728 INFO 2025-11-11 171728 info Output file jobOutput.json found 2025-11-11 171728 INFO 2025-11-11 171728 info Connector exited with exit code 0 2025-11-11 171728 INFO 2025-11-11 171728 info Reading messages from protocol version 0.2.0 2025-11-11 171728 ERROR 2025-11-11 171728 error 'GET' request to 'https://mpaani-org.freshchat.com/v2/users?items_per_page=20&amp;updated_from=2025-11-01T00%3A00%3A00.000000Z&amp;updated_to=2025-11-11T11%3A47%3A27.000000Z' failed with status code '401' and error message: 'Please provide a valid token'. Request (body): 'None'. Response (body): '{'success': False, 'error_code': 401, 'error_message': 'Please provide a valid token'}'. Response (headers): '{'Date': 'Tue, 11 Nov 2025 114728 GMT', 'Content-Type': 'application/json', 'Content-Length': '81', 'Connection': 'keep-alive', 'Cache-Control': 'no-store', 'strict-transport-security': 'max-age=31536000; includeSubDomains', 'x-xss-protection': '1; mode=block', 'x-envoy-upstream-service-time': '7', 'x-trace-id': '00-e11a40ab90076c9013b8ce0bb79c88de-88cd866989499ac2-00', 'nel': '{ "report_to": "nel-endpoint-freshchat", "max_age": 2592000, "include_subdomains": true}', 'report-to': '{ "group": "nel-endpoint-freshchat", "max_age": 2592000, "include_subdomains": true, "endpoints": [{"url": "https://edge-admin.us-east-1.freshedge.net/nelreports/freshchat"}]}', 'x-server-processing-time-ms': '9', 'x-fw-ratelimiting-managed': 'false', 'x-request-id': '5370e72b-7a1e-46f9-9bba-5a1edc2a2f73', 'cf-cache-status': 'DYNAMIC', 'Set-Cookie': '__cf_bm=ZjcNgsgdlzP.x3x6ucAKdZdqdeHL8wfnafOTwFSYk80-1762861648-1.0.1.1-JtV1rRcZ9k..bQFWwZwrE7HPP2j1FAaPBHGcyind9I7SI.UIxmnYY.wAaKNuQerqBe5ehRNqtQFjo37JTbsMJxDvJmsBuOyFGWIxIIAsUVI; path=/; expires=Tue, 11-Nov-25 121728 GMT; domain=.freshchat.com; HttpOnly; Secure; SameSite=None', 'Server': 'cloudflare', 'CF-RAY': '99cd8e12bf0847e9-BOM'}'. 2025-11-11 171728 WARN 2025-11-11 171728 warn Stream users is not available: HTTP Status Code: 401. Error: Unauthorized. Please ensure you are authenticated correctly. 2025-11-11 171728 ERROR 2025-11-11 171728 error Check failed 2025-11-11 171728 INFO 2025-11-11 171728 info Checking for optional control message... 2025-11-11 171728 INFO 2025-11-11 171728 info Optional control message not found. Skipping... 2025-11-11 171728 INFO 2025-11-11 171728 info Writing output of 100640bc-c2f3-42b2-a91a-8164f7499ec3_2d49d9de-abfb-4a50-8a31-45e158539cd5_0_check to the doc store 2025-11-11 171728 INFO 2025-11-11 171728 info Marking workload 100640bc-c2f3-42b2-a91a-8164f7499ec3_2d49d9de-abfb-4a50-8a31-45e158539cd5_0_check as successful 2025-11-11 171728 INFO 2025-11-11 171728 info Deliberately exiting process with code 0. 2025-11-11 171728 INFO 2025-11-11 171728 info 2025-11-11 171728 INFO 2025-11-11 171728 info ----- END CHECK ----- 2025-11-11 171728 INFO 2025-11-11 171728 info
    k
    • 2
    • 1
  • k

    Kothapalli Venkata Avinash

    11/11/2025, 12:21 PM
    @kapa.ai Why salesforce connector taking long time to read records?
    k
    • 2
    • 1
  • s

    Suneep Nair

    11/11/2025, 1:09 PM
    Helm chart configuration for Airbyte notification using slack webhook url
    k
    • 2
    • 5
  • g

    Gibson Wasukira

    11/11/2025, 2:02 PM
    How can i override the values referenced by the worker in the airbyte-env configmap, shouldnt env_vars overwrite the values in the configmap?
    k
    • 2
    • 1
  • g

    Gibson Wasukira

    11/11/2025, 2:05 PM
    What the latest chart version in the 2 tag series
    k
    • 2
    • 3
  • g

    Gibson Wasukira

    11/11/2025, 2:08 PM
    I am currently using chart version 2.0.10 and airbyte version 1.8.1, what are my options, i am not sure of upgrading my airbyte version, bout would like to use a newer chart
    k
    • 2
    • 1
  • a

    Anna Bogo

    11/11/2025, 2:32 PM
    the postgres replication methods explained here seems to be 2: https://docs.airbyte.com/integrations/sources/postgres but the updated methods are three: Read Changes using Write-Ahead Log (CDC) Detect Changes with Xmin System Column Scan Changes with User Defined Cursor what is the different between the second and third? and can I choose to replicate a database from a date on?
    k
    • 2
    • 1
  • l

    Leland Whitlock

    11/11/2025, 2:39 PM
    @kapa.ai Is there a way to increase the frequency of pod sweeper clearing of failed pods? I know it clears them if they have been failed for multiple hours, can I set that to failed for one hour?
    k
    • 2
    • 7
  • s

    Simon Veerman

    11/11/2025, 4:01 PM
    Hey @kapa.ai everytime I want to update my airbyte OS instance on a google VM, I get this error: ERROR failed to determine if any previous psql version exists: error reading pgdata version file: open /<redacted>/.airbyte/abctl/data/airbyte-volume-db/pgdata/PG_VERSION: permission denied I have found there are some steps to alter the folder permissions so I can update it but afterwards, the problem always returns. What can you tell me about this issue and are there lasting solutions?
    k
    • 2
    • 1
  • t

    Tatiane Corrêa da Costa e Silva

    11/11/2025, 6:23 PM
    @kapa.ai reset na connection, refresh e clear data..qual a diferença?
    k
    • 2
    • 1
  • w

    William Anputra

    11/11/2025, 6:41 PM
    @kapa.ai saya ada integrasi linkedin ads dan udah dapet consent url tapi kok malah redirect ke airbyte page ?
    k
    • 2
    • 8
  • r

    Rob Kwark

    11/11/2025, 8:25 PM
    @kapa.ai Is it possible to increase the CPU and RAM requests and limits just for the destination worker on deployment, without changing the postgresql db parameters?
    k
    • 2
    • 4
  • c

    Christopher Greene

    11/11/2025, 9:19 PM
    @kapa.ai can you review yaml file inputs to the connector builder
    k
    • 2
    • 1
  • b

    Bryan Ovalle

    11/11/2025, 9:25 PM
    @kapa.ai is there no way to see disabled streams on a connection
    k
    • 2
    • 2