https://linen.dev logo
Join Slack
Powered by
# help-connector-development
  • s
    This message was deleted.
    k
    • 2
    • 2
  • s
    This message was deleted.
    k
    • 2
    • 2
  • p
    I does not have 'secrets/config.json' in my connecter.
    k
    j
    • 3
    • 3
  • c
    Hi everybody, I'm having an issue mentioned in https://github.com/airbytehq/airbyte/issues/27494. I don't know if there is a specific way to fix this problem? I have followed but not sure how to fix it. Please help me
    k
    j
    • 3
    • 4
  • a
    Hi, I am developing a new stream for HubSpot for this issue : https://github.com/airbytehq/airbyte/issues/11178 with this PR : https://github.com/airbytehq/airbyte/pull/27091 This new stream use in-build parent-child stream logic and perform correctly the call to the contact V1 API to return merge-audit data. Records are correctly returned in the 
    read_records
    parent function however, after the sync is finished, in the logs 
    "Read 0 records from contacts_merged_audit stream"}}
    k
    j
    • 3
    • 3
  • n
    Hi All, my team wants to create a new connection for reporting needs in the dashboard from Google Bigquery to Mixpanel. Can anyone help with a guide or steps to build the process? thank you.
    k
    • 2
    • 3
  • a
    Copy code
    Hello,
For the context, we try to customize the destination-iceberg connector for our internal use without it having an interest for the community, to do this, we first try to build the image of the connector and push it on ECR without making any changes to the code. Except that when we try to add it as a custom destination on Airbyte it fails at the check level with the following message:
RetryableException(Data read has a different checksum than expected. Was 0xd41d8cd98f00b204e9800998ecf8427e, but expected 0x748f1ee24f544f0b90b317a9fd8ccb70.
Can you please guide me? Thank you!
  • m
    any idea? i just want to run the frontend (base) michael@michael:~/airbyte-platform/airbyte-webapp$ pnpm run generate-client
    airbyte-webapp@0.50.5 generate-client /home/michael/airbyte-platform/airbyte-webapp
    ./scripts/load-declarative-schema.sh && orval
    Found cached CDK manifest schema 0.43.0 🍻 Start orval v6.15.0 - A swagger client generator for typescript Running afterAllFilesWrite hook... Make options parameter mandatory in AirbyteClient.ts... Write type re-export file for AirbyteClient... 🎉 api - Your OpenAPI spec has been converted into ready to use orval! Running afterAllFilesWrite hook... Make options parameter mandatory in CloudApi.ts... Write type re-export file for CloudApi... 🎉 cloudApi - Your OpenAPI spec has been converted into ready to use orval! Running afterAllFilesWrite hook... Make options parameter mandatory in ConnectorBuilderClient.ts... Write type re-export file for ConnectorBuilderClient... 🎉 connectorBuilder - Your OpenAPI spec has been converted into ready to use orval! ⚠️ SyntaxError: Swagger schema validation failed. #/components/schemas/ConnectorManifest must be object #/components/schemas/ConnectorManifest must be object #/components/schemas/ConnectorManifest must match exactly one schema in oneOf 🛑 connectorManifest - TypeError: Cannot read properties of undefined (reading 'openapi')
    k
    j
    • 3
    • 50
  • a
    Is it possible to put several ids in a same stream_slice in order to optimize API calls using batch API?
    k
    • 2
    • 2
  • m
    Hi guys, I just developed a new connector with the connector builder UI. Where can I find it in my code? I need to configure a proxy just for that connector (they only accept requests from inside Brazil so we need to pass a proxy to it)
    k
    m
    • 3
    • 15
  • o
    🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #C045VK5AF54 octavia loves At 1PM PDT click here to join us on Zoom!
  • m
    Hello fellow Airbytians! I am new to this channel so its a pleasure to virtually meet you all. I was wondering if anyone knows how to get access to the no-code connector beta in airbyte open source? Im dying to try it out!
    k
    l
    • 3
    • 6
  • p
    Does anyone have built a db2 destination connector?
    k
    • 2
    • 2
  • m
    hi any idea? PS C:\airbyte-platform\airbyte-webapp> pnpm start
    airbyte-webapp@0.50.5 prestart C:\airbyte-platform\airbyte-webapp
    SET TS_NODE_TRANSPILE_ONLY=true && pnpm run generate-client
    airbyte-webapp@0.50.5 generate-client C:\airbyte-platform\airbyte-webapp
    cmd /C C:\airbyte-platform\airbyte-webapp\scripts\load-declarative-schema.bat && orval
    export const CDK_VERSION = 0.44.0"; >> src/components/connectorBuilder/cdk.ts Downloading CDK manifest schema 0.44.0 from PyPI The system cannot find the path specified.  ELIFECYCLE  Command failed with exit code 255.  ELIFECYCLE  Command failed with exit code 1.
    k
    j
    t
    • 4
    • 6
  • o
    🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #C045VK5AF54 octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom octavia loves
  • a
    Hi all, I'm trying to build a new stream that involves pagination. For building requests, I use JSON (free form) like this: 
    {
    "id": "{{ now_utc() }}",
    "method": "SerpstatDomainProcedure.getDomainKeywords",
    "params": {
    "se": "{{config['region']}}",
    "page": "{{next_page_token['next_page_token'] or 1}}",
    "size": "{{config['page_size']}}",
    "domain": "{{config['domain']}}"
    }
    }
    Our API requires an integer 
    page
    parameter pointing to the page number with the size of 
    size
    results per page if I need to walk through all the available results. The 
    page
    parameter is not returned in the response and is just a serial number of the page. With the JSON above I can't get results from pages 2, 3, and so on. I tried to use built-in Pagination options, but they do not support nested structures like 
    params.page
    to set the required page number in the request. Is there any way to solve this using JSON (free form) or other connector builder options?
    k
    j
    • 3
    • 9
  • m
    Hey Airbytians - does anyone know what the most recent version of OSS (open source) is? Im trying to upgrade to the most recent version to get the Builder beta! Thanks!
    k
    l
    • 3
    • 3
  • a
    Hi all - Our team is looking into getting CDC data from Postgres via AirByte. We notice here: https://github.com/airbytehq/airbyte/blob/e8ddda970905ae338377d2b2a7ed5fa9ffa57ed4[…]airbyte/integrations/debezium/internals/DebeziumEventUtils.java, that in case of 
    UPDATE
    operations, AirByte strips out the old values even if they are received from Debezium (assuming 
    REPLICA IDENTITY
    is set to 
    FULL
    ). I am curious why we do that. We are happy to contribute a patch that inserts the old values into a new field (let’s say 
    _ab_cdc_before
    ) in the payload, but would that be welcomed? If not, I’m curious to understand the rationale. Thanks!
    k
    • 2
    • 2
  • l
    Hello, I want to implement 2 endpoints.
    Copy code
    /bills
/bills/{bill_id}
    The first one is easy. How do I implement the 2nd using Python CDK?
    k
    e
    • 3
    • 11
  • p
    how to change data in messages.jsonl into columns
    k
    • 2
    • 2
  • c
    In a Source implementation, is there an upper size limit on the contents of the 
    state
    parameter passed to the 
    read
    method (and what is emitted in state messages during read)?
    k
    • 2
    • 5
  • m
    Hi all, trying to build a connector in Airbyte GUI (deployed on virtual machine) and I keep getting this error message: 
    "Invalid connector manifest with error: Validation against json schema defined in declarative_component_schema.yaml schema failed"
    . I removed everything (like pagination, custom parameters) to check that at least a basic API call works, but the error persists. Using v.0.50.5. Restarted the Airbyte, didn’t help. I do see a bunch of 
    Failed to load resource: the server responded with a status of 400 (Bad Request)
    errors in console and have “list” request code 400 in DevTools @Joe Reuter mentioned in other thread. Any Ideas? My yaml attached.
    cloud_talk.yaml
    s
    • 2
    • 2
  • d
    Hey all, is it possible to create an oauth2 custom connector via the UI that will hit the /authorize endpoint before the /token?
    k
    j
    m
    • 4
    • 5
  • w
    I am now getting a "ERROR i.a.w.i.HeartbeatTimeoutChaperone(monitor):148 - Source has stopped heart beating." The overall process takes between 5-7 minutes and I assuming this outside of the heartbeat timeout. Is there anyway to manually send heartbeat messages from a Discover step? I have tried async pausing in the hopes that the heartbeat process could potentially run in pauses but that didnt work (unlikely that it would).
    k
    • 2
    • 2
  • m
    Hello Airbytians - has anyone here had any luck using the Builder to connect to StackAdapt?
    k
    j
    • 3
    • 4
  • d
    Hi team! Do you know if the Aircall Connector is working correctly? I'm only getting 20 rows in the 
    calls
    model, but I have more than 10k calls in my account. I've set the from filter date as 
    2022-10-24T00:00:00.000Z
    .
    k
    v
    • 3
    • 5
  • d
    For Pagination, the API I am trying to connect to starts at 1 instead of 0 and gives 200 rows. next row starts at 201 but airbyte is setting it to 200. Is it possible to tell it to start at 1?
    k
    • 2
    • 3
  • o
    🔥 Community Office Hours starts in 15 minutes 🔥 At 1pm PDT click here to join us on Zoom!
  • a
    When I tested our the connector I was building, I get the following error. 
    WARNING: The requested image's platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested.
    Is there a way to build a Multi-arch build?
    k
    • 2
    • 2
  • n
    how to download tickets from zendesk (pull data of zendesk attachments) through airbyte
    k
    • 2
    • 5
1...1718192021Latest