My connection is not showing Incremental Refresh sync mode

@kapa.ai Gostaria de ter acesso aos dados de telemetria do airbyte. Gostaria de montar gráficos de desempenhos e monitoramento da plataforma, assim como pode ser feito no Datadog. Porém quero fazer fora do Datadog, em um ambiente independente, meu. Como posso ter acesso a esses dados?

@kapa.ai how can i build my custom source connector in my private erpository without having to use airbyte-ci inside the airbyte repo

@kapa.ai What would the Field Path be for this output (i'm using connection builder)

{
  "status": 200,
  "body": {
    "hasMore": true,
    "continueFrom": "XXXXXXXXXXXXXXXXXXXXADnyWno",
    "data": [
      {
        "id": 15002342348968,
        "jobId": 1500223423423419,
        "reasonId": 56423423439,
        "memo": "Job for template",
        "createdOn": "2016-05-04T15:03:20.6653821Z",
        "createdById": 1,
        "active": true
      },
      {
        "id": 150119234493,
        "jobId": 15011234989,
        "reasonId": 52346439,
        "memo": "dup",
        "createdOn": "2016-05-05T05:23:40.1511625Z",
        "createdById": 1,
        "active": true
      },

@kapa.ai Using connection builder, is there a way to use a variable/value in an endpoint and have the connector iterate through a list of values? Also I would want the streams to be named differently for each value Here is an example: jpm/v2/tenant/1111111/export/job-canceled-logs The tenant number (example in this case is 11111111 ... i have 10 tenants i want to cycle through

Do we have the option to deploy airbyte on ECS?

airbyte oss whats the list operation api for connection id

@kapa.ai on the Low-code CDK yaml spec portion of connection_specification how do i add a default value to the spec that can be overridden

requester: url_base: "https://api-stage.bill.com/api/v2" http_method: "POST" authenticator: $ref: "#/definitions/session_token_authenticator" request_body_data: #made this requestbodydata instead of request body json devKey: "{{ config['devKey'] }}" data: '{"start":{{ next_page_token.next_page_token|default(0) }}, "max":999, "sort":[{"asc":"true","field":"createdTime"}]}' how can i change the next_page_token.next_page_token thing for every request (for pagination - it needs to be increased by 999 every request until there are no more records to be returned)

Hello, how are you? I can't synchronize the airbyte connections via API. I get this error : requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: http://pierslt009.pierreval.com:8000/api/v1/connections/sync and this <p>Sorry, the page you are looking for is currently unavailable.<br/> Please try again later.</p> <p>If you are the system administrator of this resource then you should check the error log for details.</p> <p><em>Faithfully yours, nginx.</em></p> Help, how can I resolve this.

@kapa.ai @kapa.ai these are my spec

spec:
  type: Spec
  connection_specification:
    type: object
    $schema: <http://json-schema.org/draft-07/schema#>
    required:
      - instance_api_url
    additionalProperties: true
    properties:
      instance_api_url:
        type: string
        title: Metabase Instance API URL
        description: URL to your metabase instance API
        examples:
          - <https://localhost:3000/api/>
        pattern: ^https://
        order: 0
      credentials:
        order: 1
        title: Authentication Mechanism
        description: Choose how to authenticate to Metabase API
        type: object
        oneOf:
          - type: object
            title: Authenticate via API Key
            required:
              - auth_type
              - api_key
            additionalProperties: true
            properties:
              auth_type:
                type: string
                const: api_key
                order: 0
              api_key:
                title: API Key
                type: string
                description: The generated API Key for Metabase API
                airbyte_secret: true
          - type: object
            title: Authenticate via User Session token
            required:
              - auth_type
              - username
              - password
            additionalProperties: true
            properties:
              auth_type:
                type: string
                const: session_token
                order: 1
              username:
                type: string
                title: Username
              password:
                type: string
                title: Password
                airbyte_secret: true
              # session_token:
              #   type: string
              #   description: >-
              #     To generate your session token, you need to run the following command:

#

curl -X POST \
              #       -H "Content-Type: application/json" \
              #       -d '{"username": "<mailto:person@metabase.com|person@metabase.com>", "password": "fakepassword"}' \
              #       <http://localhost:3000/api/session>
              #     
Then copy the value of the `id` field returned by a successful
              #     call to that API.

              #     Note that by default, sessions are good for 14 days and needs to be
              #     regenerated.
              #   airbyte_secret: true
              expiration_duration:
                type: string
                description: >-
                  The duration in ISO 8601 duration notation after which the
                  session token expires, starting from the time it was obtained.
                  Omitting it will result in the session token being refreshed
                  for every request. By ddefault Metabase tokens expire after
                  14 days. If you are hosting your own Metabase instance, you
                  can configure this session duration on your Metabase server
                  by setting the environment variable MAX_SESSION_AGE (value 
                  is in minutes).
                default: P14D

base_requester:
    type: HttpRequester
    url_base: "{{ config['instance_api_url'] }}"
    http_method: "GET"
    authenticator:
      type: SelectiveAuthenticator
      authenticator_selection_path:
        - "auth_type"
        - "credentials"
      authenticators:
        api_key: 
          type: ApiKeyAuthenticator
          header: "X-API-KEY"
          api_key: "{{ config['credentials']['api_key'] }}"        
        session_token:
        #   type: "LegacySessionTokenAuthenticator"
        #   username: "{{ config['credentials']['username'] }}"
        #   password: "{{ config['credentials']['password'] }}"
        #   header: "X-Metabase-Session"
        #   session_token: "{{ config['credentials']['session_token'] }}"
        #   session_token_response_key: "id"
        #   login_url: "session"
        #   validate_session_url: "user/current"
        #   $parameters:
        #     url_base: "{{ config['instance_api_url'] }}"
          type: SessionTokenAuthenticator
          login_requester:
            type: HttpRequester
            url_base: "{{ config['instance_api_url'] }}"
            http_method: POST
            path: session
            authenticator:
              type: BasicHttpAuthenticator
              username: "{{ config['credentials']['username'] }}"
              password: "{{ config['credentials']['password'] }}"
            request_headers: {}
            request_body_json: {}
            request_parameters: {}
          session_token_path:
            - id
          expiration_duration: "{{ config['credentials']['expiration_duration'] }}"
          request_authentication:
            type: ApiKey
            inject_into:
              type: RequestOption
              field_name: "X-Metabase-Session"
              inject_into: header

i'm getting this error

TypeError: ModelToComponentFactory.create_session_token_authenticator() missing 2 required positional arguments: 'name' and 'decoder'\n"

This message was deleted.

@kapa.ai where to find the user name in abctl deployment

@kapa.ai i am trying to create source i am getting this error

SDKError: API error occurred: Status 401
{"code":401,"message":"Jwt is missing"}

I am uisng basic auth using email and password my airbyte is deployed on azure vm

@kapa.ai how to handle

enums

when creating schemas for connectors?

@kapa.ai Hi. I'm using Airbyte to sync data from sources to Clickhouse (2 replicas). How to set default engine when Airbyte creates tables to ReplicatedMergeTree engine instead of MergeTree ? MergeTree can't utilize parallel replicas.

@kapa.ai supported streams for recruitee connection

• @kapa.ai how can I find

definitionId

for docker-based custom connector? doc says "The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided."

@kapa.ai one schema in connector always says

Queued for next sync

and does not start syncing even when i manually trigger sync

@kapa.ai I am trying to use amazon ads source, but getting empty product and other reports with airbyte. Am I missing some configurations here?

@kapa.ai I want my streams to already fail after two attempts not five. How can I reduce the max retries before failing?

@kapa.ai how should I debug a connection that sometimes hangs but has no errors in the logs?

I'm trying to sync one table from a source. The CDC should be activated but I have this specific error : java.lang.RuntimeException: java.lang.RuntimeException: java.nio.file.NoSuchFileException: /tmp/cdc-db-history15270185180138581438/dbhistory.dat. Any idea ?

@kapa.ai airbyte-bootloader service "bootloader" didn't complete successfully: exit 255

@kapa.ai what causes this issue Storage backend has reached its minimum free drive threshold.

This message was deleted.

Hi, i'm building a custom connector for inspectlet API, which Pagination Method is suitable (offset,incremental,cursor pagination)?

I am using terraform for deploying airbyte. My code is: terraform { required_providers { airbyte = { source = "airbytehq/airbyte" version = "0.6.1" } } } provider "airbyte" { // If running locally (Airbyte OSS) with docker-compose using the airbyte-proxy, // include the actual password/username you've set up (or use the defaults below) password = var.password username = var.username // if running locally (Airbyte OSS), include the server url to the airbyte-api-server server_url = "http://localhost:8001/api/public/v1/" // (and UI is at http://airbyte.company.com:8000) // server_url = var.server_url } resource "airbyte_source_jira" "source_jira" { configuration = { api_token = var.jira_api_token domain = var.jira_domain email = var.jira_email } name = "Jira from Terraform" workspace_id = var.workspace_id } I am getting Could not resolve placeholder ${AIRBYTE_API_HOST}" error. How can i solve this issue?

getting error:

Workload failed, source: workload-launcher

Hello @kapa.ai, does airbyte gives ER diagram of data streams provided by the shopify platform?