https://linen.dev logo
Join Slack
Powered by
# ask-community-for-troubleshooting
  • l

    Lenin Mishra

    06/22/2023, 7:06 AM
    Hey I am trying to implement Zoho Books using Python CDK. This is the base class
    Copy code
    class ZohoBooksStream(HttpStream, ABC):
        
        url_base = '<https://www.zohoapis.in/books/v3/>'
    
        def next_page_token(self, response: requests.Response) -> Optional[Mapping[str, Any]]:
            
            return None
        
        def request_params(
            self, stream_state: Mapping[str, Any], stream_slice: Mapping[str, any] = None, next_page_token: Mapping[str, Any] = None
        ) -> MutableMapping[str, Any]:
            =
            return {"organization_id":{self.config['organization_id']}}
    
        def parse_response(self, response: requests.Response, **kwargs) -> Iterable[Mapping]:
                    
            return [response.json()]
    However my url_base needs to change based on the location of client. If the client's account id from US, it should be `
    Copy code
    url_base = '<https://www.zohoapis.com/books/v3/>'
    I have a key in my config called
    location
    . How can I use it here?
    k
    • 2
    • 2
  • l

    Lenin Mishra

    06/22/2023, 8:43 AM
    Every time I try to load my Docker container to Airbyte, I get this error. Worse part is, there is no other log available. How do I know what the error is?
    e
    • 2
    • 3
  • t

    Thiago Villani

    06/22/2023, 11:30 AM
    Hello, I have a source connection to sql server and destination to postgresql and Minio. I have the CDC active in the sql server, the sync was working with the changes made in the sql server, after a few days, the sync returns 0 Bytes, nothing of data was replicated. What can I do to fix?
    k
    • 2
    • 2
  • a

    Aman Kesharwani

    06/22/2023, 11:50 AM
    Hello Team With the latest version of airbyte 0.50.1 and above I am trying to create a connection between mysql and redshift but I see transformation not supported for the connection in the previous versions the transformation option was supported for Redshift destination…Has something changed or it is a bug
    k
    • 2
    • 2
  • o

    Octavia Squidington III

    06/22/2023, 1:45 PM
    🔥 Office Hours starts in 15 minutes 🔥 Topic and schedule posted in #C045VK5AF54 octavia loves At 16:00 CEST / 10am EDT click here to join us on Zoom octavia loves
  • s

    Slackbot

    06/22/2023, 2:28 PM
    This message was deleted.
    k
    • 2
    • 2
  • k

    Kevin Conseil

    06/22/2023, 3:08 PM
    Hola Everyone, Source: Google Sheet Destination: Snowflake Replication: 2 tabs are synched Synch: All tabs are synching properly Issue: 1 tab (Margin_Uplift) is actually pushing the data to Snowflake but the other one (Einkaufskosten_MASTER) are only creating the Airbyte_raw tables (JSON) with no data in it Any idea what could prevent Airbyte to push the data to Snowflake?
    k
    • 2
    • 27
  • c

    Charlotte Deurvorst

    06/22/2023, 3:10 PM
    Hi! I'm trying to run airbyte locally and I'm trying to setup a connection between Snapchat and BQ. I use standard inserts, all checks pass but I get this error when syncing:
    Copy code
    Unhandled error while executing model.airbyte_utils.organizations
    Pickling client objects is explicitly not supported.
    Clients have non-trivial state that is local and unpickleable.
    25 of 56 ERROR creating table model airbyte_ingestion_test.organizations................................................ [ERROR in 1.09s]
    Anyone who knows how to fix this? (edited)
    k
    • 2
    • 2
  • j

    Jeremy Plummer

    06/22/2023, 5:00 PM
    Hi! Can anyone help explain the expected behavior of the Salesforce Source when using
    Incremental - Deduped History
    , and what they view as the most stable version? My understanding is that: 1.
    Deduped Table
    -> should have the most up-to-date record for each
    primary key
    2.
    History (scd) Table
    -> should have unique records based on
    primary key
    and
    cursor
    , although I've noticed in most versions the Salesforce tables appear to capture duplicate records within the history table, where a
    primary key
    may have multiple records with the same
    cursor
    . I've seen this mentioned in Github Issues but can't tell if this was supposed to be resolved yet. I also understand that any Salesforce Source after v2.0.5 appears to be experiencing the issue where 20-30% of records are missed.
    k
    • 2
    • 11
  • b

    Brian Nelson

    06/22/2023, 5:38 PM
    Anyone here working with the Smartsheets connector? It used to normalize the data just fine, but after upgrading Airbyte and the connector, I started to get some interesting errors (and the log mentioned skipping connector normalization). Now that I've rebuilt the connection, I don't see any option for normalization - am I missing something or did that perhaps go away?
    k
    • 2
    • 3
  • t

    Thiago Villani

    06/22/2023, 5:42 PM
    Hello, I am getting this error, sql server source connection with CDC. Connector configuration is not valid. User airbyte does not have access to CDC schema in the following databases: sapiens. This user can only be used in initial_only snapshot mode.
    k
    • 2
    • 2
  • d

    Dima Gershtein

    06/22/2023, 6:12 PM
    Hi Airbyte team 👋
    k
    • 2
    • 2
  • d

    Dima Gershtein

    06/22/2023, 6:16 PM
    Love the builder so far! But, have problem using a URL that has a semicolon in it. like
    <https://people.googleapis.com/v1/people:listDirectoryPeople>
    . Tried to replace it with a url-encoded value, didn’t help. Any ideas what I should try?
    k
    • 2
    • 2
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/22/2023, 6:49 PM
    Hi im trying to connect to postgresql as destination, but im getting this error. Configuration check failed State code: 08001; Message: Connection to localhost:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
    k
    s
    • 3
    • 4
  • k

    KRITIN MADHAVAN D 20BCE1536

    06/22/2023, 6:57 PM
    Im still facing the same issue, if anyone could help me out
    k
    • 2
    • 2
  • m

    Madison Mae

    06/22/2023, 9:22 PM
    Hi team, I'm ingesting Hubspot companies into our warehouse and notice MadKudu generated fields are not being ingested. Does Airbyte not support these fields? All the others are added.
    k
    • 2
    • 2
  • j

    Jason Pedely

    06/22/2023, 9:59 PM
    Hi, I'm attempting to use the Youtube prebuilt connector to get some data via their API to an S3 bucket. I'm having some errors. Any knowledge articles or help would be appreciated. Errors:
    Copy code
    Internal message: 400 Client Error: Bad Request for url: <https://oauth2.googleapis.com/token>
    Failure origin: source
    Failure type: system_error
    k
    • 2
    • 2
  • s

    Sivakumar Ramaswamy

    06/22/2023, 11:27 PM
    Hi Team, I am facing java casting issue in metric reporter however, there is no document on how to rebuild the report-metrics. any pointer would be appreciated.
    Copy code
    2023-06-22 23:21:05 ERROR i.a.m.r.Emitter(emit):221 - Exception querying database for metric:
    java.lang.ClassCastException: class java.math.BigDecimal cannot be cast to class java.lang.Double (java.math.BigDecimal and java.lang.Double are in module java.base of loader 'bootstrap')
    	at java.util.LinkedHashMap.forEach(LinkedHashMap.java:729) ~[?:?]
    	at io.airbyte.metrics.reporter.OldestRunningJob.lambda$new$1(Emitter.java:71) ~[io.airbyte.airbyte-metrics-reporter-0.50.4.jar:?]
    	at io.airbyte.metrics.reporter.Emitter.emit(Emitter.java:218) ~[io.airbyte.airbyte-metrics-reporter-0.50.4.jar:?]
    	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:577) ~[?:?]
    	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:358) ~[?:?]
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
    k
    a
    • 3
    • 5
  • a

    archna singh

    06/23/2023, 7:26 AM
    want to add my ssl certificate in gitlab source of airbyte so that i can make connection, is there any solution to do it.? for now i am getting error
  • r

    Rishabh D

    06/23/2023, 8:14 AM
    Hi team, We had created a Salesforce source a while back and the user whose credentials we were using is deactivated. I cannot authenticate my account with Airbyte using the new username and password as the option is not available on the Airbyte UI(OSS).
    1. Click Authenticate your account to authorize your Salesforce account. Airbyte will authenticate the Salesforce account you are already logged in to. Make sure you are logged into the right account.
    k
    j
    • 3
    • 4
  • r

    Rohit Dhingra

    06/23/2023, 12:29 PM
    Hi Team, We are unable to get slack notification on newer airbyte version :0.50.4. However, its working on the older version 0.44.12. Error Details: 2023-06-23 122555 WARN i.a.p.j.JobNotifier(sendNotification):238 - Failed to successfully notify: io.airbyte.config.NotificationItem@6ebc82c5[notificationType=[slack],slackConfiguration=io.airbyte.config.SlackNotificationConfiguration@6569883e[webhook=https://hooks.slack.com/services/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,additionalProperties={}],customerioConfiguration=<null>,additionalProperties={}] Could you please help us in the same. Attached is the screenshot of the job executed on Air byte v0.50.4. Regards, Rohit Dhingra
    d
    • 2
    • 1
  • d

    Daniil Stepenskiy

    06/23/2023, 2:51 PM
    Hey all, I am an airbyte cloud user. I've got a bunch of slack notifications today, about successes of all my connections I checked the notification configuration, and it was like on the attached image: unchecked success notifications and checked failure notifications What I also realized is that I am not getting any failure notifications with this config. It looks like the checkboxes started working the wrong way at some point (notify when checkbox turned of and not notify when it is turned on)
    • 1
    • 1
  • v

    Victor C

    06/23/2023, 4:37 PM
    Hello all, I'm using the square connector on a self hosted version (GCP compute engine). I'm trying it out to see if I can replace my custom integration. The UI says the the connector runs fine, but the number of order records retrieved is much lower than what I have through my connector. Is there a history of issues that were raised for this connector so I can check if somebody had the same problems ?
    k
    • 2
    • 2
  • m

    Marwane Chahoud

    06/23/2023, 4:46 PM
    Hello, I deployed airbyte locally on WSL2, I tried to create a new source using API as follow:
    Copy code
    curl -X POST -u airbyte:password -H "Content-Type: application/json" -d '{
      "sourceDefinitionId": "decd338e-5647-4c0b-adf4-da0e75f5a750",
      "name": "my-postgres-src",
      "workspaceId": "b40b53c9-f197-4e3e-a8a5-05d42c6d5c72",
      "connectionConfiguration": {
        "username": "postgres",
        "password": "user",
        "host": "127.0.0.1",
        "port": 5432,
        "database": "my_src_database"
      }
    }' <http://localhost:8000/api/v1/source/create>
    I have a postgres database running on WSL2:
    Copy code
    > netstat -nlp | grep 5432
    tcp        0      0 127.0.0.1:5432          0.0.0.0:*               LISTEN      10069/postgres
    unix  2      [ ACC ]     STREAM     LISTENING     46204    10069/postgres       /var/run/postgresql/.s.PGSQL.5432
    but doing the curl command return Object not found, what's causing the error? Also I used the list workspace api
    curl -X POST -u airbyte:password -H "Content-Type: application/json" -d '{}' <http://localhost:8000/api/v1/workspaces/list>
    and it worked just fine, anyone got an idea please?
    k
    • 2
    • 2
  • l

    Leonardo Tomasi Francis

    06/23/2023, 5:35 PM
    Hello, I am trying to upgrade the to the last version (0.4.3) on Facebook Marketing, but keeps getting an error.
  • t

    Thiago Villani

    06/23/2023, 5:46 PM
    Hello, the connection is mssqlserver origin, CDC configured according to documentation, when running the sync for the second time, it does not replicate the changes, it shows 0 Byte, but there was a change in the origin. table type is like incremental - append on airbyte connection. Any tips on what to do to fix it.
    k
    • 2
    • 2
  • o

    Octavia Squidington III

    06/23/2023, 7:45 PM
    🔥 Community Office Hours starts in 15 minutes 🔥 At 1pm PDT click here to join us on Zoom!
  • j

    John Olinger

    06/23/2023, 7:50 PM
    Still getting Google Directory to mysql Failure Origin: normalization, Message: Something went wrong during normalization The same as in this post. Desperately looking for assistance. I've updated the Google Directory connector to the latest and Airbyte to 0.50.4. Same behavior. mysql is a new and fresh install of 8.0.33-0 ubuntu 0.20.04.2
    k
    • 2
    • 3
  • b

    Bob Blandford

    06/24/2023, 10:59 PM
    The CSV documentation page doesnt seem to work? Is there a new one? https://docs.airbyte.com/integrations/destinations/local-csv/
    k
    • 2
    • 2
  • b

    Bob Blandford

    06/24/2023, 11:40 PM
    can anyone help me with loading a Peoplesoft schema issue?
    k
    • 2
    • 2
1...205206207...245Latest