Lenin Mishra
06/22/2023, 7:06 AMclass ZohoBooksStream(HttpStream, ABC):
url_base = '<https://www.zohoapis.in/books/v3/>'
def next_page_token(self, response: requests.Response) -> Optional[Mapping[str, Any]]:
return None
def request_params(
self, stream_state: Mapping[str, Any], stream_slice: Mapping[str, any] = None, next_page_token: Mapping[str, Any] = None
) -> MutableMapping[str, Any]:
=
return {"organization_id":{self.config['organization_id']}}
def parse_response(self, response: requests.Response, **kwargs) -> Iterable[Mapping]:
return [response.json()]
However my url_base needs to change based on the location of client. If the client's account id from US, it should be `
url_base = '<https://www.zohoapis.com/books/v3/>'
I have a key in my config called location
. How can I use it here?Lenin Mishra
06/22/2023, 8:43 AMThiago Villani
06/22/2023, 11:30 AMAman Kesharwani
06/22/2023, 11:50 AMOctavia Squidington III
06/22/2023, 1:45 PMSlackbot
06/22/2023, 2:28 PMKevin Conseil
06/22/2023, 3:08 PMCharlotte Deurvorst
06/22/2023, 3:10 PMUnhandled error while executing model.airbyte_utils.organizations
Pickling client objects is explicitly not supported.
Clients have non-trivial state that is local and unpickleable.
25 of 56 ERROR creating table model airbyte_ingestion_test.organizations................................................ [ERROR in 1.09s]
Anyone who knows how to fix this? (edited)Jeremy Plummer
06/22/2023, 5:00 PMIncremental - Deduped History
, and what they view as the most stable version? My understanding is that:
1. Deduped Table
-> should have the most up-to-date record for each primary key
2. History (scd) Table
-> should have unique records based on primary key
and cursor
, although I've noticed in most versions the Salesforce tables appear to capture duplicate records within the history table, where a primary key
may have multiple records with the same cursor
. I've seen this mentioned in Github Issues but can't tell if this was supposed to be resolved yet.
I also understand that any Salesforce Source after v2.0.5 appears to be experiencing the issue where 20-30% of records are missed.Brian Nelson
06/22/2023, 5:38 PMThiago Villani
06/22/2023, 5:42 PMDima Gershtein
06/22/2023, 6:12 PMDima Gershtein
06/22/2023, 6:16 PM<https://people.googleapis.com/v1/people:listDirectoryPeople>
.
Tried to replace it with a url-encoded value, didn’t help. Any ideas what I should try?KRITIN MADHAVAN D 20BCE1536
06/22/2023, 6:49 PMKRITIN MADHAVAN D 20BCE1536
06/22/2023, 6:57 PMMadison Mae
06/22/2023, 9:22 PMJason Pedely
06/22/2023, 9:59 PMInternal message: 400 Client Error: Bad Request for url: <https://oauth2.googleapis.com/token>
Failure origin: source
Failure type: system_error
Sivakumar Ramaswamy
06/22/2023, 11:27 PM2023-06-22 23:21:05 ERROR i.a.m.r.Emitter(emit):221 - Exception querying database for metric:
java.lang.ClassCastException: class java.math.BigDecimal cannot be cast to class java.lang.Double (java.math.BigDecimal and java.lang.Double are in module java.base of loader 'bootstrap')
at java.util.LinkedHashMap.forEach(LinkedHashMap.java:729) ~[?:?]
at io.airbyte.metrics.reporter.OldestRunningJob.lambda$new$1(Emitter.java:71) ~[io.airbyte.airbyte-metrics-reporter-0.50.4.jar:?]
at io.airbyte.metrics.reporter.Emitter.emit(Emitter.java:218) ~[io.airbyte.airbyte-metrics-reporter-0.50.4.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:577) ~[?:?]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:358) ~[?:?]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
archna singh
06/23/2023, 7:26 AMRishabh D
06/23/2023, 8:14 AM1. Click Authenticate your account to authorize your Salesforce account. Airbyte will authenticate the Salesforce account you are already logged in to. Make sure you are logged into the right account.
Rohit Dhingra
06/23/2023, 12:29 PMDaniil Stepenskiy
06/23/2023, 2:51 PMVictor C
06/23/2023, 4:37 PMMarwane Chahoud
06/23/2023, 4:46 PMcurl -X POST -u airbyte:password -H "Content-Type: application/json" -d '{
"sourceDefinitionId": "decd338e-5647-4c0b-adf4-da0e75f5a750",
"name": "my-postgres-src",
"workspaceId": "b40b53c9-f197-4e3e-a8a5-05d42c6d5c72",
"connectionConfiguration": {
"username": "postgres",
"password": "user",
"host": "127.0.0.1",
"port": 5432,
"database": "my_src_database"
}
}' <http://localhost:8000/api/v1/source/create>
I have a postgres database running on WSL2:
> netstat -nlp | grep 5432
tcp 0 0 127.0.0.1:5432 0.0.0.0:* LISTEN 10069/postgres
unix 2 [ ACC ] STREAM LISTENING 46204 10069/postgres /var/run/postgresql/.s.PGSQL.5432
but doing the curl command return Object not found, what's causing the error? Also I used the list workspace api curl -X POST -u airbyte:password -H "Content-Type: application/json" -d '{}' <http://localhost:8000/api/v1/workspaces/list>
and it worked just fine, anyone got an idea please?Leonardo Tomasi Francis
06/23/2023, 5:35 PMThiago Villani
06/23/2023, 5:46 PMOctavia Squidington III
06/23/2023, 7:45 PMJohn Olinger
06/23/2023, 7:50 PMBob Blandford
06/24/2023, 10:59 PMBob Blandford
06/24/2023, 11:40 PM