Manish Tomar
03/17/2022, 7:42 AMRobin
03/17/2022, 11:14 AMMikhail Masyagin
03/17/2022, 12:31 PMGoogle Play
connector using HttpStream
class. I need to get app feedbacks by multiple langugages and countries. Should I make new HttpStream
for each pair - language and country or I can make multiple HTTP-request by single HttpStrem
?`Alpana Shukla
03/17/2022, 12:55 PMAlpana Shukla
03/17/2022, 12:57 PMpublic override bool CheckConnection(AirbyteLogger logger, JsonElement config, out Exception exc)
{
_Key = config.GetProperty("Key").GetString();
_UID = config.GetProperty("UID").GetString();
exc = null;
try
{
return
UrlBase.AppendPathSegment($"sensorspot").SetQueryParams(new { uid = _UID, key = _Key }).GetAsync()
.Result.GetJsonAsync().Result.success;
}
catch (Exception e)
{
exc = e;
}
return false;
}
Alpana Shukla
03/17/2022, 12:57 PMAlpana Shukla
03/17/2022, 1:07 PMpublic override bool CheckConnection(AirbyteLogger logger, JsonElement config, out Exception exc)
{
_Key = config.GetProperty("Key").GetString();
_UID = config.GetProperty("UID").GetString();
exc = null;
try
{
//return UrlBase.AppendPathSegment($"sensorspot").SetQueryParam("uid",_UID).SetQueryParam("key",_Key).GetAsync()
// .Result.GetJsonAsync().Result.success;
//return UrlBase.AppendPathSegment("sensorspot")
//.GetAsync()
//.Result.GetJsonAsync().Result.success;
return
UrlBase.AppendPathSegment($"sensorspot").SetQueryParams(new { uid = _UID, key = _Key }).GetAsync()
.Result.GetJsonAsync().Result.success;
}
catch (Exception e)
{
exc = e;
}
return false;
}
Hi I am trying to develop a connector to call an API with parameters with this as code, when I try to create a source it gives "'System.Dynamic.ExpandoObject' does not contain a definition for 'success'" error. If I write UrlBase.AppendPathSegment($"sensorspot?uid=_UID, key = _Key ").GetAsync().Result.GetJsonAsync().Result.success;
then it returns <https://api.abcsfag.com/sensorspot>*%3F*uid=8C289812CFA4&key=RJUL)
as URL replacing ? as %3F .Attaching logs for reference. Any help would be highly appreciated. 🙂Will Watkinson
03/17/2022, 2:14 PMpython -m pytest -s unit_tests
from the venv. I'm running into an error with the generated patch_base_class in all the generated tests:
E fixture 'mocker' not found
> available fixtures: cache, capfd, capfdbinary, caplog, capsys, capsysbinary, doctest_namespace, monkeypatch, patch_base_class, pytestconfig, record_property, record_testsuite_property, record_xml_attribute, recwarn, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory
> use 'pytest --fixtures [testpath]' for help on them.
Any tips to resolve?Will Watkinson
03/17/2022, 2:37 PMshould_retry
method accordingly. Based on the logs should_retry
is evaluating to True
as expected given line 200 of the logs contains the DefaultBackoffException
class, but the default retry behavior of retrying 5 times with exponential backoff does not seem to be kicking in. Has the default behavior changed, or is there something additional I need to do to enable it?Sean Zinsmeister
03/17/2022, 8:16 PMEnrico Tuvera Jr.
03/18/2022, 6:37 AMRamon Vermeulen
03/18/2022, 8:49 AMSet up the source
screen in a k8s airbyte environment on GCP? The exact same image is working if I set the source up on the local docker-compose environment. However if I try to set-up the source with the same image in the cloud environment (kubernetes) I'm getting this error. Can't find any more error messages, except that the kubernetes pod is shutting down almost immediately with exit code 1.William Phillips
03/18/2022, 7:00 PMGiunio De Luca
03/21/2022, 9:23 AMAlpana Shukla
03/21/2022, 9:38 AMManish Tomar
03/21/2022, 9:42 AMManish Tomar
03/21/2022, 9:42 AMManish Tomar
03/21/2022, 9:43 AMManish Tomar
03/21/2022, 9:43 AMMert Karabulut
03/21/2022, 1:08 PMOliver Meyer
03/21/2022, 2:30 PMspec.json
, and use that in the request. Maybe there’s a better way 🤷Narender Kumar
03/21/2022, 2:35 PMColton Pomeroy
03/21/2022, 6:07 PMWill Watkinson
03/21/2022, 7:53 PMEnrico Tuvera Jr.
03/22/2022, 5:11 AMtharaka prabath
03/22/2022, 9:15 AMtharaka prabath
03/22/2022, 9:16 AMtharaka prabath
03/22/2022, 9:18 AMCopy code2022-03-22 09:05:36 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...
tharaka prabath
03/22/2022, 9:20 AMHi Guys getting an error when try to connect Woocommerce connector to kafka
at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
... 3 more
Caused by: java.lang.IllegalStateException
at com.google.common.base.Preconditions.checkState(Preconditions.java:486)
at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:96)
at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:307)
... 4 more
,retryable=<null>,timestamp=1647939936767], io.airbyte.config.FailureReason@79ef25f6[failureOrigin=destination,failureType=<null>,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@6965f824[additionalProperties={attemptNumber=2, jobId=19}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:354)
at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
... 3 more
,retryable=<null>,timestamp=1647939930470]]]
2022-03-22 090536 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...tharaka prabath
03/22/2022, 9:26 AMHi Guys getting an error when try to connect Woocommerce connector to kafka