Artem Astapenko
03/02/2021, 9:37 PMArtem Astapenko
03/02/2021, 11:51 PM> Task :airbyte-scheduler:test
2021-03-02T21:53:49.3711488Z
2021-03-02T21:53:49.3713432Z DefaultSchedulerJobClientTest > testCreateResetConnectionJob() FAILED
2021-03-02T21:53:49.3715154Z org.opentest4j.AssertionFailedError: expected: <Mock for Job, hashCode: 566626087> but was: <null>
2021-03-02T21:53:49.3716825Z at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)
2021-03-02T21:53:49.3718640Z at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:195)
2021-03-02T21:53:49.3720571Z at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:184)
2021-03-02T21:53:49.3722536Z at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:179)
2021-03-02T21:53:49.3724452Z at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1124)
2021-03-02T21:53:49.3745430Z at io.airbyte.scheduler.client.DefaultSchedulerJobClientTest.testCreateResetConnectionJob(DefaultSchedulerJobClientTest.java:139)
2021-03-02T21:53:49.3747991Z
in master?Davin Chia (Airbyte)
throw new IOException(String.format("Imported VERSION (%s) is incompatible with current Airbyte version (%s).\n" +
"Please Upgrade your Airbyte Archive, see more at <https://docs.airbyte.io/tutorials/tutorials/upgrading-airbyte>\n",
importVersion, version));
actually link to <https://docs.airbyte.io/tutorials/upgrading-airbyte>
(1 tutorial instead of 2)?Emil J
03/03/2021, 3:32 PMclient.py
?Davin Chia (Airbyte)
localhost:8001/api/v1/logs/get
. Anyone else seeing this?Samuel Gordalina
03/04/2021, 10:20 PMdocker-compose up
3. went to the airbyte interface and configured a source/destination, its working as expected
4. i stopped the server docker-compose down server
5. and when i bring the server up with ./gradlew :airbyte-server:run
i have this error: https://gist.github.com/gordalina/480ee8cb9ceb942e318643dd800d3b00Samuel Gordalina
03/04/2021, 10:21 PMMichel
Samuel Gordalina
03/04/2021, 11:03 PMio.airbyte.api.model.*
are defined in airybyte-api/src/main/openapi/config.yaml
right?Samuel Gordalina
03/05/2021, 7:54 AMairbyte-server
?Hudson
03/05/2021, 4:50 PMSamuel Gordalina
03/05/2021, 9:07 PMSamuel Gordalina
03/06/2021, 4:12 AM./gradlew :airbyte-integrations:connectors:source-file:installLocalReqs
fails for me: https://gist.github.com/gordalina/39915a946816fb6b4456fe77197d8c8b
it says it can't find the arrow moduleSamuel Gordalina
03/06/2021, 9:49 PM./gradlew :airbyte-migration:run --target-version=0.17.0
Juan David
03/07/2021, 1:56 PMssh -i $SSH_KEY -L 8000:localhost:8000 -L 8001:localhost:8001 -N -f ec2-user@$INSTANCE_IP
but im getting this error
ssh: Could not resolve hostname 8000:localhost:8000: Name or service not known
Can anybody help me ?Juan David
03/07/2021, 6:48 PMDavin Chia (Airbyte)
var
keyword in java? I’ve appreciated it more often than not when reading Java code. Charles seems fine. Curious to hear people’s thoughts before introducing it into the codebase.
• same question about final
. I see it being used pretty judiciously throughout but not applied entirely. is the expectation to use final as much as possible?
• can I confirm we line wrap at 150? (will update the docs)Jared Rhizor (Airbyte)
Davin Chia (Airbyte)
AirbyteConnectionStatus
will get us most of the way there in terms of user errors (don’t expect authentication/networking information to change often, is that a wrong assumption?) The alternative is amending the other protocol methods to allow them to also pass more detailed errors; obviously a bigger change.Davin Chia (Airbyte)
airbyte-db | initdb: error: could not create directory "/var/lib/postgresql/data/pg_wal": No space left on device
airbyte-db | initdb: removing contents of data directory "/var/lib/postgresql/data"
left me scratching my head for half an hour today. Hitting Clean Up
in the Docker for Mac UI solved it!
edit: Jared proposes the following Docker configuration:
4 cores, 4gb RAM, 1gb swap, 60gb of disk space
Chris (deprecated profile)
airbyte-migration/src/main/resources/migrations/migrationV0_14_3/airbyte_config/AirbyteProtocolAbbreviated.yaml
?
(@charles maybe?)Jake Hawkesworth
03/17/2021, 7:45 PM# In your ssh session on the instance terminal
mkdir airbyte && cd airbyte
wget <https://raw.githubusercontent.com/airbytehq/airbyte/master/{.env,docker-compose.yaml}>
docker-compose up -d
Here's the error:
user:~/airbyte$ docker-compose up -d
ERROR: Couldn't connect to Docker daemon at <http+docker://localhost> - is it running?
If it's at a non-standard location, specify the URL with the DOCKER_HOST environment variable.
Any ideas?Coque Jardón
03/18/2021, 1:05 PMChris (deprecated profile)
Davin Chia (Airbyte)
experimental
folder for us to check in more hacky scripts/tools that aren’t part of the ‘main’ build? this folder is ‘special’ in that 1) the code doesn’t need to be reviewed to be checked in 2) it doesn’t need to be high quality, and tends to be more operational stuff that we might reuse down the line e.g. I recently wrote a simple script quickly insert a bunch of rows into a 5 column table as part of the Redshift work. A Dev could compose more ‘standard’ calls from our common libs or they could use something like this and save 10 - 20 mins of time.Chris (deprecated profile)
charles
Micah
03/21/2021, 12:39 AMMurilo Nigris
03/21/2021, 3:52 PMChris (deprecated profile)
base-normalization
module would be failing to build from a .venv
from scratch since 10 days ago… You would see errors about PyICU failing to be installed by pip.
(This also happens in the CI but it somehow manages to fallback to an older version where it doesn’t happen)
This is caused by a dependency of DBT that was upgraded in a sketchy way.
So DBT also issued a patch in “dbt-19.1” and “18.2rc1" to address this by pinning the dependency to an older version:
https://github.com/fishtown-analytics/dbt/pull/3161