https://linen.dev logo
#contributing-to-airbyte
Title
# contributing-to-airbyte
d

Davin Chia (Airbyte)

08/31/2021, 1:00 AM
@Jared Rhizor (Airbyte) do we have a timeout for our synchronous temporal jobs?
u

user

08/31/2021, 2:09 AM
varies job to job
u

user

08/31/2021, 2:09 AM
I imagine the server might have tighter limits?
d

Davin Chia (Airbyte)

08/31/2021, 2:10 AM
not positive
u

user

08/31/2021, 2:10 AM
What are you running into?
u

user

08/31/2021, 2:21 AM
user is seeing 40 min timeouts on the discover call
u

user

08/31/2021, 3:34 AM
Hmm
u

user

08/31/2021, 3:34 AM
It would be interesting if we could have him run just the docker command (not from within airbyte)
u

user

08/31/2021, 3:34 AM
the only timeout I can see is 2 hours
d

Davin Chia (Airbyte)

08/31/2021, 3:34 AM
then we could see if it’s happening within the connector vs in the framework
u

user

08/31/2021, 3:34 AM
I really doubt it’s in the framework
u

user

08/31/2021, 3:35 AM
I bet it’s some weird driver thing or maybe some sort of setting on their server?
u

user

08/31/2021, 3:35 AM
you think it's due to the JDBC impl?
u

user

08/31/2021, 3:35 AM
I'm trying to reproduce this now so I can try that
u

user

08/31/2021, 3:35 AM
Looking at the Oracle DB2 driver page though the defaults for JDBC don’t look limited https://www.ibm.com/docs/en/db2/11.1?topic=pdsdjs-common-data-server-driver-jdbc-sqlj-properties-all-database-products
d

Davin Chia (Airbyte)

08/31/2021, 3:36 AM
I’d be really curious if the SQL query we’re making succeeds if he just runs it from a terminal or something
u

user

08/31/2021, 3:37 AM
If he’s willing to help we can isolate. SQL from the terminal would help us determine if it’s his server
u

user

08/31/2021, 3:37 AM
Just the docker run would let us know if it’s in JDBC
u

user

08/31/2021, 3:37 AM
Probably easier than reproducing if he’s willing
u

user

08/31/2021, 3:38 AM
Especially since we don’t have a lead on what to reproduce. I guess we could reproduce a JDBC default problem.
u

user

08/31/2021, 3:38 AM
I was just going to create a bunch of random tables and see if I run into the same issue
u

user

08/31/2021, 3:39 AM
yeah
u

user

08/31/2021, 3:39 AM
hmm good point on running the docker command
d

Davin Chia (Airbyte)

08/31/2021, 3:40 AM
I think if he ran both we’d have a very good chance of finding the issue.
u

user

08/31/2021, 3:40 AM
I have a hunch both will fail and that it’s some server config issue.
u

user

08/31/2021, 3:40 AM
😢
u

user

08/31/2021, 3:43 AM
the docker command is something like
docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-oracle:dev discover --config /secrets/config.json
u

user

08/31/2021, 3:43 AM
source-db2. right?
d

Davin Chia (Airbyte)

08/31/2021, 3:43 AM
not oracle
u

user

08/31/2021, 3:43 AM
but yes.
u

user

08/31/2021, 3:44 AM
I think it's oracle
u

user

08/31/2021, 3:44 AM
he did mention it failing on docker-compose as well, so you could probably ask him to try that and then you could have him run the command from the mounts he’s using
u

user

08/31/2021, 3:44 AM
his screenshot has a db2 worker
u

user

08/31/2021, 3:45 AM
even though he named everything oracle
u

user

08/31/2021, 3:45 AM
db2 is an oracle product 🤷
d

Davin Chia (Airbyte)

08/31/2021, 3:46 AM
huh which screen shot are you referring to?
u

user

08/31/2021, 3:46 AM
ah
u

user

08/31/2021, 3:46 AM
his other copy paste uses source-oracle
u

user

08/31/2021, 3:47 AM
yeah that's why I'm confused 😅
u

user

08/31/2021, 3:49 AM
Yeah it’s probably worth drilling down and figuring out what he’s doing exactly and trying to just cut down the problem space with him.
u

user

08/31/2021, 3:50 AM
I don’t see any obvious candidates in oracle jdbc defaults either https://docs.oracle.com/en/database/oracle/oracle-database/18/jajdb/constant-values.html
d

Davin Chia (Airbyte)

08/31/2021, 3:50 AM
he seems pretty confident it's our less than stellar query haha
u

user

08/31/2021, 3:51 AM
Like I’m sure our query is bad
2 Views