https://linen.dev logo
Join Slack
Powered by
how to user encode and hashlib.sha512 in param hea...
# help-connector-development
c
how to user encode and hashlib.sha512 in param header on AirByte Builder? (edited)
k
A message from kapa.ai
Hmm, I don't know enough to give you a confident answer yet. However, you can refer to the Airbyte documentation on [configuring request parameters and headers](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/requester) for more information on setting request parameters and headers in Airbyte Builder.
c
how to create access hash_hmac sha512 in Builder?
j
You can't do sha512 hashing using the low code CDK; this is a place where you should switch to the Python CDK that makes this kind of thing much easier: https://docs.airbyte.com/connector-development/cdk-python/
c
By the way, i have already setup parameters for the transformations but in the settings of the connection, it is blank. How can I fix this?
IMG_0178.jpg,IMG_0179.jpg
j
Did you set up the streams as incremental in the connection?
c
yes i did
j
And just to make sure, you did run the connection after setting the sync mode to incremental?
I just tested this with the tutorial example and it records the state correctly, so it's not a general issue.
Could you share your full manifest?
Also, just to make sure here again - did it sync any records for that stream?
c
Do you mean I share the YAML file for you to test?
j
yeah, exactly (the one from the "Export YAML" button in the bottom left)
c
I'm resetting my connection to Pipedrive for some personal reasons. Can you help me see?
pipedrive(1).yaml
j
The manifest looks good from what I can tell (the schema should be edited because it looks like there are ids in there but that's a separate topic)
Can you confirm it did actually sync some records for the incremental streams?
c
Can you help me edit the yaml file?
j
Please trigger a sync for the incremental stream, verify that it's actually syncing records and then check the state again
c
please help me make an example
j
What part is unclear to you?
c
I don't understand how to setup according to what you mean by saying this "Please trigger a sync for the incremental stream, verify that it's actually syncing records and then check the state again" 😞
j
You configured the connection, now you need to actually "run" it
that's what I mean by triggering a sync
😄 1
Screenshot 2023-06-20 at 12.20.46.png
Then after this, make sure the expected activity records are actually loaded into the destination as expected
The connection state you screenshotted above (https://airbytehq-team.slack.com/archives/C027KKE4BCZ/p1687253742569939?thread_ts=1687251449.220619&cid=C027KKE4BCZ) is only set if the sync is running successfully and is actually syncing records
c
I'm noticing that fails :(
j
Please verify it actually synced any records for the activity stream
c
how to "verify it actually synced any records for the activity stream"? 😞 I see data on BigQuery that has an information field
j
That's the schema, are there actually any rows in this table?
c
image.png
I see a row
j
That looks all correct, I'm not sure what's the issue. What version of Airbyte are you running?
c
i am using version 0.50.4
j
Thanks, I think I found the problem - looks like there is a bug with recording the incremental state when copying the field like this.
Let me create an issue for this
c
Oh :D Hope you fix this bug soon 😄 thanks
j
Thanks for sticking with me explaining your issue. I will bring it up with the team later today. You can follow along here: https://github.com/airbytehq/airbyte/issues/27494
💯 1
3 Views
Open in Slack
PreviousNext
Powered by