Hi,
I am developing a custom connector (generic Py...
# help-connector-developmente
Enrico D'Urso
06/27/2023, 9:50 AMHi,
I am developing a custom connector (generic Python, extending SOURCE class ), I am also emitting a state like this:
yield AirbyteMessage(type=Type.STATE,state=AirbyteStateMessage(data={stream.name: {"date": max_date}}))k
kapa.ai
06/27/2023, 9:50 AMA message from kapa.ai
kapa.ai
06/27/2023, 9:50 AMNew message text here
j
Joe Reuter (Airbyte)
06/27/2023, 10:25 AMdataJoe Reuter (Airbyte)
06/27/2023, 10:25 AMCheck out the
streame
Enrico D'Urso
06/27/2023, 10:26 AMHey, do you have any example?
Enrico D'Urso
06/27/2023, 10:26 AMI am struggling to find the definition of AirbyteStateMessage in Python
j
Joe Reuter (Airbyte)
06/27/2023, 10:36 AMIt's a regular python class
Joe Reuter (Airbyte)
06/27/2023, 10:37 AMThe code is auto-generated from the JSON schema here: https://github.com/airbytehq/airbyte-protocol/blob/main/protocol-models/src/main/resources/airbyte_protocol/airbyte_protocol.yaml#L76
Joe Reuter (Airbyte)
06/27/2023, 10:39 AMIn most cases however you don't have to deal with this level, instead you can implement the
Streame
Enrico D'Urso
06/27/2023, 10:40 AMok, so it is suggested to use AbstractSource instead of Source?
I find Souce easier to understand
j
Joe Reuter (Airbyte)
06/27/2023, 10:41 AMit's a lower level of the abstraction, that's why you have to deal with writing the state yourself
e
Enrico D'Urso
06/27/2023, 11:04 AMI don't mind that to be honest. I'll try
Enrico D'Urso
06/27/2023, 5:20 PMit works fine like this:
yield AirbyteMessage(type=Type.STATE,state=AirbyteStateMessage(type="STREAM", stream=AirbyteStreamState(stream_descriptor=StreamDescriptor(name=stream.name), stream_state=AirbyteStateBlob(date=max_date))))Enrico D'Urso
06/27/2023, 5:24 PMneeded to experiment a lot.
You guys have a great bot, but for custom connector, the documentation is too much about http
v
Vincent
01/06/2024, 2:24 AMcustom connector documentation is a wild west