Hey Team! I'm trying to use the low-code config de...
# help-connector-development
r
Hey Team! I'm trying to use the low-code config development process for a source connector. I right now need to cast types from my fetched data to the one I defined at schemas. https://docs.airbyte.com/connector-development/cdk-python/schemas#default-type-transformation I saw that this solves my problems! However, this guide is not so focused on low-code solutions (I guess) how should I use it? Building a custom
transformation
and setting inside the stream or building a custom
stream
? or may I somehow just use it on my
manifest.yaml
upfront without building custom code?
k
A message from kapa.ai
New message text here
r
Well, this helps, but there can be ways to still use low code to solve this, right?
s
@Raffael Campos The low-code DSL doesn’t expose the ability to force-cast things into the types they are supposed to be. but building a custom transformation to do this is certainly an option! Just add a
components.py
in the same directory and build a custom transformation. See these docs: https://docs.airbyte.com/connector-development/config-based/advanced-topics#custom-components here’s an example You’ll need to override the RecordTransformation class
r
Thanks, @Sherif Nada! You've been helpful. The only part I'm missing is the ability to use the provided schema as an argument on RecordTransformation. I guess I'll need to find out how to pass a schema via
config
parameter, right? Or do you have a different tip for that?
s
it likely wouldn’t be config. If you have a static schema then you might be able to “hardcode” it or load it by reading the schemas directly in the transformation. It’s not a great option tbh, kinda hacky, but it would work
r
Thank you again, Sherif! I'll make sure to do that. Although it's a little friction, it's still better to go for it than building everything in python cdk.