Hello all and happy xmas. A question. Can I run a ...
# replication-troubleshooting
s
Hello all and happy xmas. A question. Can I run a query on a returned catalog from a source (say mysql)? Or directly query the source and get a "queried" (filtered) catalog? [edit] I've ran into this post and this post and realized it is not supported. What could be my alternatives? Is there a way to write a generic Transformation that would get a query and return a queried catalog? Thanks.
anything?
m
No, you can’t run a query in configured catalog. You can create a Github issue requesting the feature you’re trying to use. Today an workaround you must create a new user in your MySQL source and give proper access to what table you want to ingest
s
Thanks for the response Marcos. Can I achieve the same by using Transformations? I've a read some about it + watched your tutorial video - I gotta admit I was a little confused but I guess I just need a recap. I've tried to mess around with it so I setup a demo MySQL -> S3 connection and the Airbyte UI said that my connection doesn't support Transformations and Normalization 😐 Also I've noticed some transformation field in the
discover_schema
API. Is that something I can use? About the feature request, I dont mind taking a look at it. Can you perhaps direct me to the flow that eventually queries the Source? maybe I can modify stuff there and open up a PR. Thanks.
a kind ping @Marcos Marx (Airbyte)