Hi, I have a quick question on the basic normalisa...
# feedback-and-requests
b
Hi, I have a quick question on the basic normalisation step. Today, I'm ingesting a couple of mysql databases to bigquery using airbyte. What I observe is that mysql integer datatypes ultimately end up as floats in bigquery which is a bit unfortunate, especially for integer ids. Is there a way to better retain the original datatypes in the target databases? without having to write manual transformation steps to re-cast?
u
Hey Bob can you share the schema for the connection you created ?
u
What do you want me to share exactly? a screenshot from one of the table schema's in airtable?
u
In airbyte you get an option to choose streams and in the stream you have types of all the keys just wanted to check what is that
b
for example
u
you see that entity_id is marked as 'number'
u
in mysql it's an integer
u
and with basic normalisation it ends up in BQ as float
u
Hi Bob De Shutter this is expected right now. Airbyte will convert the soruce type (integer) to the Airbyte Procotol (number) and the destination will transform the Airbyte Type to one allow to it (float). There are some issues requesting to improve this, but right now it's a limitation.