<@U04SE163WC8> I was trying to do mysql to mysql d...
# ask-ai
a
@kapa.ai I was trying to do mysql to mysql data transfer and it seems the destination connector needs a specific version to do the transformation as it tries to transform raw data using JSON_VALUE function which is available from 8.0.21 while its not mentioned in airbyte documentation that the destination should be 8.0.21 and above it just mentions it should be 8.0+ JSON_VALUE is same as JSON_UNQUOTE(JSON_EXTRACT(json_column, path)); which is available on all versions of 8.0 is there any why to change what the destination is calling while transforming data ?
k
To address your issue with MySQL to MySQL data transfer and the specific version requirements for the transformation, you can leverage Airbyte's normalization feature to customize the transformation process. ### Understanding the Issue You mentioned that the destination connector uses the
JSON_VALUE
function, which is available from MySQL version 8.0.21. However, you want to use a function like
JSON_UNQUOTE(JSON_EXTRACT(json_column, path))
which is available in all versions of MySQL 8.0. ### Customizing the Transformation Airbyte allows you to customize the normalization process. Here’s how you can do it: 1. Disable Default Normalization: You can turn off the default normalization in the destination settings page. This will allow you to handle the transformation yourself. 2. Implement Custom Transformations: You can implement your own transformations using SQL queries. Airbyte provides the basic normalization outputs that you can leverage to build your own transformations. ### Steps to Customize Normalization 1. Turn Off Default Normalization: - Go to the destination settings page in Airbyte. - Disable the normalization option. 2. Create Custom Transformation Queries: - Use the basic normalization outputs generated by Airbyte. - Write your own SQL queries to transform the data as needed. Here is an example of how you can use
JSON_UNQUOTE(JSON_EXTRACT(json_column, path))
in your custom SQL queries:
Copy code
sql SELECT    JSON_UNQUOTE(JSON_EXTRACT(json_column, '$.field_name')) AS field_name FROM    your_table;
### Additional Resources For more detailed information on how to customize transformations and normalization, you can refer to the following documentation: - [Transformations with SQL](https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-sql) - [Basic Normalization](https://docs.airbyte.com/using-airbyte/core-concepts/basic-normalization) By following these steps, you can ensure that your MySQL destination connector uses the appropriate functions for your specific version requirements. If you need further assistance, feel free to ask on the [Airbyte forum](https://discuss.airbyte.io) or check the [Airbyte documentation](https://docs.airbyte.com). --- References: - [Transformations with SQL](https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-sql#first-transformation-step-normalization) - [Basic Normalization](https://docs.airbyte.com/using-airbyte/core-concepts/basic-normalization)