https://slingdata.io logo
i just started having an issue with come
# sling-help
m
i just started having an issue with text and varchar columns in mariadb, not sure if this is a new issue:
Copy code
~ insertBatch
  | Error 1366 (22007): Incorrect string value: '\xE2\x84\x85 Lu...'
Looks like an issue with the batch insert mode? The collation and charset are identical on both the source and target db (maria to maria). In this case they are CHARSET=utf8mb3 COLLATE=utf8mb3_unicode_ci
FYI, this is set the target_options.use_bulk set to "false". When i try with use_bulk "true", it doesnt have those errors, instead I see different errors:
Copy code
| Error 1406 (22001): Data too long for column 'student_answer' at row 982152
 |
I can work around the data too long issue since i dont need this replication to be exact since it is for a testing target env, although i seems like the use_bulk mode is better if it can properly handle the data too long issue
The columns that give the "data too long" error are
text CHARACTER SET utf8mb3 COLLATE utf8mb3_unicode_ci DEFAULT NULL,
. My workaround is to just do SLING_ON_CONSTRAINT_FAILURE: skip and use bulk: true
f
@mitty do you still get the error with
use_bulk: false
?
m
yeah the data too long issue happens in both cases (bulk and not bulk)
the invalid char only occurs with bulk: false
2 Views