Hi everyone, sharing a new Apache Cloudberry ecosystem update: BladePipe 1.6.0+ now supports Apache Cloudberry, enabling visual, low-code data migration and synchronization from PostgreSQL and Greenplum. The integration supports: • Schema migration • Full data migration • Incremental data synchronization • Data verification and correction • Common DDL synchronization Step-by-step guide: cloudberry.apache.org/docs/ecosystem/data-integration/bladepipe Original news: lists.apache.org/thread/… Community feedback on compatibility, usability, and real-world scenarios is very welcome.

Hey @Dianjin Wang, great to see BladePipe supporting Cloudberry now! 🎉 A few things I'd love to know here For folks coming from Greenplum, does the migration preserve distribution keys/partitioning, or does everything land with default distribution on the target? Also, is there any dry-run/schema-diff preview before a DataJob actually runs against prod? Kind of a must-have before I'd trust it with anything real.

So far as I know, BladePipe schema migration does not preserve distribution keys. Probably creating all the tables on the target and leverage BladePipe for data sync is an option.

How about the tool

cbcopy

?

Yes,

cbcopy

will preserve the distribution keys/partitioning. It will be a better option if the source is greenplum and the target is cloudberry.

Hi @Mykhailo, if you want to migrate Greenplum to Cloudberry, welcome to try the dedicated tool `cbcopy`: github.com/cloudberry-contrib/cbcopy. Also, welcome to visit this doc: cloudberry.apache.org/docs/sys-admin/migration-and-upgrade/backward-incompatible-changes-from-greenplum-6, FYI.

Thanks @chenliang and @Dianjin Wang, that's really helpful, makes sense that

cbcopy

is the right call when the source is Greenplum and schema fidelity matters. Will check out

cbcopy

and that migration doc. One thing still open from my eariler question - is there any dry-run/schema-diff preview in BladePipe itself before a DataJob runs against prod? Mainly thinking about the case where BladePipe is used for ongoing CDC/sync

Got it. Let me invite a member of the BladePipe team to help with your question.

Thanks a lot