Dianjin Wang
05/20/2026, 2:45 PMDianjin Wang
05/22/2026, 7:41 AMDianjin Wang
05/25/2026, 2:45 PMDianjin Wang
05/27/2026, 2:45 PMGitHub
05/28/2026, 7:03 AMDianjin Wang
06/08/2026, 2:45 PMАлексей Выродов
06/10/2026, 2:44 PMCloudberryCluster resource. Currently it is pre-release and i still working on data-loading, monitoring , helm tuning and bugs fixing.
https://github.com/vyrodovalexey/cloudberry-k8s
What you get:
• Deploy — Helm install + one manifest, no manual gpinitsystem
• Scale — change a field: scale-out w/ data redistribution, scale-in w/ PVC handling
• Upgrade — rolling (mirrors → primaries → standby → coordinator) with auto-rollback
• HA — segment mirroring, FTS auto-failover, WAL-streaming standby, segment recovery
• Backup/restore — to S3 or PVC via native `gpbackup`/`gprestore`; on-demand, scheduled, retention
• CLI — cloudberry-ctl instead of SSH-ing into pods
Security — Vault-first 🔒
Cluster TLS issued by Vault PKI with auto-rotation, backup creds pulled from Vault (placeholder-only on disk, resolved at runtime), Vault Kubernetes auth — no bootstrap tokens.
Auth — Keycloak
Dual-mode Basic + OIDC: JWT validation w/ JWKS caching + role-claim extraction, mapped to a five-tier permission model.
Observability — out of the box 📊
Prometheus metrics (reconciliation, FTS, scaling, mirroring, certs, backups); Cloudberry-tailored postgres-exporter + cloudberry-query-exporter sidecars; metrics → VictoriaMetrics (vmagent), logs → VictoriaLogs (Vector); Some raw Grafana dashboards. OpenTelemetry OTLP tracing (gRPC/HTTP) with span error recording via an OTel Collector.
Batteries included — prepared images
Ready-to-run images: the original Cloudberry DB built from the official Apache Cloudberry RPM on Rocky Linux (with zstd for backups), a backup-toolchain image (`gpbackup`/`gprestore`/`gpbackup_s3_plugin`/`gpbackman`), plus operator + CLI images.
Happy to take questions or feedback 🙏GitHub
06/11/2026, 7:22 AMDianjin Wang
06/11/2026, 2:30 PMDianjin Wang
06/23/2026, 2:45 PMBala Suresh
06/23/2026, 3:25 PMDianjin Wang
06/25/2026, 3:00 PMDianjin Wang
06/29/2026, 2:45 PMImad
06/30/2026, 2:52 PMGitHub
07/01/2026, 1:44 PMgpinitsystem — coordinator, standby, segments, and mirrors, all provisioned declaratively from a single YAML
• Horizontal scale-up: patch spec.segments.count, the operator provisions new pods and redistributes data automatically
• Two SSH trust models: static keypair for dev/CI, certificate mode for production (per-cluster CA, short-lived certs, annotation-driven rotation without pod restarts)
• Declarative postgresql.conf and pg_hba.conf management via DatabaseConfig
• High availability out of the box: standby coordinator (WAL streaming, auto-promoted on failure) and mirror segments (one mirror per primary, auto-recovered via gprecoverseg)
• On-demand backups to S3-compatible storage via gpbackup, with cross-cluster restore support
• Phase-driven lifecycle: PodsStarting → SSHReady → Initializing → Running, with the operator reconciling continuously from there
• Admission webhook that catches errors at the API boundary — cluster name length, HA node availability, invalid CRD references — before anything reaches a pod
• Helm install, cert-manager for webhook TLS, Kubernetes 1.29+
Why I built it: Standing up a Cloudberry cluster is operationally heavy — SSH trust, gpinitsystem, segment registration, mirror setup, replication wiring. Keldon automates all of it so you can go from zero to a running MPP cluster without touching any of it manually.
What I'm looking for:
1. Are there use cases or deployment patterns in the community I haven't accounted for?
2. Anything in the way Keldon models clusters that conflicts with how you think about Cloudberry architecture?
3. If you get a chance to try it, I'd love to hear what breaks — missing features / bug to fix
Repo: github.com/keldonio/keldon-operator
Docs: keldon.io/docs
Happy to answer questions or take direction on anything missing.
— Imad
apache/cloudberryDianjin Wang
07/08/2026, 2:45 PMDianjin Wang
07/15/2026, 2:45 PMDianjin Wang
07/20/2026, 2:45 PMDianjin Wang
07/22/2026, 2:45 PMMirza Khurram
07/27/2026, 8:44 AMDianjin Wang
07/27/2026, 2:45 PMGitHub
07/31/2026, 5:24 AMBala Suresh
07/31/2026, 1:17 PMGitHub
07/31/2026, 6:26 PMGitHub
08/02/2026, 4:09 AMGitHub
08/06/2026, 12:08 PMgpfdist utility in Apache Cloudberry.
Key Insight: LZO is specifically designed for speed over compression ratio. It's ideal for scenarios where decompression throughput matters more than storage savings - such as large-scale data loading into MPP databases like Cloudberry.
Core Features
Read Support (.lzo → Cloudberry):
• ✅ Block-level decompression: Processes LZO data block by block, extracting uncompressed length and compressed length from each block header
• ✅ Checksum verification: Validates data integrity using Adler32 and CRC32 checksums embedded in LZO blocks
• ✅ Enhanced error reporting: Provides detailed, actionable error messages for various failure scenarios (truncated files, corrupt data, invalid format, checksum mismatches)
Write Support (Cloudberry → .lzo):
• ✅ Table data unloading: Exports table data to LZO-compressed external files
• ✅ Standard LZOP format output: Generates files compatible with standard lzop tool and Hadoop LZO readers
• ✅ Configurable compression level: Supports LZO compression levels (default: level 1, fastest; configurable up to level 9)
Future Potential - Hadoop Ecosystem Integration:
• 🔮 Direct query of Hive tables stored in LZO-compressed format on HDFS
• 🔮 Seamless integration with Spark LZO Parquet output
• 🔮 Accelerated data loading from Sqoop LZO imports
Use case/motivation
Scenario 1: High-Volume Data Loading
LZO is a lightweight compression algorithm optimized for decompression speed (~500MB/s), making it ideal for scenarios requiring rapid data ingestion. Compared to BZip2 (~10MB/s) and GZIP (~100MB/s), LZO provides the fastest decompression while maintaining a reasonable compression ratio.
Scenario 2: Hadoop Ecosystem Integration
Many Hadoop ecosystem tools natively support LZO compression:
1. Hive: Supports LZO-compressed text and sequence files
2. Spark: Can write LZO-compressed output (via hadoop-lzo library)
3. Sqoop: Commonly uses LZO for bulk imports from RDBMS to HDFS
References
Technical Documentation
• LZO Official Website
• LZOP File Format Specification
• Hadoop LZO Compression Guide
Cloudberry Documentation
• GPFDIST Official Docs
• External Tables Guide
Related Projects
• Apache Cloudberry GitHub
• Greenplum Database (upstream)
Related issues
No response
Are you willing to submit a PR?
• Yes I am willing to submit a PR!
apache/cloudberryDianjin Wang
08/13/2026, 2:45 PMmain
• 📦 Apache Cloudberry 2.2.0 has entered the release process
• 🧊 Iceberg support has started in datalake_fdw
• 🔧 Continued improvements to ORCA, planner, extensions, CI, security, and packaging
• ☁️ Ecosystem projects including PXF, cloudberry-backup, cloudberry-go-libs, WAL-G, and Kubernetes operators continued to move forward
• 👥 Anton Kurochkin and Liu Shengsong joined as new Committers
• 🌏 Community engagement continued through Community Over Code Asia 2026 and other events
Thanks to everyone who continues to contribute to Cloudberry — whether through code, reviews, documentation, testing, releases, or community discussions! 🙌
🫱🏻 Read the full incubation report: cloudberry.apache.org/blog/apache-cloudberry-incubation-report-202608Dianjin Wang
08/25/2026, 2:45 PMDianjin Wang
08/26/2026, 2:45 PMGitHub
08/29/2026, 7:33 PMwoblerr/cloudberry image; driver psqlodbc 16, PostgreSQL wire):
• Linux: PASS
• macOS arm64: PASS (amd64 emulated)
• Windows x64: PASS (compose service unchanged, 3 GB / shm 1 GB)
What the compatibility entry records: an MPP cluster of PostgreSQL 14 segments behind one coordinator, driven by the postgres entry's types unchanged (INTEGER, DOUBLE PRECISION, VARCHAR, BYTEA, DATE, TIMESTAMP, NUMERIC(10,3), BOOLEAN all behave as on stock PostgreSQL) and, unlike CockroachDB, needing no PRIMARY KEY. Since it reports SQL_DBMS_NAME "PostgreSQL" behind the same psqlodbcw.so, no driver-name quirk could be correct here without also firing on real PostgreSQL; the only place Cloudberry is named in the bridge is a fork test on the version() banner. Extra steps cover what the standard workload cannot tell apart from PostgreSQL: a DISTRIBUTED BY table whose bulk-ingested rows occupy both segments plus an aggregate merged on the coordinator (Gather Motion 2:1, GPORCA), and append-optimized column-oriented storage read from pg_am as ao_column.
Full entry: https://github.com/singhpratech/adbcbridge/blob/main/docs/COMPATIBILITY.md
The question. For real PostgreSQL the bridge ingests through a multi-argument unnest form — INSERT INTO t SELECT * FROM unnest($1::bigint[], $2::text[], …) with one array parameter per column — and it only turns that on when version() is a PostgreSQL banner carrying no fork marker, so Cloudberry (banner PostgreSQL 14.4 (Apache Cloudberry 2.1.0-incubating …)) keeps the plain multi-row INSERT path. Probing Cloudberry directly, the unnest form works exactly as on PostgreSQL — from array literals and from bound `bigint[]`/`text[]` parameters, into heap, append-optimized row and append-optimized column tables, across the segments — and server-side it lands 5,000 rows roughly an order of magnitude faster than the multi-row INSERT it keeps (~530k vs ~33k rows/s, bare SQL on a shared host).
Is relying on multi-argument unnest expansion something Cloudberry considers stable across releases, the same way PostgreSQL does — i.e. is it reasonable to let Cloudberry through that gate? If there is a caveat (GPORCA vs the planner, distribution of the unnested rows, anything on the 2.x roadmap), I would rather know before flipping it.
Trying it (Python; Rust, Go, Java and C# are on the docs site):
pip install adbcbridge
import adbcbridge
with adbcbridge.connect(uri="Driver=psqlodbcw.so;Servername=127.0.0.1;Port=5432;Database=mydb;Username=gpadmin;Password=…;") as conn:
with conn.cursor() as cur:
cur.execute("SELECT ...")
table = cur.fetch_arrow_table() # a pyarrow.Table
Links: repository https://github.com/singhpratech/adbcbridge · docs https://adbcbridge.org/docs/ · upstream notes https://github.com/singhpratech/adbcbridge/blob/main/docs/UPSTREAM.md · PyPI https://pypi.org/project/adbcbridge/
It is a 0.1.0. If the entry says something wrong about Cloudberry, or you run a version I didn't, an issue on the repository with the details is the most useful thing you could send.
apache/cloudberry