<@U0A71G31CDV> how can I check iceberg meta and de...
# questions-and-troubleshooting
z
@Rocky how can I check iceberg meta and detalake meta files from starrocks 3.5.16?
r
In StarRocks 3.5.16, the methods for checking metadata differ between Apache Iceberg and Delta Lake. 1. Apache Iceberg Metadata Starting from v3.4.1, StarRocks provides Iceberg Metadata Tables, which are virtual system tables. You can query them by appending a dollar sign (
$
) and the metadata table name to your table identifier. Common Metadata Tables: *
history
: Metadata change log (snapshots and timestamps). *
snapshots
: Details about all valid snapshots. *
manifests
: Overview of manifest files. *
files
: Detailed information about data and delete files in the current snapshot (includes file paths and stats). *
partitions
: Partition-level metadata. Example Queries:
Copy code
sql
-- View snapshot history
SELECT * FROM iceberg_catalog.db_name.table_name$history;

-- View data files in the current snapshot
SELECT * FROM iceberg_catalog.db_name.table_name$files;

-- View details of all snapshots
SELECT * FROM iceberg_catalog.db_name.table_name$snapshots;
────────── 2. Delta Lake Metadata As of version 3.5.16, StarRocks does not yet support virtual metadata tables for Delta Lake (e.g.,
table$history
) in the same way it does for Iceberg. The StarRocks Delta Lake connector automatically handles the transaction log (
_delta_log/
) to ensure it reads the correct version of the data, but these metadata files are not exposed as queryable tables via the SQL interface. What you can check: * Table Schema: Use
SHOW CREATE TABLE
to see the schema and properties that StarRocks has parsed from the Delta metadata.
Copy code
sql
    SHOW CREATE TABLE delta_catalog.db_name.table_name;
* Log Files (Workaround): To inspect the actual Delta Lake JSON/Parquet log files, you must currently access the underlying storage (S3/HDFS/GCS) directly or use a processing engine like Spark. Summary Table Feature | Iceberg (v3.4.1+) | Delta Lake Virtual Meta Tables | Supported (
table$meta
) | Not Supported View Snapshots |
SELECT * FROM table$snapshots
| Not Supported View File Paths |
SELECT * FROM table$files
| Not Supported View Schema |
DESCRIBE table
/
SHOW CREATE TABLE
|
SHOW CREATE TABLE
If you specifically need to audit Delta Lake history or file lists within StarRocks, you would typically need to create an External File Table pointing directly to the
_delta_log/
path in your object storage to query the JSON files as raw data, though this requires manual parsing of the Delta protocol. References • data_source/catalog/iceberg/iceberg_meta_table.md • data_source/feature-support-data-lake-analytics.md • data_source/catalog/deltalake_catalog.md • administration/cluster_snapshot.md