I also have a question regarding platforms. I always assumed that I would end up creating a

iceberg

platform. I looked at data_platforms.json as well as your demo instance and saw a

hive

and a

AWS S3

platform. I'm confused by the S3 one... Does it exist for organization simply storing files? What about orgs like mine who store Iceberg tables in Azure Storage Account? In my mind, S3 is equivalent as Azure Storage accounts, so which one should I use then? Iceberg seems like the logical choice, but I'm curious to know more about platforms.

yes the s3 platform exists for people storing files in s3 and not using any other catalog to represent datasets.