Hello, I've been trying to start a platform which ...
# troubleshootingd
Danila Maksimenko
05/05/2023, 6:41 PMHello, I've been trying to start a platform which consists of flink, minio(for S3), sql-gateway, postgress, metastore standalone, running hive, Hadoop and iceberg. Ive run into an issue where sql-gateway is outputting that (HiveConf of name hive.s3.aws-secret-key, hive.s3.endpoint, hive.s3.aws-access-key) do not exist even though they do and that they are in the right directory, and second metastore crashing after throwing a
([main] ERROR org.apache.hadoop.hive.metastore.utils.MetaStoreUtils - Got exception: org.apache.hadoop.fs.UnsupportedFileSystemException No FileSystem for scheme "s3"). As this is my first Devops job after finishing courses I'd really appreciate any help here, even just direction to places I could ask. if you need any more information to diagnose I can provide. Thank you
n
Neha
05/05/2023, 6:46 PMtry using s3a
d
Danila Maksimenko
05/05/2023, 6:52 PMi have parameters like (fs.s3a.access.key) and so on is there a different one?
n
Neha
05/10/2023, 9:58 AMchange the path which you are trying to access to from s3 to s3a
d
Danila Maksimenko
05/11/2023, 3:22 AMissue fixed by adding hadoop class paths to metastore and core-site file to metastore.