akira
06/01/2023, 6:30 AM2023-05-28 16:40:07,949 INFO org.apache.flink.streaming.api.functions.sink.filesystem.Buckets [] - Subtask 14 checkpointing for checkpoint with id=1715 (max part counter=1856).
2023-05-28 16:40:13,887 INFO org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat [] - creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@bae30b0
2023-05-28 16:40:13,887 INFO org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper [] - initialize serde with table properties.
2023-05-28 16:40:13,887 INFO org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper [] - creating real writer to write at <s3a://xxx/dt=20230528/hh=16/.part-6af1dfde-765c-4bbb-b593-3c01c5d66192-14-1856.inprogress.4f30f53f-10c0-40e5-a707-7f572850526d>
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.codec.CodecConfig [] - Compression: GZIP
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Parquet block size to 134217728
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Parquet page size to 1048576
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Parquet dictionary page size to 1048576
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Dictionary is on
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Validation is off
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Writer version is: PARQUET_1_0
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Maximum row group padding size is 8388608 bytes
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Page size checking is: estimated
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Min row count for page size check is: 100
2023-05-28 16:40:13,887 INFO org.apache.parquet.hadoop.ParquetOutputFormat [] - Max row count for page size check is: 10000
2023-05-28 16:40:13,898 INFO org.apache.hadoop.io.compress.CodecPool [] - Got brand-new compressor [.gz]
2023-05-28 16:40:13,899 INFO org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper [] - real writer: org.apache.parquet.hadoop.ParquetRecordWriter@2d1ee4ae
2023-05-28 16:40:17,894 INFO org.apache.flink.streaming.api.functions.sink.filesystem.Buckets [] - Subtask 14 received completion notification for checkpoint with id=1715.