Is there any way to benchmark performance of query...
# questions-and-troubleshooting
s
Is there any way to benchmark performance of query to external parquet file in MinIO such as Ram , CPU with Starrocks compute node? My idea is make a script python and add a query on it, but I don't know if that's true or not. Anyone has done this before?
k
this is doable. what do you want for this scenario? as a lake house solution?
s
Yes. For example, I have 3 parquet file stored in MinIO, use starrocks as query engine join 3 file parquet and calculate CPU, RAM as resource, starttime and endtime for time execution, I already knows starrocks has an UI to check for each query performance, but it doesn't have resource used.
k
this shall be only used as ad-doc query. formal lake house solution shall be using external catalog.
s
Could you be more specific? I don't quite understand.