i am noticing that disk on a controller instance starts filling up pretty fast. what can i do to slow it down?

Are you using cloud? If so, you can configure a deep store to offload controller disk usage to s3/gcs

yes, running via launcher script on aws ec2 instances for now. what is it writing to disk?