Michael Yee
02/01/2023, 2:32 AMNataly Merezhuk (Airbyte)
02/01/2023, 2:41 PMMichael Yee
02/01/2023, 3:27 PMMichael Yee
02/01/2023, 3:49 PMMichael Yee
02/01/2023, 3:50 PMMichael Yee
02/01/2023, 3:51 PMMichael Yee
02/01/2023, 4:06 PMMichael Yee
02/01/2023, 4:40 PMOur Java connectors currently follow Java's default behaviour with container memory and will only use up to 1/4 of the host's allocated memory. e.g. On a Docker agent with 8GBs of RAM configured, a Java connector limits itself to 2Gbs of RAM and will see Out-of-Memory exceptions if this goes higher. The same applies to Kubernetes pods. You may want to customize this by setting JOB_MAIN_CONTAINER_MEMORY_REQUEST and JOB_MAIN_CONTAINER_MEMORY_LIMIT environment variables to custom values.
What percentage of the ec2 memory should be allocated to each setting?Jon Simpson
02/01/2023, 7:39 PMNataly Merezhuk (Airbyte)
02/01/2023, 8:33 PMNataly Merezhuk (Airbyte)
02/01/2023, 8:33 PMMichael Yee
02/02/2023, 4:36 PMNataly Merezhuk (Airbyte)
02/02/2023, 7:28 PM