How do I set specific cpu & memory limits and requests for a given source/destination?

To set specific CPU and memory limits and requests for a given source or destination in Airbyte, you can follow these steps: 1. Connect to the database and run the following query with the image name replaced to find the connector definition id.

sql select * from actor_definition where actor_definition.docker_repository like '%<image-name>';

2. Run the following command with the resource requirements and the connection definition id filled in.

sql update actor_definition set resource_requirements = '{"jobSpecific": [{"jobType": "sync", "resourceRequirements": {"cpu_limit": "0.5", "cpu_request": "0.5", "memory_limit": "500Mi", "memory_request": "500Mi"}}]}' where id = '<id-from-step-1>';

This will set the CPU limit to 0.5, CPU request to 0.5, memory limit to 500Mi, and memory request to 500Mi for the specific connector. Please note that these settings are specific to each connector, so you'll need to repeat these steps for each source and destination connector you want to configure. For more information, you can refer to the [Airbyte documentation on configuring connector resources](https://docs.airbyte.com/operator-guides/configuring-connector-resources#configuring-connector-specific-requirements). If you're using Kubernetes and Helm for deployment, you can also set the CPU and memory requests and limits in the

values.yaml

file under the

jobs.resources.requests

and

jobs.resources.limits

sections respectively. However, please note that these settings will apply to all containers in the job pods. For more information on how Airbyte handles memory and CPU usage, you can refer to this [forum post](https://discuss.airbyte.io/t/2214) on the Airbyte community forum.