Hi, I have updated to v 1.0 and from docker compos...
# ask-ai
a
Hi, I have updated to v 1.0 and from docker compose to abctl but am now getting "insufficient resource" errors.
Copy code
Warning from replication: Airbyte could not start the sync process. This may be due to insufficient system resources. Please check available resources and try again.
I have made no change to the servers and it has been handling the workloads fine in the past. The limits on each KubePodClient seem to be pretty beefy, does this need reducing?
limits={memory=4Gi, cpu=3}, requests={memory=1Gi, cpu=1}, additionalProperties={})
u
It seems like you're encountering resource allocation issues after migrating from Docker Compose to
abctl
and upgrading to Airbyte v1.0. The error message suggests that the system might not have enough resources to start the sync process. The resource limits you've mentioned (
limits={memory=4Gi, cpu=3}, requests={memory=1Gi, cpu=1}
) are indeed quite high. These values represent the maximum amount of CPU and memory that the Kubernetes pod can use. If your system doesn't have these resources available, it could lead to the "insufficient resource" errors you're seeing. There are a few ways you could address this issue: 1. Increase the resources on your server: If possible, you could add more CPU and memory to your server to meet the resource requirements. 2. Adjust the resource limits: You could try reducing the resource limits for the Kubernetes pods. However, be aware that setting them too low could impact the performance of Airbyte. 3. Use low resource mode: Airbyte provides a
--low-resource-mode
flag that you can use when installing Airbyte with
abctl
. This mode is designed for machines with 2 CPUs and 8 GB of RAM. If your server has these resources, you could try using this mode. Here's how you can install Airbyte in low resource mode:
Copy code
bash abctl local install --low-resource-mode
Please note that these are general suggestions. The exact solution might depend on your specific setup and requirements. For more information, you can refer to the [Airbyte documentation](https://docs.airbyte.com/using-airbyte/getting-started/oss-quickstart#suggested-resources) and the [discussion on running
abctl
with 2 CPU & 4 GB of memory](https://github.com/airbytehq/airbyte/discussions/44391). Sources: - [Github discussion on running
abctl
with 2 CPU & 4 GB of memory](https://github.com/airbytehq/airbyte/discussions/44391) - [Airbyte documentation on suggested resources](https://docs.airbyte.com/using-airbyte/getting-started/oss-quickstart#suggested-resources)