<@U04S8PLJWMT> where can i see airbyte job logs in...
# replication-ask-ai
a
@kapa.ai where can i see airbyte job logs in kubernetes
k
There are several ways to view Airbyte job logs in a Kubernetes deployment: 1. Via the Airbyte UI Navigate to a connection's Job History tab, then select the three grey dots next to a sync and choose View logs. This opens the full-screen in-app log viewer where you can search for terms like
Error
,
Exception
, or
Fail
. You can also Download logs from the same menu. [Browsing logs] 2. Via kubectl (directly on the pod) You can exec into a running worker pod to browse logs interactively:
Copy code
kubectl exec -it <pod name> -n <namespace pod is in> -c main bash
# Example:
kubectl exec -it destination-bigquery-worker-3607-0-chlle -n jobs -c main bash
root@destination-bigquery-worker-3607-0-chlle:/config# ls
FINISHED_UPLOADING  destination_catalog.json  destination_config.json
To copy a log file to your local machine:
Copy code
kubectl cp <namespace>/<pod-name>:/config/destination_catalog.json ./catalog.json
# Example:
kubectl cp jobs/normalization-worker-3605-0-sxtox:/config/destination_catalog.json ./catalog.json
cat ./catalog.json
[Browsing on Kubernetes] 3. Via kubectl logs (for server/worker pods) You can also stream logs directly from a pod:
Copy code
kubectl logs -n airbyte <pod-name>
For example, to check the workload-launcher logs: [workload-launcher logs]
Copy code
kubectl logs -l app.kubernetes.io/name=workload-launcher --namespace <airbyte-namespace> --tail=100
> Note: If you see "No logs available" in the UI, it may be due to insufficient storage space for Minio (the default log storage). Increasing the space for the
/storage
path can resolve this. [K8s No logs] 👍 0 button 👎 0 button â„šī¸ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.