@kapa.ai can I make airbyte log in a structured format like json?

Yes! Airbyte supports structured JSON logging. Here's what's available depending on your context: PyAirbyte (Python SDK) PyAirbyte supports structured JSON logging, which is disabled by default. To enable it, set the

AIRBYTE_STRUCTURED_LOGGING

environment variable to

True

. Once enabled, log files will be written in JSONL format instead of plain text. [PyAirbyte logs] You can also control where logs are written using the

AIRBYTE_LOGGING_ROOT

environment variable. [PyAirbyte logs] Self-Managed Enterprise: Audit Logging If you're on Self-Managed Enterprise, Airbyte also supports audit logging, which writes structured JSON files to a blob storage bucket (S3, GCS, or Azure Blob Storage). Each audit log entry looks like this:

{
  "id": "8478fcbd-d369-4bda-8d9b-b782cea5ad40",
  "timestamp": 1746724563299,
  "actor": {
    "actorId": "1c26c465-58h8-43e6-8jko-2252b7g8a9e2",
    "email": "user@example.com",
    "ipAddress": "192.000.000.0",
    "userAgent": "Mozilla/5.0 ..."
  },
  "operation": "deleteWorkspace",
  "request": "<request object>",
  "response": "<response object>",
  "success": true,
  "errorMessage": null
}

To enable audit logging, you configure your

values.yaml

file (Helm chart V2 example):

server:
  auditLoggingEnabled: true

storage:
  bucket:
    auditLogging: your-audit-logging-bucket-name-here

[audit logging] So in summary: for PyAirbyte, set `AIRBYTE_STRUCTURED_LOGGING=True`; for Self-Managed Enterprise audit trails, configure audit logging via

values.yaml

. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.

@kapa.ai I'm talking about airbyte-server and workload pods 1. whats pyairbyte? 2. can server and workload pods log structured?

Great clarifying questions! Let me address both: 1. What is PyAirbyte? PyAirbyte is Airbyte's Python SDK, used to run data pipelines programmatically from Python code or notebooks. It's a separate tool from the Airbyte server/platform deployment — so it's not relevant to your use case of airbyte-server and workload pods. 2. Structured logging for airbyte-server and workload pods The knowledge sources do not contain information about enabling structured JSON logging (e.g., JSON-formatted application logs) for the airbyte-server or workload pods in a self-managed Kubernetes deployment. What the docs do cover for the server component is: • Standard log level configuration via

LOG_LEVEL

(e.g., INFO, DEBUG) [configuring Airbyte] • External log storage (S3, GCS, Azure) for storing sync/job logs [configuring Airbyte] • Audit logging (Self-Managed Enterprise only), which writes structured JSON audit trail files to blob storage — but this is specifically for tracking user/permission/resource change events, not general application logs [audit logging] I'm sorry, but the knowledge sources don't explicitly mention an option to configure structured JSON formatting for the general application logs emitted by airbyte-server or workload pods. For that, I'd recommend checking the Airbyte docs directly or reaching out to Airbyte support. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.