Channels
advice-data-architecture
advice-data-ingestion
advice-data-orchestration
advice-data-privacy
advice-data-quality
advice-data-transformation
advice-data-visualization
advice-data-warehouses
advice-reverse-etl
airbyte-cloud
airbyte-for-power-users
airbyte-help
airbyte-plus-airflow
airbyte-plus-dagster
announcements
authentication
careers
cloud-master-build-failure
community-strategy
connector-builds
connector-development
contributing-to-airbyte
databricks-airbyte316
databricks-airbyte316
delete-remove
dev
dev-3-alerts
dev-db-sources
dev-frontend
dev-frontend6323
dev1-alerts
events-and-conferences
ext-torch-cube
feedback-and-requests
github-updates
good-reads
gtm
hacktoberfest-2022
help
infra-dev-alerts
infra-dev-alerts-webhook
introductions
issue
kubernetes
license-questions
linen-test
local-brazil
local-london
local-sf
marcos-test-discourse
memes-and-banter
mos-client
mos-client
motleyfool
movedata-a-different-way-to-work
movedata-airbyte-connection-management-scale
movedata-airbyte-orchestration-in-gcp
movedata-better-data-testing-with-the-data-error-generating-process
movedata-bring-your-own-infra
movedata-building-a-real-time-user-facing-dashboard-with-airbyte-redpanda-and
movedata-building-connectors-in-minutes
movedata-cicd-for-data-building-devtest-data-environments-with-lakefs
movedata-data-analysts-are-setup-to-fail-and-its-our-fault
movedata-data-engineering-is-software-engineering-and-software-engineering-is-da
movedata-data-orchestration-is-not-just-running-jobs-on-a-schedule
movedata-dataops-on-the-open-modern-data-stack
movedata-dev-first-open-source-data-observability-solution
movedata-ducky-data-crunching-on-the-laptop---the-pendulum-swings
movedata-five-causes-of-data-quality-issues
movedata-future-evolution-of-the-data-stack
movedata-general
movedata-guardrails-not-stop-signs
movedata-if-you-build-it-will-they-come-how-to-activate-your-modern-data-stack
movedata-in-2023-data-trust-will-be-more-important-than-ever-before
movedata-ingesting-data-with-airbyte-into-a-high-speed-data-lakehouse-using-trin
movedata-keynote-building-the-foundations-of-data-movement
movedata-let-your-data-team-choose-their-own-tools
movedata-mobilize-the-worlds-data
movedata-modern-data-management---how-to-achieve-data-discovery
movedata-moving-data-reliably-ingestion-observability-are-better-together
movedata-navigating-the-modern-data-stack-with-open-source-headless-bi
movedata-open-source-communities-shape-modern-data-stacks
movedata-prefect-ing-self-hosted-airbyte
movedata-prep-your-pipelines---reverse-etl-and-the-coming-great-flood
movedata-speakers
movedata-streaming-made-modern
movedata-the-best-data-warehouse-is-a-lakehouse
movedata-the-data-ecosystem-is-ready-for-etl-to-be-dead
movedata-the-end-of-the-pipeline
movedata-traditional-data-catalogs-will-be-replace-by-active-metadata-platforms
movedata-using-airbyte-on-day-1of-our-startup
movedata-using-airbyte-to-build-your-dremio-open-data-lakehouse
movedata-who-needs-a-traditional-data-warehouse-when-you-can-get-real-time-analy
movedata-why-bi-is-not-enough
octavia-cli
octavia-life
office-hour
office-hour-12-october
oss-master-build-failure
p0-cloud-syncs-failing-dec-15
p0-instagram-incompatible-metrics
p0-source-airtable-stream-failures
partner-productpair-hightouch
prod1-alerts-test
prod1-health
random-news-and-events
shameless-plugs
troubleshooting
understanding-airbyte
using-the-cdk
write-for-the-community
Title
v
Venkat Dasari
09/30/2022, 3:51 PMhow to get data from rest api, i cant find the source that says rest
m
Marcelo Pio de Castro
09/30/2022, 3:58 PMEasiest way is to use python http cdk, https://airbytehq.github.io/connector-development/tutorials/cdk-tutorial-python-http/getting-started
v
Venkat Dasari
10/04/2022, 6:05 PMHi, I built a connector for a new source. I followed the documentation to code, test and build the docker image. How to make it show up on the UI? I also included that in the source_definition.yaml as well.
@Marcelo Pio de Castro
m
Marcelo Pio de Castro
10/04/2022, 6:25 PMNice! You simply go to configuration -> sources, there is a button on the top right to add a new connector
v
Venkat Dasari
10/04/2022, 9:31 PMIs there a way that i can test this in my local docker image?
m
Marcelo Pio de Castro
10/04/2022, 9:49 PMYes! Just tag your image using docker tag and use the tag on the airbyte interface
You can for example build it with
docker build . -t mycompany/custom-image:devSo on Airbyte the repository name will be mycompany/custom-image
And docker image tag will be dev
You can put anything on documentation, even something like "Not Apply"
v
Venkat Dasari
10/05/2022, 12:16 AMI am getting this error.
{
"type": "CONNECTION_STATUS",
"connectionStatus": {
"status": "FAILED",
"message": "AttributeError(\"'dict' object has no attribute 'get_auth_header'\")"
}
}Any idea, what i am missing?
m
Marcelo Pio de Castro
10/05/2022, 12:20 AMSeems like a problem in your code, probably the object that is calling the function
get_auth_headerv
Venkat Dasari
10/05/2022, 1:00 AMthere isnt any log when i check with python main.py --config blah
it just throws me this one line error
HI, is Airbyte allowed to be deployed on EKS. Do you have a good documentation around it?
m
Marcelo Pio de Castro
10/05/2022, 6:30 PMYes! There is even the helm charts ready. https://airbytehq.github.io/deploying-airbyte/on-kubernetes
v
Venkat Dasari
10/06/2022, 3:07 AMI am getting the below error while installing airbyte on eks: "running PreBind plugin :VolumeBiding: binding volumes timedout waiting for the condition
waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
i think its stuck with trying to get a volume attached to this pvc