Marcel Prothmann
09/24/2021, 12:49 AMMartin Carlsson
09/24/2021, 7:53 AMFor security reasons, we strongly recommend to not expose Airbyte on Internet available ports. Future versions will add support for SSL & Authentication.
The advice is to ssh into the azure VM and expose Airbyte to localhost.
However, I think this is too technical for the client.
Are there any other approaches that can securely expose Airbyte’s frontend to the client?Tomas Peluritis
09/24/2021, 3:34 PMThe connection tests failed.
ParamValidationError('Parameter validation failed:\nInvalid bucket name "arn:aws:s3:::nyc-tlc": Bucket name must match the regex "^[a-zA-Z0-9.\\-_]{1,255}$" or be an ARN matching the regex "^arn:(aws).*:(s3|s3-object-lambda):[a-z\\-0-9]*:[0-9]{12}:accesspoint[/:][a-zA-Z0-9\\-.]{1,63}$|^arn:(aws).*:s3-outposts:[a-z\\-0-9]+:[0-9]{12}:outpost[/:][a-zA-Z0-9\\-]{1,63}[/:]accesspoint[/:][a-zA-Z0-9\\-]{1,63}$"')
Just don't start shooting that it's a regexp, figure it out 😄 it's a bit too complicated to me to understand and there is not much information about the datasetBoggdan Barrientos
09/24/2021, 7:48 PMMarcel Prothmann
09/25/2021, 11:04 AMPeder Sviggum
09/25/2021, 5:18 PMOshini nishnali
09/27/2021, 12:11 PMSawyer Waugh
09/27/2021, 2:38 PMDavid Beck
09/27/2021, 2:41 PMSam Werbalowsky
09/27/2021, 4:24 PMcontact_form_submissions
). I don’t see this in the airbyte default hubspot connector. Is this something that is simple to add, and are there plans to add the full suite of connectors to Airbyte?
the other thing I am worried about is if there are concerns about rate-limiting on the hubspot API. We frequently get millions of records updated via Fivetran, and I am a bit concerned about Airbyte’s handling of this given it says
Hubspot's API will rate limit the amount of records you can sync daily, so make sure that you are on the appropriate plan if you are planning on syncing more than 250,000 records per day.
David Beck
09/28/2021, 11:23 AMJonas Bolin
09/28/2021, 12:19 PMHicham Rahj
09/28/2021, 3:29 PMДмитрий Ансимов
09/28/2021, 3:30 PMMark
09/28/2021, 9:50 PMDavid Beck
09/29/2021, 1:09 PMDavid Beck
09/29/2021, 1:21 PMMani Prakash
09/29/2021, 9:44 PMNaveen Sai Patnana
09/30/2021, 7:55 AMJonas Bolin
09/30/2021, 10:33 AMMatheus de Freitas Andrade
10/01/2021, 4:45 AMRuben Jansen
10/01/2021, 1:55 PMheroku.yml
file or other steps needed to get it working at Heroku.
My current heroku.yml
file looks like this:
build:
docker:
web: airbyte-webapp/Dockerfile
airbyte-temporal: airbyte-temporal/Dockerfile
server: airbyte-server/Dockerfile
worker: airbyte-workers/Dockerfile
scheduler: airbyte-scheduler/app/Dockerfile
init: airbyte-config/init/Dockerfile
run:
web: /docker-entrypoint.sh nginx -g 'daemon off;'
airbyte-temporal: /entrypoint.sh /bin/bash -c '/start.sh autosetup'
server: /bin/bash -c bin/${APPLICATION}
worker: /bin/bash -c bin/${APPLICATION}
scheduler: /bin/bash -c bin/${APPLICATION}
init: /bin/sh -c "./scripts/create_mount_directories.sh /local_parent ${HACK_LOCAL_ROOT_PARENT} ${LOCAL_ROOT}"
Heroku App Information
1. Stack: container
2. Framework: No framework detected
3. Slug size: No slug detected
Build failedCédric Malet
10/01/2021, 5:57 PM7th-street@7th-Street ~ % ssh -i /Users/7th-street/.ssh/airbyte-key.pem -L 8000:localhost:8000 -N -f <mailto:ec2-user@c2-18-170-227-242.eu-west-2.compute.amazonaws.com|ec2-user@c2-18-170-227-242.eu-west-2.compute.amazonaws.com>
ssh: Could not resolve hostname <http://c2-18-170-227-242.eu-west-2.compute.amazonaws.com|c2-18-170-227-242.eu-west-2.compute.amazonaws.com>: nodename nor servname provided, or not known
Cédric Malet
10/01/2021, 9:36 PMMichel Yeung
10/04/2021, 7:33 AMPrateek Gupta
10/04/2021, 8:32 AMPadraig O'Leary
10/04/2021, 12:39 PMCédric Malet
10/04/2021, 2:18 PMTim Chan
10/05/2021, 1:10 AMCédric Malet
10/05/2021, 4:08 PMFailed to fetch schema. Please try again
Any idea to resolve the issue?