Chính Bùi Quang
07/07/2023, 3:50 AMkapa.ai
07/07/2023, 3:50 AMkapa.ai
07/07/2023, 3:51 AMdocker-compose on your VM instance. bash # Set variables PROJECT_ID=PROJECT_ID_WHERE_YOU_CREATED_YOUR_INSTANCE INSTANCE_NAME=airbyte # or any other name that you've used # Install Google Cloud SDK and initialize gcloud brew install --cask google-cloud-sdk gcloud init # Verify you can see your instance gcloud --project $PROJECT_ID compute instances list # Connect to your instance gcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME # Install Docker sudo apt-get update sudo apt-get install -y apt-transport-https ca-certificates curl gnupg2 software-properties-common curl -fsSL <https://download.docker.com/linux/debian/gpg> | sudo apt-key add -- sudo add-apt-repository "deb [arch=amd64] <https://download.docker.com/linux/debian> buster stable" sudo apt-get update sudo apt-get install -y docker-ce docker-ce-cli <http://containerd.io|containerd.io> sudo usermod -a -G docker $USER # Install docker-compose sudo apt-get -y install docker-compose-plugin docker compose version 2. Install and launch Airbyte - In your local terminal, connect to your Google Cloud instance. - In your VM terminal, install Airbyte. bash # Connect to your Google Cloud instance gcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME # Install Airbyte mkdir airbyte && cd airbyte wget <https://raw.githubusercontent.com/airbytehq/airbyte/master/run-ab-platform.sh> chmod +x run-ab-platform.sh ./run-ab-platform.sh -b 3. Connect to Airbyte - In your local terminal, create an SSH tunnel to connect the GCP instance to Airbyte. - Verify the connection by visiting http://localhost:8000 in your browser. bash # Create an SSH tunnel gcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME -- -L 8000:localhost:8000 -N -f For the VM instance type, if you're just testing Airbyte, an e2.medium instance with at least 30GBs of disk per node is recommended. For a production environment, a n1-standard-2 instance is recommended. Please note that for security reasons, it's strongly recommended not to expose Airbyte publicly. Sources: - [Deploy Airbyte on GCP](https://docs.airbyte.com/deploying-airbyte/on-gcp-compute-engine) - [Airbyte Security](https://docs.airbyte.com/operator-guides/security)Nhật Nam
07/12/2023, 6:52 AM