Hi Team, I'm planning to use Airbyte, AirFlow for ...
# replication-ask-ai
p
Hi Team, I'm planning to use Airbyte, AirFlow for my team. Basic task is just do ELT from E-commerce and Marketing Analysis Source to Azure Blob Storage. The local process is good, now I want to move in Azure VM, can you guys help me to pick the best p/p Azure VM options? Incremental records daily are around 30-40000 records
k
Sure, I can guide you on how to deploy Airbyte on Azure VM. The instructions provided in the [Airbyte documentation](https://docs.airbyte.com/deploying-airbyte/on-azure-vm-cloud-shell) have been tested on a standard DS1 v2 (1 vcpu, 3.5 GiB memory) Microsoft Azure VM with Ubuntu 18.04. This could be a good starting point for you. Here are the steps to deploy Airbyte on Azure VM: 1. Create a new VM and generate the SSH keys to connect to the VM. You’ll need the SSH keys to connect to the VM remotely later. 2. Connect to the VM by running the following command in the Azure Cloud Shell:
Copy code
bash ssh <admin username>@<IP address>
3. Install Docker and Docker Compose in the VM. You can follow the detailed steps provided in the [documentation](https://docs.airbyte.com/deploying-airbyte/on-azure-vm-cloud-shell). 4. Download Airbyte's install script from GitHub and deploy it in the VM using Docker Compose:
Copy code
bash wget <https://raw.githubusercontent.com/airbytehq/airbyte/master/run-ab-platform.sh>   chmod +x run-ab-platform.sh   ./run-ab-platform.sh -b
5. Test a remote connection to your VM locally and verify that Airbyte is up and running. You can create a SSH tunnel for
port 8000
and navigate to
<http://localhost:8000>
in a web browser to see Airbyte’s landing page. As for the best price/performance Azure VM options, it would depend on your specific workload and requirements. The DS1 v2 VM used in the documentation is a good starting point, but you might need to scale up depending on your data volume and the complexity of your tasks. Azure provides a wide range of VM sizes and types to fit different use cases. You can find more information on choosing the right VM size in the [Azure documentation](https://docs.microsoft.com/en-us/azure/virtual-machines/sizes). Please note that for security reasons, it is strongly recommended not to expose Airbyte on Internet available ports.