Hello, I can't seem to get airbyte to start anymor...
# replication-ask-ai
j
Hello, I can't seem to get airbyte to start anymore, I'm thinking about backing up the config for my sources/destinations and connections, nuke it and reinstall. How would I go about backing up the sources/destinations/connections?
k
A message from kapa.ai
You can back up your Airbyte configurations (sources, destinations, connections) using the Octavia CLI, which is a command line interface provided by Airbyte. This tool uses the Airbyte API under the hood and allows you to manage resource configurations as code in YAML format. Here's how you can do it: 1. First, you need to import all existing resources on your Airbyte instance. You can do this with the
octavia import all
command. This will create local configuration files for all Airbyte resources that were already existing on your instance.
Copy code
bash $ octavia import all
After running this command, you should see a message indicating that the import was successful for each of your sources, destinations, and connections. 2. Please note that any secret values that exist in these configuration files are not imported, so you will need to manually update these in the configuration files. 3. Once you have these configuration files, you can reinstall Airbyte and then use the
octavia apply
command to apply these configurations to your new Airbyte instance. For more detailed instructions, you can refer to the [Octavia CLI documentation](https://docs.airbyte.com/cli-documentation) and the [tutorial on version controlling Airbyte configurations](https://airbyte.com/tutorials/version-control-airbyte-configurations). Please note that this process requires you to have the Octavia CLI installed and configured to target your Airbyte instance. If you haven't done this yet, you can find instructions in the [Octavia CLI README](https://github.com/airbytehq/airbyte/blob/master/octavia-cli/README.md).
j
Airbyte web is not starting, I'm unable to use octavia, how do I backup my connections/sources/destinations?
i
Airbyte web is not starting, I'm unable to use octavia, how do I backup my connections/sources/destinations?
I would try to fix it first, because it can happen again 🙂 About backing up your airbyte data, It's all in the airbyte database. The one described in the
DATABASE_HOST
/
DATABASE_URL
and other
DATABASE_*
env variables. You can dump it and restore after your re-installation. If you configured external database, there will probably be no need to touch the database at all (but all depend on your configuration). In the screen how that database looks:
🙏 1
j
Thanks! I'm having a hard time cleaning up the docker stuff, I though I deleted everything, but when I run the script it complains that the
volume/airbyte_db
does not exist, not sure what I'm doing wrong...
I feel like I cleared everything out using docker prune, but for some reason airbyte is failing to start and temporal is complaining about
Copy code
Unable to create dynamic config client. Error: unable to validate dynamic config: dynamic config: config/dynamicconfig/development.yaml: stat config/dynamicconfig/development.yaml: no such file or directory
it keeps looping through these messages:
i
volume/airbyte_db
does not exist
I am not familiar with airbyte docker deployment, but it is quite a scary message if you hadn't backed up the database 🙂 I hope you did and haven't lost the data... Temporal - see several messages above: https://airbytehq.slack.com/archives/C01AHCD885S/p1689780217867399
j
I did back it up,
🔥 1
@Igor Safonov, good find, I'm trying that out now
🙌 1
kind of worked, but not it's throwing different errors...
i
what errors?
j
image.png
Ok, I think I managed, for some reason the file that I downloaded from github was in json format...
Thanks for the help @Igor Safonov
🙌 1
i
I am happy that you managed to do that, congrats 🙂
j
@Jamil B I am having the same issue, could you describe how you were able to download the file and rerun Airbyte properly? Would be much appreciated!
(I am using Google VM Instances to configure airbyte)
j
download this file: https://github.com/airbytehq/airbyte-platform/blob/main/temporal/dynamicconfig/development.yaml I added it to ./temporal/dynamicconfig as root
thanku 2