Hi, which is the best/recommended method to include drivers like sql server for my crawlers when deploying with helm?

Hello Ricardo 👋 The recommended approach would be to build your own custom

datahub-ingestion

docker image from

linkeding/datahub-ingestion

with the driver you want. A possible workaround if you don’t want to build specific images is, if you’re using datahub’s charts ,define ingestion crawlers using this subchart and edit the command per crawler you want to set up. Something like:

datahub-ingestion-cron:
  enabled: true
  crons:
    sqlserver:
      command: ["/bin/sh", "-c", "pip install 'acryl-datahub[mssql]'; datahub ingest -c <recipe.fileName>"]
      extraVolumes: ...
      extraVolumeMounts: ...

nice! will follow that, since we are not in production I don’t want to lose time building our own images. 👍👍👍