Hey all, I'm trying to run a custom transformer, i...
# ingestiong
glamorous-library-1322
07/22/2022, 11:31 AMHey all, I'm trying to run a custom transformer, it works well via CLI but cannot make it work via the Ingestion GUI, i get
ModuleNotFoundErrorc
careful-pilot-86309
07/22/2022, 11:49 AMYou will need to install them in datahub-actions container
g
glamorous-library-1322
07/22/2022, 12:23 PMthanks for a fast reply! indeed i installed the package in my datahub-actions container, however the execution still yields the same error. Anything special need to be added to the ingestion spec, or the datahub-actions is always used to run GUI ingestion?
m
mammoth-bear-12532
07/22/2022, 9:08 PM
Hi @glamorous-library-1322 unfortunately the UI-based ingestion doesn't have all the flexibility of the cli-based ingestion. Specifically, we don't have the ability for you to "bring your own code" yet.
mammoth-bear-12532
07/22/2022, 9:09 PM
This is something we are thinking about though, so we will probably come up with some creative solves for this soon, but in the meantime, you will have to use the cli-based ingestion if you need to customize the ingestion via transformers.
g
glamorous-library-1322
07/26/2022, 2:15 PM@mammoth-bear-12532 thanks for taking time to reply to me 🙂 indeed it would be cool if it was possible to run custom things in UI but i get it is not a priority, i will use the client for now observe town hall for new features.
10 Views