@Manupriya Logus autopilot mode on GKE not really stable in my experience (2 days ago) - better to go with standard mode & set node limits etc
09/23/2021, 6:19 AM
thank for the help guys' able to set up on GKE
Can any one know what is the best way to set up DBT on GKE tried with several docker images but getting errors
09/27/2021, 12:31 PM
@Zach Brak very interesting to hear that it was not really stable. We are interested which problems you were facing? I mean the airbyte on autopilot would be fantastic !
09/27/2021, 1:30 PM
@Marcel Prothmann Given I didn’t spend too much time fine tuning - but what I was seeing was when starting to build any connector
• you would try to load the connector page in the UI
• Worker would spin up to perform the action (and return config ui), but the available memory would not scale in time to accommodate the worker
• Worker would fail and time out the UI response
As it was my test environment I decided to save headaches and switch to standard with minimal nodes.