proud-table-38689
09/06/2022, 4:07 AMsql
datasource, is there an officially documented way to use a specific schema within that Postgres database? like just datahub
instead of the defalut public
schema? A use case is using the same postgres database for metadata across multiple systems, one of which would be DataHub (others could be Airflow, Superset, etc.)creamy-controller-55842
09/06/2022, 7:07 AMbright-receptionist-94235
09/06/2022, 9:07 AMdatahub.configuration.common.ConfigurationError: vertica is disabled; try running: pip install 'acryl-datahub[vertica]'
but from venv it works
source /python_ve/bin/activate
(python_ve) [root@dp-test006 ~]# python
Python 3.6.8 (default, Nov 16 2020, 16:55:22)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-44)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from sqlalchemy_vertica.base import VerticaDialect
bland-orange-13353
09/06/2022, 1:12 PMcreamy-controller-55842
09/06/2022, 2:03 PMalert-coat-46957
09/06/2022, 3:16 PM[2022-09-06, 14:55:50 UTC] {base.py:68} INFO - Using connection ID 'datahub_rest_default' for task execution.
[2022-09-06, 14:55:50 UTC] {logging_mixin.py:115} INFO - Exception: Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.9/site-packages/datahub_airflow_plugin/datahub_plugin.py", line 318, in custom_on_failure_callback
datahub_on_failure_callback(context)
File "/home/airflow/.local/lib/python3.9/site-packages/datahub_airflow_plugin/datahub_plugin.py", line 125, in datahub_on_failure_callback
DatahubGenericHook(context["_datahub_config"].datahub_conn_id)
File "/home/airflow/.local/lib/python3.9/site-packages/datahub_provider/hooks/datahub.py", line 77, in make_emitter
return datahub.emitter.rest_emitter.DatahubRestEmitter(*self._get_config())
AttributeError: module 'datahub' has no attribute 'emitter
proud-table-38689
09/06/2022, 9:42 PMcreamy-controller-55842
09/07/2022, 6:59 AMcuddly-arm-8412
09/07/2022, 7:09 AMcreamy-controller-55842
09/07/2022, 7:33 AMmysterious-scooter-52411
09/07/2022, 7:36 PMthousands-solstice-2498
09/08/2022, 6:19 AMrapid-book-98432
09/08/2022, 6:41 AMcoalesce.go220 warning: cannot overwrite table with non table for datahub.datahub-frontend.env (map[JMXPORT:1099])
coalesce.go220 warning: cannot overwrite table with non table for datahub.datahub-gms.env (map[JMXPORT:1099])
cuddly-arm-8412
09/08/2022, 8:39 AMcuddly-arm-8412
09/08/2022, 8:40 AMproud-table-38689
09/08/2022, 8:19 PMKAFKA_SCHEMAREGISTRY_URL
be in the helm chart if we are using AWS_GLUE?proud-table-38689
09/08/2022, 11:06 PMQuery threw SQLException:ERROR: relation "metadata_aspect_v2" does not exist
full-chef-85630
09/09/2022, 2:07 AM01:59:36.622 [main] WARN o.s.w.c.s.XmlWebApplicationContext:591 - Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanDefinitionStoreException: Failed to parse configuration class [com.linkedin.gms.factory.common.GitVersionFactory]; nested exception is java.io.FileNotFoundException: class path resource [git.properties] cannot be opened because it does not exist
01:59:36.651 [main] ERROR o.s.web.context.ContextLoader:313 - Context initialization failed
org.springframework.beans.factory.BeanDefinitionStoreException: Failed to parse configuration class [com.linkedin.gms.factory.common.GitVersionFactory]; nested exception is java.io.FileNotFoundException: class path resource [git.properties] cannot be opened because it does not exist
at org.springframework.context.annotation.ConfigurationClassParser.parse(ConfigurationClassParser.java:189)
at org.springframework.context.annotation.ConfigurationClassPostProcessor.processConfigBeanDefinitions(ConfigurationClassPostProcessor.java:331)
at org.springframework.context.annotation.ConfigurationClassPostProcessor.postProcessBeanDefinitionRegistry(ConfigurationClassPostProcessor.java:247)
thousands-solstice-2498
09/09/2022, 8:04 AMthousands-solstice-2498
09/09/2022, 8:04 AMbumpy-needle-3184
09/09/2022, 9:53 AMbumpy-needle-3184
09/09/2022, 9:53 AMthousands-solstice-2498
09/09/2022, 10:54 AMagreeable-belgium-70840
09/09/2022, 12:38 PMCaused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.health.HealthContributorRegistry]: Factory method 'healthContributorRegistry' threw exception; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'solrHealthContributor' defined in class path resource [org/springframework/boot/actuate/autoconfigure/solr/SolrHealthContributorAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.health.HealthContributor]: Factory method 'solrHealthContributor' threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/solr/client/solrj/impl/BaseHttpSolrClient$RemoteSolrException
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:185)
at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:653)
... 26 common frames omitted
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'solrHealthContributor' defined in class path resource [org/springframework/boot/actuate/autoconfigure/solr/SolrHealthContributorAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.health.HealthContributor]: Factory method 'solrHealthContributor' threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/solr/client/solrj/impl/BaseHttpSolrClient$RemoteSolrException
at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:658)
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:638)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1352)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1195)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:582)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfType(DefaultListableBeanFactory.java:671)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfType(DefaultListableBeanFactory.java:659)
at org.springframework.context.support.AbstractApplicationContext.getBeansOfType(AbstractApplicationContext.java:1300)
at org.springframework.boot.actuate.autoconfigure.health.HealthEndpointConfiguration.healthContributorRegistry(HealthEndpointConfiguration.java:82)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154)
... 27 common frames omitted
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.health.HealthContributor]: Factory method 'solrHealthContributor' threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/solr/client/solrj/impl/BaseHttpSolrClient$RemoteSolrException
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:185)
at
famous-fall-59477
09/09/2022, 1:05 PMcreamy-controller-55842
09/12/2022, 6:36 AMthousands-solstice-2498
09/12/2022, 7:14 AMthousands-solstice-2498
09/12/2022, 7:29 AMthousands-solstice-2498
09/12/2022, 9:26 AMwitty-lamp-55264
09/12/2022, 9:44 AMError: INSTALLATION FAILED: unable to build kubernetes objects from release manifest: unable to recognize "": no matches for kind "PodDisruptionBudget" in version "policy/v1beta1"
After searching, I found that kubernetes latest versions don't support some type of api's such as PodDisruptionBudget
. I wanna see if there will be a newer version that works with the latest versions of kubernetes or is there another solution.