kind-whale-32412
08/19/2022, 5:33 PMdatahub-gms | ERROR: No such classes directory file:///etc/datahub/plugins/auth/resources
error and datahub-gms is not starting up on quickstart. Anyone got any clue?incalculable-branch-51967
08/19/2022, 7:15 PMredshift_usage
ingestion, but I'm getting hardly any logs. I tried both python sdk in airflow and cli. In airflow I only see this log, both in successful and failed ingestions:
INFO - Setting gms config
When I run the cli I also see this:
INFO {datahub.cli.ingest_cli:91} - Starting metadata ingestion
The problem I'm facing is that the process ends because it consumes all the available ram, so I'd like to find which tables are the ones that cause these memory requirements. Is it possible that this callback isn't working as expected?nutritious-salesclerk-57675
08/21/2022, 3:39 PMbillions-horse-96717
08/22/2022, 8:39 AMfamous-florist-7218
08/23/2022, 6:48 AMClass com.datahub.authorization.ranger.RangerAuthorizerTest
. Any suggestions to bypass or fix this stuff? Thanks
java.lang.UnsatisfiedLinkError: /Users/146685/Library/Caches/JNA/temp/jna4049579015533420670.tmp: dlopen(/Users/146685/Library/Caches/JNA/temp/jna4049579015533420670.tmp, 0x0001): tried: '/Users/146685/Library/Caches/JNA/temp/jna4049579015533420670.tmp' (fat file, but missing compatible architecture (have 'i386,x86_64', need 'arm64e')), '/usr/lib/jna4049579015533420670.tmp' (no such file)
Note: I built locally on Mac M1 machine.victorious-pager-14424
08/23/2022, 1:04 PMMetric
in DataHub following the fork approach. The Metric entity only has one key aspect called MetricKey.
However, ./gradlew build
is failing in the :metadata-io:test
step. The test report indicates four failures, all with the same error:
java.lang.IllegalArgumentException: Aspect MetricKey does not exist
Any idea to debug this? more info on 🧵most-monkey-10812
08/23/2022, 2:47 PMfast-dentist-66985
08/23/2022, 4:18 PMfast-dentist-66985
08/23/2022, 4:18 PMfast-dentist-66985
08/23/2022, 4:19 PMfast-dentist-66985
08/23/2022, 4:19 PMfast-dentist-66985
08/23/2022, 4:19 PMfast-dentist-66985
08/23/2022, 4:19 PMfresh-evening-65356
08/23/2022, 6:51 PMdatahub-gms
which fails the pod creations with the following error I'll add as a reply.
Has anyone run into this before, or have any ideas? If there's any information that I can provide, please let me know. Thanks in advance for any information you can provide.numerous-account-62719
08/24/2022, 4:56 AMnutritious-salesclerk-57675
08/24/2022, 2:42 PMbest-fireman-42901
08/24/2022, 4:54 PMfresh-evening-65356
08/25/2022, 3:14 AMinstall.go:178: [debug] Original chart version: ""
install.go:195: [debug] CHART PATH: /home/sguillory/.cache/helm/repository/datahub-0.2.91.tgz
client.go:310: [debug] Starting delete for "datahub-elasticsearch-setup-job" Job
client.go:128: [debug] creating 1 resource(s)
client.go:540: [debug] Watching for changes to Job datahub-elasticsearch-setup-job with timeout of 5m0s
client.go:568: [debug] Add/Modify event for datahub-elasticsearch-setup-job: ADDED
client.go:607: [debug] datahub-elasticsearch-setup-job: Jobs active: 1, jobs failed: 0, jobs succeeded: 0
Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition
helm.go:84: [debug] failed pre-install: timed out waiting for the condition
INSTALLATION FAILED
main.newInstallCmd.func2
<http://helm.sh/helm/v3/cmd/helm/install.go:127|helm.sh/helm/v3/cmd/helm/install.go:127>
<http://github.com/spf13/cobra.(*Command).execute|github.com/spf13/cobra.(*Command).execute>
<http://github.com/spf13/cobra@v1.4.0/command.go:856|github.com/spf13/cobra@v1.4.0/command.go:856>
<http://github.com/spf13/cobra.(*Command).ExecuteC|github.com/spf13/cobra.(*Command).ExecuteC>
<http://github.com/spf13/cobra@v1.4.0/command.go:974|github.com/spf13/cobra@v1.4.0/command.go:974>
<http://github.com/spf13/cobra.(*Command).Execute|github.com/spf13/cobra.(*Command).Execute>
<http://github.com/spf13/cobra@v1.4.0/command.go:902|github.com/spf13/cobra@v1.4.0/command.go:902>
main.main
<http://helm.sh/helm/v3/cmd/helm/helm.go:83|helm.sh/helm/v3/cmd/helm/helm.go:83>
runtime.main
runtime/proc.go:255
runtime.goexit
runtime/asm_amd64.s:1581
Can someone tell me what I am doing wrong?numerous-account-62719
08/25/2022, 4:42 AMgreat-account-95406
08/25/2022, 8:07 AMfew-air-56117
08/25/2022, 1:09 PMhelm upgrade --install datahub datahub/datahub -f helm_custom_settings.yaml --version 0.2.90
but i got this error
Error: failed pre-install: timed out waiting for the condition
stale-printer-44316
08/25/2022, 4:08 PMbland-balloon-48379
08/25/2022, 6:48 PMthousands-solstice-2498
08/26/2022, 10:38 AMhigh-gigabyte-86638
08/26/2022, 3:25 PMmagnificent-petabyte-23245
08/29/2022, 5:51 AMdatahub docker quickstart
I get the following error.
(CentOS Linux 7 (Core) Kernel: Linux 3.10.0-957.el7.x86_64)
zookeeper is up-to-date
mysql is up-to-date
Starting elasticsearch ...
broker is up-to-date
Starting mysql-setup ...
datahub-gms is up-to-date
schema-registry is up-to-date
datahub_datahub-actions_1 is up-to-date
datahub-frontend-react is up-to-date
Starting elasticsearch ... error
WARNING: Host is already in use by another container
ERROR: for elasticsearch Cannot start service elasticsearch: driver failed programming external connectivity on endpoint elasticsearch (30d2cd08b59735e4a2125ca934d92258aa187167918d4f135e29c776fc62978b): Error starting userland proxy: listen tcp4 0.0.0.0:9200: bind:
Starting mysql-setup ... done
ERROR: for elasticsearch Cannot start service elasticsearch: driver failed programming external connectivity on endpoint elasticsearch (30d2cd08b59735e4a2125ca934d92258aa187167918d4f135e29c776fc62978b): Error starting userland proxy: listen tcp4 0.0.0.0:9200: bind: address already in use
ERROR: Encountered errors while bringing up the project.
.............
Unable to run quickstart - the following issues were detected:
- elasticsearch-setup container is not present
- datahub-gms is running but not healthy
- elasticsearch is not running
No other docker images are installedminiature-policeman-55414
08/26/2022, 8:53 PMmagnificent-petabyte-23245
08/29/2022, 1:45 PM# python3 -m datahub docker quickstart
/usr/local/lib/python3.6/site-packages/datahub/__init__.py:23: FutureWarning: DataHub will require Python 3.7 or newer in a future release. Please upgrade your Python version to continue using DataHub.
FutureWarning,
[2022-08-29 13:44:30,077] ERROR {datahub.entrypoints:189} - Command failed with 'DockerClient' object has no attribute 'close' In Docker SDK for Python 2.0, this method is now on the object APIClient. See the low-level API section of the documentation for more details.. Run with --debug to get full trace
[2022-08-29 13:44:30,077] INFO {datahub.entrypoints:192} - DataHub CLI version: 0.8.43 at /usr/local/lib/python3.6/site-packages/datahub/__init__.py
python3 is 3.6.8big-animal-76099
08/29/2022, 2:43 PMbig-animal-76099
08/29/2022, 3:03 PM