plain-farmer-27314
01/11/2022, 8:32 PM➜ datahub-explore python3 -m datahub version
DataHub CLI version: 0.8.22.1
Python version: 3.7.9 (default, Jan 24 2021, 17:48:25)
[Clang 7.1.0 (tags/RELEASE_710/final)]
I've also made sure to run upgrade on the bigquery plugin and the datahub-rest plugin
the error:
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/Users/zachary.bluhm/.local/lib/python3.7/site-packages/datahub/ingestion/source/sql/bigquery.py", line 25, in <module>
from datahub.ingestion.source.sql.sql_common import (
File "/Users/zachary.bluhm/.local/lib/python3.7/site-packages/datahub/ingestion/source/sql/sql_common.py", line 39, in <module>
from datahub.ingestion.source.state.stateful_ingestion_base import (
File "/Users/zachary.bluhm/.local/lib/python3.7/site-packages/datahub/ingestion/source/state/stateful_ingestion_base.py", line 18, in <module>
from datahub.ingestion.source.state_provider.state_provider_registry import (
File "/Users/zachary.bluhm/.local/lib/python3.7/site-packages/datahub/ingestion/source/state_provider/state_provider_registry.py", line 10, in <module>
assert ingestion_state_provider_registry.get("datahub")
File "/Users/zachary.bluhm/.local/lib/python3.7/site-packages/datahub/ingestion/api/registry.py", line 124, in get
raise KeyError(f"Did not find a registered class for {key}")
Also fwiw, looker ingestion is working as normalmelodic-helmet-78607
01/12/2022, 5:39 AMhigh-hospital-85984
01/12/2022, 10:43 AMcurl -X POST '<http://localhost:9002/api/graphql>' \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data-raw '{"query":"{\n me {\n corpUser {\n username\n }\n }\n}","variables":{}}'
I get a 401. making the same request to the GMS (:8080
) works but so does any other token, or with no token at all.
Is there someway to ensure that the authentication service has indeed been enabled properly?quick-pizza-8906
01/12/2022, 1:13 PMred-pizza-28006
01/12/2022, 1:45 PMValidation error of type FieldUndefined: Field 'operations' in type 'Dataset' is undefined @ 'dataset/operations' (code undefined)
faint-painting-38451
01/12/2022, 7:18 PMcareful-insurance-60247
01/12/2022, 9:35 PMeager-gpu-17565
01/13/2022, 9:02 AMacceptable-potato-35922
01/13/2022, 5:29 PMacceptable-architect-70237
01/13/2022, 9:00 PMfrontend-react
and gms
app separately. I have made sure the gms
API endpoint works as expected by running the api/graphql
in the cUrl
or postman
. I also made sure my frontend deployed successfully. But I kept receiving errors from the datahub-frontend
module
502, Unable to route request - Domain Unavailable
I did another experiment. Running the frontend-react
docker locally, and pointing the remote gms
, I received the same 502, Unable to route request - Domain Unavailable
error.
Of course, if local frontend-react
pointed to local datahub-gms
, everything works fine.
I also experimented any backend app (pyhton,
, node.js
to talk to the remote backend api/graph
, it works fine as well. What could be the problem? is any settings in front-end
module?numerous-eve-42142
01/13/2022, 9:38 PMnutritious-bird-77396
01/13/2022, 10:59 PMurn:li:dataset:(urn:li:dataPlatform:foo,bar,PROD)
returned from GMS but they don't show up in the frontend.
Are the example urns ignored in the frontend config somewhere?miniature-television-17996
01/14/2022, 7:52 AMwitty-laptop-49489
01/14/2022, 10:39 AMv0.8.22
the UI stopped showing Inputs for charts.damp-queen-61493
01/14/2022, 7:39 PMlinkedin/datahub-frontend-react:v0.8.22
, but I can't see the datahub version on top right.
I'm really using version 0.8.22?
(Sorry for my english)billions-tent-29367
01/14/2022, 8:56 PMbland-barista-59197
01/15/2022, 4:39 AMnutritious-bird-77396
01/15/2022, 5:28 PMexport DATAHUB_VERSION=0.8.23
wget <https://github.com/linkedin/datahub/archive/refs/tags/v${DATAHUB_VERSION}.tar.gz> && \
tar -xzf v${DATAHUB_VERSION}.tar.gz && \
mv datahub-${DATAHUB_VERSION} datahub-src && \
rm v${DATAHUB_VERSION}.tar.gz
cd /datahub-src && ./gradlew :metadata-service:war:build -x test
Error stack in 🧵ancient-pillow-45716
01/17/2022, 6:57 AMdatahub docker quickstart
)and that did not include any source code, just several running containers. How can I edit user.pros
file to add user to login? I tried to edit this file inside datahub-frontend-react
container but it didn't work. @square-activity-64562 @little-megabyte-1074glamorous-microphone-33484
01/17/2022, 8:33 AMbillowy-lock-72499
01/17/2022, 11:07 AMquaint-branch-37931
01/17/2022, 1:37 PMFieldUndefined
errors in the UI. Do I have to take additional steps to upgrade, apart from updating the container versions?rich-policeman-92383
01/18/2022, 8:27 AMbland-orange-13353
01/18/2022, 2:08 PMrich-policeman-92383
01/18/2022, 9:06 PMspark = (SparkSession
.builder
.appName("PythonMnMCount")
.config("spark.jars.packages","io.acryl:datahub-spark-lineage:0.0.2")
.config("spark.extraListeners","com.linkedin.datahub.lineage.spark.interceptor.DatahubLineageEmitter")
.config("spark.datahub.rest.server", "<http://localhost:8080>")
.enableHiveSupport()
.getOrCreate())
busy-zebra-64439
01/19/2022, 4:30 AMwitty-laptop-49489
01/19/2022, 2:05 PMDESCRIBE TABLE test.test_nested
┌─name──────────────────┬─type──────────────────────┬─default_type─┬─default_expression─┬─comment─┬─codec_expression─┬─ttl_expression─┐
│ id │ UInt64 │ │ │ │ │ │
│ some.column │ String │ │ │ │ │ │
│ col_Nested.ID │ Array(UInt32) │ │ │ │ │ │
│ col_Nested.Serial │ Array(UInt32) │ │ │ │ │ │
│ col_Nested.EventTime │ Array(Nullable(DateTime)) │ │ │ │ │ │
│ col_Nested.Price │ Array(Int64) │ │ │ │ │ │
│ col_Nested.OrderID │ Array(String) │ │ │ │ │ │
│ col_Nested.CurrencyID │ Array(Nullable(UInt32)) │ │ │ │ │ │
└───────────────────────┴───────────────────────────┴──────────────┴────────────────────┴─────────┴──────────────────┴────────────────┘
few-air-56117
01/19/2022, 2:55 PMmelodic-helmet-78607
01/20/2022, 10:10 AM08:04:10 [application-akka.actor.default-dispatcher-11] ERROR controllers.AuthenticationController - Authentication error
javax.naming.AuthenticationException: javax.security.auth.login.FailedLoginException: Cannot connect to LDAP server
few-air-56117
01/20/2022, 1:28 PM{datahub.ingestion.source.sql.bigquery:224} - Built lineage map containing 0 entries.
UserWarning: Cannot create BigQuery Storage client, the dependency google-cloud-bigquery-storage is not installed.