best-daybreak-64419
01/13/2023, 3:38 PMmetadata-io
, metadata-service
, metadata-ingestion
, datahub-GMS
Can someone give me a summary of what each module does and how it relates to it?microscopic-scientist-28962
01/14/2023, 6:40 PM2023-01-14 13:14:46 2 done working
2023-01-14 13:14:46 3 done working
2023-01-14 13:14:46 1 done working
2023-01-14 13:14:56 WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both.
2023-01-14 13:14:58 4 done working
2023-01-14 13:14:58 Topic Creation Complete.
The broker service appears to be running correctly but GMS says it’s still waiting on it.
Nuking, pruning and starting over. I’ve removed all other containers and don’t believe there are any port conflicts. It appears to be a timing issue (I think).
Is is possible to just start the various components one by one within the docker desktop?worried-animal-81235
01/16/2023, 2:29 PMlemon-daybreak-58504
01/16/2023, 6:25 PMgray-nightfall-60513
01/17/2023, 1:32 PMgifted-florist-55079
01/17/2023, 7:10 PMquaint-ambulance-76706
01/17/2023, 8:39 PMlively-dusk-19162
01/17/2023, 9:16 PMlively-dusk-19162
01/17/2023, 9:16 PMsteep-train-75714
01/17/2023, 9:33 PMsteep-train-75714
01/17/2023, 9:36 PMsteep-train-75714
01/17/2023, 9:39 PMgentle-plastic-92802
01/18/2023, 3:07 AMbrave-zoo-82336
01/18/2023, 2:57 PMgifted-bird-57147
01/18/2023, 3:06 PMcold-application-21589
01/18/2023, 9:11 PMcolossal-autumn-78301
01/19/2023, 1:59 PM> Task :metadata-ingestion:lint
+ black --check --diff src/ tests/ examples/
All done! ✨ 🍰 ✨
580 files would be left unchanged.
+ isort --check --diff src/ tests/ examples/
Skipped 1 files
+ flake8 --count --statistics src/ tests/ examples/
0
+ mypy --show-traceback --show-error-codes src/ tests/ examples/
src/datahub/ingestion/source_config/sql/snowflake.py:345: error: Dict entry 0 has incompatible type "str": "bytes"; expected "str": "int" [dict-item]
Found 1 error in 1 file (checked 636 source files)
> Task :metadata-ingestion:lint FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':metadata-ingestion:lint'.
> Process 'command 'bash'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at <https://help.gradle.org>
cuddly-plumber-64837
01/19/2023, 3:10 PMfresh-cricket-75926
01/20/2023, 9:04 AMgifted-bird-57147
01/20/2023, 12:35 PM[
{
"auditHeader": null,
"proposedSnapshot": {
"com.linkedin.pegasus2avro.metadata.snapshot.DataPlatformSnapshot": {
"urn": "urn:li:dataPlatform:CSW_Record",
"aspects": [
{
"com.linkedin.pegasus2avro.dataplatform.DataPlatformInfo": {
"datasetNameDelimiter": "/",
"name": "CSW_Record",
"type": "OTHER",
"logoUrl": "<https://d1q6f0aelx0por.cloudfront.net/product-logos/library-geonetwork-logo.png>"
}
}
]
}
},
"proposedDelta": null
}
]
Is there a way to have the name show up as well? (like with the standard platform types)brave-businessperson-3969
01/20/2023, 3:41 PMcolossal-van-35225
01/20/2023, 10:59 PMripe-eye-60209
01/21/2023, 12:36 PMfew-tent-85021
01/21/2023, 11:02 PMdelightful-quill-6776
01/22/2023, 12:56 PMmicroscopic-machine-90437
01/24/2023, 10:30 AMblue-pilot-81295
01/24/2023, 1:11 PMwitty-butcher-82399
01/24/2023, 2:41 PMDELETE_ENTITY_PRIVILEGE
I haven’f found the corresponding CREATE_ENTITY_PRIVILEGE
. Does it mean that this privilege is given out of the box to all users?
Instead I was thinking we may restrict the create entity privilege to some specific user, or even restrict some users to create entities (datasets) for some specific platform or even platform instance only. So just wondering whether this is possible.
Thanksbetter-orange-49102
01/24/2023, 3:05 PMsource:
type: "kafka"
config:
connection:
bootstrap: ${KAFKA_BOOTSTRAP_SERVER:-localhost:9092}
schema_registry_url: ${SCHEMA_REGISTRY_URL:-<http://localhost:8081>}
Am I misunderstanding something or missed out a configmammoth-insurance-91360
01/25/2023, 10:22 AM