gorgeous-glass-57878
08/18/2021, 4:58 PMsource:
type: "snowflake"
config:
username: user
password: "password"
host_port: port
database: database
warehouse: warehouse
table_pattern:
allow:
- "DATABASE.SCHEMA.TABLE_NAME"
sink:
type: "datahub-rest"
config:
server: 'server_url'clever-ocean-10572
08/18/2021, 8:24 PMmodern-nail-74015
08/19/2021, 3:06 AMmagnificent-camera-71872
08/19/2021, 5:44 AMbumpy-activity-74405
08/19/2021, 7:14 AMable-activity-25706
08/19/2021, 7:58 AMwitty-butcher-82399
08/19/2021, 12:36 PMredshift
connector with profiling enabled.
File "/usr/local/lib/python3.8/site-packages/datahub/ingestion/source/ge_data_profiler.py", line 222, in _handle_convert_column_evrs
column_profile.nullProportion = res["unexpected_percent"] / 100
TypeError: unsupported operand type(s) for /: 'NoneType' and 'int'
Seems a bug, so I’m sharing here. I could create an issue in github if you prefer that.clever-ocean-10572
08/19/2021, 2:01 PMclever-ocean-10572
08/19/2021, 3:47 PMbest-balloon-56
08/20/2021, 6:07 AMhandsome-football-66174
08/20/2021, 5:28 PMhandsome-football-66174
08/20/2021, 7:17 PMclever-ocean-10572
08/20/2021, 9:04 PMgorgeous-fountain-3070
08/22/2021, 1:47 PMclever-ocean-10572
08/23/2021, 5:50 PMTypeError: unsupported operand type(s) for /: 'NoneType' and 'int'
handsome-football-66174
08/23/2021, 7:26 PMhigh-house-54354
08/23/2021, 8:20 PM. 86 more\nCaused by: java.net.URISyntaxException: Invalid URN Parameter: 'No enum constant com.linkedin.common.FabricType.TESTE: urn:li:dataset:(urn:li:dataPlatform:mssql,db_XXX.dbo.tb_ZZZZ,TESTE)
Using Pipeline.create() as:
pipeline = Pipeline.create(
# This configuration is analogous to a recipe configuration.
{
"source": {
"type": "mssql",
"config": {
"username": conn_odbc.login,
"password": conn_odbc.password,
"database": database,
"host_port": conn_odbc.host,
"use_odbc": "True",
"env": "TESTE"}
}
}
bored-advantage-45185
08/23/2021, 9:14 PMdatahub_docker.sh ingest -c postges_to_datahub.yml
, a new screen pops up and it close when the execution is done. Is there a way to see the log or keep the window open to see the status of the ingestion? Currently I don't see data getting loaded to datahub metadata yet.magnificent-camera-71872
08/24/2021, 12:19 AMDataFlowSnapshotClass
for ML flows (like kubeflow pipelines). I looked thro the schema_classes.py definitions but nothing stood out.... Thanks....melodic-helmet-78607
08/24/2021, 3:39 AMgorgeous-fountain-3070
08/24/2021, 8:21 AMsquare-activity-64562
08/24/2021, 12:59 PMbored-advantage-45185
08/24/2021, 10:08 PMmagnificent-camera-71872
08/24/2021, 11:49 PMmammoth-sugar-1353
08/25/2021, 1:20 PMrhythmic-london-44496
08/25/2021, 2:50 PMblue-holiday-20644
08/25/2021, 3:01 PMcolossal-account-65055
08/25/2021, 6:26 PMadamant-furniture-37835
08/26/2021, 12:05 PMthousands-tailor-5575
08/26/2021, 2:47 PM