fast-vegetable-81275
06/01/2023, 9:21 PMlocalhost:8080 from my local machine. Below is the yaml file I have created named as `csvingestion.dhub.yaml`:
source:
type: csv-enricher
config:
# relative path to your csv file to ingest
filename: .\path\to\file\census_income_morethan50K.csv
sink:
type: "datahub-rest"
config:
server: "<http://localhost:8080>"
I am getting the below error when I do the ingestion using the command python3 -m datahub ingest -c .\path\to\file\csvingestion.dhub.yaml
I have also done installations using python3 -m pip install acryl-datahub[csv] and python3 -m pip install acryl-datahub[csv-enricher]
Please advise what should be done. Also, if there is another effective way to ingest local CSV file please let me know. Thanks in advance!better-orange-49102
06/02/2023, 1:34 AMbetter-orange-49102
06/02/2023, 1:34 AMgentle-hamburger-31302
06/06/2023, 5:14 AMgentle-hamburger-31302
06/06/2023, 5:14 AMNote that because the profiling is run with PySpark, we require Spark 3.0.3 with Hadoop 3.2 to be installed