Hello! I have dataset, resembles time-series type ...
# ingestion
i
Hello! I have dataset, resembles time-series type of aspect. Would like to ingest into DataHub & later run search/queries over REST. Would you point/help me with a json example/template, so that i extract & transform my (original the) dataset to be ingested over REST. Just wondering, did my Q making sense & the future(ingesting timeseries kind of data, their browsing & search) is available at present in DH.
b
Hi there! What type of dataset is this? Is this a time series dataset stored in some other system?
i
yes timeseries dataset(s) written into a JSON file. something like below { { "timeFrom" : <epoch-time in msecs> "timeTo" : <epoch-time in msecs> "field-01" : "string" "field-02" : 2.512 "field-03" : 9800 "field-04" : "Normal" "field-04" : "Direct-Pipe" "field-05" : 0.212 }, { "timeFrom" : <epoch-time in msecs> "timeTo" : <epoch-time in msecs> "field-01" : "string" "field-02" : 2.512 "field-03" : 9800 "field-04" : "Normal" "field-06" : 0.212 }, { "timeFrom" : <epoch-time in msecs> "timeTo" : <epoch-time in msecs> "field-02" : 2.512 "field-03" : 9800 "field-04" : "Normal" "field-04" : "Direct-Pipe" "field-02" : 0.212 }, { "timeFrom" : <epoch-time in msecs> "timeTo" : <epoch-time in msecs> "field-01" : "string" "field-02" : 2.512 "field-03" : 9800 "field-04" : "Normal" "field-04" : "Direct-Pipe" "field-05" : 0.212 }, { "timeFrom" : <epoch-time in msecs> "timeTo" : <epoch-time in msecs> "field-01" : "string" "field-02" : 21.512 "field-03" : -2800 "field-04" : "AbNormal" "field-04" : "Direct-Pipe" "field-05" : 0.912 }, ...... ...... ...... }
did this feature is avl with DH r yet to be implemented