There is some issue with data ingestion in postgre...
# ingestion
s
There is some issue with data ingestion in postgres. It has added some odd description (seems like error messages) to the tables Problem in table descriptions
Copy code
args: rastschema, rasttable, rastcolumn, srid=true, scale_x=true, scale_y=true, blocksize_x=true, blocksize_y=true, same_alignment=true, regular_blocking=false, num_bands=true, pixel_types=true, nodata_values=true, out_db=true, extent=true - Adds raster constraints to a loaded raster table for a specific column that constrains spatial ref, scaling, blocksize, alignment, bands, band type and a flag to denote if raster column is regularly blocked. The table must be loaded with data for the constraints to be inferred. Returns true of the constraint setting was accomplished and if issues a notice.
Copy code
args: schema_name, table_name, column_name, srid, type, dimension, use_typmod=true - Adds a geometry column to an existing table of attributes. By default uses type modifier to define rather than constraints. Pass in false for use_typmod to get old check constraint based behavior
Copy code
args: track1, track2 - Returns the measure at which points interpolated along two lines are closest.
Copy code
args: WKT - Return a specified ST_Geometry value from Well-Known Text representation (WKT). This is an alias name for ST_GeomFromText
Copy code
args: g - Returns TRUE if this LINESTRING is both closed and simple.
m
@square-activity-64562: are these strings inside the "description" field of the table in datahub?
s
yes
m
oh that's really odd
s
I found 5 tables with these descriptions so far when I used "hasDescription: true" as search. The table which I added description to is not showing up in search results
This looks like error message of ingestion of one table got added to the next table.
@gray-shoe-75895 any ideas?
On editing the description the popup is empty. It does not show up in popup modal. I have to add a dot or something and then click update
and even after editing the old description is still coming up in search results for "hasDescription: true"
It seems these are our table descriptions for these tables. Not sure why that is the case. So not a problem in ingestion. But the search results are still wrong.
m
So the final issue is that search previews are using the old description and not the edited one?
s
m
Cool. Waiting for CI to pass before merging this fix. https://github.com/linkedin/datahub/pull/2932