This is an issue that dataHub has. If you create an upstream or downstream lineage metadata pointing to an urn that does not exist or was deleted, you can find this entity in the search tab and even in the lineage tab.
You can delete the upstream/downstream lineage metadata from the "manage lineage" page in the UI. Just click to edit the lineage and then delete the relationship.