Hi all! I am trying to make a new entity type called Notebook searchable in the UI. I am able to render the entity page: i.e.

<http://localhost:9002/notebook/urn:li:notebook:(querybook,123456)/features>

I can see the metadata item on the main page I.e.

<http://localhost:9002>

but the browse fails to load anything I.e.

<http://localhost:9002/browse/notebook>

I suspect there's a wiring that I am missing somewhere that makes the entities discoverable when going through browse. Anyone know where that occurs? Thanks!

Hey Kartik, let me see here 🤔

No errors in the GraphQL call or the gms service

ok… did you add any @Searchable annotations to your model?

Let me check that. I also saw this file where I didn't define the new entity type`/datahub-web-react/src/app/lineage/utils/useGetEntityQuery.ts`

ok- that will be needed for the lineage viz to work, but shouldn’t be needed for search or browse.

There's some sub aspects that are marked as searchable:

record NotebookInfo includes CustomProperties, ExternalReference {

  /**
   * Title of the Notebook
   */
  @Searchable = {
    "fieldType": "TEXT_PARTIAL",
    "enableAutocomplete": true,
    "boostScore": 10.0
  }
  title: string
  
  ... other fields here, skipping to make it more concise


}

Hmm- can you double check what your elasticsearch index for the Notebook entity looks like?

not sure if this helps, but here's the raw data in the notebook index:

sh-4.2# curl -X GET "localhost:9200/notebookindex_v2/_search?pretty" -H 'Content-Type: application/json' -d'
{
    "query": {
        "match_all": {}
    }
}
'
{
  "took" : 21,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0,
    "hits" : [
      {
        "_index" : "notebookindex_v2",
        "_type" : "_doc",
        "_id" : "urn%3Ali%3Anotebook%3A%28querybook%2C123456%29",
        "_score" : 1.0,
        "_source" : {
          "urn" : "urn:li:notebook:(querybook,123456)",
          "title" : "Test",
          "customProperties" : [ ],
          "hasDescription" : true,
          "description" : "test",
          "tool" : "querybook",
          "browsePaths" : [
            ""
          ]
        }
      }
    ]
  }
}

PS- i find elasticvue to be a helpful tool for introspecting elasticsearch instances: https://elasticvue.com/

Yup:

isSearchEnabled = () => true;

    isBrowseEnabled = () => true;

    isLineageEnabled = () => true;

    getAutoCompleteFieldName = () => 'name';

    getPathName = () => 'notebook';

    getEntityName = () => 'Notebook';

    getCollectionName = () => 'Notebook';

(Sorry, I know debugging like this is hard 😞 )

Ok- I can hop on a call in ~30 mins if you want, that might be easier

🙇🏽 Thanks! That would work for me Can hop in here in 30 mins: https://meet.google.com/qdz-mvys-itz?authuser=0 Or which ever meeting tool of choice

hey- now is good for me too

Thanks for the help on this yesterday Gabe! Once we set the Paths, things started to show up in browse!

woohoo 🥳

can you please share your code, how you inserted your notebook. My not showing on search page but inserted fine.

same for me