fancy-crayon-39356
04/06/2023, 11:00 AM{
search(
input: {
type: DATASET,
query: "*",
start: 0,
count: 100,
orFilters: {
and: [
{
field: "urn",
values: ["urn:li:dataset:(...)", "urn:li:dataset:(...)"],
condition: EQUAL,
},
]
}
}
) {
start
count
total
searchResults {
entity {
... on Dataset {
urn
name
platform {
urn
}
dataPlatformInstance {
urn
}
domain {
domain {
urn
}
}
properties {
description
}
ownership {
owners {
associatedUrn
}
}
tags {
tags {
associatedUrn
}
}
glossaryTerms {
terms {
associatedUrn
}
}
schemaMetadata {
fields {
description
}
}
}
}
}
}
}
The problem is that it returns me empty results, always. The same does not happen when I try to filter for tags, platform, etc. It all works, except for filtering by URNs.
Am I doing something wrong here? My intention is to fetch information about ALL datasets that we have. However, this is not possible due to ES limitations when query is above 10k results (https://github.com/datahub-project/datahub/issues/4575), so my plan is to create batches of URNs and filter for it, one batch at a time.
Appreciate your help! πlively-cat-88289
04/06/2023, 11:01 AMfancy-crayon-39356
04/06/2023, 11:02 AMv0.10.0astonishing-answer-96712
04/07/2023, 9:56 PMbig-carpet-38439
04/10/2023, 5:20 PMbig-carpet-38439
04/10/2023, 5:21 PMelegant-salesmen-99143
04/10/2023, 5:59 PMfancy-crayon-39356
04/11/2023, 8:07 AMdataset query that supports the urn argument to get the aspects that I need. But this is bad since I need to make N queries where N is my total number of datasets π’
Will try now with the scrollAcrossEntities πaloof-gpu-11378
04/12/2023, 5:39 PMbig-carpet-38439
04/12/2023, 5:40 PMbig-carpet-38439
04/12/2023, 5:40 PMfancy-crayon-39356
04/13/2023, 8:28 AMsteep-needle-64409
04/19/2023, 1:07 PMelegant-salesmen-99143
04/19/2023, 5:20 PMhandsome-football-66174
04/26/2023, 4:34 PM{
searchAcrossEntities(input: {
types: [DATASET],
query: "*out*",
orFilters: [
{
and: [
{
field: "tags",
values: ["urn:li:tag:tag1","urn:li:tag:tag2"],
condition: EQUAL
},
{
field: "domains",
values: ["urn:li:domain:fde75cdc-69f5-4cba-8d48-c1234475ddf"],
condition: EQUAL
}
]
}
]
}) {
searchResults {
entity {
urn
... on Dataset{
urn
glossaryTerms{
terms{
term{
urn
}
}
}
}
}
}
}
}elegant-salesmen-99143
04/26/2023, 5:47 PMhandsome-football-66174
04/26/2023, 6:25 PMhandsome-football-66174
04/26/2023, 6:33 PMelegant-salesmen-99143
04/26/2023, 6:45 PMelegant-salesmen-99143
04/26/2023, 6:55 PMcondition: IN, values: ["urn:li:tag:Tag1", "urn:li:tag:tag2"]} it gave me "DataFetchingException" and error in results. I don't know, maybe multiple values in one condition are not supported in filters?
{
searchAcrossEntities (
input: { types: DATASET,
query: "*",
orFilters: [{and:
[
{field: "domains", condition: EQUAL, values: ["urn:li:domain:XXX"]}
{field: "tags", condition: EQUAL, values: ["urn:li:tag:Tag1"]}
{field: "tags", condition: EQUAL, values: ["urn:li:tag:Tag2"]}
]
}]
} )
{
searchResults {
entity {
type
... on Dataset {
urn
properties {name}
}
}
}
}
}handsome-football-66174
04/26/2023, 7:11 PMhandsome-football-66174
04/26/2023, 7:11 PMelegant-salesmen-99143
04/26/2023, 7:33 PMquery: "raw, search" worked for me (raw and search being keywords). How do you write multiple dataset names?handsome-football-66174
04/26/2023, 7:37 PMhandsome-football-66174
04/26/2023, 7:39 PM{
searchAcrossEntities(input: {
types: [DATASET],
query: "out, schema",
orFilters: [
{
and: [
{
field: "tags",
values: ["urn:li:tag:tag1","urn:li:tag:tag2"],
condition: EQUAL
},
{
field: "domains",
values: ["urn:li:domain:fde75cdc-69f5-4cba-8d48-c1234475ddf"],
condition: EQUAL
}
]
}
]
}) {
searchResults {
entity {
urn
... on Dataset{
urn
glossaryTerms{
terms{
term{
urn
}
}
}
}
}
}
}
}handsome-football-66174
04/26/2023, 7:39 PMelegant-salesmen-99143
04/26/2023, 7:53 PMhandsome-football-66174
04/26/2023, 7:55 PMelegant-salesmen-99143
04/26/2023, 8:00 PMhandsome-football-66174
04/26/2023, 8:04 PM{
"data": {
"searchAcrossEntities": {
"searchResults": []
}
},
"extensions": {}
}elegant-salesmen-99143
04/26/2023, 8:07 PMquery: "*raw*, *search*" it also returns empty for me, but when I remove one * at the end - query: "*raw*, *search"- it gives me results alrightelegant-salesmen-99143
04/26/2023, 8:07 PMhandsome-football-66174
04/26/2023, 8:10 PMhandsome-football-66174
04/26/2023, 8:12 PMelegant-salesmen-99143
04/26/2023, 8:36 PMinput: { types: DATASET
query: "keyword1"
query: "keyword2"
} )elegant-salesmen-99143
04/26/2023, 8:42 PMelegant-salesmen-99143
04/26/2023, 8:50 PMbrowsePaths: query doesn't work in GraphQL for me anymore. It worked in 9.6.1, Is it no longer supported in 10.1?handsome-football-66174
04/27/2023, 1:14 PMelegant-salesmen-99143
04/27/2023, 1:48 PMhandsome-football-66174
04/27/2023, 4:45 PMelegant-salesmen-99143
04/27/2023, 7:15 PMinput:{query: "/q browsePaths: *user* OR browsePaths: *search*"}handsome-football-66174
04/28/2023, 6:43 PMquery: "/q urn: *Group* OR urn: *Provider*",
orFilters: [handsome-football-66174
05/01/2023, 2:24 PMbrainy-park-30072
01/16/2024, 10:54 AMrich-barista-93413
01/16/2024, 10:54 AMbrainy-park-30072
01/16/2024, 10:54 AMbrainy-park-30072
01/16/2024, 10:55 AMrich-barista-93413
01/31/2024, 8:12 PM