Hi, I am trying to get data from restful api using...
# ask-community-for-troubleshooting
u
Hi, I am trying to get data from restful api using airbyte. But I don't know how to filter duplicate parent id in HttpSubStream to avoid duplicate request. For example, the data obtained by parent HttpStream is
Copy code
{
  "records": [
    {
      "id": 1,
      "group_id": 1
    },
    {
      "id": 2,
      "group_id": 1
    },
    {
      "id": 3,
      " group_id": 1
    },
    {
      "id": 4,
      "group_id": 2
    },
    {
      "id": 5,
      "group_id": 2
    }
  ]
}
The request path of HttpSubStream is
f"detail/{group_id}"
. Can anyone give some advice or use cases? Thanks!