Roberto Tolosa
05/19/2023, 3:47 AMkapa.ai
05/19/2023, 3:47 AMkapa.ai
05/19/2023, 3:48 AM{{ stream_partition.<identifier> }}
syntax. Here's an example of how to configure the SubstreamPartitionRouter component: yaml partition_router: type: SubstreamPartitionRouter parent_stream_configs: - parent_stream: parent_stream_name parent_key: nested_key_name current_partition_value_identifier: chosen_identifier
In this example, replace parent_stream_name
with the name of the parent stream, nested_key_name
with the nested key you want to extract, and chosen_identifier
with the identifier you choose for the current partition value. For more information on the SubstreamPartitionRouter component, refer to the [documentation](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/reference#SubstreamPartitionRouter).Roberto Tolosa
05/19/2023, 3:53 AMcurrent_partition_value_identifier
from? i can't find it referenced in Airbyte's docskapa.ai
05/19/2023, 3:53 AMkapa.ai
05/19/2023, 3:54 AMcurrent_partition_value_identifier
is not mentioned in the Airbyte documentation. I made an error in my response. To extract a nested value for your substream partition router, you should configure the "Parent key" field to point to the nested property you want to use as the partition value. You can use dot notation to access nested properties. For example, if your parent stream record looks like this: json { "id": 123, "details": { "nested_id": 456 } }
You can set the "Parent key" field to details.nested_id
to use the nested value as the partition value. Please refer to the [Substream partition router documentation](https://docs.airbyte.com/connector-development/connector-builder-ui/partitioning#dynamic-and-static-partition-routing) for more information on configuring the partition router.Roberto Tolosa
05/19/2023, 3:55 AMCould not perform read with error: Every message grouping should have at least one request and response
kapa.ai
05/19/2023, 3:55 AMkapa.ai
05/19/2023, 3:56 AMTatiane Corrêa
08/01/2023, 12:13 PMRoberto Tolosa
08/01/2023, 3:41 PMTatiane Corrêa
08/01/2023, 3:54 PM