I'm creating a user-defined sink for Amazon SageMaker Feature Store. I'm using the generic asynchronous base and it requires some configurations like

maxBatchSize

however Feature Store does not support batching. I can only call PutRecord which only inserts one record. Should my

maxBatchSize

be just

1

? I already have a working sql connector but I'm not sure about the configurations. My current implementation just copied the sink options from dynamodb connector.

The

PutRecord

API is used to ingest a list of

Records

into your feature group.

Does it make sense to model the "batch" as the

List<Record>

. Your element converter would output

Record

and then you generate the

PutRecordRequest

in

submitRequestEntries

? Or are your upstream operators already generating

List<Record>

? So your Sink definition would look like this:

public class SageMakerFeatureStoreSink<InputT> extends AsyncSinkBase<InputT, Record> { ...

If this is not feasible then yes, you can set

maxBatchSize

to

1

.