https://pinot.apache.org/ logo
Join Slack
Powered by
# segment-write-api
  • c
    but its been a while for me for Flink - maybe there are newer things that I don't know about
  • c
    lets wait for Yupeng's comments
  • n
    Okay. Let's have a call on Tuesday? We've been going back and forth on this async discussion
  • c
    I also think - the first version shouldn't try to over optimize
    ➕ 2
  • c
    keep it simple
  • c
    sounds good @ Tuesday
  • y
    yes, in current proposal, checkpoint not supported for pinot sink
  • y
    so if the connector fails, the job has to be relaunched
  • y
    as i explained in the connector design doc
  • y
    however, it’s still possible to support checkpoint in future
  • y
    that checkpoint shall remember the last successful segment name in the folder
  • y
    and discard other segments whose sequence numbers are higher
  • n
    set up a meeting for 11am. Please move it around if that time doesnt work @User @User
  • y
    sg
  • y
    updated the doc. PTAL
  • c
    will do
  • n
    should we have another meeting tomorrow?
  • y
    ok for me
  • c
    👍
  • y
    will 3:30-4 work for you @User
  • n
    yes works
  • x
  • n
  • n
  • n
    folks, reminder to please review 🙂 ☝️
  • n
    there’s no new code, just existing code moved around
  • n
    @User @User @User
    y
    • 2
    • 1
  • c
    yes will do by tonight
  • c
    done - sorry for the delay
  • n
    thanks!