https://pinot.apache.org/ logo
#troubleshooting
Title
# troubleshooting
w

Weixiang Sun

03/08/2022, 8:52 PM
I made the change to the table configuration for realtime table. But it does not take effect. Do I need reload all the segments?
s

Subbu Subramaniam

03/08/2022, 9:31 PM
what change did you make?
w

Weixiang Sun

03/08/2022, 9:33 PM
I added transformConfigs into ingestionConfig
m

Mark Needham

03/08/2022, 9:40 PM
it will apply to the next new consuming segment AFAIK. I think it should probably work if you reload segments, as long as the messages at those offsets are still in the streaming provider.
w

Weixiang Sun

03/08/2022, 9:41 PM
I tried to reload the segments. It did not work. By the way, is it possible to flush the consuming segment manually?
m

Mark Needham

03/08/2022, 9:42 PM
I don't think you can. But I'm sure someone else asked about that recently. @Mayank would know
m

Mayank

03/08/2022, 9:53 PM
Transform config treated as backward incompatible change, and hence not allowed.
m

Mark Needham

03/08/2022, 9:54 PM
not allowed as in it's ignored for already consumed segments?
w

Weixiang Sun

03/08/2022, 9:58 PM
Transform config change is treated as backward incompatible change. It is not allowed for existing consuming segments. Is it allowed for future consuming segments?
s

Subbu Subramaniam

03/08/2022, 10:24 PM
Flush segment on-demand feature is in the design process now.
👍 1
1
cc: @Sajjad Moradi
👍 1