Elon
02/09/2021, 9:44 PMXiang Fu
Elon
02/09/2021, 9:50 PMXiang Fu
Elon
02/09/2021, 9:52 PM2021/02/09 20:45:06.889 ERROR [ServerSegmentCompletionProtocolHandler] [oas_integration_operation_event__3__331__20210209T2044Z] Could not send request <http://pinot-us-central1-contro>
ller-1.pinot-us-central1-controller-headless.pinot.svc.cluster.local:9000/segmentStoppedConsuming?name=oas_integration_operation_event__3__331__20210209T2044Z&offset=9259054&instance=
Server_pinot-us-central1-server-0.pinot-us-central1-server-headless.pinot.svc.cluster.local_8098&reason=org.apache.kafka.common.errors.SerializationException&streamPartitionMsgOffset=
9259054
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[?:?]
at java.net.SocketInputStream.socketRead(SocketInputStream.java:115) ~[?:?]
at java.net.SocketInputStream.read(SocketInputStream.java:168) ~[?:?]
at java.net.SocketInputStream.read(SocketInputStream.java:140) ~[?:?]
at shaded.org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137) ~[pinot-all-0.6.0-jar-with-dependencies.jar:0.6.0-7115670e5c2b152812a09bd0
1
Xiang Fu
Elon
02/09/2021, 9:56 PMXiang Fu
Elon
02/09/2021, 10:01 PMXiang Fu
Elon
02/09/2021, 10:01 PMXiang Fu
Elon
02/09/2021, 10:02 PMXiang Fu
Neha Pawar
while (!_shouldStop && !endCriteriaReached()) {
// Consume for the next readTime ms, or we get to final offset, whichever happens earlier,
// Update _currentOffset upon return from this method
MessageBatch messageBatch;
try {
messageBatch = _partitionLevelConsumer
.fetchMessages(_currentOffset, null, _partitionLevelStreamConfig.getFetchTimeoutMillis());
consecutiveErrorCount = 0;
} catch (TimeoutException e) {
handleTransientStreamErrors(e);
continue;
} catch (TransientConsumerException e) {
handleTransientStreamErrors(e);
continue;
} catch (PermanentConsumerException e) {
segmentLogger.warn("Permanent exception from stream when fetching messages, stopping consumption", e);
throw e;
} catch (Exception e) {
// Unknown exception from stream. Treat as a transient exception.
// One such exception seen so far is java.net.SocketTimeoutException
handleTransientStreamErrors(e);
continue;
}
if permanent exception or more than 5 transient exceptions, we stop consuming by marking the consuming segment offlineElon
02/09/2021, 10:08 PMNeha Pawar
ServerGauge.LLC_PARTITION_CONSUMING
Elon
02/09/2021, 10:16 PMNeha Pawar