Sanjay
07/04/2024, 4:50 PM/tableConfigs
?Rohit Yadav
07/05/2024, 6:29 AMSanjay
07/05/2024, 8:06 AMrahul gulati
07/08/2024, 10:27 AMController Logs
Autoscroll:On FullScreen:Off Timestamps:Off Wrap:Off ││ 2024/07/08 08:26:59.449 INFO [BrokerResourceOnlineOfflineStateModelFactory] [HelixTaskExecutor-message_handle_thread_9] Processing transition from OFFLINE to ONLINE ││ 2024/07/08 08:26:59.449 INFO [BrokerRoutingManager] [HelixTaskExecutor-message_handle_thread_9] Building routing for table: snackscalculationprotobufnewjuly8testseg ││ 2024/07/08 08:26:59.460 INFO [BaseInstanceSelector] [HelixTaskExecutor-message_handle_thread_9] Got 3 new segments: {snackscalculationprotobufnewjuly8testsegmentnew ││ 2024/07/08 08:26:59.460 INFO [BaseInstanceSelector] [HelixTaskExecutor-message_handle_thread_9] Failed to find servers hosting new segment: snackscalculationprotobu ││ 2024/07/08 08:26:59.460 INFO [BrokerRoutingManager] [HelixTaskExecutor-message_handle_thread_9] Built routing for table: snackscalculationprotobufnewjuly8testsegmen ││ 2024/07/08 08:26:59.474 INFO [HelixExternalViewBasedQueryQuotaManager] [HelixTaskExecutor-message_handle_thread_9] Initializing rate limiter for table snackscalcula ││ 2024/07/08 08:26:59.474 INFO [HelixExternalViewBasedQueryQuotaManager] [HelixTaskExecutor-message_handle_thread_9] No qps config specified for table: snackscalculat ││ 2024/07/08 08:26:59.507 INFO [BaseInstanceSelector] [ClusterChangeHandlingThread] Got 3 new segments: {snackscalculationprotobufnewjuly8testsegmentnewconnector__0__ ││ 2024/07/08 08:26:59.507 INFO [BaseInstanceSelector] [ClusterChangeHandlingThread] Failed to find servers hosting new segment: snackscalculationprotobufnewjuly8tests ││ 2024/07/08 08:26:59.507 INFO [BrokerRoutingManager] [ClusterChangeHandlingThread] Processed segment assignment change in 10ms (fetch ideal state and external view s ││ 2024/07/08 08:26:59.568 INFO [BaseInstanceSelector] [ClusterChangeHandlingThread] Got 2 new segments: {snackscalculationprotobufnewjuly8testsegmentnewconnector__0__ ││ 2024/07/08 08:26:59.568 INFO [BaseInstanceSelector] [ClusterChangeHandlingThread] Failed to find servers hosting new segment: snackscalculationprotobufnewjuly8tests ││ 2024/07/08 08:26:59.568 INFO [BrokerRoutingManager] [ClusterChangeHandlingThread] Processed segment assignment change in 10ms (fetch ideal state and external view s ││
PInot table query results ->
Kafka topicCaleb Shei
07/08/2024, 7:19 PMpublic interface AccessControl extends FineGrainedAccessControl {
...
/**
* Fine-grained access control on pinot tables.
*
* @param requesterIdentity requester identity
* @param tables Set of pinot tables used in the query. Table name can be with or without tableType.
*
* @return {@code true} if authorized, {@code false} otherwise
*/
boolean hasAccess(RequesterIdentity requesterIdentity, Set<String> tables);
}
rahul gulati
07/09/2024, 7:24 AMSanjay
07/09/2024, 10:10 AMSanjay
07/09/2024, 10:11 AMSanjay
07/11/2024, 11:20 AM2024/07/11 11:15:32.632 ERROR [ControllerPeriodicTask] [pool-14-thread-6] Caught exception while running task: RetentionManager
java.lang.NumberFormatException: For input string: "Thu, 15 Feb 2024 16:37:32 GMT"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:67) ~[?:?]
at java.lang.Long.parseLong(Long.java:711) ~[?:?]
at java.lang.Long.parseLong(Long.java:836) ~[?:?]
at com.azure.storage.file.datalake.Transforms.toPathItem(Transforms.java:383) ~[pinot-adls-1.0.3-SNAPSHOT-shaded.jar:1.0.3-SNAPSHOT-3d3de21a7ab83645547abacac00d05693f761579]
Priyank Bagrecha
07/12/2024, 12:51 AMAdil Shaikh
07/12/2024, 6:26 AMPrijo Pauly
07/12/2024, 6:49 AM@ScalarFunction(names = {"getCid", "get_cid"})
public static String getCid(String aId, String dId) {
if (isStringEmpty(aId) && isStringEmpty(dId)) {
return "INVALID";
} else {
return !isStringEmpty(dId) ? dId : aId;
}
}
private static boolean isStringEmpty(String str) {
return str == null || str.trim().length() == 0;
}
it behaves differently during ingestion and works fine on queryingrahul gulati
07/12/2024, 8:02 AMTomáš Řehák (realrehi)
07/12/2024, 9:54 AMpiby
07/12/2024, 10:46 AM{
"connect_args": {
"use_multistage_engine": "true",
"enableNullHandling": "true",
"timeoutMs": 1000000
}
}
What is the recommended approach to fix it? I am available to support here if needed as this is critical for us.
cc @Xiang Fu
In superset logs, I get the following traceback
Traceback (most recent call last):
File "/app/superset/connectors/sqla/models.py", line 1724, in query
df = self.database.get_df(
File "/app/superset/models/core.py", line 671, in get_df
self.db_engine_spec.execute(cursor, sql_, self)
File "/app/superset/db_engine_specs/base.py", line 1836, in execute
raise cls.get_dbapi_mapped_exception(ex) from ex
File "/app/superset/db_engine_specs/base.py", line 1830, in execute
cursor.execute(query)
File "/app/superset_home/.local/lib/python3.10/site-packages/pinotdb/db.py", line 57, in g
return f(self, *args, **kwargs)
File "/app/superset_home/.local/lib/python3.10/site-packages/pinotdb/db.py", line 479, in execute
r = self.session.post(
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 1136, in post
return self.request(
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 821, in request
return self.send(request, auth=auth, follow_redirects=follow_redirects)
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 908, in send
response = self._send_handling_auth(
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 936, in _send_handling_auth
response = self._send_handling_redirects(
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 973, in _send_handling_redirects
response = self._send_single_request(request)
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_client.py", line 1009, in _send_single_request
response = transport.handle_request(request)
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_transports/default.py", line 217, in handle_request
with map_httpcore_exceptions():
File "/usr/local/lib/python3.10/contextlib.py", line 153, in _exit
self.gen.throw(typ, value, traceback)
File "/app/superset_home/.local/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ReadTimeout: timed out
Ritik Birla
07/12/2024, 1:29 PMarun udaiyar
07/15/2024, 3:07 PMAmit Banarjee
07/15/2024, 4:33 PMForward Xu
07/16/2024, 2:01 AMHarshil Shah
07/18/2024, 12:22 AMAlice
07/18/2024, 3:56 AMZhuangda Z
07/18/2024, 2:40 PMlatest
into the allowed functions? We have a use case where we want to keep the latest url field for a contact and could use this feature during ingestion.Prijo Pauly
07/18/2024, 5:10 PMAbhijeet Kushe
07/20/2024, 12:26 AMAbhijeet Kushe
07/20/2024, 12:28 AMraghav
07/21/2024, 11:10 AMPankaj Kaushal
07/22/2024, 8:25 AMAnish Nair
07/23/2024, 9:43 AMPrijo Pauly
07/23/2024, 12:01 PMProcessingException(errorCode:150, message:SQLParsingError:
java.lang.ClassCastException: class org.apache.calcite.sql.SqlWith cannot be cast to class org.apache.calcite.sql.SqlSelect (org.apache.calcite.sql.SqlWith and org.apache.calcite.sql.SqlSelect are in unnamed module of loader 'app')
at org.apache.pinot.sql.parsers.CalciteSqlParser.compileSqlNodeToPinotQuery(CalciteSqlParser.java:436)
at org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:237)
at org.apache.pinot.controller.api.resources.PinotQueryResource.executeSqlQuery(PinotQueryResource.java:181)
at org.apache.pinot.controller.api.resources.PinotQueryResource.handlePostSql(PinotQueryResource.java:120))
Getting above error on executing below query,
with temp as (
select
c1,c2
from t1
where
c1 >= DATETRUNC('day',now())
)
select * from temp;
Could someone help with this?Hari Varma N
07/23/2024, 12:23 PM