Pinot does not have this limit. Seems thrown from presto connector @Xiang Fu

the log says the limit is 50k for select * query:

you can increase it from presto config

default is 50k

In prestro config file I am not giving any limit .I have only these properties.

set the channel topic: Have a question? Check https://docs.pinot.apache.org first. Give back to the community by updating the docs (#C023BNDT0N8) when you get your answer here.

Hi experts, has someone faced this problem before while submitting a task to pinot's controller?

root@pinot-controller-0:/opt/pinot# bin/pinot-admin.sh AddTable \
> -schemaFile /opt/pinot/sch_realtime_enriched_music_data_users.json \
> -tableConfigFile /opt/pinot/realtime_enriched_music_data_users_json.json \
> -exec
Exception in thread "main" java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:386)
	at sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:401)
Caused by: java.net.BindException: Address already in use
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:461)
	at sun.nio.ch.Net.bind(Net.java:453)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
	at sun.net.httpserver.ServerImpl.bind(ServerImpl.java:133)
	at sun.net.httpserver.HttpServerImpl.bind(HttpServerImpl.java:54)
	at io.prometheus.jmx.shaded.io.prometheus.client.exporter.HTTPServer.<init>(HTTPServer.java:145)
	at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:31)
	... 6 more
FATAL ERROR in native method: processing of -javaagent failed
Aborted (core dumped)
root@pinot-controller-0:/opt/pinot#

hmm, can you set

JAVA_OPTS=""

what a precision @Xiang Fu impressed !!! seems that worked, let me double check

Any Developments in progress to support in pinot reg sorting and partitioning offline data(orc) present in Hdfs ?

If yes how much time will it take to release this feature ?

Hello

Hi @Jackie Can pinot support druid connection pool

We want to use connection pool for java service

• Hi All, Can someone confirm if Apache Pinot has support for special characters? For text based indexing, does it take care of these localized characters? Is localized search supported?

Exception while creating a build using source

Apache Maven 3.6.3 Maven home: /usr/share/maven Java version: 1.8.0_292, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-amd64/jre Default locale: en_IN, platform encoding: UTF-8 OS name: "linux", version: "5.8.0-55-generic", arch: "amd64", family: "unix"

can someone help?

stack trace: org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.pluginsmaven compiler plugin3.8.0:compile (default-compile) on project pinot-spi: Compilation failure javac: invalid target release: 11 Usage: javac <options> <source files> use -help for a list of possible options at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289) at org.apache.maven.cli.MavenCli.main (MavenCli.java:193) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347) Caused by: org.apache.maven.plugin.compiler.CompilationFailureException: Compilation failure

Hi Everyone, I have completed one end to end pinot pipeline setup on non Kerberos environment and it's working fine. But with same configuration I am trying with kerberous Kafka and kerberous hdfs( for deepstorage) I have added keytab name and Hadoop principle name in controller.conf file and trying to start components I am able to start server and broker but while starting controller I am getting this error. Can someone kindly suggest.

This is the controller.conf file details. All the details are same I have added only last 2 lines in this file.

IMG_20210628_010310.jpg

P.s. As we are giving Hadoop principle and keytab name in controller.conf file. How can we give the same details for Kerberos Kafka also. I.e. Jaas file location, principle name, keytabname.?

@Xiang Fu @Akash @Jackie

have you mount the /etc/hadoop to your pinot container?

and make sure your pinot container has access to your hdfs

you can enter k8s container to check that

I intend to enable web UI auth for Pinot and the documentation says to set the property controller.admin.access.control.principals . I am using Helm and it does not have this config exposed @ https://github.com/apache/incubator-pinot/blob/master/kubernetes/helm/pinot/README.md . How do I enable this?

Please help me out