Hey folks, is there a locally runnable integration...
# pinot-deve
Evan Galpin
10/30/2023, 11:18 PMHey folks, is there a locally runnable integration test for testing StarTree index?
x
Xiang Fu
10/30/2023, 11:21 PM
StarTreeClusterIntegrationTest?
e
Evan Galpin
10/30/2023, 11:21 PMRan into some dependency issues, but good to know that’s the right one. I’ll battle a bit with the deps, shouldn’t be too bad
x
Xiang Fu
10/30/2023, 11:22 PM
are you using IDE?
e
Evan Galpin
10/30/2023, 11:22 PMintelliJ, yep
x
Xiang Fu
10/30/2023, 11:22 PM
I’m using intelilj and the integration test runs pretty smooth
e
Evan Galpin
10/30/2023, 11:23 PMScreenshot 2023-10-30 at 16.23.11.png
Evan Galpin
10/30/2023, 11:24 PM(note that I haven’t altered, nor am I trying to directly test, ProtoBufRecordExtractor)
x
Xiang Fu
10/30/2023, 11:24 PM
might be due to missing some plugin which auto build the thrift
Xiang Fu
10/30/2023, 11:25 PM
Or you can do mvn clean install, then click on the targets/generated/xxx then right click the directory, mark it as generated source
Xiang Fu
10/30/2023, 11:26 PM
image.png
Xiang Fu
10/30/2023, 11:27 PM
image.png
e
Evan Galpin
10/30/2023, 11:28 PM1. do you know what the plugin might be called RE autobuilding Thrift?
2. I’ll try mvn build, as I don’t currently see
generated_sourcestargetEvan Galpin
10/30/2023, 11:28 PMI’ve been building like so:
Copy code
mvn -T 1.5C clean install package -DskipTests -Pbin-distEvan Galpin
10/30/2023, 11:29 PMI do have, for example:
Copy code
build/plugins/pinot-input-format/pinot-protobuf/pinot-protobuf-1.1.0-SNAPSHOT-shaded.jarx
Xiang Fu
10/30/2023, 11:41 PM
Ah, those are proto files, so should be some proto plugin I think
Xiang Fu
10/30/2023, 11:43 PM
image.png
Xiang Fu
10/30/2023, 11:43 PM
This is the one I’m using
Xiang Fu
10/30/2023, 11:44 PM
It will generate corresponding java files from proto
e
Evan Galpin
10/30/2023, 11:45 PMthanks, installed 👍 I’ll let you know what happens when compilation is done 😛
x
Xiang Fu
10/30/2023, 11:45 PM
cool!
e
Evan Galpin
10/30/2023, 11:45 PMI appreciate the help!
x
Xiang Fu
10/30/2023, 11:46 PM
another way is to run
mvn test -Dtest=org.apache.pinot.integration.tests.OfflineClusterIntegrationTeste
Evan Galpin
10/30/2023, 11:47 PMthanks! Ya, true, very nice to have the debugger connected from IDE. Still, good to have as an option!
👍 1
Evan Galpin
10/30/2023, 11:58 PMI’m hopeful! I now have those generated sources, so that’s a good sign
Evan Galpin
10/31/2023, 12:01 AMit's working
Evan Galpin
10/31/2023, 12:01 AMthanks Xiang! Saved me loads of time 😄
x
Xiang Fu
10/31/2023, 12:07 AM
Cool!
e
Evan Galpin
11/07/2023, 10:29 PMI could have sworn I also saw unit tests that confirm invocation counts of startree operators. Does that sound familiar? If so, do you know the name of the test file(s)?
Evan Galpin
11/07/2023, 11:35 PMit was
MultiNodesOfflineClusterIntegrationTest>OfflineClusterIntegrationTest.testStarTreeTriggeringx
Xiang Fu
11/07/2023, 11:54 PM
👍
2 Views