So this is not a huge deal as it's a dev environme...
# troubleshootings
Stuart Millholland
09/02/2022, 1:41 PMSo this is not a huge deal as it's a dev environment, but we accidentally loaded about 20 mutable realtime segments into an immutable offline table and want to delete them but get this error message: Table name: immutable_events_OFFLINE does not match table type: REALTIME. Can we manually delete those segments?
m
Mayank
09/02/2022, 2:19 PM
Hmm, did the offline table already exist? The error suggests there is no offline table by that name
b
Bobby Richard
09/02/2022, 2:22 PMyes it existed and had segments
s
Stuart Millholland
09/02/2022, 2:23 PMyeah we loaded our offline segments fine, but then accidentally ran the segment metadata push using the wrong segments folder as the source and ended up in this state. So 20 bad segments are sitting there and actually queryable b/c the schema is pretty close. But deletes fail through the UI and swagger api call with that error. I see in zookeeper there's an external view that has the segments in there and tried to delete one and got a 400 error.
Stuart Millholland
09/02/2022, 2:23 PMSo basically just looking for the nuclear option on a segment. Maybe delete the folder entirely for that segment from the offline table? Figured I'd ask here just in case.
k
Kishore G
09/02/2022, 2:54 PM
You can try to disable that segment first.. theoretically you can delete them but the code might have some validation because it’s seeing the table name from segment metadata
Kishore G
09/02/2022, 2:55 PM
We should probably have that validation during upload so it would have prevented you from uploading those segments in the first place
s
Stuart Millholland
09/02/2022, 2:55 PMagreed yeah
Stuart Millholland
09/02/2022, 3:11 PM@Kishore G what will pinot do if I just delete the folders for these segments on the offline server?
m
Mayank
09/02/2022, 3:12 PM
We added a feature to be able to push same segment to multiple tables. Better fix is to remove the table name dependency from metadata
➕ 1
Mayank
09/02/2022, 3:12 PM
It will throw exceptions in the log but will work
s
Stuart Millholland
09/02/2022, 3:12 PMok
a
Aaron Weiss
09/02/2022, 3:12 PMhow do you disable a segment?
Aaron Weiss
09/02/2022, 3:12 PMI don't see it in pinot UI or swagger
s
Stuart Millholland
09/02/2022, 3:18 PMThe segment reports this in the metadata in the UI
Stuart Millholland
09/02/2022, 3:18 PM Copy code
{
"code": 403,
"error": "Table name: immutable_events_OFFLINE does not match table type: REALTIME"
}Stuart Millholland
09/02/2022, 3:18 PMAnd if I look at metadat.properties on the offline server I see this as the table name
Stuart Millholland
09/02/2022, 3:18 PMsegment.table.name = mutable_events
Stuart Millholland
09/02/2022, 3:19 PM@Mayank are you saying remove that line above from metadata.properties?
k
Kishore G
09/02/2022, 3:32 PM
its a swagger api call
m
Mayank
09/02/2022, 3:57 PM
I wasn’t suggesting that as a work around right now, but a clean fix moving forward
Mayank
09/02/2022, 3:57 PM
For now, check swagger api for disable segment
👍 1
s
Stuart Millholland
09/02/2022, 6:55 PMSo we are version .10 and there is no swagger disable segment API available that we can see.
Stuart Millholland
09/02/2022, 6:55 PMAny other suggestions here?
m
Mayank
09/03/2022, 12:41 AM
Hmm, it is an old api let me check