Hi Guys I just transitioned from 2 9 1 to 3 2 3 and pulsar s pulsar #general

Hi Guys - I just transitioned from 2.9.1 to 3.2.3 ...

James Treleaven

06/03/2024, 8:32 PM

Hi Guys - I just transitioned from 2.9.1 to 3.2.3 and 'pulsar standalone --wipe-data' seems to be behaving differently in that it does not actually wipe the data. I will restart pulsar and have all of my old topics hanging around. Any advice?

👀 1

Lari Hotari

06/06/2024, 8:43 AM

Please report an issue to https://github.com/apache/pulsar/issues .

Lari Hotari

06/06/2024, 8:44 AM

As a workaround, you should be able to delete the contents of the data directory to wipe all data.

James Treleaven

06/06/2024, 2:48 PM

I will report the issue. If I can ask a dumb question - where is that 'data directory'?

Lari Hotari

06/06/2024, 3:14 PM

it's usually in the directory where you have pulsar installed. let's say if you'd run

/opt/pulsar/bin/pulsar standalone

, the data directory would be

/opt/pulsar/data

👍 1

James Treleaven

06/06/2024, 9:01 PM

Github requires that I search the issues and find nothing similar before I can report an issue. The thing is - 'Pulsar Standalone: --wipe-data does not work with RocksDB backend' (issue #16741) is pretty similar. I am not using a RocksDB backend (CORRECTION: I am using RocksDB backend) but other than that I have the same problem as the one 16741 reports. Should I click the 'I found nothing similar' checkbox and submit a new issue?

Lari Hotari

06/07/2024, 6:14 AM

please create a new issue since that one is claimed to be fixed. you can reference it in the description

Lari Hotari

06/07/2024, 7:53 AM

I found this issue in Pulsar Standalone while checking the behavior: https://github.com/apache/pulsar/pull/22868 . I added a unit test for the

--wipe-data

parameter parsing to ensure that it is handled properly. I didn't find a problem in how the parameter is passed down the layers.

Lari Hotari

06/07/2024, 7:56 AM

there have been stability issues with the RocksDB based Pulsar standalone. It's possible that the unclean shutdown has contributed to that problem. There's discussion https://github.com/apache/pulsar/discussions/20985 . It's possible to use Zookeeper metadata store by setting

PULSAR_STANDALONE_USE_ZOOKEEPER=1

in the environment. for example with command

PULSAR_STANDALONE_USE_ZOOKEEPER=1 bin/pulsar standalone -nss -nfw

(

-nss -nfw

are to disable stream storage and Pulsar Functions since those are rarely needed in Pulsar Standalone usage)

James Treleaven

06/07/2024, 8:16 PM

I've created issue #22881. Thanks again for showing me how to work around this issue.

Lari Hotari

06/09/2024, 9:10 AM

thanks for the great issue report @James Treleaven. The problem will be fixed by https://github.com/apache/pulsar/pull/22885

👍 1

Open in Slack

Previous Next