lol, yep

i'm pretty confident that can work. i actually have worked with elasticsearch for many years and back at amazon, my team operated one of the biggest clusters in aws. my biggest concern is resource utilization, especially on laptops

my wife tries to run dendron on her old mac and just starting vscode makes it sweat 😅

> @User if it were possible to abstract over ReStructuredText and Markdown and keep the PKM logic elsewhere this could make for a glorious editing experience. I love writing in MD, but RST makes it super easy to throw in the odd table where that’s the right tool @User haha, that might be too high of a praise but i'll take it 😛 we actually have a thread in #748936364283920495 about making dendron work with RST. in theory (and ideally in practice), it should be able to work over any markup. we just need to update the code in a few places. the hardest part is building the editing infrastructure around a new markup. dendron currently integrates with other extensions to provide that (eg. markdown-notes, markdown-links, markdown-preview) but there's no reason suite of integrations wouldn't work for another language

now that being said, i don't see myself having bandwidth to work on another markup integration anytime soon but if that's something you or anyone else wants to take on, happy to provide guidance and code reviews 🙂

is the "running elasticsearch" a bit like "running postgresql"? I.e. get the binaries up and running, create users with permissions, create tables etc?

this in comparison to sqlite, where it's "save a file here"

> i'm pretty confident that can work. i actually have worked with elasticsearch for many years and back at amazon, my team operated one of the biggest clusters in aws. my biggest concern is resource utilization, especially on laptops @User recently came across MeiliSearch which looked like an interesting (possibly light(er)weight) alternative to ElasticSearch. I haven't used it just yet tho. Wonder if you've seen this before. It's written in Rust. - https://www.meilisearch.com/ - https://github.com/meilisearch/MeiliSearch

yep. sqlite is definitely simpler since its file based. elasticsearch is a full blown search index (build off lucense) and offers much more functionality (eg. autocomplete, aggregations, visualizations, predictions, etc)

@User i haven't. will check it out. thanks!

I guess elasticsearch also has server interface that has to be configured properly to not have security risks

it does. you can secure elasticsearch by user/role

since elasticsearch is just running locally, the surface area for attacks is greatly minimized. it'll be the same as running a local postgres/anydb instance

sounds a bit like setting up mysql for mediawiki to be used locally. Meaning overkill (imo 🙂 )

yeah, its a lot 😅 that's why its a possible road map item instead of something i'm actively working on

you can get a sense for what it will feel like using the json pod exports and importing into elasticsearch

wrote a recipe about it here: https://www.dendron.so/notes/401c5889-20ae-4b3a-8468-269def4b4865.html#analyze-notes-using-elasticsearch

We can have it as opt-in for the people interested in overkill I guess 😄

it's just the idea of running (additional) server-processes in a local pc meant for offline-note taking that makes me shiver

mostly from the security point of view

The way I look at it is: it's practically the same as when you're using development dependencies locally, they're not exposed publicly over the network, so I'm not sure what security risks you'd be worried about?

when it comes to security, its as secure as any sort of local storage solution (eg. sqlite, file system, etc). it's more secure than plain files since the user can password protect it. the biggest concern would be some sort of elasticsearch specific injection attack where loading certain data would cause it to run code and on that end, elasticsearch has a good record for not doing that 🙂

Well, it's a server. Servers get configured, often incorrectly. Which dev dependencies run a server?

I believe sqlite isnt a server. Filesystem can certainly expose itself via shares, but hard to avoid that

Examples of these kinds of problems? Well e.g. https://snyk.io/blog/mongodb-hack-and-secure-defaults/

i see your point about a server vs sqlite. yes, elasticsearch has a bigger service area than sqlite. i wouldn't necessarily compare it to the mongodb hack though since we're talking about running it locally without exposing a port to the outside vs a cloud hosted db solution. if a malicious user is able to access your local elasticsearch, then there's a good chance they can access your local sqlite instance as well.

put it this way - lsp's are servers as well. a reason why that isn't a big concern is because they are local servers

Local as long as configured properly

Its just matter of counting the possibilities to mess something up. Less services thus better. Certainly sometimes it's worth of running such services, but elasticsearch for my markdown files in my local disk for a single user sounds overkill.

(imo)