👋 looking to add Jaccard similarity and I was curious if it would be preferred to "bake in" generating work/n-grams with some configurable params (similar to https://www.jpt.sh/projects/jellyfish/functions/#jaccard-similarity) or expect users to handle themselves and pass in two columns with type

list(str)

? I somewhat prefer the explicit handling by users over hiding some details, but curious on thoughts.

My opinion would be similar to yours where the user is expected to tokenize themselves.