Or should it go here: Although i do not see a customtags directory here

You can put customtags on WEB-INF/customtagsdirectory looks like below DEAA472EC5FA81075D038E12AC9A0D50-lucee testserver\lucee-5.3.10.120\WEB-INF\lucee-web\customtags

I would put them in an application folder and then use use the Application.cfc to define the path. This will make things portable between servers/instances. See: https://rorylaitila.gitbooks.io/lucee/content/calling_custom_tags.html#custom-tags-defined-in-a-custom-tag-path

thanks all

NOTE - The path does not have to be inside your root (and most likely should not be)

This docs page will help you https://docs.lucee.org/guides/cookbooks/application-context-set-mapping.html

🙏 thanks everyone

Dan's answer is "correct" IMO. Avoid putting anything manually in the CF server home, especially CommandBox where it's just one auto-upgrade away from being gone.