I am looking for suggestions help with SMS messages We use t cfml #cfml-general

I am looking for suggestions/help with SMS message...

Andy Larson

01/10/2023, 7:23 PM

I am looking for suggestions/help with SMS messages. We use the ckeditor to generate emails and SMS messages. Then we run the text through a regex to remove all HTML. Since we recently changed SMS providers, now our SMS message count has increased a lot due to non-GSM characters in the message. The provider we use is converting the special non-GSM characters to images causing the SMS counts to be much larger then expected. Is there anyway to convert non-GSM characters to an equivalent GSM character in Java or ColdFusion before sending the messages to the SMS provider?

bdw429s

01/10/2023, 7:25 PM

Can you be more specific about what characters you're talking about?

bdw429s

01/10/2023, 7:25 PM

If you just want to remove accents from text (like turn a spanish Ñ into an N then there are libs that do that

bdw429s

01/10/2023, 7:27 PM

Here is a similar function I've used to clean crazy chars from file names

Copy code

function cleanFileName( str ) {
		str = str.urlDecode().urlDecode();
		var Normalizer = createObject("java","java.text.Normalizer");
		var NormalizerForm = createObject("java","java.text.Normalizer$Form");
		var normalizedString = Normalizer.normalize(str, createObject("java","java.text.Normalizer$Form").NFD);
		var pattern = createObject("java","java.util.regex.Pattern").compile("\p{InCombiningDiacriticalMarks}+");
		str = pattern.matcher(normalizedString).replaceAll("");
		return str.reReplaceNoCase( '[^a-zA-Z0-9-_ \.&\+\$@]', '_', 'all' )
	}

👍🏼 1

bdw429s

01/10/2023, 7:27 PM

The

java.text.Normalizer

class specifically is what does character replacement

👍🏼 1

Andy Larson

01/10/2023, 7:28 PM

Yes, we deal with Spanish and Hawaiian languages that have letters not part of the GSM character set https://en.wikipedia.org/wiki/GSM_03.38

bdw429s

01/10/2023, 7:28 PM

https://stackoverflow.com/questions/4122170/java-change-%C3%A1%C3%A9%C5%91%C5%B1%C3%BA-to-aeouu

bdw429s

01/10/2023, 7:28 PM

I would start with that normalizer class and see how close it gets you

Andy Larson

01/10/2023, 7:29 PM

Thank you for the fast response. I will give that a try

bdw429s

01/10/2023, 7:29 PM

You can basically grab that UDF I pasted and just remove the last line which is removing chars I specifically didn't want in file names, but that probablayk doesn't apply to you

gamesover

01/10/2023, 9:08 PM

So you need to convert text to ASCII7? I use a JUnidecode library to do this and it does a great job. Here's my blog post regarding it. https://dev.to/gamesover/convert-unicode-strings-to-ascii-with-coldfusion-junidecode-lhf

Andy Larson

01/10/2023, 9:34 PM

Thanks @gamesover I will consider your option too. Appreciate the help and suggestion.

Evil Ware

01/11/2023, 5:38 PM

Just use the CHR tag, 🙂 Granted someone will eventually need to read your code and scream, but until then.

3 Views

Open in Slack

Previous Next