cfml

Racking my brain with an array from JSON that has some duplicate rows, I have tried deduping based on copying the row into a new array using a list of key values but somehow I still get 4 dupes at the end. Here is a small sample of the json data it has dupes in it.

I'm on my phone but I think this bit might be a problem because the position in each array wouldn't be the same if you are deduping
&lt;cfset aralis[x] = arrData[x]&gt;
Maybe something more like
Arrayappend(aralis, arrdata[row])

If I run your code, on CF2021, I get a result array with 7 entries and no duplicates. What platform are you on?

full json

I get an array with 25 entries, out of 115

I have used this logic hundreds of times to de-dupe.  Cant for the life of me understand why its not

<@U3R752VND> I am deduping by not copying current row into the new array (or so it should be doing)

<@U0C0VP857> at least I know its not just me :stuck_out_tongue:

This seems to work

`<cfset aralis = ArrayNew(1)>`

``
`<cfloop from="1" to="#arrayLen(arrData)#" index="row">`

    `<cfset document = arrData[row].documents[1]>`

    `<cfif NOT ListFindNoCase(keyList, document.document_object_id)>`

        ``
        ``
        `<cfset Arrayappend(aralis, arrdata[row])>`
        ``
        `<cfset aralis[x].sendEmail = "false">`
        `<cfset keyList = ListAppend(keyList, document.document_object_id)>`
        `<cfset x=x+1>`
    `</cfif>`
`</cfloop>`

&lt;cfset Arrayappend(aralis, arrdata[row])&gt;

Your revised code is better but the problem with the original is at line 35 &lt;cfset aralis[x] = arrData[x]&gt;.

x referred to the last array element stored so would add that to the array and not the new entry at "row'

with the provided json. Are you supposed to have 26 rows after removing dups?

I was trying to be fancy and came up with this.
```var data = json.map((row) => {
	row.hash = hash(row.toString());
	return row;
}).filter((row,index, arr) => {
	var indexes = arr.findAll( (iRow)=>{
		return row.hash eq iRow.hash;
	});
	return index eq indexes.first();       		
});```

I got 26 as well. <https://trycf.com/gist/ec669417d0b0fa91535b0621f6014f99/acf2021?theme=monokai>