Yes delete locally cached profiles on logoff already in place, but to me the issue seems to be starting when the second session from the same user starts in the same VDA.
With Process Explorer, I noticed that lsass.exe has active handle on the microsoft/credential folders, which seems to be to be locking the folders.
We have sent procmon/cdf/upm logs already to Citrix for them to further investigate.