Did anyone else, especially Nutanix customers, hav...
# citrix-cloud
m
Did anyone else, especially Nutanix customers, have their hypervisor plugin effectively disappear from Citrix DaaS after Christmas? It makes me wonder if it's related to the DaaS outage last week.
j
Was this the tech preview native one?
m
2.7.7.0. The plugin exists on the cloud connectors. But checking for registration in the DaaS Posh SDK does not show anything but MS Azure, Google Cloud, HPE Moonshot, W365, and Remote PC. We've been in a change freeze for the better part of a week.
j
That’s not good. I can check on my end.
m
I think something is hosed up with the virtual DDC but level 1 isn't allowed to reboot them now. They're asking for evidence the MCS snapshot exists in Nutanix and we're struggling to navigate the file system on the cluster. Our regular Nutanix engineer is out.
j
Can you check and see if the tech preview toggle is still there and off? I know you’re using our PE plugin but want to make sure it’s not something with the tech preview causing this.
The snapshot should be at the VM level.
m
Are you asking about the "Citrix Integration with Nutanix Prism Central on AHV" tech preview?
⤴️ 1
j
Base VM > snapshots
m
It's off
👍🏽 1
If the Nutanix file system has encryption enabled, I can't navigate the default container to view actual file names, right?
Nutanix support was unable to help us locate the .template file Citrix support wanted us to prove.
r
What was the end result here?
m
Citrix first level said they would escalate the ticket. But wanted evidence of the .snapshot file. Talked to Nutanix support. He had no idea how to produce that evidence. I emailed to Citrix first level management asking for the ticket to be escalated. I’m still waiting. First level thinks a reboot of the cloud ddc’s would help, but that level of access was taken away some time ago.
For the time being I can’t roll back or update my machine catalogs. Highly frustrating
j
Is power management, etc. from the hypervisor connection working? Test connection work?
j
We have not had any issues and we are running Citirx Cloud w/Nutanix. the snapshot would just be the snapshot of a base image you use to provision your Machine catalogs with. I am not sure how the snapshots relate to the original ask of the cloud connectors unless i missed something. are citrix images unregistered or you not seeing the Cloud connectors in DaaS?
j
When I get back to computer can check our tenant and also see if there are anymore reports of this issue.
m
It’s hard to tell when this stopped working. Power management worked yesterday morning. I can try it again. Test connection gives two errors. I will post them. I don’t think they are related to the on prem environment.
I’m unable to update the connection password.
image.png
image.png
r
@Matt Sliva I do see this with one customer. Digging in to see what's up.
👍 1
m
image.png
r
Yea same deal.
m
We took the time to re-install the Nutanix plugin on all cloud connectors for a site, but that didn't yield any different results.
My org has been in a change freeze since well before Christmas.
Power management is working
j
This looks like control plane side going off what I’m seeing above. Will do some digging on my end. The plugin should show in PowerShell. Since you already reinstalled then I don’t think it is a cloud connector issue.
👍🏼 1
m
Error when DaaS is attempting to query for snapshots.
image.png
I agree @Jarian Gibson
@Ray Davis 83110948 is my ticket number if you wanted to combine forces.
j
I was able to reproduce and factory shows up in PowerShell after reinstall but so far still seeing errors in Studio.
✔️ 1
r
Thanks for taking the time and checking on your end.
j
Actually it keeps showing up and disappearing
You run the command it’s there and then run it again it’s gone.
m
The Get-HypHypervisorPlugin command?
j
Yep
If you keep running it you will see it show and then disappear
m
I'm not getting that behavior
j
I’ve let our EUC PM know. We also reached out the PM on the Citrix side. Also gave them your case number. We are tracking from our side also.
m
Thanks Jarian. I really appreciate it! Also thanks Ray for reviving this from earlier.
👍🏽 1
👍 1
j
Does test hypervisor from PowerShell show any difference?
m
Similar message to ones I see in the GUI.
I attempted to toggle maintenance mode on a connection and now it's stuck in maintenance mode. 😞
@Jarian Gibson Do you have the ability to add a new Nutanix connection in Hosting for Citrix Cloud? My tenant is deployed in the US East.
j
Yep seeing same.
Nope I don’t see the option for PE.
m
Ok that's comforting to hear. I am still waiting for my Citrix ticket to be escalated and I'm beginning to wonder if there is a larger issue at hand. If you're seeing the same thing in a different region, then there's not much I can do but wait.
l
I'm in the same boat (I'm working with the customer Ray reported). Citrix is collecting CDFTraces, event logs, HAR Logs, etc. today.
👍 2
m
I appreciate the recent flurry of enhancements to DaaS and CVAD, but c'mon, let's not roll new code the last 2 weeks of the year Citrix.
j
Matt I need some info from you via DM
Further testing shows this doesn’t impact the PC integration for Azure. No issues with the Nutanix plugin on cloud connectors.
👍 1
m
It looks like we're back in business! Happy New Year!
👍🏽 1
j
Did they give you an RCA?
m
No. They just asked me to confirm it's working again.
I'll follow up with them on Thursday.
Ticket closure states they restarted the CitrixHostService on the cloud DDCs.
🤙🏼 1
j
Thanks!