Guacamole connections randomly dissapear #2480

✅ Checklist

• I have searched open and closed issues for duplicates.
• This is a problem observed when deploying a Data Safe Haven.
• I can reproduce this with the latest version.
• I have read through the documentation.
• This isn't an open-ended question (open a discussion if it is).

💻 System information

• Operating System: MacOS
• Data Safe Haven version: v5.5.1

📦 Packages

Paste list of packages here

🚫 Describe the problem

With some frequency (sometimes twice per week), SRE users cannot connect to workspaces because the list of Guacamole connections have dissapeared:

We checked the log of guacamole, identity, and guac-user-sync and didn't find anything unusual. After a debugging sessions with @craddm , we found that, for some reason, the guacamole_connection_permission table was empty.

As a workaround, redeploying the SRE fixes the issue since guacamole_connection_permission is populated as part of the process. However, the issue still reappears.

🌳 Log messages

Your log details here

♻️ To reproduce

We cannot consistently reproduce the issue. It appears to happen randomly.