Site Down CS Protocol

Site Down CS Protocol

Context

Note: The "Site Down Support (Latency, Server, etc.)" chat is only for escalated flag/critical status tasks. Only use it if something is CRITICALLY DOWN. Do not use the chat for a dot AM site, Beta or Test site that isn't working. Those tickets do not go in that chat becuase those are a Sukhdeep/deployment thing. We only want to put the .COM or .US sites in The "Site Down Support (Latency, Server, etc.)" chat.
  1. .AM is development team
  2. .COM is client facing.
  3. .US can be client facing if they are on gov cloud

Action Steps

  1. PRIOR to messaging other teams, confirm that YOU CANNOT access the URL the client has indicated. Some "Site Down" issues are localized to the client and/or are user specific.
    1. IF you CAN access the URL, have the user clear their cache, try a new browser, and/or if possible, try a different Wifi connection.
    2. IF you CANNOT access the URL move to step 2.
  2. Immediately post in the the Teams chat " Server, Site Down, & Latency" with screen shots and tag @Sukhdeep Kaur and @Gaja Naik.
    1. Urgency Notes (make extra note if any of the following apply):
      1. GLWA takes ultimate precedence due to their contract. If any of their environments are not accessible it is critical.
      2. LIVE/PRODUCTION environments take precedence over test sites
      3. CUSTOMER FACING URLS specifically 311 URLs are also more urgent. 
    2. Note for Early Morning:
      1. If and when a client is saying their site is down and it’s early morning, please tag Denstan in chat and Supriya to look since Gaja and Sukhdeep are most likely not available at that early time.
  3. Please use the image to the right as a reference when filling in the ticket tags.
    1. We will always tag them same way and always hold these types of tickets until the site is back up.
  4. We keep these items in NEW status until we have fixed the issue.
  5. If no one is responding follow the call order below to try and get someone to resolve the issue:
    1. Sukhdeep
    2. Gaja
  6. Continue to call/message people every 10 minutes until someone has responded that they are looking into the issue.


Additional Notes

If a server issue happens to be system wide, take longer than 1 hour to resolve, and/or is due to an external source (Cloudflaire issue), a company wide email may need to be sent out. Prior to an email being released Gaja/Sukhdeep must sign-off on the email. Ed team (Gaby/Marianne) will create a Zoho Campaigns newsletter for all clients and release if needed. Please flag for them in CS/SD chat if necessary.

Helpful Links

  1. http://serverstatus.nexgenam.com/ - This is the website where you can check the status of our servers. Green is good, if there is any Red, please alert in the Teams chat "Site Down Support (Latency, Server, etc.)".
  2. Here are some tickets to reference regarding drafts to clients:
    1. https://help.nexgenam.com/agent/nexgenam/nexgen-client-success/tickets/details/544943000067757164
    2. https://help.nexgenam.com/agent/nexgenam/nexgen-client-success/tickets/details/544943000069105003
    3. https://help.nexgenam.com/agent/nexgenam/nexgen-client-success/tickets/details/544943000069055002
  3. Client & Portals Per Server.xlsx - Here is the link to what clients are affected by different servers and their domains