System Status News | Operations

Outage and reconfiguration news about ACCESS integrated RP resources and ACCESS' online services

OR update an existing news item by clicking on the Subject below.

Subject	Type	When	Affected Infrastructure
ACCESS XDMoD Downtime	Outage Partial	04-29-2024 10:00 CDT 05-01-2024 17:00 CDT	ACCESS Metrics on Demand Service (XDMoD)
ACES Partial Availability, April 22-26	Reconfiguration	04-22-2024 09:00 CDT 04-26-2024 18:00 CDT	Texas A&M University Accelerated Computing for Emerging Sciences (ACES) Cluster
Delta compute and login nodes to be rebooted	Outage Full	04-21-2024 13:00 CDT 04-21-2024 18:00 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU)
NCSA Delta /scratch file system exhibiting intermittent availability and performance issues	Degraded	04-20-2024 12:01 CDT 04-21-2024 09:00 CDT	NCSA Delta Storage (Delta Storage)
Ookami has two new NVIDIA Grace CPUs (144 cores each)	Reconfiguration	04-15-2024 00:00 CDT 05-31-2024 18:00 CDT	IACS at Stony Brook Ookami
Bridges-2 Maintenance Friday April 12	Outage Full	04-12-2024 09:02 CDT 04-12-2024 13:02 CDT	PSC Bridges-2 Regular Memory (Bridges-2 RM) PSC Bridges-2 GPU (Bridges-2 GPU) PSC Bridges-2 Extreme Memory (Bridges-2 EM)
Delta Post-Maintenance Status Update	Outage Partial	03-29-2024 17:00 CDT 04-01-2024 17:00 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU)
Ticket System (JSM) Issues with creating issues and transitions	Outage Partial	03-20-2024 13:16 CDT 03-20-2024 17:00 CDT	ACCESS Ticket System (JSM or RT)
Delta Projects file system maintenance Thursday March 14th, 2024	Outage Partial	03-14-2024 08:00 CDT 03-15-2024 17:00 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU)
Bridges-2 Maintenance Wednesday March 13, 2024	Outage Full	03-13-2024 15:13 CDT 03-13-2024 17:30 CDT	PSC Bridges-2 Regular Memory (Bridges-2 RM) PSC Bridges-2 GPU (Bridges-2 GPU) PSC Bridges-2 Extreme Memory (Bridges-2 EM) PSC Bridges-2 Storage (Bridges-2 Ocean)
Anvil Cluster Maintenance	Outage Full	03-12-2024 07:00 CDT 03-12-2024 19:05 CDT	Purdue Anvil CPU Purdue Anvil GPU
Bridges-2 Maintenance Tuesday, March 5, 2024	Outage Full	03-05-2024 13:15 CST 03-05-2024 14:44 CST	PSC Bridges-2 Storage (Bridges-2 Ocean) PSC Bridges-2 Regular Memory (Bridges-2 RM) PSC Bridges-2 GPU (Bridges-2 GPU) PSC Bridges-2 Extreme Memory (Bridges-2 EM)
Kerberos Outage	Outage Full	03-05-2024 13:00 CST 03-05-2024 16:00 CST	ACCESS Kerberos Authentication Service
ACCESS Ticket System degraded Feb. 28, 2024 through Mar. 1, 2024	Outage Partial	02-28-2024 06:00 CST 03-01-2024 10:00 CST	ACCESS Ticket System (JSM or RT)
Anvil SLURM intermittent issues - Issue isolated, Outage resolved	Outage Partial	02-27-2024 07:00 CST 02-27-2024 16:00 CST	Purdue Anvil CPU Purdue Anvil GPU
SDSC Expanse maintenance, 8AM-4PM (PT), Monday, 02/12/2024 [Completed]	Outage Full	02-12-2024 10:00 CST 02-12-2024 18:00 CST	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU) SDSC Expanse Project Storage
Anvil Scheduled Maintenance Wednesday, February 7th, 2024	Outage Full	02-07-2024 07:00 CST 02-07-2024 21:00 CST	Purdue Anvil CPU Purdue Anvil GPU
ACES Scheduled Reconfiguration/Partial Outage Feb 5-15, 2024	Reconfiguration	02-05-2024 09:00 CST 02-15-2024 18:00 CST	Texas A&M University Accelerated Computing for Emerging Sciences (ACES) Cluster
Delta Notice: Delta maintenance 01-23-2024 - 01-25-2024	Reconfiguration	01-23-2024 08:00 CST 01-25-2024 17:00 CST	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU)
Georgia Tech Hive Gateway Scheduled Downtime	Outage Full	01-23-2024 06:00 CST 01-25-2024 23:59 CST	GaTech Hive Cluster
ACCESS XDMoD Scheduled Downtime	Outage Full	01-16-2024 07:00 CST 01-16-2024 17:00 CST	ACCESS Metrics on Demand Service (XDMoD)
ACCESS XDMoD Scheduled Downtime	Outage Full	12-19-2023 12:00 CST 12-19-2023 18:00 CST	ACCESS Metrics on Demand Service (XDMoD)
Bridges-2 Outage December 19-20	Outage Full	12-19-2023 06:00 CST 12-20-2023 18:00 CST	PSC Bridges-2 Regular Memory (Bridges-2 RM) PSC Bridges-2 GPU (Bridges-2 GPU) PSC Bridges-2 Extreme Memory (Bridges-2 EM) PSC Bridges-2 GPU-AI (Bridges-2 GPU Artificial Intelligence) PSC Bridges-2 Storage (Bridges-2 Ocean)
SDSC Expanse Maintenance 7AM-Midnight (PT), Monday, Dec 18, 2023 [Completed]	Outage Full	12-18-2023 09:00 CST 12-18-2023 20:30 CST	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU) SDSC Expanse Project Storage
ACCESS XDMoD Scheduled Downtime	Outage Partial	12-14-2023 08:00 CST 12-14-2023 11:00 CST	ACCESS Metrics on Demand Service (XDMoD)
ACCESS Web Login Partial Outage October 31, 2023	Outage Partial	10-31-2023 09:15 CDT 11-02-2023 08:00 CDT	ACCESS Identity Management Service
Anvil Unplanned Outage	Outage Full	10-17-2023 08:45 CDT 10-17-2023 09:55 CDT	Purdue Anvil CPU Purdue Anvil GPU
Delta /projects file system temporarily unavailable	Outage Partial	10-09-2023 13:30 CDT 10-09-2023 16:05 CDT	NCSA Delta Storage (Delta Storage)
Delta maintenance 10-04-2023	Outage Full	10-04-2023 06:00 CDT 10-04-2023 22:00 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU) NCSA Delta Storage (Delta Storage)
SDSC Expanse NFS server issues [resolved]	Outage Full	09-29-2023 14:05 CDT 09-30-2023 20:30 CDT	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU) SDSC Expanse Project Storage
SDSC Expanse: Home directory server and login issues [Resolved]	Outage Full	09-28-2023 03:00 CDT 09-28-2023 16:30 CDT	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU)
Jira Service Management ticketing system is non-responsive	Outage Full	09-27-2023 13:25 CDT 09-27-2023 14:02 CDT	ACCESS Ticket System (JSM or RT)
Jira Service Management ticketing system is non-responsive	Outage Full	09-27-2023 08:00 CDT 09-27-2023 10:19 CDT	ACCESS Ticket System (JSM or RT)
Delta projects file system maintenance 09-14-2023	Outage Partial	09-14-2023 08:00 CDT 09-14-2023 22:00 CDT	NCSA Delta Storage (Delta Storage)
Anvil Unplanned Outage	Outage Full	09-10-2023 12:12 CDT 09-11-2023 12:17 CDT	Purdue Anvil CPU
DUO authentication slowness or failure August 21, 2023	Outage Partial	08-21-2023 08:34 CDT 08-21-2023 13:00 CDT	ACCESS Identity Management Service
SDSC Expanse Maintenance, 7AM-Midnight (PT), August 14, 2023	Outage Full	08-14-2023 09:00 CDT 08-15-2023 01:59 CDT	SDSC Expanse Project Storage SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU)
RESOLVED -- 8/13/2023 Network outage upstream from Jetstream2	Outage Full	08-13-2023 11:00 CDT 08-13-2023 12:15 CDT	Indiana Jetstream2 Indiana Jetstream2 GPU Indiana Jetstream2 Large Memory Indiana Jetstream2 Storage
8/8/2023 3:56pm ET - IU Bloomington power event affecting Jetstream2 services	Outage Partial	08-08-2023 08:30 CDT 08-08-2023 14:56 CDT	Indiana Jetstream2 Indiana Jetstream2 GPU Indiana Jetstream2 Large Memory Indiana Jetstream2 Storage
ACCESS User Identity and OAuth Client Registry Planned Maintenance July 1, 2023	Outage Full	07-01-2023 06:00 CDT 07-01-2023 07:00 CDT	ACCESS User Identity and OAuth Client Registry
NCSA Delta Resource Power Outage Event	Outage Full	06-29-2023 19:00 CDT 06-29-2023 20:03 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU) NCSA Delta Storage (Delta Storage)
Jetstream2 / Jetstream2 GPU / Jetstream2 Large Memory Power Outage	Outage Full	06-29-2023 14:55 CDT 06-29-2023 22:14 CDT	Indiana Jetstream2 Indiana Jetstream2 GPU Indiana Jetstream2 Large Memory Indiana Jetstream2 Storage
NCSA Delta Resource Power Outage	Outage Full	06-29-2023 13:30 CDT 06-29-2023 15:45 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU) NCSA Delta Storage (Delta Storage)
Anvil Cluster Maintenance	Outage Full	06-28-2023 07:00 CDT 06-29-2023 10:00 CDT	Purdue Anvil CPU Purdue Anvil GPU
ACCESS Ticket System	Outage Full	05-19-2023 06:00 CDT 05-19-2023 11:25 CDT	ACCESS Ticket System (JSM or RT)
Anvil Storage Restored	Outage Partial	05-16-2023 10:30 CDT 05-16-2023 14:45 CDT	Purdue Anvil CPU Purdue Anvil GPU
SDSC Expanse Maintenance May 8-9, 2023	Outage Full	05-08-2023 10:00 CDT 05-10-2023 01:59 CDT	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU)
Bridges-2 Maintenance Wednesday April 26, 2023	Outage Full	04-26-2023 08:00 CDT 04-26-2023 17:00 CDT	PSC Bridges-2 Extreme Memory (Bridges-2 EM) PSC Bridges-2 GPU (Bridges-2 GPU) PSC Bridges-2 Regular Memory (Bridges-2 RM) PSC Bridges-2 Storage (Bridges-2 Ocean)
SDSC Expanse system status update	Reconfiguration	04-26-2023 01:00 CDT 04-27-2023 18:30 CDT	SDSC Dell Cluster with AMD Rome HDR IB (Expanse) SDSC Dell Cluster with NVIDIA V100 GPUs NVLINK and HDR IB (Expanse GPU)
Delta maintenance Wednesday April 19th, 2023	Outage Full	04-19-2023 08:00 CDT 04-19-2023 20:00 CDT	NCSA Delta CPU (Delta CPU) NCSA Delta GPU (Delta GPU) NCSA Delta Storage (Delta Storage)