Update - The filesystem has been stable today, however several users have reported degraded interactive IO experience. We expect this is caused by ongoing heavy metadata load as a result of the continuing background integrity check. Based on current progress we unfortunately expect this to continue into next week.
There have been no major impact to jobs, though some workloads paused when trying to write to the filesystem during the incident, and as a result a few jobs have timed out. If you see this and need help resolving it then please contact support.
Aug 28, 2025 - 16:08 NZST
There have been no major impact to jobs, though some workloads paused when trying to write to the filesystem during the incident, and as a result a few jobs have timed out. If you see this and need help resolving it then please contact support.
Aug 28, 2025 - 16:08 NZST
Update - We are continuing to monitor for any further issues.
Aug 28, 2025 - 00:16 NZST
Aug 28, 2025 - 00:16 NZST
Monitoring - Full filesystem functionality was restored at approx 11pm NZST. The issue appears to have been triggered by a brief backend network disruption - WEKA support are investigating why the filesystem didn't recover automatically. Ongoing data integrity checks may impact IO performance for a while longer.
Thankfully there seem to be no widespread job impacts, however we will check this more thoroughly in the morning and contact any users who may have had work impacted. Apologies again for the disruption (and goodnight)!
Aug 28, 2025 - 00:16 NZST
Thankfully there seem to be no widespread job impacts, however we will check this more thoroughly in the morning and contact any users who may have had work impacted. Apologies again for the disruption (and goodnight)!
Aug 28, 2025 - 00:16 NZST
Investigating - We have identified an ongoing issue with our high performance filesystems. This is impacting scratch/nobackup, project, home and likely impacting any new logins to the HPC and OnDemand services. At present, existing jobs are continuing to run and complete, however we anticipate there may be job failures as a result of this problem. We are currently awaiting urgent vendor support. Apologies for the inconvenience and disruption, we'll update as soon as we know more.
Aug 27, 2025 - 21:19 NZST
Aug 27, 2025 - 21:19 NZST
Investigating - We are investigating intermittent errors occurring using Globus to the new HPC platform. Failures often rectify themselves on retry but we are working to improve the stability of this service.
Jul 02, 2025 - 11:32 NZST
Jul 02, 2025 - 11:32 NZST
About This Site
New Zealand eScience Infrastructure High Performance Compute and Storage Service Status
Apply for Access
?
Operational
Data Transfer
Degraded Performance
Submit new HPC Jobs
Operational
Jobs running on HPC
Operational
NeSI OnDemand
?
Operational
HPC Storage
Degraded Performance
User Support System
?
Operational
Flexible High Performance Cloud
?
Operational
Long-term Storage (Freezer)
?
Operational
NeSI HPC Compute Infrastructure - Legacy
?
Under Maintenance
HPC Lander node
?
Operational
HPC Login nodes - Māui
?
Operational
HPC Login nodes - Mahuika
?
Operational
HPC Compute nodes - Māui
?
Operational
HPC Compute nodes - Mahuika
?
Under Maintenance
Mahuika Extension nodes - Mahuika
?
Under Maintenance
Māui Ancillary nodes
?
Operational
Mahuika Ancillary nodes
?
Operational
NeSI Storage Infrastructure - Legacy
Under Maintenance
HPC Shared Storage system
?
Operational
Online storage
?
Operational
Nearline storage
Under Maintenance
Scratch storage
?
Operational
NeSI Data Transfer Infrastructure - Legacy
?
Operational
NeSI HPC Facility (Greta Point, Wellington) DTN
?
Operational
Flexible High Performance Cloud Services
?
Operational
Virtual Compute Service
Operational
Bare Metal Compute Service
Operational
FlexiHPC Dashboard (web interface)
?
Operational
FlexiHPC CLI interface
?
Operational
Public API of the FlexiHPC Service
?
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Scheduled Maintenance
Ondemand, ssh, my.nesi maintenance Sep 3, 2025 11:00-13:00 NZST
Changes to our keycloak functionality will prevent all new logins to Ondemand and ssh to Mahuika (new) for 30mins to 2 hours from 1100hrs Wed Sep 3rd.
my.nesi will also be inaccessible throughout the maintenance period
Posted on Sep 02, 2025 - 09:11 NZST
my.nesi will also be inaccessible throughout the maintenance period
Posted on Sep 02, 2025 - 09:11 NZST