Update - There has been a period of IO stalls this morning as we've dealt with some storage hardware failures. That issue is now resolved, however space reclamation continues in the backend and is having a detrimental impact on read performance. We are working with WEKA support to look at mitigation options. Apologies for the performance impact - if your jobs are impacted and need a runtime limit extension then please reach out to support.
Nov 24, 2025 - 12:44 NZDT
Nov 24, 2025 - 12:44 NZDT
Identified - Our storage system is currently very full and this is forcing the backend object storage to undertake some urgent administration by way of defragmentation. This increased load is having a detrimental affect on I/O performance, especially read I/O, and this is likely to continue for some days. We are urgently looking at ways to mitigate this. Researchers could help alleviate this in the short term by cleaning up any unwanted files and data as soon as possible please.
Nov 21, 2025 - 12:29 NZDT
Nov 21, 2025 - 12:29 NZDT
About This Site
This page shares the system status of REANNZ's advanced computing platform and storage services.
To view the status of REANNZ's network services, visit: https://reannz.status.io
Apply for Access
Operational
Data Transfer
Operational
Submit new HPC Jobs
Operational
Jobs running on HPC
Operational
NeSI OnDemand
Operational
HPC Storage
Degraded Performance
User Support System
Operational
Flexible High Performance Cloud
Operational
Long-term Storage (Freezer)
Operational
Flexible High Performance Cloud Services
Operational
Virtual Compute Service
Operational
Bare Metal Compute Service
Operational
FlexiHPC Dashboard (web interface)
Operational
FlexiHPC CLI interface
Operational
Public API of the FlexiHPC Service
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Scheduled Maintenance
WEKA filesystem and compute core changes - Announcement Sep 8, 2025 09:00-17:00 NZST
In order to get our new WEKA filesystems up to their best possible performance we need to dedicate some cores on each compute node for exclusive use by WEKA. So on Milan nodes Slurm jobs will only be able to use 126 cores per node rather than 128, and on Genoa nodes 166 rather than 168.
This change has already begun, having already been applied to all of the Milan nodes and the majority of the Genoa nodes. We expect to be doing the last of the Genoa nodes on September 8th.
Posted on Sep 04, 2025 - 12:10 NZST
This change has already begun, having already been applied to all of the Milan nodes and the majority of the Genoa nodes. We expect to be doing the last of the Genoa nodes on September 8th.
Posted on Sep 04, 2025 - 12:10 NZST
Automatic cleaning launched for scratch filesystem (/nesi/nobackup) - Announcement Nov 20, 2025 09:00 - Nov 21, 2025 09:00 NZDT
Update -
The scratch autocleaner is now underway, doing its first round of file deletions. The next deletion run will start on Dec 17th,, once that is completed we will suspend the autocleaner over the Christmas holiday period. Then it will start again with a scan on Jan 14th, followed by the file deletions two weeks later. From there it will run every two weeks. If you have any issues please contact support @nesi.org.nz.
Dec 05, 2025 - 10:43 NZDT
Dec 05, 2025 - 10:43 NZDT
Scheduled -
As announced earlier, we’ve re-activated an automatic cleaning process for temporary data stored on our scratch filesystem (/nesi/nobackup). Project members with files scheduled for deletion were notified by email (Subject to their my.nesi.org.nz Notification preferences. To confirm or adjust what notifications you receive, follow these instructions: https://docs.nesi.org.nz/Getting_Started/my-nesi-org-nz/Managing_notification_preferences/)
Files will be deleted on Wednesday 03 December (two weeks from yesterday's email notification). For more details on how the auto-deletion process works, visit:
https://docs.nesi.org.nz/Storage/File_Systems_and_Quotas/Automatic_cleaning_of_nobackup_file_system/
If you have files identified as candidates for deletion that you need to keep beyond the scheduled expiry date, you can move them to your project directory or to Freezer, our long-term storage service. However, if you plan to move more than 2 TB of data or if you need to increase your project directory quota, email support@nesi.org.nz so that we can discuss your storage needs and assist you.
Nov 20, 2025 - 08:44 NZDT
Files will be deleted on Wednesday 03 December (two weeks from yesterday's email notification). For more details on how the auto-deletion process works, visit:
https://docs.nesi.org.nz/Storage/File_Systems_and_Quotas/Automatic_cleaning_of_nobackup_file_system/
If you have files identified as candidates for deletion that you need to keep beyond the scheduled expiry date, you can move them to your project directory or to Freezer, our long-term storage service. However, if you plan to move more than 2 TB of data or if you need to increase your project directory quota, email support@nesi.org.nz so that we can discuss your storage needs and assist you.
Nov 20, 2025 - 08:44 NZDT
WEKA upgrade Dec 9, 2025 12:00-16:00 NZDT
We will be performing a live upgrade of the backend WEKA storage cluster to the latest LTS version. This will resolve some known issues and give us greater insight to address current issues with performance consistency / intermittent slow reads. The system is expected to remain online through the upgrade, though there may be some reduction in performance at various times as nodes are rebooted.
Posted on Dec 08, 2025 - 11:45 NZDT
Posted on Dec 08, 2025 - 11:45 NZDT
Cumulus switch upgrades Dec 9, 2025 18:00 - Dec 10, 2025 06:00 NZDT
The border switches maintenance has been rescheduled to Dec 9th from 1800hrs. Any ssh and external connections to the cluster and OnDemand may get broken during this maintenance. Slurm jobs will be unaffected.
Posted on Dec 03, 2025 - 13:56 NZDT
Posted on Dec 03, 2025 - 13:56 NZDT
my.nesi.org.nz system update Dec 11, 2025 15:30-17:30 NZDT
We will be undergoing scheduled maintenance during this time.
Posted on Dec 05, 2025 - 12:15 NZDT
Posted on Dec 05, 2025 - 12:15 NZDT