All Systems Operational

About This Site

This page shares the system status of REANNZ's advanced computing platform and storage services.
To view the status of REANNZ's network services, visit: https://reannz.status.io

Apply for Access Operational
Data Transfer Operational
Submit new HPC Jobs Operational
Jobs running on HPC Operational
NeSI OnDemand Operational
90 days ago
99.84 % uptime
Today
HPC Storage Operational
User Support System Operational
Support Documentation Operational
Flexible High Performance Cloud Operational
Long-term Storage (Freezer) Operational
90 days ago
99.97 % uptime
Today
Flexible High Performance Cloud Services Operational
90 days ago
99.99 % uptime
Today
Virtual Compute Service Operational
Bare Metal Compute Service Operational
FlexiHPC Dashboard (web interface) Operational
90 days ago
99.99 % uptime
Today
FlexiHPC CLI interface Operational
90 days ago
100.0 % uptime
Today
Public API of the FlexiHPC Service Operational
90 days ago
99.99 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

Scheduled Maintenance

Automatic cleaning launched for scratch filesystem (/nesi/nobackup) - Announcement Nov 20, 2025 09:00 - Nov 21, 2025 09:00 NZDT

Update - The scratch autocleaner is now underway, doing its first round of file deletions. The next deletion run will start on Dec 17th,, once that is completed we will suspend the autocleaner over the Christmas holiday period. Then it will start again with a scan on Jan 14th, followed by the file deletions two weeks later. From there it will run every two weeks. If you have any issues please contact support @nesi.org.nz.
Dec 05, 2025 - 10:43 NZDT
Scheduled - As announced earlier, we’ve re-activated an automatic cleaning process for temporary data stored on our scratch filesystem (/nesi/nobackup). Project members with files scheduled for deletion were notified by email (Subject to their my.nesi.org.nz Notification preferences. To confirm or adjust what notifications you receive, follow these instructions: https://docs.nesi.org.nz/Getting_Started/my-nesi-org-nz/Managing_notification_preferences/)
Files will be deleted on Wednesday 03 December (two weeks from yesterday's email notification). For more details on how the auto-deletion process works, visit:
https://docs.nesi.org.nz/Storage/File_Systems_and_Quotas/Automatic_cleaning_of_nobackup_file_system/
If you have files identified as candidates for deletion that you need to keep beyond the scheduled expiry date, you can move them to your project directory or to Freezer, our long-term storage service. However, if you plan to move more than 2 TB of data or if you need to increase your project directory quota, email support@nesi.org.nz so that we can discuss your storage needs and assist you.

Nov 20, 2025 - 08:44 NZDT
Mar 5, 2026

No incidents reported today.

Mar 4, 2026
Resolved - Additional SSD storage has been added to HPC3/Mahuika's WEKA filesystems earlier in February. This has almost completely eliminated capacity related back-pressure events, which were previously having an adverse impact on ongoing read and write performance. The additional SSD capacity also adds to the peak performance capability of our filesystems, nearly doubling their total throughput to 376 GB/s reads and 71 GB/s writes, and so giving us plenty of headroom for more data-intensive workloads, particularly of the AI variety.

We are still working on additional tuning to improve performance for tiered reads from underlying object storage, but the overall situation should already be much improved. If you continue to experience any IO related issues or performance inconsistencies please reach out to support so we can investigate.

Mar 4, 23:10 NZDT
Monitoring - With the implementation of a new autocleaning process on the scratch/nobackup filesystem last month we have now resolved the associated storage capacity issues related to this incident.

Unfortunately, some workloads will still be experiencing reduced read performance depending on other activity on the system - if you notice highly variable or poor IO performance then please report it to support as we may be able to assist with workarounds.

There are several pieces of work in progress to improve IO performance on the new platform based on learnings from the first 6 months of operations, including an expansion of SSD/NVMe capacity. We will make an announcement soon providing some additional details on this and also update documentation to reflect important considerations for users.

Jan 15, 11:57 NZDT
Update - There has been a period of IO stalls this morning as we've dealt with some storage hardware failures. That issue is now resolved, however space reclamation continues in the backend and is having a detrimental impact on read performance. We are working with WEKA support to look at mitigation options. Apologies for the performance impact - if your jobs are impacted and need a runtime limit extension then please reach out to support.
Nov 24, 12:44 NZDT
Identified - Our storage system is currently very full and this is forcing the backend object storage to undertake some urgent administration by way of defragmentation. This increased load is having a detrimental affect on I/O performance, especially read I/O, and this is likely to continue for some days. We are urgently looking at ways to mitigate this. Researchers could help alleviate this in the short term by cleaning up any unwanted files and data as soon as possible please.
Nov 21, 12:29 NZDT
Completed - The scheduled maintenance has been completed.
Mar 4, 12:52 NZDT
Verifying - We have completed the required updates to OnDemand and its support services.

During this time users would have noticed that they were asked to log back in and all previous sessions were gone, this is expected as we have changed some under lying supporting services that required this.

All work should have saved to the shared file system.

We thank you for patience and if you are having any issues at all please reach out to the team.

Mar 3, 13:34 NZDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 3, 09:32 NZDT
Scheduled - We will be doing an update to OnDemand and its supporting services.

During this time you will experience some intermittent connection issues with a high possibility of current active sessions being closed or dropped.

We apologize for the inconvenience caused at during this time

Mar 2, 10:09 NZDT
Mar 3, 2026
Mar 2, 2026

No incidents reported.

Mar 1, 2026

No incidents reported.

Feb 28, 2026

No incidents reported.

Feb 27, 2026

No incidents reported.

Feb 26, 2026
Completed - The scheduled maintenance has been completed.
Feb 26, 17:07 NZDT
Verifying - Verification is currently underway for the maintenance items.
Feb 26, 17:07 NZDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Feb 26, 15:30 NZDT
Scheduled - We will be undergoing scheduled maintenance during this time.
Jan 30, 13:36 NZDT
Feb 25, 2026

No incidents reported.

Feb 24, 2026
Completed - The scheduled maintenance has been completed.
Feb 24, 11:00 NZDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Feb 24, 09:00 NZDT
Scheduled - We will be doing an update to OnDemand and its supporting services.

During this time you will experience some intermittent connection issues with a high possibility of current active sessions being closed or dropped.

We apologize for the inconvenience caused at during this time

Feb 17, 09:18 NZDT
Feb 23, 2026

No incidents reported.

Feb 22, 2026

No incidents reported.

Feb 21, 2026

No incidents reported.

Feb 20, 2026

No incidents reported.

Feb 19, 2026

No incidents reported.