Partially Degraded Service
AARNet Sites and Services ? Operational
CloudStor Operational
CloudStor Service Operational
S3 Service Operational
Brisbane Node Operational
Melbourne Node Operational
Canberra Node Operational
Perth Node Operational
Customer Dashboard Operational
Eduroam ? Operational
Eduroam RADIUS Operational
SAML IdP broker ? Operational
Admin Tool ? Operational
Mirror Operational
Unified Communications eXchange (AUCX) Operational
Zoom ? Degraded Performance
AARNet Zoom Meetings ? Operational
AARNet Zoom Virtual Room Connector ? Operational
AARNet Zoom Cloud Recording ? Operational
Zoom.us Meetings ? Operational
Zoom.us Cloud Room Connector Operational
Zoom.us Group Messaging Operational
Zoom.us Telephone Services Operational
Zoom Web Client Operational
Zoom Web Portal Operational
Zoom Cloud Recording Degraded Performance
Zoom REST API Operational
Zoom Marketplace Operational
Zoom Dashboard & Reporting Operational
Zoom Video Webinars Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
AARNet CloudStor and S3 services will be undergoing scheduled maintenance at this time.

This is a hazard notice only. We do not expect any issues to arise during this maintenance window or for services to be impacted.

If you experience issues during this period, please contact the AARNet support team.
Posted on Feb 25, 18:10 AEDT
Past Incidents
Mar 2, 2021

No incidents reported today.

Mar 1, 2021

No incidents reported.

Feb 28, 2021
Resolved - CloudStor services have been recovered and we are now monitoring it.
Feb 28, 08:33 AEDT
Investigating - CloudStor is currently experiencing operational issues and is unavailable. Our Cloud Services team are working to restore services.
Feb 28, 07:00 AEDT
Feb 27, 2021
Completed - The scheduled maintenance has been completed.
Feb 27, 08:00 AEDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Feb 27, 07:00 AEDT
Scheduled - We will be undergoing scheduled maintenance during this time.
Should be no impact to service.

Hazard Warning only.
Feb 23, 08:21 AEDT
Feb 26, 2021

No incidents reported.

Feb 25, 2021

No incidents reported.

Feb 24, 2021

No incidents reported.

Feb 23, 2021

No incidents reported.

Feb 22, 2021

No incidents reported.

Feb 21, 2021

No incidents reported.

Feb 20, 2021

No incidents reported.

Feb 19, 2021
Resolved - This incident is now resolved and all CloudStor and S3 services are operational.
Feb 19, 11:14 AEDT
Monitoring - The incident was due to a short network outage at our Canberra site. Services have been recovered and we are currently confirming all are accessible.
Feb 19, 10:54 AEDT
Investigating - We have notified of server errors for our Canberra CloudStor and S3 site. Our initial assessment is that all S3 services are unavailable and some CloudStor services are affected reducing performance and access to files. The Cloud Services team are currently investigating.
Feb 19, 10:32 AEDT
Feb 18, 2021
Resolved - This issue has been resolved. CloudStor and FileSender are now reliably supporting file uploads >1GB. The Cloud Services team apologise for any inconvenience caused.
Feb 18, 09:54 AEDT
Monitoring - The Cloud Services team have identified a likely cause of the file upload and performance issue and have applied changes to mitigate this issue. Our internal testing has shown improved performance and completion rates for file uploads >1GB in the browser, using the sync client and using RClone. We will continue to monitor the system performance and will provide further updates next week. We still recommend using RClone as the preferred method to upload files >1GB on a regular basis.
Feb 12, 11:53 AEDT
Update - The Cloud Services team are continuing to address the issues with large file uploads and are currently applying configuration tuning to the file system on the advice of our storage partner. The team are treating this with the highest priority and we will provide updates as this work progresses.
Feb 8, 15:56 AEDT
Update - The Cloud Services team are working with our software vendors to apply multiple updates to CloudStor to overcome the issues with large file uploads. We understand that the updates applied on 27/01/21 have not provided a significant improvement. We will be scheduling more system updates over the coming weeks. However, our current advice is to avoid using the browser or sync client for file uploads greater than 1 GB. In our testing we see higher success rates for large file uploads using the RClone and Rocket tools, and suggest using these tools outside of business hours.
Information on these tools is available via our knowledge base: https://support.aarnet.edu.au/hc/en-us/articles/360000911395-Preferred-Client-Tools
Jan 28, 16:44 AEDT
Update - The AARNet Cloud Services team are continuing to work with our software partners to analyse the root cause of these issues. The team have been testing new software to help address these issues and expect to implement this as early as the week beginning January 18, if not earlier.

We apologise for the significant inconvenience caused. We will provide regular updates on progress here.
Jan 11, 15:30 AEDT
Update - CloudStor is still experiencing errors for large file uploads. This is generally for files > 1GB but excessive waits and timeouts may occur for smaller files as well. Users may see "Upload Failed" errors in their browser, or "400 Bad Request" errors in client based uploads. The AARNet Cloud Services team are working with our software partners to diagnose the root cause of these issues. We apologise for the significant inconvenience caused. We will provide regular updates on progress here.
Dec 17, 16:22 AEDT
Update - The Cloud Services team have identified the cause of the file upload failures for large files. File uploads have improved for the majority of files larger than 1 GB, and we are working towards a complete remediation.
Dec 17, 08:57 AEDT
Identified - The Cloud Services team are making changes on the file upload services that we expect will significantly reduce the number of upload failures for >1 GB files. The changes will be implemented this Friday afternoon during the current maintenance period. We will then monitor the uploads and identify next steps early next week. We apologise for the inconvenience caused and thank you for your patience as we work through these issues.
Dec 11, 16:28 AEDT
Update - The Cloud Services team are still investigating this issue of an increase of error rate for large file uploads on CloudStor, and are treating it as the highest priority. We apologise for the inconvenience caused and we are working towards a resolution as quickly as possible.
Dec 9, 14:35 AEDT
Investigating - The Cloud Services team have identified an increase of error rate for large file uploads on CloudStor. Users will see "Upload Failed" errors in their browser, or "400 Bad Request" errors in client based uploads. This may be resolved by retrying, or smaller uploads. The team are investigating as a matter of priority and we will keep you informed as the investigation progresses.

This does not affect S3 services.
Dec 7, 14:06 AEDT
Feb 17, 2021

No incidents reported.

Feb 16, 2021

No incidents reported.