We are currently experiencing some issues with our GPFS file system, which are causing logins to the departmental systems to hang. Updates to this blog post will be added as we debug the issue.
08:34 - A file system fsck process appears to be hung. A support call to IBM has been initiated as we continue to try and debug the issues on our own.
08:47 - We ejected a node (necco) from the GPFS cluster that seemed to having some issues and the load is slowly returning to normal. It will still be a little while until the NFS servers are able to catch up with outstanding requests. Logins to departmental workstations should be working again.