Technical Staff Blog

Category archives: Service Instability

Tstaff announcements about service instabilities

RSS feed of Service Instability

Last update on .

This is an after the fact report - this issue has been resolved. Certain parts of the 4th and 5th floor of CIT experienced a brief network outage on Thursday, October 4th sometime between 2pm and 3pm. TStaff immediately contacted CIS Networking and they dispatched Comm Ops, it appeared to be a bad uplink on one ...

Last update on .

In hopes of fixing the ongoing FastX issues permanently, we are going to do some reconfiguration of the virtual hosts in the FastX cluster that will require all of them to be shut down. We will take the cluster offline at 8am tomorrow morning (Thursday the 27th). While we don't know how long this ...

Last update on .

FastX continues to be unreliable for most users. Even after a cold reboot of the entire cluster last Friday, most connections are getting rejected, seemingly nondeterministically and accompanied by any one of a few recurring error messages.

We still don't know the underlying cause and have contacted StarNet to see if they have any ...

Last update on .

Users have reported an unusual volume and variety of FastX problems over the last couple of days. So far we have been unable to determine the precise cause, or narrow the problems down to any particular host in the cluster. Therefore, as part of our ongoing attempt to diagnose and fix the problems, we are ...

Last update on .

Late Friday evening into Saturday CIS expereinced a failure of one of the VMWare servers in the stack they provide to us. A number of our internal services depend on the virtual machines hosted by that server, which resulted in intermittent issues through the department (website, dhcp, vpn, ssh, and others).

CIS has temporarily migrated ...

Last update on .

On the morning of Wednesday, January 17th, CIS will change the VLAN numbers of seven of the department's virtual network segments, affecting up to 422 systems, mostly desktop machines.  A simple bookkeeping change, users who are up very early that morning should notice only a brief network outtage.   The change is necessary for a ...

Last update on .

For several days in the past week email messages sent to some CS users were forwarded to an incorrect address, causing them to "bounce."  Those messages were not delivered, and the senders were informed that the intended recipient's account does not exist.  This was due to an error on our part that has been ...

Last update on .

CIS Networking Group Scheduled Network Maintenance:

We are providing this notification that maintenance will be performed to the BC POD between the hours of 6:00 am and 8:00 am on 2/14, 2/15 and 2/16.

During this time, wired, wireless network and IPTV may experience a brief outage lasting less than ...