Technical Staff Blog

Author archives: Mark Dieterich

RSS feed of Mark Dieterich

Last update on .

ibm-gpfs.jpg The GPFS hardware is scheduled to be moved starting May 23rd @ 06:30am. Please check this page on the day of the move for periodic status updates...

... and so it begins...

05:45: Prep work for the move has begun. We are working to ensure that the most critical services remain active during the file ...

Last update on .

postfix.png As part of our ongoing virtualization efforts, we rolled out an upgraded version of our mail relay server yesterday at noon. Unbeknownst to us, the default value for a configuration variable changed in a subtle way that affected delivery to some subdomains. This definitely affected delivery to some of our email lists. We put a ...

Last update on .

ibm-gpfs.jpg In just under two weeks, Tstaff will be physically moving our GPFS file system hardware from CIT 531 to the datacenter in the basement of the CIT. The purge of the upstairs machine rooms is the culmination of nearly two years of work by Tstaff. We will be shutting down GPFS @ 6:30am to begin ...

Last update on .

owncloud.png We are migrating the background data store for the ownCloud file syncing service today. The service will be offline while we perform a final sync. We estimate the final sync will take about an hour and a half, at which time we will enable the service again.

07:36: Taking the service offline for final ...

Last update on .

owncloud.png 08:54: We are experiencing some database issues with our ownCloud service that could affect syncing back to the servers. The database cluster is managed by CIS, so we are working with their DBAs to diagnose and fix the problems.

09:22: We have shut down one of the backend servers to aid in debugging ...

Last update on .

openvpn.png We downgraded one of our VPN servers to the previous version debian, in hopes that this version of OpenVPN doesn't suffer from the file handle leak bug. This morning, we failed our VPN service to this downgraded server. So far, it looks like this version is immune from the bug. We are going to ...

Last update on .

filemaker.jpeg We have just been informed of the following by CIS:

"Due to scheduled maintenance, FileMaker A will be unavailable on 3/15/2016 from 6:30 AM to 8:00 AM.  During this time, you will not be able to access databases hosted on Brown's FileMaker A server, either using FileMaker or via a ...

Last update on .

openvpn.png We are continuing to experience some authentication issues with our OpenVPN server. A recent upgrade has introduced a bug that leaks file handles, ultimately leading to system resource starvation. We've filed a bug report, but have yet to hear back from the software maintainers. While we continue to investigate this bug and/or find ...

Last update on .

postgresql.png Tstaff will be upgrading the OS on the backend servers providing database service, for a number of our production services, starting at 07:30 on Tuesday, March 15th. This will affect: the CS website, CS email lists, our problem ticket system (RT), CS wikis, instant messaging service, and a variety of Tstaff utlitilies. Assuming all ...

Last update on .

openvpn.png 09:57: We experienced some authentication issues with our VPN server. The process has been restarted and we are investigatng the root cause.

17:03: It looks like there is a libgcrypt bug that crops up when you use openVPN and authenticate against LDAP over TLS, which is exactly our setup. This bug results in ...