Performance issues, June 7, 2018

[11am EDT] The Commons is experiencing intermittent performance issues, which may make the site slow to respond in some cases. The technical team is investigating the issue.

[4pm EDT] The Commons will be unavailable for a maintenance window, starting at 9:30pm EDT, June 7, 2018, while we perform some system upgrades that we hope will address these issue. We expect the downtime to last about 90 minutes.

Commons downtime

[10:15pm EST] The Commons is currently unavailable while we investigate some abnormal behavior.

[Update 10:37pm EST] The site is available again. The problem appears to be related to a corrupted object cache, which was resolved with a hard flush of Memcached.

Maintenance downtime

The Commons will be offline for a few minutes for maintenance related to recent performance issues.

[4:35pm] The site is back online. We’ve put an emergency caching layer in front of one of the sources of the issues, and site resources are stabilizing.