Our hosting provider restored final backups slightly before noon (ET). Auric tested and monitored the restored servers for several hours.
As of 3:00 PM ET, vault02 traffic is returned to the west coast hosting facility as normal.
Sep 16, 15:12 EDT
Auric's hosting provider continue to work on restoring the West coast (Seattle/vault02) configuration -- as well as other client's environments. Our plan is to keep all traffic moving through vault01 overnight and re-evaulate the situation in the morning (east coast US time).
Sep 15, 16:48 EDT
Our hosting provider has restored network connectivity but are now reporting they had an "electrical issue" that corrupted multiple virtual machines, including our web and application servers. We continue to work with our provider on the issue. vault01 continues to be live.
Sep 15, 07:23 EDT
Hosting provider says issues beginning to resolve. We now have VPN access into our servers but continue to see instabilities. Will continue to monitor situation overnight.
Sep 14, 23:04 EDT
Our hosting service provider has informed us there is a 'backbone' issue at the Seattle facility; all networking is down.
They do not have any ETA on when the issue will be resolved.
All traffic is currently directed at the East-coast hosting facility.
Auric will review the issue in a few hours.
Sep 14, 20:22 EDT
We're investigating a problem on vault02 that is causing extremely slow response times. We've switched all transactions to vault01/proxy01.
Sep 14, 19:57 EDT