FS hardware migration outage summary

Outage Follow Up Summary:

The backup for FS didn’t occur as expected. Seems Novastor virtual expects weekly tapes if the job is defined as a weekly no mater what day the job occurs on. Got FSAPPS running again (crashed for some reason), and finally got a full DSREPAIR to work on it. Downed all servers but NS, imaged the sys partitions to NS. Downed NS and imaged it to FSAPPS.

Brought all servers back online, started a “real” tape backup of FS. After it completed, started the migration process. The migration process seemed to go relatively smooth. After it completed around 6:30, post migration procedures were started. DSREPAIR failed with a 608 error when “checking volume objects and trustees”. This occurred because of an objectID conflict between the volume and another object. Of course this was the case for ALL the volumes. 1 was in conflict with a container, the other were in conflict with users. After various procedures and research on Novells site failed to correct the problem, Jeremy Good came in and we contacted Novell. Trevor stated the “error” was known and the best way to resolve the problem was by deleting the user objects and recreating. (yea right). This was tried with one user – it worked. He then found a utility to change the objectid of a volume. “voleid.nlm” This was tried and worked on the other volumes. Using this utility, we changed the volume object id’s 1 at a time then ran dsrepair (check volume id’s and trustees), then repeated the cycle for the rest of the volumes. It was stated that this NLM doesn’t appear to work for NSS volumes – luckily we have traditional volumes. This process was completed around 11:30PM.

Novastor, pwrchute, and sophos were added to the FS server and appeared to run fine. Changes were made to the autoexec.ncf to allow for automatic loading of these and a few other Novell nlms. An image was made to FSAPPS and a full backup was started to “real” tape. What had yet to be done was go through the “Performance tuning” tid, and check a few other parameters.

— technical summary by Dan Marple Jr. —

Duration: 1 day

Assigned Technicians: Dan Marple Jr