System rebuilds August 19-22, 1999




     SYSTEM REBUILDS AUGUST 19-22, 1999




Arrange for Weekend support from Sirsi

Messages on webcat    pearce        /usr/local/etc/httpd/htdocs/index.html
             motd     root          /etc/login.cfg

Eric put messages on Library Webpages. 

Add the system rebuild weekend dates to the Dates Closed so books don't
become due on those days.

Meet with Roger, Barrie, Nella to decide who does what when.

Message to lib-m: - Linda
     manual circ on Thursday 6 p.m. Aug.19- some time Monday

Work out all the authentication stuff with Eric.
Eric send message to lib-m re authentication alternatives for Booking system,
for web-based databases and for document delivery webforms.

Message to Lucille for all circ supervisors - Linda
     rekeying manual trans some time Monday

Disable User Services on      Nut Webcat
                              Nut Chui
Disable Electra access on Nut Webcat

Message to Angus - Linda
     no f.s. backup Thursday morning
     two f.s. backups: one Thursday at 6 p.m., disk to tape right after.  The 
         second whenever everything is done, probably Sunday morning.      
     Use new tape for the second one.
     cc Joseph etc.  No halt and run on Friday or Saturday or Sunday           
     mornings (maybe Monday too)
     no need for Daily trans backup tape on Friday,Sat, Sunday aft

Schedule rebuilds - Linda

No daily trans backup will be done on Friday or Saturday or Sunday.  The
Thursday 6 pm f.s. backup will take care of it.
Tell Lucille weekend staff don't have to do backups.

Tell Accounts they have to stop commitments and payments as of 4:30 on
Thursday.

FRS interface
     The XI10,20 & 30 can all run as usual.
     Barrie will set up in the crontab all three extraction jobs to run a day
     earlier than usual.  (Barrie doing all the crontab work).
     Other crontab jobs to be taken out until Monday at 9:30 a.m.:
          sfucron - for Simon Fraser's authorization checking
          rcphisttohorus - copies the history files from Osiris every 15
               min.
          zserverpid - removed unused pid's (locks)
          verifycron - for authentication of booking system

Cancel Saturday night ID interface batch update - Barrie

Nella will Cancel RLDID10 & 21 on the weekend of the rebuilds.



Thursday 4:30
     Stop online update to borrower file - Barrie
     Turn off Hogwatch - Barrie
     Suspend all reports, schedule single run reports ?? - could be done
          earlier than 4:30 Thursday?? - Nella
	See documentation at:Nella's website
     Print df - Linda
Thursday  August 19

6:00 p.m. Operations does full system backup, disk to disk
7:00 ~    Operations notifies Linda that backup complete
          Operations begins disk to tape backup
          Linda takes down all servers EXCEPT report
               server OR brings up report server

                                        ACTUAL TIME
7:30 Rebuildheading Should take 31 hours     31 hr 43 min
                      until 2:30 Saturday a.m.

Saturday August 21

     Rebuildauth         Should take 2.5 hours    10 hr 50 min
     Auth_maint          Should take 5.5 hours     7 hr 13 min
     Rebuildtext union   Should take 16 hours     16 hr 12 min

Sunday August 22  (Library NOT closed)

     Rebuildtext imm     Should take 1 second     ----
     Rebuildtext shadow  Should take 25 minutes         39 min
     Rebldthesauri  Should take 32 minutes              35 min
     Correctthesauri     11 times, total 1 hour   1 hr  16 min
=================================================================
TOTAL                                            68 hrs 24 min
=================================================================

... done...  4:25 p.m. Sunday



     Linda asks Operations for a full system backup disk to disk.
          (It can go to tape right away on a new tape.)

     Print df - Linda
     Halt and run - Linda
       make sure system OK, do a few searches, but
       leave system down.


Monday  August 23
8:00 a.m. 

     Take info off webcat front page and motd - Linda

     Nella deal with reports as per:
              Report procedures after downtime
     Update Unicorn borrower file - Roger will do everything on this.

     Message to lib-m - Linda
     Tell Lucille OK to key manual transactions  - Linda
     Circulation key manual transactions - tell Linda when done
     Linda tell Roger
     Load card cancellations - Roger
     Load catchup files - Roger
     Re-enable Electra access on nut
     Re-enable User services on Nut     
          Chui
          Webcat

Re-enable online interface from ID system - Barrie
     Restart Hogwatch - Barrie
     Check df and uptime - Linda

9:00 a.m.

     Re-enable all crons - Barrie

4:30 p.m. Unsuspend adutextam for Tuesday morning - Nella


Sirsi's phone number: 256 704 7001

weekend service: Julian's pager: (256)551-3944

Operations: 5445









Roger will do this stuff:

* Loading card cancellations:

1.  In /Bincustom
     mail_catchup fix_can

2.  In /s/sirsi
     mv forward_old .forward*

3.  mail_catchup catch
--------------------------------------------------


STATISTICS:

1,382,148 bibliographic records
7,794,204 headings
1,460,223 authority records
 (326,846 unauthorized authority records)
15,839,886 unique words in keyword union index
    38,555 unique words in Shadow index


From Nella: Just for consideration next time we do rebuilds... -this year we selected to mark the days the rebuild ran as CLOSED dates for the library so that no items fell due during this "downtime" -so we said dates closed were: 8/19/1999-8/23/1999 Even though we were open on Thursday Aug. 19 and didn't start the rebuilds until 18:00. This meant that hourly and two hour books were pulling due dates on the 24th! Didn't hurt--only gave the patron a break but staff were shocked by it and called me to ask what was going on. Same thing happened on the 23rd--we brought the system up (and before releasing it we should have changed the closed dates back to 8/19/1999-8/22/1999. But we forgot--therefore, again today the hourly and two hour books are pulling due dates for the 24th. So we can improve on this next time with: -better communication to all circ staff as to the ramifications of our choices of closed dates -remember to modify the dates closed when we release the fresh new system.

Page last updated August 23/1999 by Linda Pearce