Some bincustom programs

• RETIRED post migration to sirsi1 (although striptags.sh was developed there and works)-striptags.ksh is a program which strips out the tags listed in the /Unicorn/Custom/junksmart file. It is used in WorkFlows to strip out tags listed in the junksmart file from incoming "SmartPorted" records. This only works, if the WorkFlows client has been setup with striptags.ksh in the Preference/SmartPORT settings box under the Special Processing Script as shown below:
  

• newbyfund.ksh is a program written in 2001 which runs monthly and creates webpages of all the newly catalogued items sorted by purchasing fund. These webpages are created in siris's tmp directory and then scp'd to the library webserver. The output consists of: fund, title key, shelving key, locn, ckey. To see output go to http://wwww.ucalgary.ca/library/collections/newbyfund and log in with your email id and password. Other files used by this program in residing in Bincustom:
  • newitem.awk
  • newheader2.html
• This is run via the crontab as shown in this line:

  0 6 2 * * /s/sirsi/Unicorn/Bincustom/newbyfund.ksh
  

• RETIRED...ejournal2cellnew.ksh runs weekly on Tuesday mornings and is used to generate the ejournal webpages from the catalogue records's 856's etc. Like newbyfund.ksh, webpages (html coded) are created in sirsi's tmp directory and then scp'd to the library webpserver. The output consists of: title (130 or 245) which is clickable via the 856|u url, Holdings from 856|e, Note from 856|z . To see output go to http://www.ucalgary.ca/library/ejournals and pick a "letter" of the alphabet to view the ejournal titles we have which begin with that letter. Other files used by this program and residing in Bincustom are:
  • ejfind.pl - used to extract the necessary bits from the catalogdump/marcprint output
  • ejournal.2cell.awk for formatting the output
  • ejheaderpt1.html
  • ejheaderpt2.html
  • ejheaderpt3.html
  • ejfooter.html
• The results of previous week's run is backed up in the library webserver's Web/library/ejournals/backups directory
• Results of the current week's run is stored on the sirsi server in /tmp as ejournalLETTER.bak eg ejournalB.bak and ejournalC.bak etc.

  8 6 * * 2 /s/sirsi/Unicorn/Bincustom/ejournal2cellnew.ksh
  

• turbo_url_wrapper.ksh runs on the 3rd Saturday of each month and checks all the 856 links in the catalogue EXCEPT for those listed in /s/sirsi/Unicorn/Custom/url_except file. It strips out the ezproxy string before checking the url and doesn't check 856's of IN-PROCESS or Serials Solutions items. Reports of problem urls are emailed out to those listed in Bincustom/checkurl_maillist. Details are in sirsi2 directory: /s/sirsi/Unicorn/Work/NDL/Develop/HOW-TO.ucheker file. Other files used by this program and residing in Bincustom are listed below with one residing in Custom as noted:
  • our /s/sirsi/Unicorn/Custom/url_except file has these enteries currently:

    firstsearch.oclc.org
    newfirstsearch.oclc.org
    firstsearch.org
    

  • checkurl_maillist is a list of the library (by number) and the email addresses to send the url check results to. Currently our's is this:

    1|UCALGARY|ckewong@ucalgary.ca|
    2|AUC-NUC|ndlall@gmail.ca|
    3|STMARYS|ndlall@yahoo.com|
    4|BOWVALLEY|ndlall@ucalgary.ca|
    

  • The wrapper is simple and calls a few programs:

    ${custdir}/select_urls.pl ${custdir}/select_urls.out 2> $select_error
    ${custdir}/turbo_url.pl -i "$custdir/select_urls.out" -t /tmp -m "$custdir/checkurl_maillist" -e "$custom/url_except" 2> $turbo_error
    

  • libr_pol_list.pl -- used to create the checkurl_maillist file
  • checkurl.pl -called by turbo_url.pl
  • turbo_url.pl is checking four URLs simultaneously. The number of threads can be cahnged with the -n option.

• RETIRED-getusername.ksh allows the user name to display in eLibrary when he/she uses the login box to log in.

• givebranch gives the branch location of an AVAILABLE hold in My Account area of eLibrary.

• RETIRED-giveitemdesc.ksh allows the full item description rather than it's name to display in eLibrary.

• RETIRED-mail_fcsshauna is no longer used but gives you a template of how to email a file from the server to someone and backup the file.

• move_emailntcran This program runs monthly and moves the current emailntc log (Bincustom/emailntc.ran) into a backup file (Bincustom/emailntc.ran.bak) and empties out the current emailntc.ran log file.

• permission.ksh This program runs daily to ensure that the correct permissions are set on the Bincustom/sirsiaccesscgi program which is essential for the relais software Z39.50 access to our program which delivers the holdings and other cgi-bin programs.

• RETIRED-run.carlnewserials.ksh This program runs the Korn shell program found in Work/NDL/Carl/carlnewserialsCRON.ksh via the crontab. This allows this to run at night or at an off-peak hour to obtain the Carl Statistics for Medical and MacKimmie NEW serials with the results being emailed to S.Telfer and others. This generated monthly reports so that serials could be reviewing the results and deciding how accurate it was and how to align procedures so that accurate results COULD be obtained.

• RETIRED-run.carlsercancelmedmack.ksh This program runs the Korn shell program found in Work/NDL/Carl/carlsercancelmedmackCRON.ksh via the crontab. This allows this to run at night or at an off-peak hour to obtain the Carl Statistics for Medical and MacKimmie serial cancellations with the results being emailed to S.Telfer and others. This was done monthly so that the results could be reviewed throughout the year and accuracy could be monitored.

• save_billreport.ksh This program runs the Korn shell program found in Bincustom/save_billreport.ksh via the crontab. This program creates backups of important month end bill reports like billbalance, billabmonth, DOUCETTEpdbill. Reports which are generally non-repeatable due to time sensitivity. They are saved into Rptcustom/Billbackups with the report name.rundate.(prn or log).

RESTORE programs on TEST system (was on neter pre April 2008) but NOT fully tested-from Bernardo at Emory

• So on neter I have put all the pieces in place:
• a /s/sirsi/Unicorn/Rptcustom/bibload.pl which creates the Korn shell scripts in /s/sirsi/Unicorn/Marcimport/Bibbackup directory for all records loaded in via the bibload.pl report
• bernardo.pm is in /s/sirsi/Unicorn/Rptcustom/Runs
• myseltrans is in /s/sirsi/Unicorn/Bincustom
• trans_restore is in /s/sirsi/Unicorn/Bincustom Remember this is the key script which you use at restore time. It is invoked with 4 parameters:
  • the history-file's absolute path.
  • the start time of the transactions
  • the end time of the transactions
  • and the date of the transactions.
  • Note that script can handle one day at the time.
• Final untested steps are to run trans_restore which will extract the transactions and the tracking scripts (bibload) and creates a Korn shell script with a sequence of catalogload and bserver commands that fall in the correct TIME order. The resulting Korn shell script is named /s/sirsi/Unicorn/Bincustom/run_and_load_nnn, where nnn is a process id number. This script run_and_load has a safety type "lock" to prevent accidental retores. You can only run it as in:

  % run_and_load_nnn Y
  

RESTORING Unicorn transactions and catalog loads.
Author: Bernardo Gomez
Date:   Emory University
Last update: July 17,2003
Disclaimer:
 Package is good for NON-Oracle Unix systems.
 Use it only after practicing in a TEST system.
 Package is based on U2002, and it's not compatible with previous releases.
  It's not compatible because U2002's reports depend on perl scripts.
Report problems or send questions to: bgomez@emory.edu

Purpose of this package: 
 To automate the Unicorn restore procedure.
Background:
 Unicorn saves files that have been loaded with catalogload tool in 
 Unicorn/Marcimportdir/Bibbackup. The load parameters are not saved, what makes   a restore a challenging activity.
 This package includes a bibload script that contains tracking information related
 to the loaed catalog file. The tracking information is really a K-shell script  that contains the catalogload command that was used to load the input
 file.
File delivered: trans_restore.tar
How to install:
  -  move tar file to Bincustom.
  -  unpack with "tar -xvf trans_restore.tar"
  Package is expanded in Develop directory.
Package components:
 1) A *sample* of the bibload.pl script with the required modification.
 I suggest that you copy Unicorn/Rptscript/Runs/bibload.pl to
 Unicorn/Rptcustom/Runs/bibload and insert the statements marked with #Bernardo
 into your bibload.pl.
 2) bernardo.pm should be stored in Unicorn/Rptcustom/Runs/
    bernardo.pm creates the K-shell script that will be stored in the 
    Marcimportdir/Bibbackup.
 3) trans_restore is a K-shell script that should be stored in
    Unicorn/Bincustom. trans_restore is the script that should be run
    when a restore is needed. trans_restore should be invoked with 4
    parameters:
      the history-file's absolute path.
      the start time of the transactions
      the end time of the transactions
      and the date of the transactions.
	Note that script can handle one day at the time.

  4) myseltrans.c is the source of a C program that replaces Sirsi's 
     seltrans. myseltrans can handle time ranges that include seconds.
     Sirsi's seltrans,on the other hand, can resolve hours and 
     minutes only.
     A C compiler is needed to produce a binary file that should be named
     Unicorn/Bincustom/myseltrans. If you prefer to use Sirsi's seltrans 
	replace Bincustom/myseltrans with seltrans in trans_resotore.
     A make file (make.myseltrans) has been included for your convenience.
     Modify make.myseltrans to reflect your local C compiler, and
     issue "make -f make.myseltrans"

How does trans_restore work?
  trans_restore extracts the transactions and the tracking scripts and
  creates a K-shell script with a sequence of catalogload and bserver commands
  that fall in the correct order.
  The resulting K-shell script is named 
  Unicorn/Bincustom/run_and_load_nnnn, where nnn is a process id number.
 run_and_load  has a safety lock to prevent accidental restores:
 run_and_load  will run only if it's invoked as "run_and_load_nnn  Y"