RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.15.06 ---------------------------------------------------------------- In production April 16, 2013. Patches ======= * 2013-07-31: UvotProduct.pm patched to access JD's catalog at its new location on swift-v. * 2013-04-29: UvotProduct.pm was patched to handle a situation affecting very new GRBs, when both 1) the object name in job.par does not have the form YYMMDDL, and 2) the job.par trigger time (burst_time parameter) is 0. The patch allows the earliest results to become available, albeit without the UVOT lightcurves. proc3.15.06 =========== * CVS-tagged as "proc3_15_06". * sw0: - use common/com8.6 - Order of "use" statements reversed so modules in "sw" will override those in "common". * sw0.par: - Version updated to 3.15.06 - New parameter GrbCat gives path to Lorella's/Davide's catalog (formerly hardcoded). - Current clock and calibration files. - Paths to heasoft-6.11p16 (see below). * Calibration used includes the v.3 sensitivity correction file, swusenscorr20041120v003.fits. * Math.pm has been added to the Utils directory (but as part of the Utils package). This is a copy of Math.pm from the patched heasoft-6.11 (heasoft-6.11p16, see below), and is needed because Attitude.pm now calls some subroutines in it. Since it's not run as an external program, the extra copy is needed. * AddGTI2Att.pm: - GTI extensions from ALL files are now added to the attitude (*sat.fits) files. * Attitude.pm: - Time keywords TSTART, TSTOP, DATE, etc. are now added to all extensions. - If the sequence is in the new database nominal_pnt.rdb, take the nominal pointing coordinates and roll from there. This allows manual override for cases where the pointing cannot be reliably determined automatically. - The mean aspect solution is now compared with the requested pointing (SACSREQ). If the positions disagree by more than 10 arcmin, an E2 error is logged and an email notification is sent. If the roll differs by more than 2 deg, an E1 warning is logged. - Uses Math.pm. * BAT2FITS.pm: - Extra logging for BAT repository files. * BATImages.pm: - sub plot_images: Note the source of trigtime. * BATLightCurve.pm: - Discard empty output gifs. * ExtractGTIs.pm: - use Util::GTIlist. * NominalPointing.pm has been removed from proc3.15.06/Subs, and is now found only in common/com8.6. Previously there had been a version in each place. * SWCheckInput.pm: - Check for duplicate module names in the path, and give an E2 error if any are found; this is considered to indicate a configuration error. - New sub listModules returns an array listing all Perl module (.pm) files beneath the specified directory. - Contains testing code, currently inactive for production, to log the path and environment. * UvotProduct.pm: - Many more log entries to tell which GRB coordinates are used, why, and which catalog they came from, as in XrtGrbLc.pm and XrtProducts.pm. - Name of the Lorella/Davide GRB catalog is now read from sw0.par parameter GrbCat instead of being hardcoded in the source. - GRB catalogs are only copied in once. - No longer crashes if the GRB catalog entry is missing fields. - Sanity checks that values read from the catalogs actually are numbers. - Trigger time source is reported. - Queries of JD's catalog by trigger ID work now. - Works correctly for GRBs that have target IDs < 100000 (eg. bursts discovered elsewhere). - Target/trigger IDs are compared with database IDs numerically instead of as strings. - sub convertTG: More flexible in how trigger time is formatted. - Log entries to tell if matched on the GRB name or the trigger ID. - Obtain watchers_JDcat from the correct .par file. - sub getTrigFromJDCatalog: Correctly determines whether to query by name or trigger ID, and senses catalog errors correctly. * XrtGrbLc.pm: - sub sendEmail: Strip any apostrophes from the subject argument. They would break the shell command line being built and prevent the email from being sent, even though the job log entry would say it was, and prevent the sequence from advancing from copyout. - Many more log entries to tell which GRB coordinates are used, why, and which catalog they came from, as in UvotProduct.pm and XrtProducts.pm. - Email alert about optical/xrt coordinate mismatch is worded more clearly. * XrtProducts.pm: - sub GetRaDec: Many more log entries to tell which GRB coordinates are used, why, and which catalog they came from, as in UvotProduct.pm and XrtGrbLc.pm. * New module Email.pm in Util directory and Util package with sub sendEmail for sending email. Unlike XrtGrbLc.pm sub sendEmail, it takes a single argument, a hash. common/com8.6 ============= * CheckInput.pm: - sub checkTargetID: Log entry now explicitly states that a changed sequence number was remapped. * NominalPointing.pm: - sub determine_pointing: Takes 2 new optional named arguments, ERROR_LEVEL and PROBLEM_REF. heasoft-6.11p16 =============== "heasoft-6.11p16" is a fresh build of HEASoft-6.11 with extra patches. All of these are already in 6.12 or 6.13, or will be included in a future release. The following lists the patches relative to a standard 6.11 build. Patches 1-10 were included in heasoft-6.11 as used in proc3.15.05. The 6.11p16 name refers to the 16 patches. 1) Includes Tim Reichard's patched ftools/image/ximage/src/readwr/wr_fithdr.c, fixes WCSAXES keyword location error causing files to fail ftverify (this should be incorporated in future distributions of HEAsoft). Redid the security context adjustment afterwards. 2) Includes Bob Wiegand's modified uvotproduct which prevents ds9 from stalling the job because the STScI DSS server did not return a valid image, causing ds9 to try to put up an interactive prompt window. (Should be incorporated into future distributions.) 3) Bob's new swiftxform. This replaces 3 directories and adds 1: attitude/lib/rew/ attitude/tasks/minnow/ (new directory) swift/gen/tasks/swiftxform/ swift/uvot/tasks/uvotimage/ The old versions have been renamed to ".orig". The .tgz files Bob supplied are in the respective parent directories. The security context of the libraries had to be readjusted (chcon) after installation. 4) In the new swift/uvot/tasks/uvotimage/uvotimage supplied by Bob above, in the swiftxform call changed parameter alignfile's value to 'CALDB'. Bob has committed this change to the repository. 5) Bob's "6.11.delta.tgz" patches to coordinator, getxform, swiftxform, and uvotexpmap, plus some subsequent bug fixes, also to implement the swiftxform issues above. 5) Craig Markwardt's patch to batdetmask (his taskvers=1.6) which may fix the errors batdetmask sometimes produces when reading the outfile parameter. 6) Bob's patch to uvotgraspcorr (version 1.1, rev 1.13): infile may now be a comma-delimited list of files, or a reference to a file containing a list of file names. 7) Craig's patch to batdetmask (taskvers=1.7) to read the clobber parameter with PILGetBool instead of PILGetString, hopefully fixing the intermittent errors reading this parameter. 9) Bryan Irby's fsort patch (version 3.1f), which permits its use on 0- and 1-line extensions (it just bypasses sorting in those cases). 10) Updated leapsec.fits and tai-utc.dat to the heasoft-6.12 versions which include the 2012-07-01 leap second. (2012-06-21) They each had to be replaced in two places: heasoft-6.11/heacore/refdata/, and heasoft-6.11/heacore/i686-pc-linux-gnu-libc2.5/refdata/ (Note that there are also symbolic links in heasoft-6.11/heacore/BLD/i686-pc-linux-gnu-libc2.5/refdata/ and heasoft-6.11/i686-pc-linux-gnu-libc2.5/refdata/, which did not need to be modified.) The old versions were renamed to leapsec.fits.orig and tai-utc.dat.orig. 11) Bob's patched swift/uvot/lib/perl/UVOT/Time.pm which uses only sec2time and not swifttime to convert from MET to UTC (and not apply the Swift clock correction), for consistency with other SDC software. 12) Bob's new tool swacsreq (swift/gen/tasks/swacsreq/) which determines Swift requested pointing from values in the ACS housekeeping. Updated with Bob's 2012-09-10 bug fix of the swacsreq file (v.1.2). 13) Bob's patch to swift/gen/lib/perl/Math.pm sub u2angle, to treat values of the dot product just outside +/-1.0 (by 1e-12) as if they were +/-1. 14) Bob's patches to skip or disable catalog cross-referencing, which should speed up processing. Affected files (all dated 2012-08-16): attitude/tasks/aspcorr/aspcorr attitude/tasks/tristarid/tristarid.par attitude/tasks/tristarid/StarID/SourceTable.pm swift/uvot/tasks/uvotskycorr/uvotskycorr 15) Bob's patch to uvotproduct (his rev 1.36) to improve how it draws images with current versions of ds9, allow user to specify grid file, and use a ds9 v6 grid file if it detects that version. Files, dated 2012-09-13, from uvotproduct-ds9.tgz, in swift/uvot/tasks/uvotproduct/: uvotproduct, uvotproduct.par, uvotproduct_ds9v6.grd. 16) Program rewaiter from heasoft-6.12 added to attitude/lib/rew/, Makefile modified to include rewaiter. Required by Bob's uvotproduct rev 1.36. Bob supplied this copy of rewaiter. Other notes concerning heasoft-6.11p16: 1) Cleaned the patched heasoft-6.11 with "hmake distclean" then removing the i686-... installation directories, then copied it to heasoft-6.11p16. 2) /aps/tools/gcc/gcc-3.4.3/bin:/aps/tools/perl/bin: at beginning of $PATH (this is required). Did not try to make a fully clean environment. 3) scat program copied in from previous version. 4) Security context of libs adjusted (chcon -t textrel_shlib_t *) 5) Added a symlink to the ds9 program in the /bin directory. ds9 is not by default in the path, at least on our system. Fresh tool builds using heasoft-6.11p16: acs2fits2.1_heasoft6.11p16 fitspackets1.7_heasoft6.11p16 stools.4.7_big_heasoft6.11p16 bat2fits6_7.15_heasoft6.11p16 tdrss2fits_3.22_heasoft6.11p16 uvot2fits_3.32_heasoft6.11p16 xrt2fits_6.3_heasoft6.11p16