RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.04 ---------------------------------------------------------------- In production on April 30, 2014 A few days after proc3.16.03 went into production, it was discovered that the SOFTVER keywords were being set incorrectly, showing an old version of HEAsoft (V6.0.3 instead of V6.13). THE CORRECT HEASOFT VERSION WAS USED, ONLY THE KEYWORD WAS INCORRECT. proc3.16.04 fixes this problem; there are no other changes. proc3.16.04 =========== * CVS-tagged as "proc3_16_04". * SwitfSub.pm: - Get the HEAsoft version by reading and parsing the HEAsoft ftools.par file manually. - Log resulting value for the SOFTVER keyword. * sw0, sw0pargen: - Version changed to 3.16.04. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.03 ---------------------------------------------------------------- In production on April 25, 2014 Summary of Major Changes: ------------------------- * BAT and XRT processing no longer use the uat attitude files. This was requested by the respective instrument teams. * Calibration database for XRT uses updated gain, ARF, RMF, event threshold, and teldef files. * ATTFLAG keywords should now accurately reflect the type of attitude file used for each file. They are now set only in BAT, UVOT, and XRT files; plus a few XRT TDRSS files at the XRT team's request. Possible values are: 100 = sat file, spacecraft attitude 110 = pat file, attitude is jump corrected 101 = uat file, attitude is uvot corrected 111 = uat file, attitude is jump and uvot corrected uat files are only used for FINAL processing. * SOFTVER keywords (HEAsoft and Swift software versions) now also indicate the number of patches the SDC has applied to the HEAsoft version in use. This correlates with the list of HEAsoft patches below. This information also appears in the log files. For example, for SDC patch level 11: SOFTVER = 'Hea_21Dec2012_V6.13_Swift_Rel4.0(Bld29)_14Dec2012_SDCpatch_11' * BAT mask tagged light curves are now created for all sequences, not just GRB segment 0s. * XRT light curves and related files are now created for PhotoDiode Low Rate (PD/LR) and Piled Up (PD/PU) mode events, if available. These modes were only used very early in the mission. * Improved UVOT attitude corrections. Detailed Change List: --------------------- proc3.16.03 =========== * CVS-tagged as "proc3_16_03". * Uses heasoft-6.13 plus 13 patches (see below). * Uses calibration database caldb20130405 plus updated XRT files (see below). * sw0: - Uses common/com8.7. * sw0.par: - Version updated to 3.16.03 - New parameter sdc_hea_patches gives the number of patches applied at the SDC to the HEAsoft version in use. - Current clock and calibration files, with XRT updates. - alerTime changed from 3.0 to 1.0 days to provide warning before FINAL processing that a GRB is not in the catalogs. - Removed from direct version control, replaced by an sw0.par created by sw0pargen (see below). * sw0pargen: - New script to generate the appropriate sw0.par file for the type of installation (development, test, or production). Future changes will be made to sw0pargen rather than directly in sw0.par. * Attitude.pm: - ATTFLAG comment explains the value. - Sequence and seqprocnum are included on the subject line of the email notice sent when aspect and SACREQ are inconsistent. * BATBurst.pm: - Don't use the uat attitude file (requested by BAT Team). * BATSpectra.pm: - Create mask tagged light curves for all sequences, not just GRB segment 0s. * BATImages.pm: - Don't use the uat attitude file (requested by BAT Team). * Coordinates.pm: - In event_transforms, only look for an attitude file if one wasn't supplied in the $coordParams parameter. - Improved the attitude file log messages. * SW0Header.pm: - Added a header item for the SDC HEAsoft patch level. - Fixed the header items for xrt2fits, bat2fits, and uvot2fits. - Output of the FTOOLS and HEAsoft versions now work, because of the fix to HEAdas.pm. * SW0WrapUp.pm: - Set the ATTFLAG keyword only in BAT, UVOT, and XRT files, and don't overwrite any ATTFLAGs set earlier. - ATTFLAG value is now set separately for each file and depends on the instrument and on whether this is a FINAL FOR ARCHIVE run: UVOT products use the uat attitude file only for FINAL runs, and BAT and XRT products now always use either the pat or the sat file. These changes were requested by the respective instrument teams. The value used for each file is logged. - For previously written ATTFLAG keywords, check against the value expected for the file and email watchers if they don't agree. Also if we find an unexpected previous ATTFLAG. - SOFTVER keyword value is now so long that there is too little space for a useful comment string, so the comment has been removed. * SwiftSub.pm: - Add the number of SDC patches to HEAsoft, from the sdc_hea_patches sw0.par parameter, to the softver job.par parameter (goes into SOFTVER keywords). - HEAsoft version now comes from the fversion ftool, which also logs to job log. - Also run xrtversion, to log XRT software version in job log. - Log whether this is a FINAL FOR ARCHIVE type run. * UvotAttitude.pm: - New sub get_attfile_name to pick correct attitude file. - Informative comment string for the ATTFLAG keyword. - Ensure ATTFLAG keyword is a string. - Check if this is a "FINAL"-type run using the more reliable jobpar object rather than the job_title parameter. - uvotimage and uvotskycorr called with chatter=3 instead of 5. * UvotCoords.pm: - No longer sets ATTFLAG keywords (leaves that for SW0WrapUp). - Chooses appropriate attitude file and passes it to event_transforms. * UvotImages.pm: - New sub get_attfile_name to pick correct attitude file. - Only set ATTFLAG keyword for the uat attitude file created here, leave the other ATTFLAGs for SW0WrapUp. This is because this uat is created from the images, not used to create them. Ensure it's a string. - Check if this is a "FINAL"-type run using the more reliable jobpar object rather than the job_title parameter. - uvotimage and uvotskycorr called with chatter=3 instead of 5. * UvotProduct.pm: - Include trigger ID in subject of the "GRB not found in catalogs" email. * XRT2FITS.pm: - Add ATTFLAG=100 keyword to ATTITUDE extensions of XRT TDRSS *msxim_rw.fits and *msxpc_uf.evt files (requested by XRT Team). * XrtCoords.pm: - Chooses appropriate attitude file and passes it to event_transforms. * XrtEvents.pm: - Don't use the uat attitude file (requested by XRT Team). * XrtGrbLc.pm: - Processes light curves from XRT PD/LR and PD/PU mode events. - Reorganized to process PD mode without necessarily having PC or WT modes. - New subs make_pd_mode_lc and concatLogs. - Don't use the uat attitude file (requested by XRT Team). - No longer sets ATTFLAG keywords (leaves that for SW0WrapUp). - Check if is a "FINAL"-type run using the more reliable jobpar object rather than the job_title parameter. - Include trigger ID in subject of the "GRB not found in catalogs" email. - Sub write_standard_keyword logs each file it works on. * XrtProducts.pm: - Don't use the uat attitude file (requested by XRT Team). com8.7 ====== * CVS-tagged as com8_7. * HEAdas.pm: - Fixed the regex that extracts the HEAsoft version string from the install directory name. * All modules now have the CVS revision in their # VERSION comment. caldb20130405clock100xrt ======================== * Incorporates two patch sets from the XRT Team, XRTCALDB_patch20131220.tgz and XRTCALDB_patch20140120.tgz, which update the XRT gain, ARF, RMF, event threshold, and teldef files. They can be used only for XRT data processed with the SAT or PAT attitude files. * Latest clock file: swclockcor20041120v100.fits heasoft-6.13 ============ As usual, the scat and ds9 programs have been added. Patches installed: 1) swift/gen/tasks/Makefile does not build swacsreq (or swiftcheck). Replaced with Makefile from an earlier patched 6.11 build (heasoft-6.11p16) which does build swacsreq. (We don't seem to use swiftcheck.) Renamed original Makefile to Makefile.orig. Installed in the original build. 2) Bob Wiegand's uvotdetect-1.65, which converts SExtractor fluxes to rates when using count images, uses externally calculated background, and adds expopt=EVENTS for detecting sources in low count images. The original source directory was renamed to uvotdetect-1.63. Some files in the patch predate the original build so they would only install if unpacked with the current date. heasoft-6.13_SRC has the orignal dates. 3) Bob's uvotskycorr-1.24, with parameter detopt which is passed to uvotdetect. The original source directory was renamed to uvotskycorr-1.23. Some files in the patch predate the original build so they would only install if unpacked with the current date. heasoft-6.13_SRC has the orignal dates. 4) Brought swift/xrt/ up to XRTDAS-2.9.1 (from XRTDAS-2.8.0). Affected files are: swift/xrt/lib/xrtdasversion/xrtdasversion.c swift/xrt/lib/xrtperl/ut_xrtobj.pm swift/xrt/tasks/xrtcalcpi/xrtcalcpi.c swift/xrt/tasks/xrtpccorr/xrtpccorr.c swift/xrt/tasks/xrtpipeline/xrtpipeline The original version was preserved as the directory swift/xrt-2.8.0/. Patch files were touched with the current date, so that hmake would recognize them all as newer than the installed versions. 5) [Rebuild, not a patch. Included to maintain numbering consistency of the notes.] 6) Bob's uvotsource-2013jul09.tgz, including uvotsource rev.1.50, uvotsource.html rev.1.28, and Source.pm rev.1.39, to fix UAT file interpolation. These patches include the aperture, large scale sensitivity, and detector sensitivity corrections in the upper limit calculations (previously, only coincidence loss was included); add the CORR_RATE_LIMIT and SATURATED columns; derive the MAG_LIM, MAG_HZ_LIM, MAG_AA_LIM, FLUX_AA_LIM, FLUX_HZ_LIM columns from CORR_RATE_LIMIT instead of COI_RATE_LIMIT; and update the rate limit calculation to correctly address uncertainty in the background. Original versions were renamed with their respective revision numbers. The patch files were touched with the current date so that hmake would build them; in heasoft-6.13_SRC, they have their correct dates. 7) attjumpcorr, rev. 1.5, which has Bob's fix for a rare infinite-looping problem. The original version is renamed to attjumpcorr_1.4. 8) Time.pm, rev. 1.5, utc2met uses uses swifttime. Original renamed to Time.pm_1.4. Touched for installation. 9) uvotdetect, rev. 1.66, makes RATE and RATE_ERR columns 32-bit float. Original renamed to uvotdetect_1.65. Touched for installation. 10) Applied Bob's patch to attitude/lib/rew/rewaiter changing the kill signal from ALRM to KILL. Original renamed to rewaiter_1.2. 11) uvotproduct, rev. 1.38, which tries the SAO DSS server if the STScI server does not provide an image. This addresses a rare, intermittent issue with ds9 retrieving DSS images. Previous source renamed to uvotproduct_1.37. 12) uvotimage, rev. 1.35, which works around rare invalid values in UVOT event file WINDOW extension. Previous source renamed to uvotimage_1.34. 13) uvotattcorr, rev. 1.2, applies delta quaternions for entire duration of exposure instead of at a single epoch, for improved attitude correction. Previous source renamed to uvotattcorr_1.1.