RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.15 ---------------------------------------------------------------- In production on Nov 09, 2020 Summary of Changes: * Update to uvotdetect v3.7 Add a post-processing step to remove objects in SExtractor output with RATE/RATE_ERR < errfilt parameter value (default 2). RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.14 ---------------------------------------------------------------- In production on Oct 14, 2020 Summary of Changes: * Modify use of BAT scaled map repository to handle trigger numbers of 1 million or more. * UVOT CALDB update 20201008 - bcf/senscorr/swusenscorr20041120v006.fits This file contains information about the long-term change in the UVOTA detector sensitivity. It extends the information in swusenscorr20041120v005.fits and revises the shape of the change for the W1, W2, M2, and White filters. It is used by UVOT photometry software. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.13 ---------------------------------------------------------------- In production on Aug 25, 2020 Summary of Changes: * XRT CALDB update 20200724 - Update of the XRT gain calibration files. * UVOT CALDB update - Contains a new set of TELDEF calibration files effective 2019-01-01. Addresses UVOT boresight drift since mid 2016 (roughly +3" X, -1" Y). * Swift clock update v138 20200908 [Sep 10, 2020] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.12 ---------------------------------------------------------------- In production on Jun 18, 2020 Summary of Changes: * Update to uvotrawevtimg v1.1 - BUGFIX: update attitude for each new event time instead of every ~1000 events. The primary impact of this bug was star trails in settling images. * Swift clock update v137 20200708 [Jul 09, 2020] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.11 ---------------------------------------------------------------- In production on Apr 02, 2020 Summary of Changes: * bat2fits update to v7.21 - Include BAT event dump LDPs with a target ID corresponding to a BAT trigger but non-zero segment with observation data. * Swift clock update v136 20200504 [May 04, 2020] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.10 ---------------------------------------------------------------- In production on Jan 16, 2020 Summary of Changes: * bat2fits update to v7.20 - Made BAT data validity check function of current time * Swift clock update v135 20200305 [Mar 25, 2020] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.09 ---------------------------------------------------------------- In production on Dec 31, 2019 Summary of Changes: * bat2fits update to v7.19 - Accept BAT data approaching the 2020 era * Swift clock update v134 20200106 [Jan 07, 2020] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.08 ---------------------------------------------------------------- In production on Oct 28, 2019 Summary of Changes: * XRT CALDB update 20190910 - Update of the XRT gain for substrate voltage 6 both PC and WT mode. This gain update is a revise version of what was released on April 2019. - Update of the teldef files. These updated are valid for data starting from Jun 2017. * Swift clock update v133 20191017 [Oct 28, 2019] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.07 ---------------------------------------------------------------- In production on Oct 16, 2019 Summary of Changes: * Include record in Swift TDRSS database with time taken from BAT TDRSS HK files even if no TRIGTIME or TDRSS PKTTIME is available. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.06 ---------------------------------------------------------------- In production on Jun 10, 2019 Summary of Changes: * Update to XRTDAS v3.5.0 - xrwtcorr: added identification and flagging of trailing charge pixels for data taken in Windowed Timing mode - xrtevtrec: modified update of STATUS column (case "flagneigh = yes”) - xrtcalcpi: added dependence on event grade for energy offset correction associated to charge traps * XRT CALDB update 20190412 * Swift clock update v131 20190607 [Jun 10, 2019] * Swift clock update v132 20190813 [Aug 14, 2019] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.05 ---------------------------------------------------------------- In production on May 15, 2019 Summary of Changes: * Support rapid access to BAT TDRSS event data RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.04 ---------------------------------------------------------------- In production on Nov 20, 2018 Summary of Changes: * Updated the calculation of the pointing GTI. The old GTIs are constrained by intersection with the observation snapshots. * Swift clock update v129 20190129 [Jan 31, 2019] * Swift clock update v130 20190405 [Apr 11, 2019] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.03 ---------------------------------------------------------------- In production on Jul 16, 2018 Summary of Changes: * XRT CALDB update 20180710 Contains a new set of gain calibration files. The update improves the accuracy of the gain correction to data taken from October 2016 (older data are unaffected). * Swift clock update v127 20180911 [Sep 13, 2018] * Swift clock update v128 20181114 [Nov 16, 2018] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.02 ---------------------------------------------------------------- In production on Jul 10, 2018 Summary of Changes: * Swift clock update v126 20180709 [Jul 10, 2018] * XRT event processing fix: Missing XRT science trailer was improperly preventing photon counting mode data from being processed. * Enable UVOT large scale sensitivity correction for uvotproduct * Swift clock update v125 20180511 [May 17, 2018] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.01 ---------------------------------------------------------------- In production on May 10, 2018 Summary of Changes: * Fix sw<>x.mkf.fits STLOCKFL/STLOCKST column comments * Include RA/Dec in OBJECT keyword value for generic names (TOO, Tiling, Unknown). For example, 'TOO (207.816, -48.029)' instead of 'TOO'. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.18.00 ---------------------------------------------------------------- In production on Apr 23, 2018 Summary of Changes: * Update to bat2fits 7.18 * Handle updates to target ID assignments 030xxxxx TOOs 031xxxxx Fill-In targets 032xxxxx GI program 033xxxxx Calibration 034xxxxx NuSTAR 035xxxxx Non-BAT GRBs 036xxxxx Non-Science Targets (e.g., saa-cold) 037xxxxx - 039xxxxx reserved for future types RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.17 ---------------------------------------------------------------- In production on Mar 28, 2018 Summary of Changes: * Updated to XRTDAS v3.4.1 Incorporated changes from xrtfilter: - Added the handling of quick look sequences (*991) for the extrapolation of the values of the STAST_LOSSFCN/SAC_MODESTAT columns of the filter file * Swift clock update 20180305 [Mar 22, 2018] * Updated UVOT CALDB index file to reflect CALDBVER 20170922 RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.16 ---------------------------------------------------------------- In production on Jan 19, 2018 Summary of Changes: * Allow overriding attitude data used to process observation. The raw/ingested attitude data is preserved in the RAW_ATTITUDE and RAW_ACS_DATA extensions of swsat.fits * Swift clock update 20180103 [Jan 11, 2018] * Swift-XRT CALDB version 20171113 [Nov 16, 2017] Contains a new set of teldef calibration files. This calibration update improves the accuracy of the XRT sky positions for data taken after January 1st, 2016, older observations are not affected. * Swift-BAT CALDB version 20171016 [Oct 31, 2017] RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.15 ---------------------------------------------------------------- In production on Sep 28, 2017 Summary of Changes: * Install UVOT CALDB update which includes teldef files to address boresight drift. * uvotdetect 3.5 Added a step to check SExtractor results and if too many indicate unreasonable background or significance, re-run SExtractor overriding background and sigma. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.14 ---------------------------------------------------------------- In production on Aug 03, 2017 Summary of Changes: * uvotdetect v3.4 Added a step to check SExtractor results and if too many indicate unreasonable background or significance, re-run SExtractor overriding background and sigma. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.13 ---------------------------------------------------------------- In production on Jun 01, 2017 Summary of Changes: * swifttime v1.7 Update extrapolation polynomial. * uvotdetect v3.3 Update how images and weight maps are passed to SExtractor to reduce spurious detections. * uvotimage v0.7 Zero out pixels corresponding to RAWX <= 8 to avoid image wrap-around issue. * uvotproduct v2.4 Support ds9 v7.x RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.12 ---------------------------------------------------------------- In production on May 09, 2017 Summary of Changes: * Update to XRT CALDB version 20170501 * Update clock file to v119 RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.11 ---------------------------------------------------------------- In production on Feb 06, 2017 Summary of Changes: ------------------------- * XRTDAS build 33 patch - xrtwtcorr: Bug fixed in the bias adjustment calculation. - xrtscreen: Fixed some keywords duplication in output GTI files. - xrtfilter: Modified the call to the multi-mission FTOOL prefilter. - xrtgrblc: Update of the clean-up of temporary files. - xrtgrblcspec: Adjust some output formatting to mimic behavior prior to a recent increase in output precision from Xspec. * Retrieve trigger/GRB info from JD's catalog using https. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.10 ---------------------------------------------------------------- In production on Jan 04, 2017 Summary of Changes: ------------------------- * Improve handling of UVOT damaged image with no pixel data. Write out a minimal image HDU to preserve metadata and file structure. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.09 ---------------------------------------------------------------- In production on Dec 30, 2016 Summary of Changes: ------------------------- * Prepare for end of 2016 leap second. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.08 ---------------------------------------------------------------- In production on Nov 23, 2016 Summary of Changes: ------------------------- * Processing of unfiltered XRT event files was improperly being prevented if no cleaned event file was produced by xrtscreen. Now processing of the unfiltered event file continues provided xrtscreen does not exit with an error. * Update clock file to v116 (deployed 2016-11-18) RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.07 ---------------------------------------------------------------- In production on Nov 04, 2016 Summary of Changes: ------------------------- * Update prefilter to version 3.3 to address issue propagating Swift positions due to clock drift. For Swift, prefilter v3.3 will use the UTCFINIT keyword from attitude file if present to calculate the propagation time. * Include UTCFINIT in attitude files. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.06 ---------------------------------------------------------------- In production on Aug 02, 2016 Summary of Changes: ------------------------- * Fix issue determining BAT GTIs for special case (when Bayesian block computation fails and low significance). RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.05 ---------------------------------------------------------------- In production on Jul 21, 2016 Summary of Changes: ------------------------- * Update CALDB XRT CALDB patch 20160609 Clock v114 20160706 * Apply patch to xrtwtcorr (version 0.2.2). * Fix issue retrieving BAT scaled map from shared repository in special case (when Bayesian block computation fails and low significance). RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.04 ---------------------------------------------------------------- In production on May 31, 2016 Summary of Changes: ------------------------- * Update uvotdetect configuration for generating UVOT catalog * Update CALDB Clock v113 20160504 RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.03 ---------------------------------------------------------------- In production on Apr 7, 2016 Summary of Changes: ------------------------- * Updated CALDB Clock v112 20160311 UVOT COLORTABLE v108 RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.02 ---------------------------------------------------------------- In production on Feb 8, 2016 Summary of Major Changes: ------------------------- * Screen XRT events from bad CCD frames using the XRTDAS 3.2.0 updates to xrtpccorr and xrtscreen. * Updated CALDB Clock v111 20160113 RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.17.01 ---------------------------------------------------------------- In production on Sep 28, 2015 Summary of Major Changes: ------------------------- * Updated to HEASoft 6.17 * Updated CALDB XRT CALDB 20150721 UVOT long-term sensitivity 20150717 Clock v109 20150911 * Modified XRT event file processing to avoid further processing of an event file after an error occurs RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.09 ---------------------------------------------------------------- In production on Jun 4, 2015 Summary of Major Changes: ------------------------- * Updated for leap second at end of Jun 2015. * Fixed UVOT exposure maps created with method=SHIFTADD to address dead time correction. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.08 ---------------------------------------------------------------- In test on Feb. 24, 2015 In production on Mar 24, 2015 Summary of Major Changes: ------------------------- * Update clock calibration file. * The XRT team requested that xrtgrblc invocation be updated to include lccorravg=no pcreglist=2 wtreglist=2 To support that change, xrtgrblc and xrtexpomap were brought up to dat.e * Removed incorrect MJD-OBS from XRT exposure maps * Updated xrt2fits to handle more than 1024 extensions. This occurred when reprocessing RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.07 ---------------------------------------------------------------- In production on Jan. 02, 2015 Summary of Major Changes: ------------------------- * The BAT team identified an issue in the bat2fits conversion of LDPs to FITS files. The validation of times in the BAT LDP headers was treating data after the beginning of 2015 (i.e., 2015-01-01T00:00:00Z) as damaged and therefore not converted to FITS. The BAT team provided a patch to bat2fits which has been applied. The updated version in the SDC pipeline is bat2fits6_7.16_heasoft6.13. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.06 ---------------------------------------------------------------- In production on Aug. 29, 2014 Summary of Major Changes: ------------------------- * We have discovered that one of the changes made in 3.16.05, not processing XRT PC-mode SLEW and SETTLING event files (*xpc*sl* and *xpc*st*) with xrtpcbias (and thus xrtpccorr), could sometimes cause other problems: Since their EVENTS HDUs would not contain PHAS0 (array of pulse height analyzer on-board values) columns and they would not have BIASDIFF HDUs, the Filter module could get errors when trying to create the calibration sources file (*xpc*cb_uf.evt). So, this version reverts to the previous behavior, calling xrtpcbias (with srcdetx=300 and srcdety=300) for these files, even though this has a somewhat increased risk of xrtpccorr failing with an ".mkf file is not appropriate for the events file" error, the problem the original change was intended to prevent. Detailed Change List: --------------------- proc3.16.05 =========== * CVS-tagged as "proc3_16_06". * XrtEvents.pm: - Revert to processing XRT PC SLEW and SETTLING event files with xrtpcbias (with srcdetx=300 and srcdety=300). * sw0pargen: - VERSION updated to 3.16.06. RELEASE NOTES FOR SWIFT PROCESSING SOFTWARE, Version proc3.16.05 ---------------------------------------------------------------- In production on August 21, 2014 Summary of Major Changes: ------------------------- * In certain circumstances, it was possible for the UVOT summed sky image and exposure map files *u_sk.img and *u_ex.img to repeat HDUs, with different (and incorrect) EXTNAME and FILTER keywords. (Typically in such cases these keywords would not match.) This has been fixed. * UVOT grism images are no longer included in the summed sky image file *u_sk.img, because they are sensitive to roll angle and summing them has doubtful scientific relevance. (They have never correctly been in the summed exposure map file *u_ex.img.) This was at the recommendation of the UVOT team. * UVOT grism HDUs should now consistently have EXTNAME keyword values UGRISM or VGRISM for UV and visual respectively. Some were formerly called "Grism1 UV" or "Grism2 Visible". * XRT Photon Counting (PC) mode SLEW and SETTLING events are no longer processed with xrtpcbias. This was at the recommendation of the XRT team. These events are not used for scientific purposes. Detailed Change List: --------------------- proc3.16.05 =========== * CVS-tagged as "proc3_16_05". * Uses heasoft-6.13 plus 13 patches (see below). (Same as proc3.16.03/04.) * Uses calibration database caldb20130405 plus updated XRT files (see below). * Attitude.pm: - Sends an email alert to SDC staff if nominal pointing cannot be determined by any method. Formerly only did this if the aspect and sacsreq solutions were inconsistent. - Job title now included in both nominal-pointing email alerts. * BATLightCurve.pm: - Minor formatting and VERSION comment only. * StartEndTimes.pm: - Log a more informative message if a file is skipped because TSTOP-TSTART > max_duration. * UvotImages.pm: - Do not sum grism images to the sky (sw*u_sk.img) and exposure-map (sw*u_exp.img) files. (sum_images) - Fixed bug where spurious copies of summed images with incorrect extension names could be added to the sw*u_sk.img and sw*u_exp.img files. (sum_images) - Use filterIDs instead of filterNames for the extension names in the summed image files. (sum_images, plot_images) - Improved logging. (sum_images) * UvotNames.pm: - New array filterIDs contains UGRISM and VGRISM as the grism filter names. These are used, eg. for EXTNAME keywords. * UvotProduct.pm: - Handle leading/trailing whitespace in RA and Dec strings. (convertRAStringToDegrees, convertDecStringToDegrees) - More informative email alerts to SDC staff if can't find trigger time or GRB in catalogs. (make_uvot_gif_files) - Log a different message if it was too soon to send the email alert. (make_uvot_gif_files) - More informative email alerts to SDC staff if errors are found in the catalog. (get_grb_coord, getTrigFromJDCatalog) * XrtEvents.pm: - Skip xrtpcbias for Photon-Counting (PC) mode SLEW and SETTLING events. * XrtGrbLc.pm: - More informative email alerts to SDC staff if can't find GRB in catalogs. (make_xrt_grb_lc) - Log a different message if it was too soon to send the alert. (make_xrt_grb_lc) * SW0Filename.pm: - New functions filter_id_for_code and filter_code_for_id to convert between filter codes and IDs as defined in UvotNames.pm. * sw0pargen: - VERSION updated to 3.16.05. - Note: The parameter "grism2uv" really ought to be called "grism1uv". caldb20130405_clock102_xrt20140610 ================================== * caldb20130405 plus three patch sets from the XRT Team: - XRTCALDB_patch20131220.tgz and XRTCALDB_patch20140120.tgz, which update the XRT gain, ARF, RMF, event threshold, and teldef files. (Same as proc3.16.03/04.) - XRTCALDB_patch20140610.tgz, which updates the XRT RMF, swxbadpix, and swxonboardbp files. (This was added as an out-of-band update to proc3.16.04 in June 2014.) * Latest clock file: swclockcor20041120v102.fits. See the sw0.par file for out-of-band updates. heasoft-6.13 ============ (No changes from proc3.16.03/04.) As usual, the scat and ds9 programs have been added. Patches installed: 1) swift/gen/tasks/Makefile does not build swacsreq (or swiftcheck). Replaced with Makefile from an earlier patched 6.11 build (heasoft-6.11p16) which does build swacsreq. (We don't seem to use swiftcheck.) Renamed original Makefile to Makefile.orig. Installed in the original build. 2) Bob Wiegand's uvotdetect-1.65, which converts SExtractor fluxes to rates when using count images, uses externally calculated background, and adds expopt=EVENTS for detecting sources in low count images. The original source directory was renamed to uvotdetect-1.63. Some files in the patch predate the original build so they would only install if unpacked with the current date. heasoft-6.13_SRC has the orignal dates. 3) Bob's uvotskycorr-1.24, with parameter detopt which is passed to uvotdetect. The original source directory was renamed to uvotskycorr-1.23. Some files in the patch predate the original build so they would only install if unpacked with the current date. heasoft-6.13_SRC has the orignal dates. 4) Brought swift/xrt/ up to XRTDAS-2.9.1 (from XRTDAS-2.8.0). Affected files are: swift/xrt/lib/xrtdasversion/xrtdasversion.c swift/xrt/lib/xrtperl/ut_xrtobj.pm swift/xrt/tasks/xrtcalcpi/xrtcalcpi.c swift/xrt/tasks/xrtpccorr/xrtpccorr.c swift/xrt/tasks/xrtpipeline/xrtpipeline The original version was preserved as the directory swift/xrt-2.8.0/. Patch files were touched with the current date, so that hmake would recognize them all as newer than the installed versions. 5) [Rebuild, not a patch. Included to maintain numbering consistency of the notes.] 6) Bob's uvotsource-2013jul09.tgz, including uvotsource rev.1.50, uvotsource.html rev.1.28, and Source.pm rev.1.39, to fix UAT file interpolation. These patches include the aperture, large scale sensitivity, and detector sensitivity corrections in the upper limit calculations (previously, only coincidence loss was included); add the CORR_RATE_LIMIT and SATURATED columns; derive the MAG_LIM, MAG_HZ_LIM, MAG_AA_LIM, FLUX_AA_LIM, FLUX_HZ_LIM columns from CORR_RATE_LIMIT instead of COI_RATE_LIMIT; and update the rate limit calculation to correctly address uncertainty in the background. Original versions were renamed with their respective revision numbers. The patch files were touched with the current date so that hmake would build them; in heasoft-6.13_SRC, they have their correct dates. 7) attjumpcorr, rev. 1.5, which has Bob's fix for a rare infinite-looping problem. The original version is renamed to attjumpcorr_1.4. 8) Time.pm, rev. 1.5, utc2met uses uses swifttime. Original renamed to Time.pm_1.4. Touched for installation. 9) uvotdetect, rev. 1.66, makes RATE and RATE_ERR columns 32-bit float. Original renamed to uvotdetect_1.65. Touched for installation. 10) Applied Bob's patch to attitude/lib/rew/rewaiter changing the kill signal from ALRM to KILL. Original renamed to rewaiter_1.2. 11) uvotproduct, rev. 1.38, which tries the SAO DSS server if the STScI server does not provide an image. This addresses a rare, intermittent issue with ds9 retrieving DSS images. Previous source renamed to uvotproduct_1.37. 12) uvotimage, rev. 1.35, which works around rare invalid values in UVOT event file WINDOW extension. Previous source renamed to uvotimage_1.34. 13) uvotattcorr, rev. 1.2, applies delta quaternions for entire duration of exposure instead of at a single epoch, for improved attitude correction. Previous source renamed to uvotattcorr_1.1.