Subject: 2.5m obslog 20140824 (MJD 56894) From: pgaulme@apo.nmsu.edu Date: Mon, 25 Aug 2014 11:34:05 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday August 24, 2014 (MJD 56894) ---- Observing Team ---- Dan Oravetz Patrick Gaulme Paul Harding Brian Cherinka Online/telephone support from: David Schlegel Stephen Bailey Kyle Dawson John K. Parejko ---- Observing Summary ---- - Lightnings and precipitation in the county during first half. - Tests on guiding camera Nikon lens and filters. Done by mounting the engineering camera on the dolly installed on the concrete pier after sunset. - Manga Calibrations - EBOSS coverage calibration - Manga test on sky - BOSS observations: ct=12, pl=7877 ------------------ Notes: - b2 Amp 3 is indicated to experience high read noise (see SOS page) - b2 looks a lot worse than b1 in terms of SNR : upper half of b2 we cannot see the fiber traces, we can see only the sky lines. - None of the r2 images was reduced in SOS even though all 4 processes were running - Dewars are low ---- Observing Log ---- ============================================================================ AFTERNOON CHECKOUT ============================================================================ Took a bias and short dark to verify aliveness, but the BOSS Exp Status hung on 'Aborted' following the 20s dark integration: 22:09:58 APO.doravetz.sop 591 boss e text="Error while waiting for flush to complete on sp2cam. " 22:09:58 APO.doravetz.sop 591 boss f text="Flush failed, exposure aborted." 22:09:58 CmdDone: APO.doravetz.sop 591 boss exposure dark itime=20 22:09:58 .boss 51 boss w text="this command has already been finished!!!! (client.v4 51): exposure dark itime=20 " 22:09:58 .boss 51 boss w text="this command has already been finished!!!! (client.v4 51): exposure dark itime=20 " 22:09:58 .boss 51 boss f text="exposure aborted" 22:09:58 APO.doravetz 5 sop e text="BOSS failed on 20s dark exposure" 22:09:58 APO.doravetz 5 sop f text="Failed to take dark exposure" 22:09:58 CmdDone: APO.doravetz 5 sop doBossCalibs nBias=1 nDark=1 nFlat=0 nArc=0 darkTime=20.0 flatTime=30.0 guiderFlatTime=0.5 arcTime=4.0 22:16Z - Critical alert because the BOSS ICC has been dead for 600s. Restarted BOSS from stageManager. Soon after restarting BOSS we had another critical alert about BOSS ICC being dead. We noticed that sp2cam was not responding to pings. We restarted BOSS again, reloaded controllers, and then 'boss ping' responded with all controllers alive and talking. All actors alive and responsive with the exception of the sos actor. We continued to receive BOSS ICC critical alerts on a regular basis, but the alert would disappear on its own from the Alerts window in a matter of seconds. After restarting the alerts actor the critical alerts (which weren't actually true because all six controller ping-ed properly) stopped. Took two biases, a flat, and an arc with cart. 1, 8069. When we dismounted cart. 1 we noticed one of the IFUs had dropped below the focal plane. The gcamera plumbing was reconnected and the set point adjusted to -40C. Paul worked on focusing gcamera, but its initial focus after last night's focus sweeps was quite good. %... ATTEMPT TO DO THE BOSS COVERAGE (XMID, WAVEMID) Mounted cart. 13 planning to adjust the spatial and wavelength coverage on the cameras, but found that we had no SOS feedback. The SOS output files were not being created, nor was there a directory created in /data/boss/sos for today's MJD. We checked the status of SOS with 'sos_apocontrol status' as observer@sdss4-eboss and it showed no processes running. We tried to restart them, but unsurprisingly the restart attempt abruptly failed. We ping-ed Kyle and are awaiting his instructions. Several calibration frame were taken, even though not processed on SOS: 00:08:21 boss exposure 0.0, file=180717 Flat 00:09:47 boss exposure 20.0, file=180718 Dark 00:11:32 boss exposure 30.0, file=180719 Flat 00:15:57 boss exposure 4.0, file=180720 Arc ============================================================================ NIGHT ============================================================================ %---------------------------------------------------------- % TESTS ON FILTERS AND LENSES FOR GUIDING CAMERA %---------------------------------------------------------- %... Guiding camera focusing Paul refocused the guide camera front lens onto the guider flat block. The images are sharp with the spare lens that with the lens that was removed. The tangent arm focus mecanism for the front lens is at its end of travel just past focus. Not sure about interpretation: if temperature cools it goes the wrong way and it'll hit the limit. To be confirmed. %... Filters for APOGEE-SOUTH Testing image quality through different filters (G, I, Z) by taking sky images with the engineering camera installed on the dolly.In focus all images we have pixel limited FWHM (less than 2 pixels). Throughput was good. %... Testing the NIKON LENS that was removed from the guider camera The Nikon lens that was removed from the guider was used on the same engineering camera to check its quality. It produced beautiful images, which indicates that the adaptor ring and baionette fitting for the lens are responsible for the bad imaging that was observed when used on the guiding camera. In other words, the ring on the telescope is not circular and stresses the lens. %---------------------------------------------------------- % MANGA CALIBRATIONS %---------------------------------------------------------- 04:23:47 loadCart: ct=2, pl=7991, sd=A; %... Bias 04:24:23 boss exposure 0.0, file=180722 %... Hartmann 04:27:53 boss exposure 4.0, file=180723 04:29:21 boss exposure 4.0, file=180724 04:31:52 sp1.motor.move= 1877, 1879, 1878 04:32:08 sp2.motor.move= 1110, 1111, 1111 %... Flat, Arc 04:33:17 boss exposure 30.0, file=180725 % Flat 04:37:45 boss exposure 4.0, file=180726 % Arc ----------------------------------------------------------- John P modified the image numbering which was stuck John's e-mail to explain: I've set it to 182700 to make room if we want to move all the previous exposures to higher numbers so there's no overlap. Note that we'd want to change some header keywords as well, as the raw exposure number is encoded in the header, I believe. Here's some potentially useful stuff, recorded just before I did the change: [boss@sdss4-boss-icc spectro]$ ls 5689*/*r1* | wc 343 343 9947 [boss@sdss4-boss-icc spectro]$ stageManager boss stop Stopping boss. [boss@sdss4-boss-icc spectro]$ cat nextExposureNumber 180726 [boss@sdss4-boss-icc spectro]$ cat > nextExposureNumber 182700 I had the observers take a bias, and it came out as 182702, so I'm guessing "nextExposureNumber" really means "lastExposureNumber-1", which... IDKWTF? Anyway, conservative off-by-one errors aside, I think we're ok for now, and can decide what to do about the images from the last four days at some point in the future. ----------------------------------------------------------- %... Bias Flat Arc 05:18:20 boss exposure 0.0, file=182702 % Bias 05:28:31 boss exposure 30.0, file=182703 % Flat 05:32:58 boss exposure 4.0, file=182704 % Arc %---------------------------------------------------------- % BOSS CALIBRATIONS %---------------------------------------------------------- 05:57:52 loadCart: ct=13, pl=7572, sd=A; 06:04:52 sp2.motor.move= 0, -1, 0 %... Flat, Arc 06:05:00 boss exposure 30.0, file=182705 % Flat 06:09:26 boss exposure 4.0, file=182706 % Arc %.......................................................... % ADJUSTMENT OF SPATIAL & SPECTRAL COVERAGE (XMID, WAVEMID) %.......................................................... %... First shift on sp1 06:19:34 sp1.motor.move= 62, 58, -63 06:19:53 sp1.motor.move= 64, 66, -63 %... shift of sp1 and sp2 06:20:25 boss exposure 30.0, file=182707 06:34:25 sp2.motor.move= -378, -377, 378 06:36:27 sp1.motor.move= 159, 159, -158 06:37:03 boss exposure 30.0, file=182708 06:59:48 boss exposure 4.0, file=182709 %... shift of sp1 and sp2 07:08:43 sp1.motor.move= 92, -92, 0 07:09:32 sp2.motor.move= 372, -378, 0 07:13:28 boss exposure 4.0, file=182710 %... Result Using cart 13 we got: XMID Actual Desired Diff b1 2036 2039 -3 pix r1 2040 2038 +2 pix b2 2043 2044 -1 pix r2 2041 2040 +1 pix WAVEMID Actual Desired Diff b1 4915.6 4913 +2.6 A r1 8002.1 8006 -3.9 A b2 4992.4 4992 +0.4 A r2 8053.7 8052 +1.7 A %.......................................................... % HARTMANN %.......................................................... 07:20:01 boss exposure 4.0, file=182711 07:21:30 boss exposure 4.0, file=182712 07:26:46 sp1.motor.move= -2647, -2647, -2646 07:27:00 sp2.motor.move= -2859, -2863, -2860 07:27:32 boss exposure 4.0, file=182713 07:29:01 boss exposure 4.0, file=182714 %... Flat, arc 07:32:44 boss exposure 30.0, file=182715 07:37:12 boss exposure 4.0, file=182716 %---------------------------------------------------------- % MANGA OBSERVATIONS %---------------------------------------------------------- Weather look fairly stable even though humidity id rather high 07:47:05 encl25m : open; 07:48:20 loadCart: ct=1, pl=8069, sd=A; %... Long Hartmann 07:49:15 sp2.motor.move= 0, -2, 0 07:49:23 boss exposure 4.0, file=182717 07:50:52 boss exposure 4.0, file=182718 %... Arc and Flat 07:57:32 boss exposure 4.0, file=182719 07:59:05 boss exposure 30.0, file=182720 %... Go to field Went OK for slewing but when the guider attempted to apply modifications but tcc refused.e.g.: 08:08:15 client.v4.guider 453 hub f NoPermission="you do not have permission to command tcc" We asked tcc to not block: log 1> perms hackOn Seeing is good ~ 1.1 arcsec %... Tonight are sky spectra only 08:13:13 boss exposure 900.0, file=182721 08:30:13 boss exposure 900.0, file=182722 %---------------------------------------------------------- % BOSS OBSERVATIONS %---------------------------------------------------------- 09:02:14 loadCart: ct=12, pl=7877, sd=A; GSOGTF - high altitude clouds - seeing ~1.5 arcsec - humidity rising up %... Arc and flat 09:06:21 boss exposure 4.0, file=182723 09:07:55 boss exposure 30.0, file=182724 %... Data 09:12:43 boss exposure 900.0, file=182725 09:29:09 boss exposure 900.0, file=182726 09:45:37 boss exposure 900.0, file=182727 10:02:02 boss exposure 900.0, file=182728 10:18:27 boss exposure 900.0, file=182729 10:34:53 boss exposure 900.0, file=182730 10:51:21 boss exposure 900.0, file=182731 b2 looks a lot worse than b1 in terms of SNR : upper half of b2 we cannot see the fiber traces, we can see only the sky lines. Forcus do not look bad though. None of the r2 images was reduced in SOS even though all 4 processes were running ======================= Cart 12 is left in the telescope 11:15:04 encl25m : closed; ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Inst Az Alt Rot objArcOff guideRot calibOff -------------------------------------------------------------------------------- 08:12 1-8069A -33.3 67.8 151.6 ( 3.7, 10.0) (179.6) ( 0.0, 0.0, 0.0) boss 08:29 1-8069A -42.2 65.6 144.5 ( 5.0, 9.4) (173.7) ( 0.0, 0.0, 0.0) boss 09:12 12-7877A 25.3 52.5 201.1 ( 3.9, 17.3) (189.6) ( 0.0, 0.0, 0.0) boss 09:28 12-7877A 18.7 53.8 195.7 ( 5.5, 17.8) (187.9) ( 0.0, 0.0, 0.0) boss 09:45 12-7877A 11.9 54.8 190.0 ( 6.5, 17.6) (188.9) ( 0.0, 0.0, 0.0) boss 10:01 12-7877A 4.7 55.3 184.0 ( 7.5, 17.6) (187.1) ( 0.0, 0.0, 0.0) boss 10:17 12-7877A -2.5 55.3 178.0 ( 8.8, 17.6) (186.3) ( 0.0, 0.0, 0.0) boss 10:34 12-7877A -9.7 55.0 171.9 ( 10.0, 16.6) (186.2) ( 0.0, 0.0, 0.0) boss 10:50 12-7877A -16.6 54.2 166.1 ( 11.3, 15.7) (183.8) ( 0.0, 0.0, 0.0) boss ---- Focus Log ---- --- Focus --- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 08:12 1-8069A 1.000350 -3456 -1420 305 -33.3 67.8 12.4 4 187 1.3 boss 08:29 1-8069A 1.000355 -3500 -1457 301 -42.2 65.6 12.7 7 201 1.2 boss 09:12 12-7877A 1.000416 -4106 -1899 327 25.3 52.5 12.9 5 194 1.6 boss 09:28 12-7877A 1.000397 -3905 -1758 313 18.7 53.8 12.7 6 192 1.5 boss 09:45 12-7877A 1.000378 -3733 -1619 304 11.9 54.8 13.2 6 189 1.5 boss 10:01 12-7877A 1.000375 -3704 -1609 294 4.7 55.3 13.1 6 217 1.6 boss 10:17 12-7877A 1.000378 -3736 -1638 290 -2.5 55.3 13.4 7 227 1.6 boss 10:34 12-7877A 1.000379 -3749 -1648 283 -9.7 55.0 13.6 8 215 1.8 boss 10:50 12-7877A 1.000378 -3733 -1644 278 -16.6 54.2 13.6 7 232 1.5 boss ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 08:12 1-8069A 12.4 9.4 3.0 81 4 187 2879 189.0 814 1.3 boss 08:29 1-8069A 12.7 9.4 3.3 80 7 201 2308 150.4 827 1.2 boss 09:12 12-7877A 12.9 10.3 2.6 84 5 194 2851 196.7 842 1.6 boss 09:28 12-7877A 12.7 10.1 2.6 84 6 192 2244 183.8 827 1.5 boss 09:45 12-7877A 13.2 10.2 3.0 81 6 189 2140 224.2 840 1.5 boss 10:01 12-7877A 13.1 10.1 3.0 81 6 217 2147 267.6 838 1.6 boss 10:17 12-7877A 13.4 10.1 3.3 80 7 227 2028 156.2 817 1.6 boss 10:34 12-7877A 13.6 9.9 3.7 78 8 215 1891 65.1 807 1.8 boss 10:50 12-7877A 13.6 9.7 3.9 77 7 232 1705 110.8 804 1.5 boss ---- Telescope Status ---- Status at:11:31Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 12 Counterweights at: 423 422 422 423 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 97 lbs, 20 psi SP2 71 lbs, 20 psi ---- Software Used ---- -- STUI software -- STUI : 1.4.1b4 alerts : trunk+svn149374 apo : trunk+svn153334 boss : trunk+svn157642 -boss.daq : 1.3.2 -boss.specMec : 3.0.4 gcamera : trunk+svn151798 guider : trunk+svn158013 hub : Tag: sdss3_v1_2_0 mcp : v6_6_18 -mcp.plc : 29 -mcp.azFiduci : v1_112 -mcp.altFiduc : v1_112 -mcp.rotFiduc : v1_112 platedb : branch_sdss4_platedb_removal+svn157983M sop : trunk+svn157845 sos : FAILED -sos.idlspec2 : FAILED tcc : 2.14.0 apogee : not availble apogeecal : not availble apogeeql : trunk+svn158024 -- Other software -- sdssProcedure : v3_06 APO-local : trunk ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.036 0.037 Axial B: -0.02 -0.042 Axial C: -0.019 -0.022 Trans D: 3.205 3.21 Lateral E: 10.7188 10.7188 Lateral F: 12.3063 12.3063 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 651.00 937.40 PrimOrient: 0.00 0.00 0.00 651.08 936.54 SECONDARY: ---------- Focus: 0.00 Air temp: 18.6 Altitude: 30.1 MIGS TONIGHT NOMINAL Axial A: -7.059 -7.063 Axial B: -7.12 -7.128 Axial C: -7.031 -7.034 Trans D: -0.178 -0.179 GALILS Commanded: 1581300 1578850 1590700 1400 -2000 Actual: 1581696 1579315 1590780 1400 -2000 SETMIR VALUES SecDesOrient: 1257.00 -3.80 0.00 0.00 9.58 SecOrient: 1257.25 -3.68 0.00 0.00 9.35