Subject: 2.5m obslog 20140911 (MJD 56912) From: asimmons@apo.nmsu.edu Date: Fri, 12 Sep 2014 10:57:30 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday September 11, 2014 (MJD 56912) ---- Observing Team ---- Patrick Gaulme Audrey Oravetz ---- Jon Holtzman on the phone ---- Observing Plan ---- Thu 11 SEP 2014 56912.0 0.90 01:50 12:11 18:10 04:33 Day APOGEE-2 (10.3 h) ---- Observing Summary ---- The night was lost due to rain, clouds, and humidity. While we were closed, we completed the focus sweep test on cart 4, plate 7570. JohnP tagged the following software: sop v2_6 and guider v2_4 Problems: ========= - We encountered a few flush failures during the tests, which aborted some exposures. We sent a separate email to JohnP, JonB, and Fritz so that they can help diagnose the problem. - We restarted the apogeeql actor during afternoon checkout because it was not responding and restarted it again later on when APOGEE files were not bundling properly. Nathan and JonH were notified. ---- Observing Log ---- ============================================================================ AFTERNOON CHECKOUT ============================================================================ 23:57Z Started checkouts %... APOGEE - Short darks did not work. apogeeql was not answering. Instructions on the APOGEE-2 wiki to restart the actor were obsolete. We called Jon Hltzmann who indicated us how to do: ssh apogee@sdss4-apogee (we added the password on the password paper) then $ start-apogeeql - Evening cals %... Miscellaneous - Test slews (121,30, 121,90, 141,90, rota = 0, 30, 0) - Did 'platedb showActive' All BOSS/APOGEE carts are ready - Then, stui->script->srartUp->plugging - Tested the actors - Check calib lamps %... BOSS - 1 bias - 1 20-s dark %... Status motorPosition sp1: 26657, 26534, 26015; sp2: 28869, 28119, 29306; ---------- Median spectrographs temperatures: Tsp1= 14.3, Tsp2= 13.6; Outside air temperature= 11.0; ============================================================================ NIGHT ============================================================================ Light rain and thick clouds at sunset. We will delay opening/ventilating. ======================= 01:18:45 loadCart: ct=4, pl=7570, sd=A; MANGA CART 4 COMMISSION TEST: FOCUS SWEEP %... Hartmanns COLLIMATE: Predict blue camera ring movement of 3.2 degrees for spectro-1 COLLIMATE: Predict blue camera ring movement of 8.1 degrees for spectro-2 COLLIMATE: Predict (red) piston movement of -3031 steps for spectro-1 COLLIMATE: Predict (red) piston movement of -2134 steps for spectro-2 red cameras adjusted COLLIMATE: Predict blue camera ring movement of -5.5 degrees for spectro-1 COLLIMATE: Predict blue camera ring movement of 2.7 degrees for spectro-2 COLLIMATE: Predict (red) piston movement of -42 steps for spectro-1 COLLIMATE: Predict (red) piston movement of -256 steps for spectro-2 We moved the rings COLLIMATE: Predict blue camera ring movement of -7.0 degrees for spectro-1 COLLIMATE: Predict blue camera ring movement of -0.2 degrees for spectro-2 COLLIMATE: Predict (red) piston movement of 42 steps for spectro-1 COLLIMATE: Predict (red) piston movement of -170 steps for spectro-2 Still not OK for b1. We moved the b1 ring again: COLLIMATE: Predict blue camera ring movement of -7.2 degrees for spectro-1 Not better. We move it again: COLLIMATE: Predict blue camera ring movement of -12.7 degrees for spectro-1 Interesting... Moving the ring produces real random outputs. We went back to move it again: COLLIMATE: Predict blue camera ring movement of -2.2 degrees for spectro-1 We consider the focus good enough given the previous attempts! %... Piston positions. sp1: 23622, 23499, 22987; sp2: 26736, 25985, 27172; %... The script ***** Started at 02:49Z. Exposure 184453. Flush failed after a right hartmann was started. We cleared the exposure and began to run the full hartmann set again. Please ignore exposure 184455. 02:55:59 APO.Patrick.sop 61 boss e text="Error while waiting for flush to complete on sp1cam. " 02:55:59 APO.Patrick.sop 61 boss f text="Flush failed, exposure aborted." Flush failed after a right hartmann was started. We cleared the exposure and began to run the full hartmann set again, from the exposure within the script that we left off. Please ignore exposure 184474. 03:31:24 APO.Patrick.sop 94 boss e text="Error while waiting for flush to complete on sp2cam. " 03:31:24 APO.Patrick.sop 94 boss e text="Error while waiting for flush to complete on sp1cam. " 03:31:24 APO.Patrick.sop 94 boss f text="Flush failed, exposure aborted." 03:31:24 CmdDone: APO.Patrick.sop 94 boss exposure arc itime=4 hartmann=right Focus sweep test complete with exposure 184523. Motor positions currently: motorPosition sp1: 23622, 23496, 22988 sp2: 26743, 25990, 27171 Clouds starting to part, but now the humidity difference is bad and unstable. We will still wait till the weather improves before opening. **** 06:05Z - Started the APOGEE Dither Cleaning Script. After the script finished, we noticed that the images were not recording values with the list_ap script on observer@sdss4-eboss: 56912 14 06:05 13500014 Arc---- 10 A 10.0 ------- x-x-x - - 56912 15 06:07 13500015 Arc---- 10 ? 11.0 ------- x-x-x - - 56912 16 06:09 13500016 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 17 06:11 13500017 Arc---- 10 ? 15.0 ------- x-x-x - - 56912 18 06:13 13500018 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 19 06:15 13500019 Arc---- 10 ? 9.0 ------- x-x-x - - 56912 20 06:17 13500020 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 21 06:19 13500021 Arc---- 10 ? 17.0 ------- x-x-x - - 56912 22 06:21 13500022 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 23 06:23 13500023 Arc---- 10 A 10.0 ------- x-x-x - - 56912 24 06:25 13500024 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 25 06:26 13500025 Arc---- 10 ? 15.0 ------- x-x-x - - 56912 26 06:28 13500026 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 27 06:30 13500027 Arc---- 10 ? 12.0 ------- x-x-x - - 56912 28 06:32 13500028 Arc---- 10 ? 13.0 ------- x-x-x - - 56912 29 06:34 13500029 Arc---- 10 ? 13.5 ------- x-x-x - - 56912 30 06:36 13500030 Arc---- 10 ? 13.0 ------- x-x-x - - Checked to see if the images were being bundled with apogeeql - they weren't. Issued 'start_apogeeql' at approx 06:50Z even though apogeeql actor was still alive (this was the same procedure we did during afternoon checkout). It looks as if files stopped bundling during the middle of the evening cals and we didn't notice it until now. So, the files are being written to /data-ql/data/56912 but are not showing up at /data/apogee/archive/56912. 07:05Z - Since the humidity is still too high to open, we will redo the evening calibration sequence and watch the bundling in real time... 56912 31 no file found: /data/apogee/utr_cdr/56912/apRaw-13500031.fits 56912 32 06:59 13500032 Dark 3 ? 13.0 4-7570 a-b-c - - 56912 33 07:04 13500033 Dark 60 ? 13.0 4-7570 a-b-c - - 56912 34 07:15 13500034 QuarFlat 10 ? 13.0 4-7570 a-b-c - 87 56912 35 07:17 13500035 Arc-Thar 12 ? 13.0 4-7570 a-b-c 0.03 - 56912 36 07:19 13500036 Arc-Une 40 ? 13.0 4-7570 a-b-c - - 56912 37 07:28 13500037 Arc---- 12 ? 13.5 ------- x-x-x - - 56912 38 07:35 13500038 Arc---- 40 ? 13.5 ------- x-x-x - - 56912 39 07:46 13500039 Dark 60 ? 13.0 ------- x-x-x - - It looks as if the bundling stopped at the same place during the evening cals as before. This is definitely a problem that needs the attention of JonH and APOGEE team. Since the weather is not great still, we will wait to notify them until the morning. 10:53Z - The humidity is not getting better, and now there are many thick clouds around and a large storm approaching from the south. We started APOGEE cals and BOSS cals. Attempted to run the autoscheduler on sdss3@sdss4-apogee like within SDSS3 in order to create the observing page for tomorrow, but it just hung. The command is not found within apogee@sdss4-apogee. The BOSS-ICC went dead as we were sending out the plugging email. We cleared the exposure, cleared the alert, and restarted the cals. ---- Telescope Status ---- No interlocks bypassed Status at: 10:29Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 4 Counterweights at: 425 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 127 lbs, 18 psi SP2 161 lbs, 21 psi ---- Software Used ---- Get Versions, 09/12/14, 06:45:25 -- STUI software: STUI : 1.4.1b5 alerts : trunk+svn149374 apo : trunk+svn153334 boss : v3_3 -boss.daq : 1.3.2 -boss.specMec : 3.0.4 gcamera : v2_0 guider : v2_4 hub : Tag: sdss3_v1_2_0 mcp : v6_6_18 -mcp.plc : 29 -mcp.azFiduci : v1_112 -mcp.altFiduc : v1_112 -mcp.rotFiduc : v1_112 platedb : v2_3 sop : v2_6 sos : FAILED -sos.idlspec2 : FAILED tcc : 2.14.0 apogee : not availble apogeecal : not availble apogeeql : trunk+svn158196M -- Other software sdssProcedure : v3_06 APO-local : trunk -- Other versions ---- idlspec2d (sos3) --- trunk 158099:158100M plate-mapper3 ------ ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.034 0.037 Axial B: -0.023 -0.042 Axial C: -0.02 -0.022 Trans D: 3.211 3.21 Lateral E: 10.7061 10.7188 Lateral F: 12.3063 12.3063 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 651.00 937.40 PrimOrient: 0.00 0.00 0.00 651.08 936.54 SECONDARY: ---------- Focus: 0.00 Air temp: 10.8 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -7.062 -7.063 Axial B: -7.122 -7.128 Axial C: -7.032 -7.034 Trans D: -0.179 -0.179 GALILS Commanded: 1581300 1578850 1590700 1400 -2000 Actual: 1581444 1578843 1590717 1400 -2000 SETMIR VALUES SecDesOrient: 1257.00 -3.80 0.00 0.00 9.58 SecOrient: 1257.04 -3.81 -0.05 -0.03 9.44