Subject: 2.5m obslog 20140927 (SJD 56928) From: asimmons@apo.nmsu.edu Date: Sun, 28 Sep 2014 10:51:10 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday September 27, 2014 (SJD 56928) ---- Observing Team ---- Dmitry Bizyaev Audrey Oravetz Karen Kinemuchi (visitor) ---- Observing Summary ---- We lost the first few hours and the entire second half of the night due to high humidity. We opened for 1.5 hours and collected two good eboss exposures with cart 17, plate 7577. Notes: ====== An arc hung at the 'pre-reading' stage during afternoon checkout. The guider failed to start within 'sop gotoField' with cart 17 (see problem section). Quick hartmanns failed during gotoField with cart 16 because the blue cameras were out of focus. End of the night BOSS biases hung at 'readout'. Apogeediskwarn apogeeql.qlDiskAlarm (Enum('Warning'), Int(655 GB)) ---- Observing Plan ---- Sat 27 SEP 2014 56928.0 0.12 02:02 11:48 19:25 05:13 ---- eBOSS until 05:56 ( 3.9 h), then MaNGA ( 5.9 h) ---- Observing Log ---- Checked hardware, software, telescope, guider, plates, actors checked, no problems found. Collimation with cart 11: ==> Collimate-56928-b1-00185769.log Collimate-56928-b2-00185769.log Collimate-56928-r1-00185769.log Collimate-56928-r2-00185769.log 85 ) ---------- Weather: humid25m = 79.5; airTemp25m = 12.3C, dpTemp25m = 8.8C; diff= 3.5C; wind25m = n/a, direction = n/a ---------- semOwner = TCC:0:0 stuiVer=(1.4.1b5 2014-08-29), pid = 6649 memory = 189 MB Taking test calibs in the evening: 00:06:42 APO.dmbiz 30 sop f text="Failed to prepare for arc" 00:06:42 CmdDone: APO.dmbiz 30 sop doBossCalibs nBias=0 nDark=0 nFlat=1 nArc=1 darkTime=900.0 flatTime=30.0 guiderFlatTime=0.5 arcTime=4.0 Te exposure for arc hanged at pre-reading. Reloaded controllers. Cleared exposure. Took calibs manually. Night: ------ We did not ventilate or open on time due to high humidity. 03:10Z - Started to ventilate. 03:32Z - Humidity got much better. We opened the enclosure, force filled the spectrographs, and mounted cart 17. We also swept off all of the rat and mouse droppings and nests that accumulated alongside the enclosure tracks. Found a dead mouse.. Yuck! 03:46Z - gotoField cart 17, plate 7577. Used quick hartmanns. 03:49Z - Hartmanns 185775-76. 03:50:47 sp1.motor.move= -242, -244, -242 03:50:53 sp2.motor.move= -1989, -1993, -1987 03:51Z - Cals 185777-78. Guider failed to start within the gotoField command. See excerpt in problem section. We manually started the guider. GSFOGTF. 03:59Z - 15 min exposure. Seeing 1.5". Mostly clear. Humidity started to climb back up... Difference at 2.3 but we are ok with 'touch test'. 04:15Z - 15 min exposure. We decided to switch cartridges because we do not have the chance to finish this plate tonight. We have a better chance at finishing the next one. MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56928 2.17 4.76 2.69 6.48 900.1 16.10 7577-56918-01 56928 1.52 3.64 2.03 5.36 900.1 12.55 7577-56918-01 --------------------------------------------------------------- s/n2= 3.69 8.40 4.72 11.84 1800.2 --> 28.65 [above 0.50] 04:35Z - Mounted cart 16, plate 7590. 04:38Z - Hartmanns 185781-82. gotoField failed because the quick hartmanns predicted a large move of the b1 camera ring. We decided to take the full hartmanns after this failure. 04:41Z - The humidity has been steadily rising for the past 5 minutes. We decided to close the enclosure and stop ventilating (difference at 1.7C). Unfortunately, the humidity did not let up the rest of the night. We had to call it a night at 10:45Z. Better luck tomorrow night. Started BOSS and APOGEE cals. ---- eBOSS Data Summary ---- Reading FITS from /data/spectro/56928/ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n time filename cart plt flav hrt exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:50 b1-00185767 11 7826 bia Clo 0.0 23210 23079 22576 23:50 b2-00185767 11 7826 bia Clo 0.0 25278 24528 25702 23:50 r1-00185767 11 7826 bia Clo 0.0 23210 23079 22576 23:50 r2-00185767 11 7826 bia Clo 0.0 25278 24528 25702 2 23:51 b1-00185768 11 7826 dar Clo 20.0 23210 23079 22576 23:51 b2-00185768 11 7826 dar Clo 20.0 25278 24528 25702 23:51 r1-00185768 11 7826 dar Clo 20.0 23210 23079 22576 23:51 r2-00185768 11 7826 dar Clo 20.0 25278 24528 25702 3 23:55 b1-00185769 11 7826 arc Lef 4.1 23210 23079 22576 HART 23:55 b2-00185769 11 7826 arc Lef 4.2 25278 24528 25702 HART 23:55 r1-00185769 11 7826 arc Lef 4.1 23210 23079 22576 HART 23:55 r2-00185769 11 7826 arc Lef 4.2 25278 24528 25702 HART 4 23:57 b1-00185770 11 7826 arc Rig 4.1 23210 23079 22576 HART 23:57 b2-00185770 11 7826 arc Rig 4.2 25278 24528 25702 HART 23:57 r1-00185770 11 7826 arc Rig 4.1 23210 23079 22576 HART 23:57 r2-00185770 11 7826 arc Rig 4.2 25278 24528 25702 HART 5 00:08 b1-00185772 11 7826 bia Clo 0.0 23210 23079 22576 00:08 b2-00185772 11 7826 bia Clo 0.0 25278 24528 25702 00:08 r1-00185772 11 7826 bia Clo 0.0 23210 23079 22576 00:08 r2-00185772 11 7826 bia Clo 0.0 25278 24528 25702 6 00:10 b1-00185773 11 7826 arc Out 4.1 23210 23079 22576 00:10 b2-00185773 11 7826 arc Out 4.2 25278 24528 25702 00:10 r1-00185773 11 7826 arc Out 4.1 23210 23079 22576 00:10 r2-00185773 11 7826 arc Out 4.2 25278 24528 25702 7 00:12 b1-00185774 11 7826 fla Out 30.1 23210 23079 22576 00:12 b2-00185774 11 7826 fla Out 30.2 25278 24528 25702 00:12 r1-00185774 11 7826 fla Out 30.1 23210 23079 22576 00:12 r2-00185774 11 7826 fla Out 30.2 25278 24528 25702 8 03:49 b1-00185775 17 7577 arc Lef 4.1 23210 23079 22576 HART 03:49 b2-00185775 17 7577 arc Lef 4.2 25278 24528 25702 HART 03:49 r1-00185775 17 7577 arc Lef 4.1 23210 23079 22576 HART 03:49 r2-00185775 17 7577 arc Lef 4.2 25278 24528 25702 HART 9 03:49 b1-00185776 17 7577 arc Rig 4.1 23210 23079 22576 HART 03:49 b2-00185776 17 7577 arc Rig 4.1 25278 24528 25702 HART 03:49 r1-00185776 17 7577 arc Rig 4.1 23210 23079 22576 HART 03:49 r2-00185776 17 7577 arc Rig 4.1 25278 24528 25702 HART 10 03:51 b1-00185777 17 7577 arc Out 4.1 22968 22835 22334 03:51 b2-00185777 17 7577 arc Out 4.2 23289 22535 23715 03:51 r1-00185777 17 7577 arc Out 4.1 22968 22835 22334 03:51 r2-00185777 17 7577 arc Out 4.2 23289 22535 23715 11 03:52 b1-00185778 17 7577 fla Out 30.1 22968 22835 22334 03:52 b2-00185778 17 7577 fla Out 30.1 23289 22535 23715 03:52 r1-00185778 17 7577 fla Out 30.1 22968 22835 22334 03:52 r2-00185778 17 7577 fla Out 30.1 23289 22535 23715 12 03:59 b1-00185779 17 7577 sci Out 900.1 22968 22835 22334 03:59 b2-00185779 17 7577 sci Out 900.2 23289 22535 23715 03:59 r1-00185779 17 7577 sci Out 900.1 22968 22835 22334 03:59 r2-00185779 17 7577 sci Out 900.2 23289 22535 23715 13 04:15 b1-00185780 17 7577 sci Out 900.1 22968 22835 22334 04:15 b2-00185780 17 7577 sci Out 900.2 23289 22535 23715 04:15 r1-00185780 17 7577 sci Out 900.1 22968 22835 22334 04:15 r2-00185780 17 7577 sci Out 900.2 23289 22535 23715 14 04:38 b1-00185781 16 7590 arc Lef 4.1 22968 22835 22334 HART 04:38 b2-00185781 16 7590 arc Lef 4.2 23289 22534 23715 HART 04:38 r1-00185781 16 7590 arc Lef 4.1 22968 22835 22334 HART 04:38 r2-00185781 16 7590 arc Lef 4.2 23289 22534 23715 HART 15 04:39 b1-00185782 16 7590 arc Rig 4.1 22968 22835 22334 HART 04:39 b2-00185782 16 7590 arc Rig 4.2 23289 22534 23715 HART 04:39 r1-00185782 16 7590 arc Rig 4.1 22968 22835 22334 HART 04:39 r2-00185782 16 7590 arc Rig 4.2 23289 22534 23715 HART 16 04:41 b1-00185783 16 7590 arc Lef 4.1 22968 22835 22334 HART 04:41 b2-00185783 16 7590 arc Lef 4.2 23289 22534 23715 HART 04:41 r1-00185783 16 7590 arc Lef 4.1 22968 22835 22334 HART 04:41 r2-00185783 16 7590 arc Lef 4.2 23289 22534 23715 HART 17 04:42 b1-00185784 16 7590 arc Rig 4.1 22968 22835 22334 HART 04:42 b2-00185784 16 7590 arc Rig 4.2 23289 22534 23715 HART 04:42 r1-00185784 16 7590 arc Rig 4.1 22968 22835 22334 HART 04:42 r2-00185784 16 7590 arc Rig 4.2 23289 22534 23715 HART - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- OK --- ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Inst Az Alt Rot objArcOff guideRot calibOff -------------------------------------------------------------------------------- 03:58 17-7577A 49.8 69.8 222.7 ( 10.2, 4.3) (162.5) ( -3.6, 14.4, 0.0) boss 04:14 17-7577A 40.5 72.2 215.2 ( 10.6, 3.0) (167.2) ( -3.6, 14.4, 0.0) boss ---- Focus Log ---- --- Focus --- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 03:58 17-7577A 1.000232 -2290 -178 586 49.8 69.8 8.6 19 125 1.7 boss 04:14 17-7577A 1.000250 -2471 -300 619 40.5 72.2 8.5 17 125 1.8 boss ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 03:58 17-7577A 8.6 5.4 3.2 80 19 125 194 24.6 797 1.7 boss 04:14 17-7577A 8.5 5.9 2.6 84 17 125 216 13.0 797 1.8 boss ---- Telescope Status ---- Status at: 10:45Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 16 Counterweights at: 425 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 173 lbs, 21 psi SP2 182* lbs, 21 psi ---- Software Used ---- Setting up: idlspec2d Flavor: Linux64 Version: trunk ... optional setup bbspec requested by idlspec2d trunk failed Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_21 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_2_2 Setting up: | sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: | psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: | idl Flavor: Linux64 Version: 7.1 Setting up: | dust Flavor: Linux64 Version: v0_1 ... optional setup first requested by idlutils v5_5_16 failed Setting up: | photolog Flavor: Linux64 Version: trunk ... optional setup rc3 requested by idlutils v5_5_16 failed ... optional setup rass requested by idlutils v5_5_16 failed ... optional setup gsc requested by idlutils v5_5_16 failed ... optional setup twomass requested by idlutils v5_5_16 failed ... optional setup twomass_xsc requested by idlutils v5_5_16 failed ... optional setup tycho2 requested by idlutils v5_5_16 failed ... optional setup ucac requested by idlutils v5_5_16 failed ... optional setup usno requested by idlutils v5_5_16 failed ... optional setup ucac3 requested by idlutils v5_5_16 failed ... optional setup ucacr14 requested by idlutils v5_5_16 failed ... optional setup wise requested by idlutils v5_5_16 failed Setting up: actorcore Flavor: Linux64 Version: v2_3 Setting up: |opscore Flavor: Linux64 Version: v2_1 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: trunk Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.5.1 Setting up: |tron Flavor: Linux64 Version: sdss4_v2_0 STUI : 1.4.1b5 alerts : trunk+svn149374 apo : trunk+svn158476 boss : v3_4 -boss.daq : 1.3.2 -boss.specMec : 3.0.4 gcamera : v2_0 guider : v2_4 hub : Tag: sdss3_v1_2_0 mcp : v6_6_18 -mcp.plc : 29 -mcp.azFiduci : v1_112 -mcp.altFiduc : v1_112 -mcp.rotFiduc : v1_112 platedb : v2_3 sop : v2_7 sos : FAILED -sos.idlspec2 : FAILED tcc : 2.14.0 apogee : not availble apogeecal : not availble apogeeql : trunk+svn158315M -- Other software sdssProcedure : v3_06 APO-local : trunk ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.034 0.037 Axial B: -0.023 -0.042 Axial C: -0.021 -0.022 Trans D: 3.208 3.21 Lateral E: 10.7061 10.7188 Lateral F: 12.3063 12.3063 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 651.00 937.40 PrimOrient: 0.00 0.00 0.00 651.08 936.54 SECONDARY: ---------- Focus: 0.00 Air temp: 11.8 Altitude: 30.1 MIGS TONIGHT NOMINAL Axial A: -7.063 -7.063 Axial B: -7.123 -7.128 Axial C: -7.031 -7.034 Trans D: -0.18 -0.179 GALILS Commanded: 1581700 1578050 1590300 1400 -2000 Actual: 1581690 1578049 1590313 1400 -2000 SETMIR VALUES SecDesOrient: 1257.00 -3.80 0.00 0.00 9.58 SecOrient: 1257.01 -3.76 -0.07 -0.05 9.41 ---- Problems in Detail ---- After gotoField on cart 17: 03:53:29 APO.dmbiz.sop 324 mcp f command="ffs_move" 03:53:29 CmdDone: APO.dmbiz.sop 324 mcp ffs.open 03:53:29 APO.dmbiz 52 sop w text="Failed to open flat field screen" 03:53:43 APO.dmbiz 52 sop e text="Failed to turn guider decentering off." 03:53:43 APO.dmbiz 52 sop e text="Failed to start the guider" 03:53:58 .boss 6765 boss w SP2R1VSc2Read=-3.945; SP2B2VSc1Read=5.938 03:53:58 .boss 6765 boss w camCheck=SP2R1VSc2Read,SP2B2VSc1Read 03:53:58 .alerts 0 alerts w alert=boss.SP2R1VSc2Read,warn,"Reported by camCheck",enabled,noack,"" 03:53:58 .alerts 0 alerts w alert=boss.SP2B2VSc1Read,warn,"Reported by camCheck",enabled,noack,"" 03:54:15 APO.dmbiz 52 sop f text=";failed to cleanup gotofield/start guiding" 03:54:15 CmdDone: APO.dmbiz 52 sop gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderTime=5.0 BOSS hung on readout: 10:44:42 APO.telescope 268 sop f text="Failed to take bias exposure" 10:44:42 CmdDone: APO.telescope 268 sop doBossCalibs nBias=20 nDark=1 nFlat=0 nArc=0 darkTime=900.0 flatTime=30.0 guiderFlatTime=0.5 arcTime=4.0 10:46:28 .sop 78 sop w text="this command has already been finished!!!! (APO.telescope 78): doBossCalibs nBias=20 nDark=1 nFlat=0 nArc=0 darkTime=900.0 flatTime=30.0 guiderFlatTime=0.5 arcTime=4.0" 10:46:28 .sop 78 sop e text="BOSS failed on exposure readout"