Subject: 2.5m obslog 20140929 (SJD 56930) From: kpan@apo.nmsu.edu Date: Tue, 30 Sep 2014 11:07:31 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday September 29, 2014 (SJD 56930) ---- Observing Team ---- Karen Kinemuchi Kaike Pan ---- Observing Summary ---- The night was lost to high humidity, rain. Never open. Notes for engineers and developers: 1. we compared results from the old hartmann script and hartmann collimate command, looks like that best focuses determined by the two codes are similar on r1 (differ by only 200 steps), and very different on B1 (5 degrees), R2 (1500 steps), and B2 (4 degrees). 2. boss failed on both prereading and flushing during afternoon checkout. ---- Observing Plan ---- Mon 29 SEP 2014 56930.0 0.28 01:59 11:49 19:30 05:23 ---- eBOSS until 07:53 ( 5.9 h), then MaNGA ( 3.9 h) ---- Observing Log ---- AFTERNOON CHECKOUT: =================== 22:20Z Grabbed mirror numbers -ok; actors tested -ok; platedb checked -ok; APOGEE evening cals started; gcamera/guider prep -ok; 23:18Z Cart bay checked - ready; Cart 11 installed for collimation. APOGEE evening cals done. 23:26Z eBOSS bias and short dark taken - ok; Collimation begins (on Cart 11): Also trying the "hartmann collimate" command. BOSS hung on the pre-reading of one of the hartmanns. We issued a boss clearExposure and checked with boss ping, and we restarted the hartmann collimate sequence. To run this command, the HgCd and Ne lamps must be turned on. Rerun "hartmann collimate", it failed with error: 23:41:02 APO.kpan 7 hartmann e text="!!!! Unknown error when processing Hartmanns! !!!!" 23:41:02 APO.kpan 7 hartmann e text="r1 reported ValueError: File not found: '/data/spectro/56930/sdR-r1-00185856.fit.gz'" 23:41:02 APO.kpan 7 hartmann e text="!!!! Unknown error when processing Hartmanns! !!!!" 23:41:02 APO.kpan 7 hartmann e text="r2 reported ValueError: File not found: '/data/spectro/56930/sdR-r2-00185856.fit.gz'" 23:41:02 APO.kpan 7 hartmann e text="!!!! Unknown error when processing Hartmanns! !!!!" 23:41:02 APO.kpan 7 hartmann e text="b1 reported ValueError: File not found: '/data/spectro/56930/sdR-b1-00185856.fit.gz'" 23:41:02 APO.kpan 7 hartmann e text="!!!! Unknown error when processing Hartmanns! !!!!" 23:41:02 APO.kpan 7 hartmann e text="b2 reported ValueError: File not found: '/data/spectro/56930/sdR-b2-00185856.fit.gz'" 23:41:02 APO.kpan 7 hartmann e text="Collimation calculation failed! Collimation calculation failed for b2,r1,r2,b1." 23:41:02 APO.kpan 7 hartmann i status=idle 23:41:02 APO.kpan 7 hartmann f text="collimation process failed" 23:41:02 CmdDone: APO.kpan 7 hartmann collimate noCorrect noSubframe Checked the data, files are there, then we run "hartmann recompute id=185855 id2=185856, nocorrect", it did output results as: 23:44:32 APO.kpan 10 hartmann w r1MeanOffset=-0.30,"Out of focus" 23:44:32 APO.kpan 10 hartmann i r1PistonMove=-1979 23:44:32 APO.kpan 10 hartmann w r2MeanOffset=-0.25,"Out of focus" 23:44:32 APO.kpan 10 hartmann i r2PistonMove=-1577 23:44:32 APO.kpan 10 hartmann w b1MeanOffset=-0.38,"Out of focus" 23:44:32 APO.kpan 10 hartmann i b1RingMove=7.7 23:44:32 APO.kpan 10 hartmann w b2MeanOffset=-0.43,"Out of focus" 23:44:32 APO.kpan 10 hartmann i b2RingMove=8.5 To compare results from Collimate script and hartmann collimate, we ran Collimate script and hartmann recompute on hartmann exposure 185850 and 851. Results are very different: From hartmann recompute: 23:45:18 CmdStarted: APO.kpan 11 hartmann recompute id=185850 id2=185851 noCorrect 23:45:18 APO.kpan 11 hartmann i status=processing 23:45:32 APO.kpan 11 hartmann w r1MeanOffset=-0.30,"Out of focus" 23:45:32 APO.kpan 11 hartmann i r1PistonMove=-1979 23:45:32 APO.kpan 11 hartmann w r2MeanOffset=-0.25,"Out of focus" 23:45:32 APO.kpan 11 hartmann i r2PistonMove=-1577 23:45:32 APO.kpan 11 hartmann w b1MeanOffset=-0.38,"Out of focus" 23:45:32 APO.kpan 11 hartmann i b1RingMove=7.7 23:45:32 APO.kpan 11 hartmann w b2MeanOffset=-0.43,"Out of focus" 23:45:32 APO.kpan 11 hartmann i b2RingMove=8.5 From hartmann script: Predict blue camera ring movement of 2.5 degrees for spectro-1 Predict blue camera ring movement of 4.3 degrees for spectro-2 Predict (red) piston movement of -2134 steps for spectro-1 Predict (red) piston movement of -683 steps for spectro-2 rerun hartmann collimate and got: 00:00:31 CmdStarted: APO.karen 89 hartmann recompute id=185857 noCorrect 00:00:32 APO.karen 89 hartmann i status=processing 00:00:46 APO.karen 89 hartmann i r1MeanOffset=0.00,"In Focus" 00:00:46 APO.karen 89 hartmann i r1PistonMove=0 00:00:46 APO.karen 89 hartmann i r2MeanOffset=-0.05,"In Focus" 00:00:46 APO.karen 89 hartmann i r2PistonMove=-315 00:00:46 APO.karen 89 hartmann i b1MeanOffset=-0.08,"In Focus" 00:00:46 APO.karen 89 hartmann i b1RingMove=1.6 00:00:46 APO.karen 89 hartmann w b2MeanOffset=-0.23,"Out of focus" 00:00:46 APO.karen 89 hartmann i b2RingMove=4.5 We decided to setup blue rings with results from hartmann collimate. So B1 focus ring was moved by +6 degrees. After moving the ring, we start hartmann collimate noSubframe noCorrect. The command failed on flushing. 00:09:22 APO.karen.hartmann 23 boss w text="value for motor status was bad: ['132', '132', 'NaN']" 00:10:34 APO.karen 90 hartmann e text="Failed to take left hartmann exposure"; UNPARSEDTEXT="\"" 00:10:34 APO.karen 90 hartmann f text="collimation process failed" 00:10:34 CmdDone: APO.karen 90 hartmann collimate noSubFrame noCorrect 00:15:38 APO.kpan 20 hartmann i r1MeanOffset=0.00,"In Focus" 00:15:38 APO.kpan 20 hartmann i r1PistonMove=0 00:15:38 APO.kpan 20 hartmann i r2MeanOffset=-0.05,"In Focus" 00:15:38 APO.kpan 20 hartmann i r2PistonMove=-315 00:15:38 APO.kpan 20 hartmann w b1MeanOffset=0.37,"Out of focus" 00:15:38 APO.kpan 20 hartmann i b1RingMove=-7.5 00:15:38 APO.kpan 20 hartmann w b2MeanOffset=-0.23,"Out of focus" 00:15:38 APO.kpan 20 hartmann i b2RingMove=4.5 00:15:38 APO.kpan 20 hartmann i sp1Residuals=-1189,-3.7,"OK" 00:15:38 APO.kpan 20 hartmann i sp1AverageMove=1189 00:15:38 APO.kpan 20 hartmann i sp2Residuals=567,1.8,"OK" 00:15:38 APO.kpan 20 hartmann i sp2AverageMove=-882 00:35Z stopped ventilation due to nearby radar returns and lightning. Night: ===== 02:50Z started ventilation. B1 focus rings was moved by -4 degrees. 02:56:33 APO.kpan 34 hartmann i r1MeanOffset=0.05,"In Focus" 02:56:33 APO.kpan 34 hartmann i r1PistonMove=329 02:56:33 APO.kpan 34 hartmann i r2MeanOffset=-0.00,"In Focus" 02:56:33 APO.kpan 34 hartmann i r2PistonMove=0 02:56:33 APO.kpan 34 hartmann w b1MeanOffset=0.22,"Out of focus" 02:56:33 APO.kpan 34 hartmann i b1RingMove=-4.4 02:56:33 APO.kpan 34 hartmann i b2MeanOffset=-0.18,"In Focus" 02:56:33 APO.kpan 34 hartmann i b2RingMove=3.6 02:56:33 APO.kpan 34 hartmann i sp1Residuals=-542,-1.7,"OK" 02:56:33 APO.kpan 34 hartmann i sp1AverageMove=871 02:56:33 APO.kpan 34 hartmann i sp2Residuals=567,1.8,"OK" 02:56:33 APO.kpan 34 hartmann i sp2AverageMove=-567 Elena wants to test new log-Function script, we started "hartmann collimate", it failed with error: 06:17:39 APO.kpan.hartmann 39 boss w text="value for motor positions was bad: ['NaN', '22382', '21885']" 06:19:08 APO.kpan 52 hartmann e text="Failed to take right hartmann exposure"; UNPARSEDTEXT="\"" 06:19:08 APO.kpan 52 hartmann f text="collimation process failed" We pong boss and had 6 OKs, and boss status shows it was in idle, so issued "hartmann collimate" again and got: 06:19:08 CmdDone: APO.kpan 52 hartmann collimate 06:21:55 .hub 0 cmds d CmdQueued=72619,1412058115.74,"APO.kpan",54,"hartmann",44,"collimate" 06:21:55 .hub 0 cmds d CmdQueued=72620,1412058115.80,"APO.kpan.hartmann",40,"boss",319,"exposure arc hartmann=left itime=4 window=850,1400 " 06:21:55 APO.kpan.hartmann 40 boss f text="exposure already in progress! Do a 'boss clearExposure' if you want to kill and or clear it." 06:21:55 CmdDone: APO.kpan.hartmann 40 boss exposure arc hartmann=left itime=4 window=850,1400 06:21:55 APO.kpan 54 hartmann e text="Failed to take left hartmann exposure"; UNPARSEDTEXT="\"" 06:21:55 APO.kpan 54 hartmann f text="collimation process failed" It's strange that it seems boss is ready to take next exposure, but we had to issue boss clearExposure before could take any data. 11:10Z called it the night. ---- Telescope Status ---- Never open. No interlocks bypassed Status at: 11:10Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 11 Counterweights at: LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 ??? lbs, 18 psi SP2 182 lbs, 19 psi ---- Software Used ---- et Versions, 09/29/14, 22:19:05 -- STUI software: STUI : 1.4.1b5 alerts : trunk+svn149374 apo : trunk+svn158476 boss : v3_4 -boss.daq : 1.3.2 -boss.specMec : 3.0.4 gcamera : v2_0 guider : v2_4 hub : Tag: sdss3_v1_2_0 mcp : v6_6_18 -mcp.plc : 29 -mcp.azFiduci : v1_112 -mcp.altFiduc : v1_112 -mcp.rotFiduc : v1_112 platedb : v2_3 sop : v2_7 sos : FAILED -sos.idlspec2 : FAILED tcc : 2.14.0 apogee : not availble apogeecal : not availble apogeeql : trunk+svn158315M -- Other software sdssProcedure : v3_06 APO-local : trunk -- done -- Setting up: idlspec2d Flavor: Linux64 Version: trunk ... optional setup bbspec requested by idlspec2d trunk failed Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_21 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_2_2 Setting up: | sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: | psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: | idl Flavor: Linux64 Version: 7.1 Setting up: | dust Flavor: Linux64 Version: v0_1 ... optional setup first requested by idlutils v5_5_16 failed Setting up: | photolog Flavor: Linux64 Version: trunk ... optional setup rc3 requested by idlutils v5_5_16 failed ... optional setup rass requested by idlutils v5_5_16 failed ... optional setup gsc requested by idlutils v5_5_16 failed ... optional setup twomass requested by idlutils v5_5_16 failed ... optional setup twomass_xsc requested by idlutils v5_5_16 failed ... optional setup tycho2 requested by idlutils v5_5_16 failed ... optional setup ucac requested by idlutils v5_5_16 failed ... optional setup usno requested by idlutils v5_5_16 failed ... optional setup ucac3 requested by idlutils v5_5_16 failed ... optional setup ucacr14 requested by idlutils v5_5_16 failed ... optional setup wise requested by idlutils v5_5_16 failed Setting up: actorcore Flavor: Linux64 Version: v2_3 Setting up: |opscore Flavor: Linux64 Version: v2_1 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: trunk Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.5.1 Setting up: |tron Flavor: Linux64 Version: sdss4_v2_0 -- Other versions ---- idlspec2d (sos3) --- trunk 158099:158455M plate-mapper3 ------ NOCVS:v5_1_7 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.032 0.037 Axial B: -0.024 -0.042 Axial C: -0.022 -0.022 Trans D: 3.21 3.21 Lateral E: 10.7061 10.7188 Lateral F: 12.3063 12.3063 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 651.00 937.40 PrimOrient: 0.00 0.00 0.00 651.08 936.54 SECONDARY: ---------- Focus: 0.00 Air temp: 16.1 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -7.062 -7.063 Axial B: -7.122 -7.128 Axial C: -7.031 -7.034 Trans D: -0.181 -0.179 GALILS Commanded: 1581300 1578850 1590700 1400 -2000 Actual: 1581312 1578843 1590704 1400 -2000 SETMIR VALUES SecDesOrient: 1257.00 -3.80 0.00 0.00 9.58 SecOrient: 1257.01 -3.80 0.00 0.00 9.43