Subject: 2.5m obslog 20110516 (MJD 55698) From: doravetz@apo.nmsu.edu Date: Tue, 17 May 2011 11:00:31 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday May 16, 2011 (MJD 55698) ---- Observing Team ---- Audrey Simmons Dan Oravetz Steph Snedden (support) Craig Loomis (support) ---- Observing Plan ---- Pointing model, flexible engineering, and/or MARVELS/APOGEE ---- Observing Summary ---- We completed and installed an 82-point pointing model. MARVELS fields observed: Cart. 4, 4810A, APG SGR1 Cart. 9, 4918A, AGP NGP Cart. 5, 4819A, APG M13 Cart. 7, 4912A, APG 030-08 PROBLEMS -------- 'platedb showActive' fails because of an error associated with cartridge 8. The error message is in the Log body. We had a couple of instances of boss heartbeat alerts resulting from controllers being "DEAD." The first occurrence was fixed by logging out ports 3 and 4 (sp*mech controllers) from the terminal server and then reloading the controllers. The next occurrence, logging out ports did not solve the problem. We had a hung slew attempt during cart. 5. See Log. ---- Observing Log ---- Afternoon ========= The only problem we encountered during afternoon checkout was with the platedb when we tried to look at current cartridge/plate configurations with 'platedb showActive.' Here's the STUI output: 04:30:14 APO.doravetz 23 platedb f text="command failed: MultipleResultsFound('Multiple rows were found for one()',) at /home/sdss3/products/Linux64/sqlalchemy/0.5.5/lib/python/sqlalchemy/orm/query.py:1260" We see all cartridges/plates UP TO cartridge 8 (which is where it fails), but we're unable to see cartridge 9 and its associated plate because of the command failure occurring at cartridge 8. There was some mention of this problem in an email this afternoon following email traffic regarding the platedb, but we are still experiencing the problem. 23:52Z - Started the home/relax mirrors procedure in anticipation of a pointing model later on tonight. Reported position errors were all within acceptable tolerances: M1 -- A=0 B=-50 C=50 D=0 E=0 F=0 M2 -- A=-33 B=-20 C=12 D=-50 E=0 00:00Z - Started ventilation. Night ===== 02:00Z - Opened. Started DIMM. Forced a fill from 180L LN2 dewars. 02:16Z - MARVELS cals. 02:23Z - Checked telescope balance and performed test slew checking fiducials. MARVELS ------- Cart. 4, 4810A, APG SGR1 ************************ 02:25Z - After the gotoField when the guider was toggled on Audrey did not see guider images in the Guide window.Instead of guider images, there was just path text in the window where the images are supposed to appear including information about frame versions, Tcl, etc. in the path. Even though guider images were being taken, she wasn't seeing them. She was running STUI 1.1a5. I was also running STUI 1.1a5 and saw the same thing; path text instead of images. Steph was running 1.1a5 on her laptop and was able to see guider images normally. Audrey and I updated to running 1.1a6 and then we were able to see guider images as expected. While it seems that using 1.1a6 instead of 1.1a5 was the solution, it still remains to be understood why Steph did not experience the same problem we did while she was running 1.1a5 on her laptop. 02:54Z - Science. 50 min. 03:45Z - MARVELS cals. Cart. 9, 4918A, APG NGP *********************** 03:53Z - GSOGTF. 03:59Z - Science. 50 min. Please check these fibers as their corresponding spectra were relatively low S/N: Spectra: 019,020 -- Fiber: Yellow Blue Orange Spectra: 077,078 -- Fiber: Blue Blue Yellow Spectra: 111,112 -- Fiber: Blue Clear Magenta Spectra: 113,114 -- Fiber: Blue Clear Yellow 05:05Z - MARVELS cals. 05:10Z - Mounted engineering camera, adjusted counterweights, checked fiducial crossings during test slew. POINTING MODEL -------------- 05:25Z - Started pointing model procedure. 05:29Z - BOSS heartbeat critical alert. sp1mech and sp2mech controllers were "DEAD" and with Craig's help we logged out the offending ports (3 & 4) from the terminal server and then reloaded the controllers. 'boss ping' now showed all controllers "OK." tpoint results from the pointing model data: * getdat pterr_20110517.dat Read 82 data points * fix * use ie ia pzz1 an aw ca * fit coeff change value sigma 1 IE +5.422 +3.60 0.888 2 IA +1.392 -79.28 1.438 3 PZZ1 -1.588 -141.79 1.068 4 AN -0.595 +0.69 0.357 5 AW +1.372 -6.20 0.360 6 CA +0.456 +4.93 1.021 7 TX -0.80 8 HWCA2 +0.12 9 HWSA2 +1.12 10 HNCA1 +1.80 11 HNSA1 -0.83 12 ACEC -0.23 13 ACES +0.78 Sky RMS = 2.79 Popn SD = 2.90 * use * fit coeff change value sigma 1 IE +1.518 +5.12 1.197 2 IA +0.295 -78.99 1.373 3 PZZ1 +4.943 -136.85 3.115 4 AN +0.511 +1.20 0.447 5 AW -0.330 -6.53 0.422 6 CA -0.259 +4.67 1.018 7 TX -2.165 -2.96 1.338 8 HWCA2 -0.688 -0.57 0.554 9 HWSA2 -0.413 +0.70 0.594 10 HNCA1 -0.433 +1.37 0.677 11 HNSA1 +0.303 -0.52 0.657 12 ACEC -0.844 -1.07 0.753 13 ACES -1.995 -1.22 0.814 Sky RMS = 2.60 Popn SD = 2.83 We loaded this model and then took pointing model data with a 20-point grid to check the Sky RMS and it was an acceptable 1.6. We switched back to MARVELS for the remainder of the night. 08:21Z - MARVELS cals. 08:23Z - Disconnected/unmounted engineering camera, adjusted counterweights, set the instrument block back to spectro, mounted cart. 5. Cart. 5, 4819A, APG M13 *********************** 08:33Z - When we tried slewing to the field, the STUI slew button was pushed (grayed out), but it didn't slew. We tried to abort the gotoField and had this error: 08:36:29 APO.doravetz 31 sop w text="gotoField will abort when it finishes its current activities; be patient" The gotoField command appeared to be hung in some capacity because although SOP was reporting "Running" the telescope was not slewing. We tried to issue "Stop" and "X" from the SOP GUI to abort and back out, but it still wouldn't release the "gotoField" button. Eventually, Audrey opened up an old STUI (STUI_1.0 installed Mar. 15th) and she was able to slew without any problems. We don't know if this was serendipitous or if there actually was some sort of problem with STUI 1.1a6 that was stalling the slew. Unfortunately, I don't have additional details to provide because at the same time we were dealing with STUI/SOP not slewing the telescope we had BOSS heartbeat critical alerts again; some of the controllers were dead. Only this time, logging out ports 3 and 4 from the terminal server and trying to reload the controllers did NOT bring things back to normal. 08:51Z - Science. 50 min. 09:46Z - MARVELS cals. Cart. 7, 4912A, APG 030-08 ************************** 09:51Z - GSOGTF. 09:54Z - Science. 50 min. 10:46Z - MARVELS cals. Please check these fibers as their corresponding spectra were relatively low S/N: Spectra: 031,032 -- Fiber: Yellow Green Orange 10:51Z - Closed. Turned off ThAr lamp. ---- Spectroscopy Data Summary ---- Image Cart Plate Texp PMT_avg Image_avg Exptype Object Seeing - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - T02:16:48.410 0 2. 96078. 4054. TIO NULL -9999.0 T02:18:48.500 0 15. 5314. 760. THAR NULL -9999.0 T02:21:00.760 0 2. 17396. 4068. TIO NULL -9999.0 T02:54:04.350 4 4810A 3000. 31. 884. STAR APG SGR1 1.5 T03:45:52.050 0 2. 58429. 4126. TIO NULL -9999.0 T03:47:52.680 0 15. 5906. 798. THAR NULL -9999.0 T03:50:06.840 0 2. 114009. 4135. TIO NULL -9999.0 T03:59:18.290 9 4918A 3000. 41. 1026. STAR APG NGP 2.0 T05:05:59.710 0 2. 331. 4247. TIO NULL -9999.0 T05:07:59.880 0 15. 5989. 803. THAR NULL -9999.0 T05:10:13.300 0 2. 111385. 4275. TIO NULL -9999.0 T08:21:24.510 0 2. 64982. 4269. TIO NULL -9999.0 T08:23:26.330 0 15. 5344. 764. THAR NULL -9999.0 T08:25:39.360 0 2. 107967. 4241. TIO NULL -9999.0 T08:51:23.130 5 4819A 3000. 56. 1261. STAR APG M13 1.5 T09:46:17.080 0 2. 25899. 4281. TIO NULL -9999.0 T09:48:17.660 0 15. 6019. 809. THAR NULL -9999.0 T09:50:32.180 0 2. 4371. 4261. TIO NULL -9999.0 T09:54:14.530 7 4912A 3000. 39. 1035. STAR APG 030-08 1.5 T10:46:16.370 0 2. 34018. 4209. TIO NULL -9999.0 T10:48:17.360 0 15. 5780. 799. THAR NULL -9999.0 T10:50:29.390 0 2. 36413. 4244. TIO NULL -9999.0 ---- Telescope Offsets and Scale ---- Time Inst Az Alt Rot objArcOff guideRot calibOff scale -------------------------------------------------------------------------------- 02:53 4-4810A -102.2 49.9 104.6 ( 2.6,-1.5) (-8.3) (-14.3,15.2, 0.0) 1.000235 04:12 9-4918A 9.7 84.2 189.2 (-0.3, 3.9) (104.2) (-14.3,15.2, 0.0) 1.000138 09:10 5-4819A 249.7 76.5 78.6 (-3.4,-7.4)(-201.4) ( 0.0, 0.0, 0.0) 1.000291 10:00 7-4912A 15.3 49.9 192.8 (-7.8, 7.3) (38.7) ( 0.0, 0.0, 0.0) 1.000228 ---- Focus Log ---- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 02:53 4-4810A 1.000235 -2315 -387 347 -102.2 49.9 12.7 15 208 1.3 04:12 9-4918A 1.000138 -1363 290 304 9.7 84.2 12.0 16 203 1.6 09:10 5-4819A 1.000291 -2873 -779 478 249.7 76.5 8.7 24 264 1.4 10:00 7-4912A 1.000228 -2250 -264 417 15.3 49.9 8.5 20 261 1.4 ---- Telescope Status ---- 00:00Z - Started ventilation. Fans on, doors and louvers opened. 02:00Z - Opened. 10:51Z - Closed. No interlocks bypassed Status at: 10:58:07 Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 7 Counterweights at: 288, 287, 287, 287 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 222.30 lbs, 16.77 psi SP2 204.50 lbs, 22.49 psi ---- Software Used ---- getVersions, 2011-05-16 23:01:45 ----STUI software---- STUI: 1.1a5 2011-05-06 LATER SWITCHED TO RUNNING 1.1a6 alerts: v1_1_4 apo: v1_7 boss: v2_5_0 boss.daq: 1.3.1 boss.specMech: 3.0.1 gcamera: v1_2_3 guider: v1_3_6 hub: Tag: sdss3_v1_1_5 mcp: v6_6_6 mcp.plc: 27 platedb: v1_0_5 sop: trunk+svn124258 sos: v1_1_7 sos.idlspec2d: v5_4_34 tcc: 2.14.0 ----Other software---- sdssProcedure(sdss3): v3_06 MARVELS MJCI version 2011/01/14 MARVELS MJDD version 2010/12/09 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -5.518 -5.520 Axial B: -0.023 -0.022 Axial C: 15.922 15.924 Trans D: 11.032 11.033 Lateral E: 10.668 10.6426 Lateral F: 12.2555 12.2428 GALILS Commanded: 10600 -250 5800 10250 13050 12650 Actual: 10600 -250 5800 10250 13050 12650 SETMIR VALUES PrimDesOrient: 0.00 -13.67 10.53 574.80 742.37 PrimOrient: 0.00 -13.67 10.53 574.80 742.37 SECONDARY: ---------- Focus: 0.00 Air temp: 16.4 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -0.013 -0.013 Axial B: -2.439 -2.442 Axial C: 13.81 13.810 Trans D: 14.18 14.184 GALILS Commanded: 1585350 1566700 1598900 -1450 -50 Actual: 1585249 1566660 1598855 -1450 -50 SETMIR VALUES SecDesOrient: 1257.00 -9.00 -4.00 -58.00 23.67 SecOrient: 1256.95 -9.02 -3.97 -58.06 23.33