Subject: 2.5m obslog 20110222 (MJD 55615) From: dmbiz@apo.nmsu.edu Date: Wed, 23 Feb 2011 12:32:46 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday February 22, 2011 (MJD 55615) ---- Observing Team ---- Alaina Shelden Dmitry Bizyaev Jon Brinkmann (support in the evening) Craig Loomis (support from Japan) ---- Observing Plan ---- BOSS until 06:19Z, then MARVELS. ---- Observing Summary ---- Clear night with moderate seeing. BOSS plates exposed: 11 4471 - not done 12 4498 - DONE 10 4635 - DONE MARVELS plates exposed: 4 4590 A missing fibers: 13,14, 53,54, 4 4590 B no missing fibers 3 4516 B missing: 49,50, 89,90 6 4587 A missing: 15,16, 49,50, 61,62, 79,80, 81,82 8 4588 A missing: 49,50, 107,108, 117,118 5 4592 B missing: 91,92, 95,96 We got a complex software problem in the evening which was solved by a proper sequence of rebooting of mcp, icc, and stui actors (see log). ---- Observing Log ---- Afternoon: ---------- Telescope checked, all is well. Mounted Cart 12, first of the night ThAr lamp was already on. Took cals, bias, dark, hartmanns. 23:30Z ventilation started. 00:01Z MCP got stuck. says "MCP unavailable". Also, huge delays in STUI and messages: 00:03:45 .tcc 0 tcc F Modu="prt_Read"; Text="read timed out on port LTA19:" 00:03:48 .tcc 0 tcc F Modu="prt_Read"; Text="read timed out on port LTA19:" Jon Brinkmann is notified, he's on site. 00:07Z JB: we couldn't connect to MCP via telnet. MCP rebooted. 00:56Z hub25m was restarted accidentally. 01:01Z dome opened. 01:40Z we still experience problems with mpc. Craig is on connection. Jon is here. JB and Craig fixed some issues with NSF mounting and permissions. 01:52Z mcp is unavailable again... Hartmann failed, because of MCP got unavailable. 0158Z gotoField again. 01:59:57 APO.alaina.sop 37 sos f text="collimation process failed" 01:59:57 .sop 23 sop w text="this command has already been finished!!!! (APO.alaina 23): gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderExpTime=5.0 " 01:59:57 .sop 23 sop i stageState="gotoField.hartmann","failed",0.0,0.0 01:59:57 .sop 23 sop w text="this command has already been finished!!!! (APO.alaina 23): gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderExpTime=5.0 " 01:59:57 .sop 23 sop i gotoFieldState="running","OK","done","failed","pending","pending" 01:59:57 .sop 23 sop w text="this command has already been finished!!!! (APO.alaina 23): gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderExpTime=5.0 " 01:59:57 .sop 23 sop i gotoFieldState="failed","failed to take hartmann sequence","done","failed","pending","pending" 01:59:57 .sop 23 sop w text="this command has already been finished!!!! (APO.alaina 23): gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderExpTime=5.0 " 01:59:57 .sop 23 sop f text="Failed to do Hartmann sequence" 0204Z it does not help - sop does not understand that lamps are on. They are on, we see them. Commands to turn lamps on and off are in the mcptpm log. Craig is trying to fix the problem. 02:12:34 APO.Craig: When this exposure is done, try again. The hub25m-p reboot left the ICC with some stale file handles, which caused trouble. 02:15:57 hartSp2: r=-948, b=-3.2, txt=OK, sp2Temp = 3.7 ; 02:15:57 sos.sp2AverageMove = 820 02:16:01 motorPos.sp2.move: 820, 820, 819; 02:16:01 hartSp1: r=-269, b=-0.9, txt=OK, sp1Temp = 4.3 ; 02:16:01 sos.sp1AverageMove = 1883 0220Z No GS. Spiral Pattern applied. There was a "hidden fiducial correction". Corrected, gotoField again. GSOGTF. 0240Z sos3 reduction was off. Turned on via sos_apocontrol Seeing ~ 1.7 - 2.2", clear sky. 02:13 r2-00126870 11 4471 arc Lef 4.8 19094 18734 20066 HART 02:14 r2-00126871 11 4471 arc Rig 4.9 19094 18734 20066 HART 02:16 r2-00126872 11 4471 arc Out 4.9 19914 19554 20885 02:18 r2-00126873 11 4471 fla Out 30.9 19914 19554 20885 02:39 r2-00126874 11 4471 sci Out 900.9 19914 19554 20885 02:55 r2-00126875 11 4471 sci Out 900.9 19914 19554 20885 ------------------------------------------------------------ MJD b1 r1 b2 r2 Texp Sum Plugfile ------------------------------------------------------------ 55615 2.6 6.1 2.0 4.4 900.8 15.1 4471-55601-01 55615 1.8 4.9 1.5 3.5 900.8 11.7 4471-55601-01 ------------------------------------------------------------ 4.4 11.0 3.5 7.9 1801.6 --> 26.8 ------------------------------------------------------------ The plate is not finished. --- 03:14Z cart 12 plate 4498 is mounted. 03:20:23 hartSp2: r=-608, b=-2.1, txt=OK, sp2Temp = 3.3 ; 03:20:23 sos.sp2AverageMove = -159 03:20:27 motorPos.sp2.move: -161, -158, -158; 03:20:27 hartSp1: r=-211, b=-0.7, txt=OK, sp1Temp = 4.1 ; 03:20:27 sos.sp1AverageMove = -95 GSOGTF Seeing ~ 1.4 - 1.7", clear sky 03:17 r2-00126876 12 4498 arc Lef 4.9 19914 19554 20885 HART 03:18 r2-00126877 12 4498 arc Rig 4.9 19914 19554 20885 HART 03:20 r2-00126878 12 4498 arc Out 4.9 19753 19396 20727 03:21 r2-00126879 12 4498 fla Out 30.9 19753 19396 20727 03:33 r2-00126880 12 4498 sci Out 900.9 19753 19396 20727 03:49 r2-00126881 12 4498 sci Out 900.9 19753 19396 20727 04:06 r2-00126882 12 4498 sci Out 900.9 19753 19396 20727 04:22 r2-00126883 12 4498 sci Out 900.9 19753 19396 20727 04:38 r2-00126884 12 4498 sci Out 900.9 19753 19396 20727 ------------------------------------------------------------ MJD b1 r1 b2 r2 Texp Sum Plugfile ------------------------------------------------------------ 55615 3.1 6.9 2.2 5.3 900.8 17.5 4498-55615-01 55615 3.8 7.7 2.7 6.4 900.8 20.6 4498-55615-01 55615 3.7 7.8 2.7 6.2 900.8 20.4 4498-55615-01 55615 2.7 6.0 2.0 4.7 900.8 15.4 4498-55615-01 55615 3.6 7.8 2.7 6.1 900.9 20.2 4498-55615-01 ------------------------------------------------------------ 16.9 36.2 12.3 28.7 4504.1 --> 94.1 ------------------------------------------------------------ This plate is done. --- 04:58Z cart. 10 plate 4635 is mounted. 05:03:40 hartSp2: r=-804, b=-2.8, txt=OK, sp2Temp = 3.2 ; 05:03:40 sos.sp2AverageMove = -2205 05:03:48 motorPos.sp2.move: -2204, -2203, -2205; 05:03:48 hartSp1: r=-649, b=-2.2, txt=OK, sp1Temp = 3.7 ; 05:03:48 sos.sp1AverageMove = -2859 Slew failed, although Hartmanns worked normally and moved pistons correctly. Craig: 05:38:22 APO.Craig: The 05:02 hartmann failure is because the sop timeout needs to be made even longer. Notice that the motors are still moving after the failure message at 05:02:08. GSOGTF Seeing ~1.5 - 1.8" 05:01 r2-00126885 10 4635 arc Lef 4.9 19753 19396 20727 HART 05:02 r2-00126886 10 4635 arc Rig 4.9 19753 19396 20727 HART 05:04 r2-00126887 10 4635 arc Out 4.9 17549 17193 18522 05:06 r2-00126888 10 4635 fla Out 30.9 17549 17193 18522 05:09 r2-00126889 10 4635 sci Out 900.9 17549 17193 18522 05:26 r2-00126890 10 4635 sci Out 900.9 17549 17193 18522 05:42 r2-00126891 10 4635 sci Out 900.9 17549 17193 18522 05:58 r2-00126892 10 4635 sci Out 900.9 17549 17193 18522 ------------------------------------------------------------ MJD b1 r1 b2 r2 Texp Sum Plugfile ------------------------------------------------------------ 55615 4.3 9.5 3.9 7.6 900.8 25.3 4635-55614-01 55615 4.4 9.6 3.9 7.5 900.8 25.4 4635-55614-01 55615 4.1 9.1 3.5 6.9 900.9 23.6 4635-55614-01 55615 4.4 9.4 3.6 7.3 900.8 24.7 4635-55614-01 ------------------------------------------------------------ 17.2 37.6 14.9 29.3 3603.3 --> 99.0 ------------------------------------------------------------ This plate is done. --- 06:14Z cart 4 plate 4590 A is mounted. GSOGTF 0628Z The sky is clear, photometric. Seeing ~ 1.6 - 2.0". T06:09:04.690 0 2. 149954. 5786. TIO NULL .0 T06:11:03.700 0 15. 6860. 830. THAR NULL .0 T06:13:15.940 0 2. 73871. 5776. TIO NULL .0 T06:24:44.460 4 4590A 3000. 41. 1035. STAR APG_210+08 2.0 -- 07:16Z plate 4590 side B is mounted. GSOGTF Seeing ~ 1.6 - 2.0", the sky is clear, photometric. T07:16:28.160 0 2. 117199. 5737. TIO NULL .0 T07:18:26.010 0 15. 6686. 816. THAR NULL .0 T07:20:37.300 0 2. 71856. 5703. TIO NULL .0 T07:22:44.350 4 4590B 3000. 32. 909. STAR APG_N2420 2.0 --- 08:13Z cart 3 plate 4516 B is mounted. GSOGTF Seeing ~ 1.5 - 2.0", clear photometric sky. T08:14:33.580 0 2. 78027. 5705. TIO NULL .0 T08:16:31.450 0 15. 6641. 810. THAR NULL .0 T08:18:43.710 0 2. 38025. 5667. TIO NULL .0 T08:22:09.950 3 4516B 3000. 37. 982. STAR APGS_N4147 2.0 --- 09:12Z cart 6 plate 4587 side A is mounted GSOGTF Clear photometric sky, seeing ~ 1.3 - 1.8" T09:13:56.570 0 2. 192069. 5692. TIO NULL .0 T09:15:55.360 0 15. 6822. 828. THAR NULL .0 T09:18:07.670 0 2. 162980. 5678. TIO NULL .0 T09:22:25.600 6 4587A 3000. 26. 803. STAR APGS_M3 2.0 -- 10:13Z cart 8 plate 4588 A is mounted. GSOGTF Clear photometric sky, seeing ~ 1.8 - 2.2" T10:14:41.390 0 2. 336236. 5591. TIO NULL .0 T10:16:39.250 0 15. 6512. 801. THAR NULL .0 T10:18:51.540 0 2. 312851. 5638. TIO NULL .0 T10:22:47.600 8 4588A 3000. 24. 746. STAR APGS_N5466 2.0 -- 11:14Z cart 5 plate 4592 B is mounted GSOGTF Photometric sky, seeing ~ 1.4 - 1.8" T11:14:36.430 0 2. 106404. 5557. TIO NULL T11:16:35.300 0 15. 6554. 811. THAR NULL T11:18:48.680 0 2. 30179. 5571. TIO NULL T11:21:40.000 5 4592B 3000. 33. 901. STAR APG_M53 T12:13:36.000 0 2. 13267. 5548. TIO NULL T12:15:34.800 0 15. 6527. 807. THAR NULL T12:17:47.040 0 2. 333049. 5603. TIO NULL 12:28Z dome closed ---- Telescope Offsets and Scale ---- Time Inst Az Alt Rot objArcOff guideRot calibOff scale -------------------------------------------------------------------------------- 01:43:19 11-4471A 88 46 245 ( 0.0, 0.0) ( 0.0) ( 0.0, 0.0, 0.0) 1.000000 04:07:45 12-4498A 44 67 217 ( 0.9, 7.1) ( 2.4) ( 0.0, 0.0, 0.0) 1.000048 05:41:11 10-4635A 104 65 268 (-4.6, 3.8) (47.2) ( 0.0, 0.0, 0.0) 1.000087 08:28:18 3-4516B 27 74 203 (-1.4,10.1) (84.9) ( 0.0, 0.0, 0.0) 1.000200 10:31:21 8-4588A 56 82 233 (-2.5, 5.6) (98.3) ( 0.0, 0.0, 0.0) 1.000211 11:30:03 5-4592B -55 65 133 ( 2.8, 9.1) ( 3.8) ( 0.0, 0.0, 0.0) 1.000204 ---- Focus Log ---- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 01:43:19 11-4471A 1.000000 0 1191 0 88 46 2.9 13 245 99.9 04:07:45 12-4498A 1.000048 -477 1189 448 44 67 2.8 16 233 1.6 05:41:11 10-4635A 1.000087 -853 876 444 104 65 2.2 15 247 1.7 08:28:18 3-4516B 1.000200 -1968 -58 451 27 74 1.4 11 246 1.5 10:31:21 8-4588A 1.000211 -2080 -158 447 56 82 0.8 12 278 2.1 11:30:03 5-4592B 1.000204 -2010 -53 472 -55 65 0.4 15 264 1.5 ---- Telescope Status ---- 23:30Z - Began ventilation. 01:01Z - Enclosure off. 12:28Z - Enclosure on, doors and louvers closed, fans off. No interlocks bypassed. Status at: 12:32Z Telescope stowed at: 30,121,00 mount Instrument mounted: Cartridge 11 Counterweights at: 288 lbs LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Spectro2 186 lbs, 23 psi Spectro1 206 lbs, 20 psi ---- Software Used ---- getVersions, 2011-02-23 00:03:01; ----STUI software: STUI: 1.0b17 2011-02-16; alerts: trunk+svn115546; apo: v1_5; boss: v2_4_2; boss.daq: 1.2.14; boss.specMech: 3.0.1; gcamera: v1_2_3; guider: v1_3_2; hub: Tag: sdss3_v1_1_5; mcp: v6_6_6; mcp.plc: 26; platedb: v1_0_5; sop: v1_1_7; sos: v1_1_7; sos.idlspec2d: v5_4_25; tcc: 2.14.0; -----Other software sdssProcedure(sdss3): v3_06; Setting up: idlspec2d Flavor: Linux64 Version: v5_4_25 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: start Setting up: |specflat Flavor: Linux64 Version: v1_8 Setting up: |speclog Flavor: NULL Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |platedb Flavor: Linux64 Version: v1_0_4 Setting up: | sqlalchemy Flavor: Linux64 Version: 0.5.5 Setting up: | |psycopg Flavor: Linux64 Version: 2.0.11 ... optional setup psycopg2 failed Setting up: | actorcore Flavor: Linux64 Version: v1_11_5 Setting up: | |opscore Flavor: Linux64 Version: CPL Setting up: | | external Flavor: Linux64 Version: v1_2_0 Setting up: | | actorkeys Flavor: Linux64 Version: trunk Setting up: | | |plc Flavor: Linux64 Version: v26 Setting up: | | |sdss3tools Flavor: Linux64 Version: v1_7_10 Setting up: | | RO Flavor: Linux64 Version: RO-2.3.5 Setting up: | |RO Flavor: Linux64 Version: trunk Setting up: |idlutils Flavor: Linux64 Version: v5_4_15 Setting up: | idl Flavor: Linux64 Version: 7.1 Setting up: | dust Flavor: Linux64 Version: v0_1 ... optional setup first failed ... optional setup rc3 failed ... optional setup rass failed ... optional setup gsc failed ... optional setup twomass failed ... optional setup twomass_xsc failed ... optional setup tycho2 failed ... optional setup ucac failed ... optional setup usno failed ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -5.521 -5.5210 Axial B: 16.096 16.0910 Axial C: 15.918 15.9190 Trans D: 11.028 10.9960 Lateral E: 10.6553 10.6553 Lateral F: 12.2682 12.2555 GALILS Commanded: 10600 -250 5800 10250 13050 12650 Actual: 10600 -250 5800 10250 13050 12650 SETMIR VALUES PrimDesOrient: 0.00 -13.67 10.53 574.80 742.37 PrimOrient: 0.00 -13.67 10.53 574.80 742.37 SECONDARY: ---------- Focus: 0.00 Air temp: 6.8 Altitude: 30.3 MIGS TONIGHT NOMINAL Axial A: -7.834 -7.8330 Axial B: -2.431 4.8850 Axial C: 13.816 13.820 Trans D: 14.18 14.1910 GALILS Commanded: 1585350 1566700 1598900 -1450 -50 Actual: 1585274 1566698 1598805 -1450 -50 SETMIR VALUES SecDesOrient: 1257.00 -9.00 -4.00 -58.00 23.67 SecOrient: 1256.95 -9.01 -3.98 -58.07 23.32