Subject: 2.5m obslog 20121103 (MJD 56235) From: gebelke@apo.nmsu.edu Date: Sun, 4 Nov 2012 12:46:35 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday November 03, 2012 (MJD 56235) ---- Observing Team ---- Moses Marchante Garrett Ebelke Dan Long (night) Joe Huehnerhoff (night) ---- Observing Plan ---- 3 Nov 2012 56235.0 0.67 01:19 12:15 21:11 08:08 BOSS until 03:57 (2.6 h), then APOGEE (8.6 h) ---- Observing Summary ---- Delayed opening due to nearby radar returns, but after opening, the skies were photometric with 1" seeing. ----- On arrival, the South Rail e-stop would not clear in the STUI Interlocks. It is now bypassed. See Problems in Detail. STUI (1.1.3b1) - Quit Unexpectedly on Minidru while observing. STUI (1.1.3b1) - Interlocks shows PLC:NOTAG. Also, lavalamp interlock is gone (not that it was ever a functional interlock), and altitude interlock is no longer red when the axis is cleared (yay). 3:27Z - Lost ~1hr of time due to the altitude axis brake not clearing. See Problems in detail. The site lost external internet at 9:05Z. We lost all weathertap pages and couldn't access any websites. Internet came back online about 15min later. ----- We observed the following plates: Cart 10, 5038 - DONE Cart 6, 5601 - 2x ABBA Sequences Cart 7, 6221 - 2x ABBA Sequences Cart 1, 6324 - 2x ABBA Sequences Cart 3, 6342 - 2x ABBA Sequences Cart 4, 6359 - 2x ABBA Sequences Cart 8, 5532 - 2x ABBA Sequences 12:37Z - Started APOGEE Morning Cals Started BOSS 20x bias and 1x 900s dark ---- Observing Log ---- Afternoon: ---------- 22:20Z Started the afternoon checkout. Checked email and changeNotes Checked 180-L dewars weight Cleaned APOGEE gang connector with air. Did 3-read dark Checked images Did APOGEE evening cals Checked the images Checked status of rain sensor Recorded the software versions Recorded and checked mirror numbers Did 'platedb showActive' All BOSS/APOGEE carts are ready Tested the actors Check calib lamps Guider/gcamera tests: a) gcamera status (simulate=off; temp=-40) b) gcamera dark time=20 c) guider status d) guider flat Spectro tests and focus a) guider loadCartridge b) boss exposure bias itime=0 c) boss exposure dark itime=20 d) sop hartmann 150034 Predict blue camera ring movement of -5.2 degrees for spectro-1 Predict blue camera ring movement of 3.6 degrees for spectro-2 Predict (red) piston movement of 170 steps for spectro-1 Predict (red) piston movement of 170 steps for spectro-2 motorPosition sp1: 22828, 23268, 23062; sp2: 34593, 34778, 35441; Median spectrographs temperatures: Tsp1= 11.7, Tsp2= 11.4; Outside air temperature= 11.6; ----------------------------- Checked that carts were in bay correctly; All BOSS/APOGEE carts are ready 23:41Z Opened doors/louvers; turned on fans Mounted first cart of the night. hub25m> df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 95G 17G 74G 19% / /dev/sda4 793G 275G 478G 37% /home /dev/sda1 99M 31M 63M 33% /boot tmpfs 5.9G 0 5.9G 0% /dev/shm sdssfiles1-p://data1/data/MARVELS 1.8T 516G 1.3T 29% /MARVELS /dev/drbd1 13T 11T 2.1T 84% /data N UT File/Exp Imagetype Nread Dth Comment - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 22:26 06730001 Dark 3 A None 2 22:41 06730002 Dark 60 A None 3 22:43 06730003 QuartzFlat 10 A None 4 22:45 06730004 ArcLamp 12 A None 5 22:52 06730005 ArcLamp 40 A None 6 22:54 06730006 ArcLamp 12 B None 7 23:02 06730007 ArcLamp 40 B None 8 23:13 06730008 Dark 60 A None ----- Night ----- Nearby radar returns delayed opening. 2:20Z - Enclosure Open Cart 10, 5038 - Loaded Due to STUI quitting, I do not have hartmann values for cart 10 as my logfun window closed and Moses didn't have his open. 2:28Z - Cals - 150040-41 GSOGTF. Seeing 0.9-1.0". Clear skies. 2:38Z - 15min exposure 2:52Z - 15min exposure 3:08Z - 15min exposure MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56234 0.50 0.88 0.43 0.96 900.8 2.78 5038-56234-01 56235 4.67 9.03 3.96 9.73 900.8 27.38 5038-56234-01 56235 4.74 9.34 4.02 10.23 900.8 28.33 5038-56234-01 56235 4.77 9.39 4.13 10.46 900.8 28.75 5038-56234-01 --------------------------------------------------------------- s/n2= 14.68 28.64 12.54 31.38 3603.3 --> 87.24 --------------------------------------------------------------- This plate is done! ----- 3:27Z - After loading cart 12, the altitude axis brakes would not clear. See Problems in Detail. ----- 04:19:19 loadCart: ct=6, pl=5601, sd=A; 04:24:40 sop.gotoField = running; GSOGTF. Seeing 1.1". Clear skies. 4:29Z - Started 2x ABBA Sequences. 9 04:19 06730009 Dark 10 A None 10 04:21 06730010 Dark 10 A None 11 04:37 06730011 Object 47 A None 12 04:45 06730012 Object 47 B None 13 04:53 06730013 Object 47 B None 14 05:02 06730014 Object 47 A None 15 05:10 06730015 Object 47 A None 16 05:19 06730016 Object 47 B None 17 05:27 06730017 Object 47 B None 18 05:35 06730018 Object 47 A None 19 05:38 06730019 Object 14 A sky flat, offse 20 05:41 06730020 Object 14 B sky flat, offse 21 05:43 06730021 Object 14 B sky flat, offse 22 05:46 06730022 Object 14 A sky flat, offse 23 05:47 06730023 DomeFlat 5 A None flat= /data/apogee/utr_cdr/56235/apRaw-06730023.fits master= /home/observer/bin/apRaw-03720068.fits nfibers= 300 average ratio= 0.89685463058 missing fibers (flat/master -------------------------------------------------------------------------------- 02:35 10-5038A 1.000114 -1124 478 283 6.9 72.7 6.8 2 223 1.2 boss 02:51 10-5038A 1.000124 -1226 406 294 -6.3 72.7 7.5 2 241 1.1 boss 03:07 10-5038A 1.000124 -1223 430 315 -19.1 72.0 6.6 3 233 1.2 boss 04:28 6-5601A 1.000215 -2143 -293 311 146.1 59.9 6.9 2 195 1.2 apog 04:36 6-5601A 1.000236 -2331 -469 311 147.6 60.9 6.9 2 196 1.2 apog 04:45 6-5601A 1.000229 -2255 -412 307 149.2 61.8 6.9 2 191 1.1 apog 04:53 6-5601A 1.000219 -2162 -339 305 150.9 62.7 6.8 2 188 1.2 apog 05:02 6-5601A 1.000214 -2115 -312 295 152.9 63.5 6.8 2 188 1.2 apog 05:10 6-5601A 1.000210 -2070 -268 302 155.0 64.3 6.9 2 191 1.1 apog 05:18 6-5601A 1.000203 -2000 -217 297 157.3 65.0 6.7 2 187 1.4 apog 05:27 6-5601A 1.000199 -1968 -195 294 159.7 65.7 6.9 4 194 1.3 apog 06:00 7-6221A 1.000011 -108 1374 326 95.8 66.5 6.7 4 186 1.1 apog 06:08 7-6221A 0.999984 162 1583 315 95.1 68.2 6.7 2 214 1.2 apog 06:17 7-6221A 0.999980 200 1616 317 94.3 70.0 6.8 4 193 1.1 apog 06:25 7-6221A 0.999980 194 1610 319 93.5 71.8 6.8 4 188 1.1 apog 06:34 7-6221A 0.999978 216 1609 302 92.7 73.5 6.6 2 200 1.1 apog 06:42 7-6221A 0.999972 273 1659 309 91.8 75.3 6.6 4 196 1.1 apog 06:50 7-6221A 0.999978 216 1609 309 90.9 77.0 6.7 3 200 1.1 apog 06:59 7-6221A 0.999971 283 1664 309 89.8 78.8 6.7 4 199 1.0 apog 07:19 1-6324A 1.000063 -621 926 297 138.9 64.3 6.4 4 203 1.2 apog 07:28 1-6324A 1.000081 -802 773 298 140.7 65.4 6.3 5 207 1.1 apog 07:36 1-6324A 1.000078 -767 810 308 142.6 66.5 6.4 6 227 1.2 apog 07:44 1-6324A 1.000080 -793 780 302 144.9 67.6 6.3 6 220 1.2 apog 07:53 1-6324A 1.000077 -764 810 308 147.4 68.6 6.3 5 224 1.1 apog 08:01 1-6324A 1.000075 -735 832 309 150.2 69.5 6.4 3 217 1.2 apog 08:10 1-6324A 1.000071 -704 861 313 153.3 70.3 6.2 3 223 1.2 apog 08:18 1-6324A 1.000073 -719 844 312 156.7 71.0 6.1 3 240 1.2 apog 08:39 3-6342A 1.000164 -1618 105 323 68.9 75.9 6.1 2 209 1.2 apog 08:47 3-6342A 1.000170 -1678 59 328 64.8 77.5 6.1 2 211 1.2 apog 08:56 3-6342A 1.000174 -1717 22 324 59.7 79.1 6.2 1 215 1.3 apog 09:04 3-6342A 1.000162 -1599 120 325 53.1 80.5 6.2 2 223 1.5 apog 09:12 3-6342A 1.000162 -1599 117 324 44.5 81.9 6.3 1 204 1.3 apog 09:21 3-6342A 1.000155 -1532 169 321 32.8 83.0 6.7 1 210 1.4 apog 09:29 3-6342A 1.000157 -1554 141 313 18.2 83.7 6.2 4 236 1.1 apog 09:38 3-6342A 1.000157 -1548 144 312 0.3 84.0 6.1 3 233 1.1 apog 10:02 4-6359A 1.000291 -2870 -912 300 10.4 55.8 6.3 1 219 1.2 apog 10:10 4-6359A 1.000310 -3058 -1053 314 6.7 56.0 6.3 1 214 1.2 apog 10:18 4-6359A 1.000291 -2870 -909 303 2.9 56.2 6.1 3 251 1.2 apog 10:27 4-6359A 1.000312 -3080 -1069 318 -0.9 56.2 6.7 2 245 1.2 apog 10:35 4-6359A 1.000299 -2949 -968 311 -4.7 56.1 6.1 4 256 1.2 apog 10:44 4-6359A 1.000300 -2959 -978 308 -8.4 55.9 6.4 3 255 1.2 apog 10:52 4-6359A 1.000307 -3026 -1042 299 -12.1 55.6 6.4 2 245 1.2 apog 11:00 4-6359A 1.000313 -3093 -1098 298 -15.8 55.2 6.6 2 264 1.2 apog 11:22 8-5532A 1.000065 -640 888 302 254.6 81.7 6.5 2 275 1.1 apog 11:30 8-5532A 1.000056 -554 971 313 256.3 80.0 6.2 5 265 1.1 apog 11:39 8-5532A 1.000055 -538 966 293 257.2 78.3 6.2 2 295 1.1 apog 11:47 8-5532A 1.000062 -614 936 324 257.8 76.5 6.3 2 256 1.1 apog 11:55 8-5532A 1.000067 -662 892 316 258.1 74.8 6.1 5 282 1.1 apog 12:04 8-5532A 1.000074 -729 838 315 258.2 73.0 6.2 1 318 1.1 apog 12:12 8-5532A 1.000070 -691 878 320 258.2 71.3 6.5 1 332 1.0 apog 12:21 8-5532A 1.000079 -774 815 325 258.1 69.6 6.2 1 318 1.1 apog ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 02:35 10-5038A 6.8 -2.5 9.3 51 2 223 545 5.3 1526.0 1.2 boss 02:51 10-5038A 7.5 -3.6 11.1 45 2 241 417 5.4 1522.0 1.1 boss 03:07 10-5038A 6.6 -3.1 9.7 50 3 233 489 5.5 1530.0 1.2 boss 04:28 6-5601A 6.9 -3.3 10.2 48 2 195 509 5.3 1539.0 1.2 apog 04:36 6-5601A 6.9 -3.2 10.1 48 2 196 489 5.3 1535.0 1.2 apog 04:45 6-5601A 6.9 -3.1 10.0 48 2 191 517 5.4 1535.0 1.1 apog 04:53 6-5601A 6.8 -3.3 10.1 48 2 188 485 5.4 1537.0 1.2 apog 05:02 6-5601A 6.8 -3.2 10.0 48 2 188 481 5.5 1539.0 1.2 apog 05:10 6-5601A 6.9 -3.8 10.7 46 2 191 470 5.4 1541.0 1.1 apog 05:18 6-5601A 6.7 -3.6 10.3 47 2 187 492 6.0 1548.0 1.4 apog 05:27 6-5601A 6.9 -3.1 10.0 48 4 194 479 5.9 1543.0 1.3 apog 06:00 7-6221A 6.7 -3.3 10.0 48 4 186 472 5.8 1543.0 1.1 apog 06:08 7-6221A 6.7 -3.3 10.0 48 2 214 489 5.2 1553.0 1.2 apog 06:17 7-6221A 6.8 -3.3 10.1 48 4 193 453 6.1 1553.0 1.1 apog 06:25 7-6221A 6.8 -3.2 10.0 48 4 188 507 5.8 1548.0 1.1 apog 06:34 7-6221A 6.6 -3.1 9.7 49 2 200 461 5.1 1548.0 1.1 apog 06:42 7-6221A 6.6 -3.1 9.7 49 4 196 414 5.1 1547.0 1.1 apog 06:50 7-6221A 6.7 -3.1 9.8 49 3 200 484 5.2 1554.0 1.1 apog 06:59 7-6221A 6.7 -3.2 9.9 49 4 199 499 5.1 1552.0 1.0 apog 07:19 1-6324A 6.4 -3.1 9.5 50 4 203 463 5.4 1534.0 1.2 apog 07:28 1-6324A 6.3 -3.1 9.4 51 5 207 445 5.3 1540.0 1.1 apog 07:36 1-6324A 6.4 -3.0 9.4 51 6 227 511 5.9 1538.0 1.2 apog 07:44 1-6324A 6.3 -2.8 9.1 52 6 220 471 5.1 1542.0 1.2 apog 07:53 1-6324A 6.3 -2.6 8.9 53 5 224 467 5.2 1542.0 1.1 apog 08:01 1-6324A 6.4 -2.2 8.6 54 3 217 532 5.3 1532.0 1.2 apog 08:10 1-6324A 6.2 -2.2 8.4 55 3 223 490 7.3 1535.0 1.2 apog 08:18 1-6324A 6.1 -1.6 7.7 57 3 240 509 6.1 1543.0 1.2 apog 08:39 3-6342A 6.1 -1.9 8.0 56 2 209 468 5.2 1552.0 1.2 apog 08:47 3-6342A 6.1 -1.6 7.7 58 2 211 480 5.4 1553.0 1.2 apog 08:56 3-6342A 6.2 -1.4 7.6 58 1 215 495 5.4 1549.0 1.3 apog 09:04 3-6342A 6.2 -1.3 7.5 58 2 223 491 5.9 1557.0 1.5 apog 09:12 3-6342A 6.3 -1.4 7.7 57 1 204 461 5.7 1542.0 1.3 apog 09:21 3-6342A 6.7 -1.2 7.9 56 1 210 488 5.3 1540.0 1.4 apog 09:29 3-6342A 6.2 -1.3 7.5 58 4 236 480 6.2 1539.0 1.1 apog 09:38 3-6342A 6.1 -1.1 7.2 60 3 233 507 5.2 1541.0 1.1 apog 10:02 4-6359A 6.3 -1.1 7.4 59 1 219 450 5.6 1558.0 1.2 apog 10:10 4-6359A 6.3 -1.2 7.5 58 1 214 509 5.4 1553.0 1.2 apog 10:18 4-6359A 6.1 -1.4 7.5 58 3 251 501 5.3 1546.0 1.2 apog 10:27 4-6359A 6.7 -1.5 8.2 55 2 245 506 5.3 1544.0 1.2 apog 10:35 4-6359A 6.1 -1.9 8.0 56 4 256 467 5.3 1545.0 1.2 apog 10:44 4-6359A 6.4 -1.9 8.3 55 3 255 495 5.4 1541.0 1.2 apog 10:52 4-6359A 6.4 -2.0 8.4 55 2 245 493 5.2 1541.0 1.2 apog 11:00 4-6359A 6.6 -2.1 8.7 53 2 264 435 5.2 1540.0 1.2 apog 11:22 8-5532A 6.5 -2.4 8.9 52 2 275 457 5.3 1547.0 1.1 apog 11:30 8-5532A 6.2 -2.7 8.9 52 5 265 439 5.2 1546.0 1.1 apog 11:39 8-5532A 6.2 -2.7 8.9 52 2 295 439 5.0 1548.0 1.1 apog 11:47 8-5532A 6.3 -2.4 8.7 53 2 256 434 5.2 1553.0 1.1 apog 11:55 8-5532A 6.1 -2.3 8.4 54 5 282 420 5.0 1551.0 1.1 apog 12:04 8-5532A 6.2 -2.3 8.5 54 1 318 425 5.3 1550.0 1.1 apog 12:12 8-5532A 6.5 -2.3 8.8 53 1 332 448 5.8 1559.0 1.0 apog 12:21 8-5532A 6.2 -2.4 8.6 53 1 318 408 5.1 1554.0 1.1 apog ---- Telescope Status ---- 23:40Z Started ventilation 2:20Z encl25m : open 12:40Z encl25m : closed No interlocks bypassed Status at: 12:46Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 11 Counterweights at: 303, 301, 303, 303 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 184.6 lbs, 20.0 psi SP2 168.8 lbs, 19.4 psi ---- Software Used ---- etVersions, 2012-11-03 22:26:46 ----STUI software: STUI: 1.1.2b5 2012-06-19; alerts: v1_2_1; apo: v1_7; boss: v2_5_12; boss.daq: 1.3.2; boss.specMech: 3.0.1; gcamera: v1_2_10; guider: v1_3_23; hub: Tag: sdss3_v1_2_0; mcp: v6_6_15; mcp.plc: 28; mcp.azFiducialVersion: v1_106; mcp.altFiducialVersion: v1_106; mcp.rotFiducialVersion: v1_106; platedb: v1_0_5; sop: v1_2_14; sos: v1_2_0; sos.idlspec2d: v5_5_9; tcc: 2.14.0; apogee: ** FAILED ** apogeecal: ** FAILED ** apogeeql: v1_4_1 -----Other software sdssProcedure(sdss3): v3_06; idlspec2d (sos3) --- v5_5_13 plate-mapper3 ------ NOCVS:v5_0_14 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 5.362 5.357 Axial B: 5.217 5.221 Axial C: 5.515 5.516 Trans D: 10.363 10.374 Lateral E: 10.6299 10.6299 Lateral F: 12.2682 12.2428 GALILS Commanded: 11300 -650 5500 21900 13500 13050 Actual: 11300 -650 5500 21900 13500 13050 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 612.35 1500.90 PrimOrient: 0.00 0.00 0.00 612.07 1500.38 SECONDARY: ---------- Focus: 0.00 Air temp: 11.6 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: 7.039 7.041 Axial B: 7.061 7.059 Axial C: 7.034 7.041 Trans D: 0.328 0.33 GALILS Commanded: 1576550 1594600 1580000 -3550 -6650 Actual: 1576569 1594591 1579983 -3550 -6650 SETMIR VALUES SecDesOrient: 1257.00 3.00 5.00 0.00 115.81 SecOrient: 1257.00 2.99 5.01 -0.16 116.15 ---- Problems in Detail ---- South Rail e-Stop While doing afternoon checkout, Moses noticed that the South Rail stop was engaged. When he checked it, the button light was turned on, but the e-stop itself was pulled. He cycled it in/out a few times and the light stayed on and it wouldn't clear. We called DanL who suggested and gave us permission to bypass it in the splitter chassis. Slot #1, Channel 7 has been bypassed on the splitter chassis using the key. Dan will have Wendell look at it on Monday, but said they have seen this before so it shouldn't be a big issue. ----- 3:27Z - Altitude Axis failed to clear brakes When I got back to the control room after mounting a new cartridge, Moses asked me if I pulled the altitude pin. I said yes but that I'd go back down to check. The instrument lift lights were off (indicating the pin was out), so I tried an axis stop, put the pin in, hit an estop, pulled the estop, removed the pin (cycled it in/out about 4 times), then tried another axis init. The altitude brakes would clear, then reengage. We got DanL on the phone and after spending about 15min troubleshooting, we narrowed it down to the Altitude #1 Glentek might be. This was due to several LED lights being red on that glentek compared to Altitude #2. When we informed Dan of this, he suggested we call Joe and have Joe call Dan to talk through swapping of the amp. Joe arrived on-site, when he checked out the telescope he attempted to clear the brakes in the MCP one more time before working on the glenteks. For some reason, the altitude axis cleared for him, but leaves us clueless why it wouldn't clear the 15-20 times we tried it with Dan on the phone watching the interlocks. ----- 7:40Z - Guider Failed 07:38:40 client.v681.guider 732 gcamera w text="IMAGE READ FAILED: 4" 07:38:40 client.v681.guider 732 gcamera w exposureState="failed",0.0,0.0 07:38:40 client.v681.guider 732 gcamera f text="exposure failed: failed to read image from camera; please try gcamera reconnect before restarting the ICC" 07:38:40 CmdDone: client.v681.guider 732 gcamera expose time=5.000000 stack=1 07:38:40 APO.Moses.sop 624 guider w text="Failed to take exposure" 07:38:40 APO.Moses.sop 624 guider f guideState=failed 07:38:40 CmdDone: APO.Moses.sop 624 guider on time=5