From: harvanek@apo.nmsu.edu Subject: 2.5-m Obslog 20010218 (MJD 51959) Date: Mon, 19 Feb 2001 07:02:31 -0700 (MST) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday February 18, 2001 (MJD 51959) OBSERVING TEAM: =============== Mike Harvanek (APO) Atsuko Nitta Kleinman (APO) Bing Chen (JHU) PT VISITORS: ========= Jurek Krzesinski (KPU: Poland) Connie Rockosi (UC; by phone) Jon Brinkmann (APO; by phone) Craig Loomis (APO; by phone) THE PLAN: ========= Science. SYNOPSIS FOR NIGHT: =================== 16:45 Doors open, fan on 18:10 Enclosure off 06:15 Enclosure on, doors closed, fan off Four plates (541, 550, 547, 283) finished. Another plate (297) may be finished and should be examined by the data reduction folks to determine if it is good enough to declare done. GENERAL COMMENTS (see Problems below for details): ================================================== The first science exposure (8798) for plate 541 did not appear in Son-of-Spectro. This might be due to the fact that this exposure was taken before the pre-calib. This exposure exists both in /data/spectro on sdsshost and on plate-mapper though. The first science exposure (8808) for plate 550 was also done prior to the pre-calib and was also missing from SoS. Although we erred in not doing the pre-calib first, it would be nice if SoS still processed these images after the pre-calib is completed. SoS did not process b2 for the 3rd science exposure (8812) for plate 550. We did a 4th science exposure to make sure this plate was done. The first science exposure (8825) for plate 283 was also done prior to the pre-calib and so was also missing from SoS. The watcher continued to report MCP communications timeouts. There was a vs+ error on spectrograph ccd03 around 18:15. According to the plot from watcher, the nominal voltage should be 6.45 +/- 0.293 but the actual value was around 0.1 and had been so for hours. The other 3 ccds (01, 02, 04) had similar values (~0.1) and the watcher had not reported them to be in error. Operation appeared to be normal. The error was cleared and did not return. We contacted Connie Rockosi and she confirmed these were normal operating voltages. There was also a rot_motor_V1_R_check problem that occurred at around 18:30. The positions were either az=121, alt=30, rot=0 (stow) or az=0, alt=60, rot=0 (a test slew position). An alt_motor1_V1_R_check error occurred at around 01:19. The positions were az=176, alt=57, rot=187. An alt_motor1_V1_R_check error occurred at around 03:19. The positions were about az=4, alt=57, rot=183. None of these caused an abort but they did cause their respective interlocks to show red. Some of the science exposures were 1 sec longer than they should have been. We're not sure why this occurred as all science exposures were taken using doNextScience which has a 900 sec exposure time by default. Fiber 11 in cartridge 3 (plate 297) was void of signal (no star, no sky) during guiding although it appeared to be ok during the flats. Around 04:30 we noticed that the final science exposure for plate 297 was taking a long time to complete. An attempt to check on the exposure showed that the SOP window had froze and that the guider was no longer updating. An endStare was tried from another SOP window but it replied "Error: No exposure is in progress." We then attempted to log out the ports but found that we could not telnet to them: > telnet sdss-ts-spectro 2000 Trying 192.41.211.136... telnet: Unable to connect to remote host: Connection timed out We then called Jon Brinkmann. After some discussion, we called Craig Loomis who informed us that the ports had been renamed when the switch from Xyplex to MUX was done. We were then able to telnet to the ports and log them out. However, the ports became reconnected (perhaps from the scheduled grabInst command in the frozen SOP session?). See the Problems section for the traceback. At this point, we gave up trying to grab the instruments and attempted a post-calib. It appeared to work but even if it didn't, the pre-calib is good (according to SoS) and so should be sufficient to reduce the data. This plate is nearly done. Three of the 4 chips have s/n > 15. The 4th (r2) has s/n = 13.8 and so we did not declare this plate done. However, as per the recent discussion regarding s/n for plates, someone may wish to examine the data for this plate to determine if it is good enough to declare done. If it is done, please tell the pluggers to replug it (cartridge 3 plate 297 --> plate 296). As of now, the instruments are still grabbed in SOP. Jon B. and Craig L. have been notified and hopefully will be able to correct the problem. DATA ACQUISITION (see IOP/SOP output below): ============================================ IMAGING: -------- Run Stripe Strip Flavor Lambda Last Frame # Begin End ------------------------------------------------------------------ 2118 100 O bias in doghouse -134.00 -123.40 84 ignore SPECTROSCOPY: ------------- UT Exp Time flavor comment (S/N)^2 totals ------------------------------------------ b1 r1 b2 r2 ------ sequence 8796, plate -9999 ------- 00:31 8796 0.0 bias {{}} 01:01 8797 0.0 bias {{}} ------ sequence 8797, plate 541 ------- 16.6 20.1 24.9 20.3 (frame 8798 missing) 02:26 8798 900.0 target science 02:30 8799 10.0 flat pre-flat 02:32 8800 2.0 arc pre-arc 02:53 8801 900.0 target science 03:11 8802 900.0 target science 03:28 8803 900.0 target science 03:46 8804 901.0 target science 03:53 8805 240.0 smear {{Smear Pattern}} 03:56 8806 10.0 flat post-flat 03:58 8807 2.0 arc post-arc ------ sequence 8808, plate 550 ------- 31.3 32.4 16.2 28.7 (frame 8808 and b2 from 8812 missing) 04:40 8808 900.0 target science 04:44 8809 10.0 flat pre-flat 04:46 8810 2.0 arc pre-arc 05:06 8811 901.0 target science 05:24 8812 900.0 target science 05:34 8813 240.0 smear {{Smear Pattern}} 05:37 8814 10.0 flat post-flat 05:39 8815 2.0 arc post-arc 05:57 8816 900.0 target science ------ sequence 8817, plate 547 ------- 25.3 23.1 30.8 22.5 06:27 8817 10.0 flat pre-flat 06:29 8818 2.0 arc pre-arc 07:06 8819 901.0 target science 07:24 8820 901.0 target science 07:42 8821 901.0 target science 07:49 8822 240.0 smear {{Smear Pattern}} 07:52 8823 10.0 flat post-flat 07:54 8824 2.0 arc post-arc ------ sequence 8825, plate 283 ------- 23.4 23.8 19.4 17.2 (frame 8825 missing) 08:39 8825 900.0 target science 08:42 8826 10.0 flat pre-flat 08:44 8827 2.0 arc pre-arc 09:03 8828 901.0 target science 09:21 8829 901.0 target science 09:39 8830 900.0 target science 09:46 8831 240.0 smear {{Smear Pattern}} 09:49 8832 10.0 flat post-flat 09:51 8833 2.0 arc post-arc ------ sequence 8834, plate 297 ------- 19.8 22.5 17.8 13.8 10:14 8834 10.0 flat pre-flat 10:16 8835 2.0 arc pre-arc 10:35 8836 900.0 target science 10:53 8837 900.0 target science 11:10 8838 900.0 target science ------ sequence 8839, plate -9999 ------- 12:35 8839 0.0 bias {{}} ------ sequence 8840, plate 297 ------- 12:45 8840 10.0 flat post-flat 12:48 8841 2.0 arc post-arc Plate 541 was observed in sequence(s) 8797 for a total of 4501 seconds Plate 550 was observed in sequence(s) 8808 for a total of 3601 seconds Plate 547 was observed in sequence(s) 8817 for a total of 2703 seconds Plate 283 was observed in sequence(s) 8825 for a total of 3602 seconds Plate 297 was observed in sequence(s) 8834 8840 for a total of 2700 seconds OFFSETS: -------- Time Cart Plate getclock Az Alt Rot Scale 19:15 7 541 982548936 0.002700 0.004007 0.010220 1.000150 21:46 2 550 982557977 0.010380 0.002389 0.010220 1.000000 23:30 1 547 982564215 0.006612 -0.001635 0.010220 1.000000 01:43 8 283 982572188 0.002044 0.001675 0.000000 1.000060 03:12 3 297 982577563 -0.001184 0.002118 0.000000 1.000060 TAPES: ------ Ship to FNAL: JL3641 Stays at APO: JL3642 MIRROR NUMBERS: =============== PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0419 0.0150 Axial B: -0.0520 -0.0510 Axial C: 0.0280 0.0300 Trans D: 3.7490 3.7560 Lateral E: 1.9075 1.9100 Lateral F: 0.4079 0.4095 GALILS Commanded: 4900. -2750. 450. -6650. 8750. 8300. Actual: 4900. -2750. 450. -6650. 8750. 8300. SETMIR VALUES primDesOrient: 0.00 -4.40 10.70 586.50 240.70 primOrient: 0.00 -4.56 10.53 586.58 240.03 SECONDARY: ---------- Focus: 200.0 Air temp: 4.2 C Altitude: 55.18 MIGS TONIGHT Axial A: -1.3799 Axial B: -1.3819 Axial C: -1.3860 Trans D: 0.2639 GALILS Commanded: 1720600. 1720600. 1720600. 7450. 8650. Actual: 1720562. 1720682. 1720726. 7450. 8650. SETMIR VALUES secDesOrient: 1365.27 0.00 0.00 0.00 -287.26 secOrient: 1365.31 -0.03 0.04 0.03 -287.03 FOCUS LOG: ========== setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm " 16:45 Doors open, fan on 18:10 Enclosure off 19:15 7 541 1.00015 -1481 30 100 100 58.7 4.0 13 266 - 2.0 19:57 7 541 1.00020 -1975 -399 100 97 67.5 4.5 15 273 - 2.1 20:45 7 541 1.00012 -1185 140 0 93 77.5 5.4 16 282 - 2.5 21:46 2 550 1.00000 0 1105 -25 148 71.0 5.2 16 294 - 1.8 23:30 1 547 1.00000 0 1076 -50 225 73.1 5.3 15 269 - 2.2 23:59 1 547 0.99998 198 1247 -50 232 68.6 4.8 14 268 - 1.5 00:49 1 547 0.99998 198 1266 -50 238 59.9 4.6 14 303 - 1.5 01:43 8 283 1.00006 -593 594 -75 3 57.2 4.5 10 277 - 1.8 02:24 8 283 1.00006 -593 597 -75 -16 56.2 4.2 16 270 - 1.8 03:13 3 297 1.00006 -593 620 -50 9 56.9 4.1 12 290 - 2.5 03:54 3 297 1.00003 -296 866 -50 -10 56.8 4.0 10 279 - 2.5 04:37 3 297 1.00003 -296 874 -50 -29 53.7 4.2 14 272 - 2.7 06:15 Enclosure on, doors closed, fan off WEATHER SYNOPSIS: ================= Thin clouds from the southern horizon to zenith at sunset. Variable clouds throughout the night. Nearly clear around 20:00. Mostly cloudy around 01:30 then nearly clear at 02:00. Seeing was decent for much of the night and, if not for the clouds, we would have been imaging for at least some of the night. WEATHER DATA: ============= Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky Precip. 16:01 46 1 16 292 (WNW) 208 - pcl none 17:01 44 6 9 269 (W) 269 - pcl none 18:01 39 13 11 288 (WNW) 382 - pcl none 19:01 39 11 13 266 (W) 417 - pcl none 20:01 41 12 17 276 (W) 384 - pcl none 21:01 41 9 10 270 (W) 397 - pcl none 22:01 41 10 16 297 (WNW) 373 - pcl none 23:01 41 11 10 274 (W) 376 - pcl none 00:01 41 12 16 270 (W) 432 - pcl none 01:01 40 14 16 274 (W) 416 - pcl none 02:01 39 15 13 306 (NW) 416 - pcl none 03:01 39 15 10 277 (W) 411 - pcl none 04:01 39 16 9 277 (W) 469 - pcl none 05:01 39 14 9 269 (W) 374 - pcl none 06:01 39 14 13 258 (WSW) 429 - pcl none [pmt]cl = partly, mostly, totally cloudy LN2 SCHEDULE: ============= Spectrographs filled at 18:15. Spectro dewar weight at 06:45: 43 lb. Imager dewar weight at 06:45: 73 lb. TELESCOPE STATUS: ================= Stowed at 30 deg alt with Cart 9 (plate 480) mounted. Counterweights at 240. Spectro auto-fill connected. INTERLOCKS: =========== None bypassed SOFTWARE USED: ============== IOP/SOP: v3_29_4 Watcher: v2_8_14 MCP: v4_5_1 TPM: v2_2_2 AstroDa: 14_34 TCC: 2.5.0b2 tccMon: v1_5 sdssProcedures: v1_11 PROBLEMS IN DETAIL: =================== Frozen SOP session ------------------ Here is the traceback after the ports became reconnected: sp1> grabInstruments -handlers 80 Couldn't open udp socket 30410 : Address already in use Couldn't open udp socket 30410 : Address already in use while executing "dp_connect -udp $iopUdpPort" invoked from within "set addressList [dp_connect -udp $iopUdpPort]..." (procedure "setupUdpPort" line 2) invoked from within "setupUdpPort $packeteerPort" invoked from within "set packeteerSocket [setupUdpPort $packeteerPort]..." (procedure "setupPacketeer" line 5) invoked from within "setupPacketeer $arrayList $port $frequency" invoked from within "if {$port > 0} { # not a request to reconnect set frequency 9 setupPacketeer $arrayList $port $frequency }" (procedure "startServer" line 87) invoked from within "startServer -backup -relay [cameraType] -listen 2" invoked from within "if {![info exists packeteerPort] && $dt > 0} { startServer -backup -relay [cameraType] -listen 2 set msg [getPortOwner [relayPort [cameraType] 1] ..." invoked from within "if {$drop || $stop_handlers} { if 1 { requestListen -[cameraType] 1; # tell server we're quitting } if [info exists packeteerPort ..." (procedure "grabInstruments" line 70) invoked from within "grabInstruments -handlers 80 -reconnect" ("eval" body line 1) invoked from within "eval $procname $args" grabInstruments is scheduled, further errors sent to murmur DATA LOGS FROM IOP/SOP: =======================