Date: Wed, 7 May 2003 11:44:15 GMT From: jurek@apo.nmsu.edu (Jurek Krzesinski) Subject: 2.5m obslog 20030506 (MJD 52766) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday May 6, 2003 (MJD 52766) ---=== OBSERVING TEAM ===--- Swing: Pete Newman Night: Howard Brewington, Jurek Krzesinski ---=== OBSERVING PLAN ===--- Science. ---=== OBSERVING SUMMARY ===--- First part of the night lost due to clouds, but at the morning the weather has improved and we've done one plate: cart 9 plt 1331 Then partialy done: cart 8 plt 1337 At the beginning of the night tcc computer has rebooted - spontaneuosly. That probably caused some of our troubles during the night (goStare failed on first exposure - see the log). ---=== OBSERVING LOG ===--- Swing shift notes ----------------- The MCP was rebooted during the day following problems controling the counterweights. The positions were adjusted slightly during preflight checks without further incident. I had a minor problem ending the preflight doghouse bias drift. See problem section 1 for details. Spectrograph focus was checked and adjusted at Ttruss=8.3 C. See section at end of this log for details. Night ------ 02:00Z tcc rebooted on us. After waiting 15 minutes, it was back on again. Craig is very unhappy unhappy about it - no wonder. Waiting for clouds to move away. 07:30Z Finally we opened, for a while it was photometric, but a satellite map was showing some small clouds coming. Since its early in the morning, we would not have enough imaging done before twilight, if were to wait for clouds to dissapear. So we decided for spectroscopy. 07:35Z Cart 9 plt 1331 mounted. fk5 star uset to find guide stars. As soon as we set up on the guide stars clouds moved over. goStare failed on precalib (sopGUI was used to issue the command) - we started another sop session and restarted everything since the beginning in it. Sanity checked with bias, then precalib went without any problems. We think it was connected to the tcc problem reboot at the beginning of the night. After tcc rebooted we didn't restart sop window but tried to recover by: sop> tccClose and sop> startDa -tcc But maybe in this case it didn't do a proper job after all. Trace back is not available for that event (see the problem section for more info, and for a time stamp). We lost approximately 15 minutes to that problem. Plate done with 3 exposures. 09:04Z Cart 8 plt 1337 mounted, no guide stars, no fk5. Watcher shows: too large to correct error on alt axis. We slewed telescope to see how other axies are doing and if corrections are applied on other fiducials, but only alt axis caused a trouble: 2003-05-07 09:10:56Z sdssmcp tLatch dsc_I_trcInfo Applying correction -3709 to altitude 2003-05-07 09:10:56Z sdssmcp tLatch dsc_E_trcErr correction for altitude -3709 is too large 2003-05-07 09:10:56Z sdssmcp tLatch dsc_I_trcInfo Not disabling MS.ON; error -3709 (max allowed: 600) 2003-05-07 09:10:56Z sdssmcp tLatch dsc_I_trcInfo rotator MS.ON 2003-05-07 09:11:13Z sdssmcp tLatch dsc_I_trcInfo alt fiducial 75.16 deg so we forced fiducials on alt axis, which solved the problem. Now we got stars on slew, but clouds got more dense, and we lost first half an hour exposure. Finaly we got two exposures during variable cloud conditions. Smear not done (too bright + clouds). It happened, that these two exposures got a minimum S/N= 13.6, but since we don't have the third exposure, we didn't decalared plate done. We moved telescope to the stow position before we noticed that postcalib is necessary. 11:14Z Closing. endNight finished ok. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 3934 23:16Z 23:37Z 100 O -77.24 -72.15 40 ignore ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n): yes QA Procedures Done (y/n): yes UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 20862, plate -9999 ------- 23:10 20862 0.0 bias ----- sequence 20863, plate 1340 ------- 23:33 20863 2.1 arc Ignore - focus checks 23:35 20864 2.1 arc Ignore - focus checks 23:53 20865 2.1 arc Ignore - focus checks 23:55 20866 2.1 arc Ignore - focus checks 00:05 20867 2.1 arc Ignore - focus checks 00:07 20868 2.1 arc Ignore - focus checks 00:23 20869 2.1 arc Ignore - focus checks 00:26 20870 2.1 arc Ignore - focus checks ----- sequence 20871, plate 1331 ------- 07:04 20871 0.0 bias ----- sequence 20872, plate -9999 ------- 07:56 20872 0.0 bias ----- sequence 20873, plate 1331 ------- 08:02 20873 10.0 flat 08:05 20874 2.0 arc ----- sequence 20873, plate 1331 ------- 08:24 20875 900.1 target 08:37 20876 600.1 target 08:50 20877 600.1 target 08:58 20878 240.0 smear ----- sequence 20879, plate 1337 ------- 09:18 20879 10.0 flat 09:21 20880 2.0 arc 09:57 20881 1800.1 target not enoug S/N 10:29 20882 1800.1 target 10:58 20883 1500.1 target ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 10:56Z 8 1337 249.42 0.0000 58.71 0.0000 91.97 0.0000 1.000050 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL 6389 Stays: JL 6390 ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 10:56Z 8 1337 1.00005 -493 497 -250 249 58.7 8.2 20 233 gdr 2.2 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 22:53Z 51 14 18 242 (WSW) 869 - 23:25Z 52 14 21 264 (W) 1063 - 23:57Z 51 12 25 243 (WSW) 952 - 00:29Z 51 11 22 257 (WSW) 907 - 02:24Z 49 7 20 287 (WNW) 1086 - 02:54Z 49 6 13 267 (W) 1128 - 03:25Z 49 6 10 269 (W) 1143 - 03:56Z 49 7 14 290 (WNW) 1135 - 04:28Z 50 7 10 284 (WNW) 1007 - 04:59Z 49 8 7 274 (W) 1118 - 05:30Z 50 8 9 266 (W) 1009 - 06:01Z 50 8 12 263 (W) 919 - 06:32Z 49 8 11 249 (WSW) 975 - 07:02Z 49 8 11 252 (WSW) 984 - 07:34Z 49 8 12 250 (WSW) 990 - 08:04Z 48 8 13 237 (WSW) 1010 - 08:37Z 48 7 11 263 (W) 1015 - 09:07Z 48 8 13 257 (WSW) 943 - 09:37Z 48 8 12 251 (WSW) 901 - 10:10Z 47 8 14 247 (WSW) 1040 - 10:42Z 47 8 20 234 (SW) 957 - 11:14Z 45 9 13 241 (WSW) 982 - ---=== TELESCOPE STATUS ===--- 01:45Z Telescope ready to go, fans on, doors open. 07:30Z Telescope opend - dewars not refilled. 11:25Z Telescope closed, hoses hooked up. ---=== SOFTWARE USED ===--- IOP/SOP: v3_113_1 Watcher: v2_22_0 MCP: v5_18_0 TPM: tpm_v2_28_0 AstroDa: v14_47 TCC: TCC 2.6.8 November 13 2002 sdssProcedures: v1_68 SoS: v4_9_13 hoggPT: v1_6_8 plate-mapper: v4_2_0 ---=== MIRROR NUMBERS ===--- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.0980 0.0790 Axial B 0.7970 0.7970 Axial C 0.8190 0.8240 Trans D -9.0710 -9.1130 Lateral E 1.8420 1.8870 Lateral F 0.0000 1.4300 GALILS Commanded: 5400. -3700. 900. -200. 31550. 30650. Actual: 5377. -3699. 923. -208. 31535. 30647. SETMIR VALUES PriDesOrient: 0.00 -11.80 23.00 1256.90 642.10 PriOrient: 0.00 -12.16 22.81 1257.41 642.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 10.9 Alt.: 30.014771 MIGS TONIGHT NOMINAL Axial A 1.5180 1.5170 Axial B 1.1560 1.1560 Axial C 1.0910 1.0990 Trans D -0.6940 -0.7070 GALILS Commanded: 1619724. 1555252. 1576310. -3400. -7900. Actual: 1619650. 1555250. 1576350. -3400. -7900. SETMIR VALUES SecDesOrient: 1257.00 0.00 -20.00 0.00 130.98 SecOrient: 1257.01 0.01 -20.04 -0.50 130.87 ---=== PROBLEMS IN DETAIL ===--- Problem 1 - Error message from endDrift --------------------------------------- An error message was issued by endDrift when stopping the preflight check doghouse bias drift on the imager. Here are the full set of commands. im> goDrift -bias 2003-05-06 23:16:22Z: No heartbeat found from ad1 in last 500 of murmur log 2003-05-06 23:16:22Z: 2003-05-06 23:16:22Z: Murmur not working for all ad1 node - Losing information!! 2003-05-06 23:16:22Z: No heartbeat found from ad2 in last 500 of murmur log 2003-05-06 23:16:22Z: 2003-05-06 23:16:22Z: Murmur not working for all ad2 node - Losing information!! 2003-05-06 23:16:22Z: No heartbeat found from ad3 in last 500 of murmur log 2003-05-06 23:16:22Z: 2003-05-06 23:16:22Z: Murmur not working for all ad3 node - Losing information!! 2003-05-06 23:16:22Z: No heartbeat found from ad4 in last 500 of murmur log 2003-05-06 23:16:22Z: 2003-05-06 23:16:22Z: Murmur not working for all ad4 node - Losing information!! 2003-05-06 23:16:48Z: Beginning data taking leap seconds = 32 0 im> startDa -scd im> endDrift 2003-05-06 23:31:50Z: Error stopping focus loop: couldn't open "/astrolog/52766/focus-52766.par": Permission denied 2003-05-06 23:31:53Z: stopping drift with: iccExec id1 id2 id3 id4 id5 id6 ad1 ad2 ad3 ad4 readoutEnd prn:sdsshost:~/ > ls -l /astrolog/52766/focus-52766.par -rw-r--r-- 1 observer dss 789 May 6 16:53 /astrolog/52766/focus-52766.par prn:sdsshost:~/ > date Tue May 6 17:33:00 MDT 2003 Note that the file does not have group write permission. I don't know where this gets created, but sdsshost was rebooted shortly before the time-stamp on the file, and the only "observer" users appear to be the instrument servers. They are all showing umask=2, which should give the correct permissions. I changed the permissions by logging in as root and issuing chmod g+w /astrolog/52766/focus-52766.par This _may_ be due to a problem I had with the initial "initNight -tapeLoad" that I used ctrl-C to abort, then follwed by an "initNight -tapeRelabel" after I actually inserted the last two tapes. The question of why the focus loop was involved with a bias drift is a different matter. ---=== SPECTROGRAPHS' FOCUS AND COLLIMATION ===--- Check and adjustment made starting with Ttruss=8.3 C. Collimator motor positions before adjustment: sp1> Coll_motor_A -2848 Coll_motor_B -2832 Coll_motor_C -2848 sp2> Coll_motor_A 6317 Coll_motor_B 6321 Coll_motor_C 6315 sp1> goSpecFocus IDL> collimate,20863 COLLIMATE: Mean offset = -0.06 pix COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| 0.15 pix) COLLIMATE: Predict (red) piston movement of 2254 steps for spectro-1 COLLIMATE: Issue SOP command: "sp1; mechPiston 2254" COLLIMATE: Mean offset = 0.07 pix COLLIMATE: Camera r2 appears to be IN-FOCUS (|mean| sp1; mechPiston 2254 sp1> sp2; mechPiston -618 sp2> sp1 sp1> goSpecFocus IDL> collimate,20865 COLLIMATE: Mean offset = -0.18 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 6.6 degrees for spectro-1 COLLIMATE: Mean offset = -0.07 pix COLLIMATE: Camera b2 appears to be IN-FOCUS (|mean| sp1; mechPiston 913 sp1> goSpecFocus IDL> collimate,20867 COLLIMATE: Mean offset = -0.25 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 8.8 degrees for spectro-1 COLLIMATE: Mean offset = -0.06 pix COLLIMATE: Camera b2 appears to be IN-FOCUS (|mean| goSpecFocus IDL> collimate,20869 COLLIMATE: Mean offset = -0.06 pix COLLIMATE: Camera b1 appears to be IN-FOCUS (|mean| Coll_motor_A 319 Coll_motor_B 335 Coll_motor_C 320 sp2> Coll_motor_A 5697 Coll_motor_B 5705 Coll_motor_C 5698 and at the end, Ttruss = 8.2 C. goStare problem --------------- sp1> SOPGUI: preCalibs 1 1 mcpPut: SYSTEM.STATUS mcpPut: SYSTEM.STATUS Closing Flat Field Screen 4 FF lamps are on Saved 19 seconds Image Size is 768 by 512 (should be 768 x 512) Background: 115.000000 726.24849500000005 611.248495 Fiber 1 row diff: 0.650 col diff: -0.810 {mean 2267} {meanErr -1} {pixels 2451} {retVal 0} [...] Fiber 11 row diff: 0.530 col diff: -0.070 {mean 2646} {meanErr -1} {pixels 6663} {retVal 0} Flat Field Median 444.400000 Starting Flat field 0 (press cntrl-C to abort) goStare was not successful, trying again [...] goStare was not successful, trying again Could not do goStare in 5 attempts Finished with Flat field 0 Finished with Flat Field Closing Flat Field Screen 4 Ne and 4 HgCd lamps are on Starting Arc lamp exposure 0 (press cntrl-C to abort) goStare was not successful, trying again [...] goStare was not successful, trying again Could not do goStare in 5 attempts Finished with Arc Lamp exposure 0 Finished With Arc Lamps Opened Flat Field Screen Exiting successfully This calibration took 92.122 seconds IOP running as Backup Relay Server requestListen: listening 2003-05-07 07:47:25Z 9 sp1 camcheck 2003-05-07 07:47:25Z 9 sp1 SHOWREADVOLTS 2003-05-07 07:47:26Z 9 sp2 camcheck 2003-05-07 07:47:26Z 9 sp2 SHOWREADVOLTS sp1: list element in quotes followed by ":" instead of space sp2: list element in quotes followed by ":" instead of space invoked from within "camHandler" invoked from within "if {([exposureRemaining -quiet] == 0 && [statusGet daqBusy] ==0)} { # echo "Idle camHandler" camHandler return }" (procedure "camHandler_maybe" line 12) invoked from within "camHandler_maybe 60" ("eval" body line 1) invoked from within "eval $procname $args" camHandler_maybe is scheduled, further errors sent to murmur 2003-05-07 07:47:27Z: registered (addr6) listener sdsshost:observer:2229