Subject: 2.5m obslog 20090922 (MJD 55097) Date: Wed, 23 Sep 2009 13:06:01 +0000 (UTC) From: alaina@apo.nmsu.edu APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday September 22, 2009 (MJD 55097) ---=== OBSERVING TEAM ===--- Dan Oravetz Alaina Shelden Paul Harding (CWRU) Connie Rockosi (phone) ---=== OBSERVING PLAN ===--- Science! Working on guider while doing BOSS science ---=== OBSERVING SUMMARY ===--- SP1B CCD has problems with holding a vacuum and staying cool. We tried filling it several times, and it stayed hovering at -58C. Connie instructed us on disconnecting the full system electronics, and changed voltage settings so that the CCD stays warm relative to the rest of the world. She said that the CCD will warm up to about 30C, and MUST NOT GO HIGHER. We continued with Cart 11 with 3 cameras instead of 4 for the rest of the night. Note: to get the guider vector plot, use the following guider on time=5 plot psPlot display=localhost:15.0 Imaged stripe 79S at the end of the night. lambda position ------------------------------ 177 start focus loop 178 RA=3.2 DEC=7.5 ----> makes sense after 2 scanStripes 179 start ramp, frame 30 -179 start science, frame 38 -169 ramp starts, frame 110 11:30Z -167 ramp stops, frame 122 11:39Z Cart 12 plate 3536 summary Exp type --------------------- 101898 flat 101899 arc 101900-901 science 101902 flat 101903 arc 101907-909 science 101910 flat 101911 arc 101912-913 science Cart 11 plate 3615 summary Exp type --------------------- 101919 flat 101920 arc 101921 arc 101922-924 science 101925 flat 101926 arc ---=== OBSERVING LOG ===--- Afternoon: ---------- 23:53Z Restarted servers. 23:53Z Disk space Filesystem Size Used Avail Use% Mounted on /dev/sda3 142G 123G 12G 92% / /dev/sda1 99M 30M 64M 33% /boot /dev/sdb1 917G 805G 67G 93% /data hub25mp:/home 92G 52G 41G 56% /home_hub25m sdssfiles1p:/data1/data 1.8T 62G 1.8T 4% /files 00:01Z Storm coming in from the North, will try to get on sky asap. 00:10Z Afternoon checkout had no problems. 00:38Z Start Hartmanns, exp 101892-894 sp1 sp2 ------------------------------ temp 11.4 10.6 b -4.8 57.3 r -85 -14582 pre motorPosition=-10536,-10948,-10948,33685,32886,33420 post motorPosition=-10536,-10948,-10948,19103,18306,18838 00:50Z Started ventilating 01:09Z Closed doors to rerun collimate--lights were on in dome. 01:09Z Start Hartmanns, exp 101895-897 sp1 sp2 ------------------------------ temp 11.3 10.4 b -6.3 8.9 r 400 -3059 pre motorPosition=-10536,-10948,-10948,19103,18306,18838 post motorPosition=-10536,-10948,-10948,16044,15248,15780 Night: ------ 01:08Z Sunset 01:35Z Opened enclosure 01:42Z Serious boss.SP1ExecBoot Reported by camCheck Waiting to see if the noack will come up again, and then will iack. 01:42Z Slew to field, Cart 12 to begin guiding tests. 01:49Z boss iack 02:13Z All images taken will have command followed by exposures. APO.doravetz: sop doCalibs narc=1 nflat=1 101898, 101899 02:22Z Evening twilight (18 deg) 02:31Z APO.doravetz: boss exposure science itime=900 101900 02:48Z APO.doravetz: boss exposure science itime=900 101901 02:58Z For afternoon checkout--do gcamera status gcamera i cooler=-40.0,-10.1,4.3,6.5,0,1 First is the asked for temp, second is actual temp. They must match. Do guider setTemp temp=-40.0 03:06Z APO.doravetz: boss exposure science itime=900 101902 03:33Z Exposure 101902 disappeared, never showed up. Then it showed up as a flat. Found the following text in the log, but no command was ever sent. 03:26:09 APO.doravetz 94 boss i text="clearExposure -- Wipe the exposure state." 03:27Z Moonset 03:37Z Hartmann take:3 exp=101904-906 Keep getting Right door errors. 03:41:48 APO.doravetz.sop 129 boss w text="sp1mech failed with message: cr' 03:41:48 .boss 0 boss w RawLine="failed: { right Hartmann door timed out } sp1 sp2 ------------------------------ temp 5.0 5.0 b -4.8 -7.4 r -114 -1544 pre motorPosition=-10536,-10948,-10948,16044,15249,15780 post motorPosition=-10536,-10948,-10948,14500,13703,14235 03:51Z APO.doravetz: boss exposure science itime=900 04:09Z APO.doravetz: boss exposure science itime=900 04:26Z APO.doravetz: boss exposure science itime=900 04:45Z APO.doravetz: sop doCalibs narc=1 nflat=1 04:45Z Warn boss.SP2B2VPbB Reported by camCheck 04:49Z Critical boss.SP1B2CCDTemp Reported by camCheck Both appear in spec. 04:54Z APO.doravetz: boss exposure science itime=900 04:59Z Force filled SP1 from 10L dewar. 05:15Z APO.doravetz: boss exposure science itime=900 exp=101913 05:34:15 APO.doravetz: boss sp1cam raw=1 tcheck 2 tcheck 05:39:25 APO.doravetz: boss sp1cam raw=1 stopfillseq 05:39:32 APO.doravetz: boss sp1cam raw=1 startfillseq 05:47Z Fill didn't work sp1 CCD is still warming. So we had to fill from the telescope. 05:48Z Got this error: Critical boss.SP1MicroNotTalking Reported by camCheck We can't send the command to do cals from either boss or sop 05:46Z APO.doravetz 172 boss f text="command failed: ICCError('command CAMCHECK is active, cannot send new command 2112 LINES',) at /home/sdss3/products/Linux64/boss/v1_2_6/python/boss/Controllers/Forth.py:126" 06:06Z CCD temp is hovering around -58C, and won't go either down or up. 06:15Z Visual check shows sp1 blue dewar has alot more snow on it than the others. No liquid ever came out of the dewars. 06:19Z Called Connie, she said to do a vcheck, and we found the following descrepancy. boss sp1cam raw=1 vcheck SIGNAL DAC SET MEASURED NOM TOL READ boss i sp1camRawText="VS+ 102 4.03 V 0.10 V 716 5 517" 06:31Z Ion pump is flashing and fluctuating, isolation is frosty. Vacuum has major problems. 06:37Z Disconnected electronics on sp1 B fill system. 06:38Z To keep the CCD warm, use following from Connie boss sp1cam raw = setbluvddlo 06:47Z SP1 Blue is set to warm up, but not above 30C. It should NOT go higher. 06:48Z NOTE: We could not get calibs because of the CCD warming and sop hanging up. Cart 12 plate 3536 summary Exp type --------------------- 101898 flat 101899 arc 101900-901 science 101902 flat 101903 arc 101907-909 science 101910 flat 101911 arc 101912-913 science 07:01Z Cart 11 plate 3615 07:02Z Found stars on gotoField, going to go about our business without the SP1B camera. 07:24Z Had to reboot sop again. Still can't take cals. Took it with Boss. 07:33Z APO.doravetz 239 boss w text="failed to make exposure end cards: 'sp1mech'" 07:33Z APO.doravetz 239 boss w text="failed to make exposure end cards: 'sp2mech'" ** But still got readout. Said it was exposure 101914 but neither 914 now 915 ever showed up on disk. 07:37Z Got the following messages in the log. 07:37:05 .boss 18554 boss i shutterStatus=0x00,0x00 07:37:05 .boss 18554 boss i screenStatus=0x00,0x00 07:37:05 .boss 18554 boss i motorStatus=0x00,0x00,0x00,0x00,0x00,0x00 07:37:05 .boss 18554 boss i motorPosition=-1,-1,-1,-1,-1,-1 07:37:05 .boss 18554 boss i specMechVersion=Offline,Offline 07:51Z Went outside to reset the daq on the telescope. 08:14Z To make boss start talking to hub again, did the following Called Kyle. ssh boss@boss-icc setup boss stageManager boss stopdead status stageManager boss start status STUI hub startNubs boss 08:25Z Had to logout the telnet ports, 1-4 08:38Z Took some biases, which had no problems. (yay!) 08:39Z Took cals, flattime=4 arctime=30 08:57Z boss exposure science itime=900 09:15Z boss exposure science itime=900 09:35Z boss exposure science itime=900 10:00Z Cals Cart 11 plate 3615 summary Exp type --------------------- 101919 flat 101920 arc 101921 arc 101922-924 science 101925 flat 101926 arc 10:25Z Mouted the imager. Going to do 79S stripe. Note: new cone cover blocks imager cart, so we put the old one on just for this. 10:28Z tcc timeout on scanStripe 10:31Z tcc timeout on scanStripe from a different window. 10:42Z Focus is good from frame 23. Run 8049 lambda position ------------------------------ 177 start focus loop 178 RA=3.2 DEC=7.5 ----> makes sense after 2 scanStripes 179 start ramp, frame 30 -179 start science, frame 38 -169 ramp starts, frame 110 11:30Z -167 ramp stops, frame 122 11:39Z From frame 123, uber cal stuff. Photometric during entire run. Median seeing on ave ~1.5", collimate, 101893L % Compiled module: COLLIMATE. Reading /data/spectro/55097/sdR-b1-00101893.fit SDSSPROC: Read noise = 1.67195 1.75453 1.74794 1.80582 electrons Reading /data/spectro/55097/sdR-b1-00101894.fit SDSSPROC: Read noise = 1.67452 1.75392 1.72344 1.81949 electrons COLLIMATE: Min offset = -0.20 pix COLLIMATE: Max offset = 0.40 pix COLLIMATE: RMS across CCD = 0.22 pix COLLIMATE: Mean offset = 0.22 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -4.8 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b1-00101893.log PostScript file = Collimate-55097-b1-00101893.ps Reading /data/spectro/55097/sdR-b2-00101893.fit SDSSPROC: Read noise = 1.76694 1.96131 2.04145 2.00991 electrons Reading /data/spectro/55097/sdR-b2-00101894.fit SDSSPROC: Read noise = 1.75761 1.93231 2.01419 1.98418 electrons COLLIMATE: Min offset = -3.00 pix COLLIMATE: Max offset = -2.20 pix COLLIMATE: RMS across CCD = 0.25 pix COLLIMATE: Mean offset = -2.57 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 57.3 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b2-00101893.log PostScript file = Collimate-55097-b2-00101893.ps Reading /data/spectro/55097/sdR-r1-00101893.fit SDSSPROC: Read noise = 2.18157 2.31842 2.26782 9.12922 electrons Reading /data/spectro/55097/sdR-r1-00101894.fit SDSSPROC: Read noise = 2.11419 2.33569 2.14125 9.03710 electrons COLLIMATE: Min offset = -0.40 pix COLLIMATE: Max offset = 0.60 pix COLLIMATE: RMS across CCD = 0.24 pix COLLIMATE: Mean offset = -0.01 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| 0.15 pix) COLLIMATE: Predict (red) piston movement of -14582 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -14582" Log file = Collimate-55097-r2-00101893.log PostScript file = Collimate-55097-r2-00101893.ps % Program caused arithmetic error: Floating illegal operand COLLIMATE Try 2 01:09Z temp=11.3, 10.4 IDL> collimate, 101896L Reading /data/spectro/55097/sdR-b1-00101896.fit SDSSPROC: Read noise = 1.69814 1.75114 1.72521 1.77017 electrons Reading /data/spectro/55097/sdR-b1-00101897.fit SDSSPROC: Read noise = 1.70701 1.74667 1.71795 1.77225 electrons COLLIMATE: Min offset = -0.20 pix COLLIMATE: Max offset = 0.60 pix COLLIMATE: RMS across CCD = 0.28 pix COLLIMATE: Mean offset = 0.28 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -6.3 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b1-00101896.log PostScript file = Collimate-55097-b1-00101896.ps Reading /data/spectro/55097/sdR-b2-00101896.fit SDSSPROC: Read noise = 1.75013 1.96051 2.02353 2.01231 electrons Reading /data/spectro/55097/sdR-b2-00101897.fit SDSSPROC: Read noise = 1.74288 1.88682 2.02090 2.00416 electrons COLLIMATE: Min offset = -1.60 pix COLLIMATE: Max offset = 0.00 pix COLLIMATE: RMS across CCD = 0.50 pix COLLIMATE: Mean offset = -0.40 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of 8.9 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b2-00101896.log PostScript file = Collimate-55097-b2-00101896.ps Reading /data/spectro/55097/sdR-r1-00101896.fit SDSSPROC: Read noise = 2.18081 2.30324 2.19020 9.29646 electrons Reading /data/spectro/55097/sdR-r1-00101897.fit SDSSPROC: Read noise = 2.20098 2.29947 2.22565 9.33988 electrons COLLIMATE: Min offset = -0.20 pix COLLIMATE: Max offset = 0.80 pix COLLIMATE: RMS across CCD = 0.29 pix COLLIMATE: Mean offset = 0.07 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| 0.15 pix) COLLIMATE: Predict (red) piston movement of -3059 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -3059" Log file = Collimate-55097-r2-00101896.log PostScript file = Collimate-55097-r2-00101896.ps % Program caused arithmetic error: Floating illegal operand COLLIMATE Try 3 03:37Z temp=5.0, 5.0 IDL> collimate, 101905L Reading /data/spectro/55097/sdR-b1-00101905.fit SDSSPROC: Read noise = 1.74565 1.75807 1.71765 1.91929 electrons Reading /data/spectro/55097/sdR-b1-00101906.fit SDSSPROC: Read noise = 1.76206 1.76764 1.73738 1.94192 electrons COLLIMATE: Min offset = -0.20 pix COLLIMATE: Max offset = 0.40 pix COLLIMATE: RMS across CCD = 0.22 pix COLLIMATE: Mean offset = 0.22 pix COLLIMATE: Camera b1 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -4.8 degrees for spectro-1 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b1-00101905.log PostScript file = Collimate-55097-b1-00101905.ps Reading /data/spectro/55097/sdR-b2-00101905.fit SDSSPROC: Read noise = 1.65172 1.94775 2.02127 2.04203 electrons Reading /data/spectro/55097/sdR-b2-00101906.fit SDSSPROC: Read noise = 1.65184 1.89895 2.06060 2.04646 electrons COLLIMATE: Min offset = -0.40 pix COLLIMATE: Max offset = 0.60 pix COLLIMATE: RMS across CCD = 0.29 pix COLLIMATE: Mean offset = 0.33 pix COLLIMATE: Camera b2 appears to be OUT-OF-FOCUS (|mean| > 0.15 pix) COLLIMATE: Predict blue camera ring movement of -7.4 degrees for spectro-2 COLLIMATE: (if red is already in focus) Log file = Collimate-55097-b2-00101905.log PostScript file = Collimate-55097-b2-00101905.ps Reading /data/spectro/55097/sdR-r1-00101905.fit SDSSPROC: Read noise = 1.89765 2.01872 2.05368 6.47863 electrons Reading /data/spectro/55097/sdR-r1-00101906.fit SDSSPROC: Read noise = 1.96044 1.99475 2.01116 6.49522 electrons COLLIMATE: Min offset = -0.40 pix COLLIMATE: Max offset = 0.80 pix COLLIMATE: RMS across CCD = 0.30 pix COLLIMATE: Mean offset = -0.02 pix COLLIMATE: Camera r1 appears to be IN-FOCUS (|mean| 0.15 pix) COLLIMATE: Predict (red) piston movement of -1544 steps for spectro-2 COLLIMATE: Issue SOP command: "sp2; mechPiston -1544" Log file = Collimate-55097-r2-00101905.log PostScript file = Collimate-55097-r2-00101905.ps % Program caused arithmetic error: Floating illegal operand