Subject: 2.5m obslog 20120827 (MJD 56167) From: doravetz@apo.nmsu.edu Date: Tue, 28 Aug 2012 11:48:25 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday August 27, 2012 (MJD 56167) ---- Observing Team ---- Moses Marchante Howard Brewington Dan Oravetz Joe Huehnerhoff (support) Dan Long (support) ---- Observing Plan ---- 27 Aug 2012 56167.0 0.77 03:00 11:10 18:23 02:35 APOGEE until 09:35 (7.1 h), then BOSS (1.6 h) ---- Observing Summary ---- Most of the night was lost to high humidity and some clouds with associated radar returns. We were able to observe the first APOGEE field of the night, Cart. 8, 5817, BAADEWIN_001-04_A, but there were no guide stars in 5 of the fibers and the seeing was poor (2.1-3.8" FWHM). We had a few instances of altitude aborts during afternoon checkout and one azimuth abort during the first plate of the night. Some detail in Log body. Four of the FF petals will not close. Details in Log. We lost about 1.5 hours at the end of the night to this problem. ---- Observing Log ---- Afternoon: ---------- 20:30Z Started the afternoon checkout. Checked email and changeNotes Checked 180-L dewars weight Cleaned APOGEE gang connector with air. Did 3-read dark Did APOGEE evening cals Checked the images Checked status of rain sensor Recorded the software versions Recorded and checked mirror numbers Did 'platedb showActive' All BOSS/APOGEE carts are ready Tested the actors Check calib lamps Guider/gcamera tests: a) gcamera status (simulate=off; temp=-40) b) gcamera dark time=20 c) guider flat d) guider status Spectro tests and focus a) guider loadCartridge b) boss exposure bias itime=0 c) boss exposure dark itime=20 d) sop hartmann 146487 Predict blue camera ring movement of -6.5 degrees for spectro-1 Predict blue camera ring movement of 4.5 degrees for spectro-2 Predict (red) piston movement of 42 steps for spectro-1 Predict (red) piston movement of 170 steps for spectro-2 MCP instr 16 (mounted); Guider cart= 16, pl= 6164, side= A (loaded); motorPosition sp1: 25830, 26130, 26044; sp2: 38182, 38229, 38807; Median spectrographs temperatures: Tsp1= 16.3, Tsp2= 15.6; Outside air temperature= 20.2; Boss CCD Temp : sp1r0= -124.6 (-126.6); sp1b2= -99.6 (-100.0); sp2r0= -134.0 (-134.8); sp2b2= -100.8 (-100.0); sp1LN2: 10.0; sp2LN2: 10.0; e) sop doCalibs f) checked xMid and waveMid values g) declared calibs as test h) 19 bias exposures00:36Z i) one 900-sec dark Checked that carts were in bay correctly; All BOSS/MARVELS carts are ready 00:37Z Opened doors/louvers; turned on fans Mounted first cart of the night hub25m> df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 95G 17G 74G 19% / /dev/sda4 793G 249G 503G 34% /home /dev/sda1 99M 31M 63M 33% /boot tmpfs 5.9G 0 5.9G 0% /dev/shm sdssfiles1-p://data1/data/MARVELS 1.8T 363G 1.5T 20% /MARVELS /dev/drbd1 13T 12T 842G 94% /data During afternoon checkout, while slewing ALT from 30 to 90 deg, axis aborted at 45 deg, checked for slips found none, check top bottom balance it was good, could move ALT axis with MCP, tried again with TCC and worked fine. Joe was informed. Night ===== 01:46Z - Opened to mostly clear skies. Force-filled spectrographs from 180L LN2 dewars. Started DIMM. Checked telescope balance and fiducials. 02:04Z - Darks. 02:04:41 apogee.expose=apRaw-06050009, 10, A, Dark 02:06:28 apogee.expose=apRaw-06050010, 10, A, Dark Cart. 8, 5817, BAADEWIN_001-04_A ******************************** 02:11Z - GSOGTF. Variable seeing 2.1-3.8" FWHM. 27 deg. Alt. No guide stars in fibers 2, 4, 6, 10, 16. 02:20Z - Science. 2XABBA @ 500s. 02:20:39 apogee.expose=apRaw-06050011, 47, A, Object 02:29:02 apogee.expose=apRaw-06050012, 47, B, Object 02:37:23 apogee.expose=apRaw-06050013, 47, B, Object 02:45:51 apogee.expose=apRaw-06050014, 47, A, Object 02:54:18 apogee.expose=apRaw-06050015, 47, A, Object 03:02:41 apogee.expose=apRaw-06050016, 47, B, Object 03:11:02 apogee.expose=apRaw-06050017, 47, B, Object 03:19:30 apogee.expose=apRaw-06050018, 47, A, Object 03:26Z - SOP gangChange failed because half of the FF petals did not close for the dome flat. The upper four petals remained open, but the bottom four petals did close properly. We tried to manually cycle the petals through the MCP, but we still weren't able to get the upper four petals to close. After a minute or two, all petals closed and the dome flat was taken as expected. There must have been a gangChange command still in queue which explains why the dome flat was taken seemingly on its own, but we don't understand why half of the FF petals having been previously uncooperative all of a sudden worked properly. 03:27:05 APO.marchante.sop 868 guider w text="FF petals aren't all open; aborting guiding" 03:27:08 APO.marchante.sop 886 mcp f command="ffs_move" 03:27:08 CmdDone: APO.marchante.sop 886 mcp ffs.close 03:27:08 APO.marchante 148 sop w text="Failed to close flat field screen" 03:27:08 APO.marchante 148 sop f text="Failed to take cals going before gang change" 03:27:08 CmdDone: APO.marchante 148 sop gotoGangChange alt=45.0 We initiated a slew to 121,30,00 because we were closing for approaching clouds/radar, and the azimuth axis aborted at 75 degrees. 03:28Z - Dome flat. 03:28:50 apogee.expose=apRaw-06050019, 5, A, DomeFlat 03:32:02 apogee.expose=apRaw-06050020, 5, A, DomeFlat 09:35Z - Darks. 09:35:55 apogee.expose=apRaw-06050021, 10, A, Dark 09:37:42 apogee.expose=apRaw-06050022, 10, A, Dark 05:29Z - Stopped ventilation. Humidity too high. 09:25Z - Humidity decreasing. Started ventilation. Mounted cart. 17, 6205. 09:51Z - Opened to clear skies. Cart. 17, 6205 ************** 09:56Z - gotoField failed. 9:54:04 .mcp 0 mcp w rotBadFiducial=-6,76.98 09:54:05 APO.marchante.sop 897 mcp f command="ffs_move" 09:54:05 CmdDone: APO.marchante.sop 897 mcp ffs.close 09:54:05 APO.marchante 165 sop w text="Failed to close flat field screen" 09:54:27 .mcp 0 mcp w rotBadFiducial=-6,122.08 09:54:55 APO.marchante 165 sop w text="in slew with halted=False slewing=False" 09:54:55 APO.marchante 165 sop f text="Failed to close screens, warm up lamps, and slew to field" 09:54:55 CmdDone: APO.marchante 165 sop gotoField arcTime=4.0 flatTime=30.0 guiderFlatTime=0.5 guiderExpTime=5.0 The upper four FF petals would not close. We tried manually cycling the petals with the manual override pendant, but they still would not open. When we manually pulled one of the troublesome petals partly closed and tried to open it, it would open normally. The two motors that control the four upper FF petals were not turning on at all when we tried to close the petals, which suggested a problem with the motors receiving a "close" signal from the controller. We checked all of the limit switches and verified they were OK, although the closed status switch at 11 o'clock when viewing the telescope from the front was loose and needs some attention. We tried swapping one of the Burndy connectors from a properly actuating set of FF petals with a connector associated with a malfunctioning set of FF petals (the two middle cables in the FF junction box) and the problem did not transfer with the cable, but stayed with the port. In other words, swapping the cables resulted in what was the troublesome set of FF petals working properly, and the previously cooperative set of FF petals now no longer closed. We tried swapping fuses associated with these ports, but that had no effect. We called Joe and he came to site to inspect. We also called Dan L. and he suggested using contact cleaner on the connectors. Joe tried cleaning and re-seating connectors, but that didn't solve the problem. They will investigate beginning with the FF junction box today. 10:57Z - Closed because of hardware problem. 11:39Z - Started APOGEE morning cals. ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Inst Az Alt Rot objArcOff guideRot calibOff -------------------------------------------------------------------------------- 02:19 8-5817A 5.2 27.0 185.0 ( -4.8, -0.4) ( 37.1) ( 5.7, 8.8, 0.0) apog 02:27 8-5817A 3.2 27.1 183.0 ( -4.7, 0.3) ( 32.4) ( 5.7, 8.8, 0.0) apog 02:36 8-5817A 1.2 27.2 181.0 ( -4.6, 0.2) ( 24.1) ( 5.7, 8.8, 0.0) apog 02:44 8-5817A -0.9 27.2 179.0 ( -4.7, 0.2) ( 20.9) ( 5.7, 8.8, 0.0) apog 02:53 8-5817A -3.0 27.1 177.0 ( -4.2, 0.4) ( 8.1) ( 5.7, 8.8, 0.0) apog 03:01 8-5817A -5.0 27.0 175.1 ( -3.9, 0.9) ( 9.2) ( 5.7, 8.8, 0.0) apog 03:09 8-5817A -7.0 26.8 173.1 ( -4.5, 0.7) ( 8.4) ( 5.7, 8.8, 0.0) apog 03:18 8-5817A -9.0 26.6 171.1 ( -4.8, 0.6) ( -6.5) ( 5.7, 8.8, 0.0) apog ---- Focus Log ---- --- Focus --- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 02:19 8-5817A 1.000290 -2863 -745 355 5.2 27.0 14.8 21 73 2.1 apog 02:27 8-5817A 1.000300 -2959 -785 394 3.2 27.1 14.7 14 80 2.2 apog 02:36 8-5817A 1.000300 -2959 -781 398 1.2 27.2 14.5 24 75 2.4 apog 02:44 8-5817A 1.000300 -2959 -768 411 -0.9 27.2 14.7 22 77 2.7 apog 02:53 8-5817A 1.000300 -2959 -764 415 -3.0 27.1 14.6 24 73 3.0 apog 03:01 8-5817A 1.000300 -2959 -801 377 -5.0 27.0 14.5 20 78 3.2 apog 03:09 8-5817A 1.000300 -2959 -758 420 -7.0 26.8 14.5 23 75 3.3 apog 03:18 8-5817A 1.000300 -2959 -745 431 -9.0 26.6 14.4 28 73 3.8 apog ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 02:19 8-5817A 14.8 5.5 9.3 53 21 73 1581 6.9 1455.0 2.1 apog 02:27 8-5817A 14.7 5.4 9.3 54 14 80 1555 7.0 1458.0 2.2 apog 02:36 8-5817A 14.5 5.5 9.0 54 24 75 1542 7.9 1457.0 2.4 apog 02:44 8-5817A 14.7 5.7 9.0 54 22 77 2017 10.2 1469.0 2.7 apog 02:53 8-5817A 14.6 6.3 8.3 57 24 73 1764 10.8 1467.0 3.0 apog 03:01 8-5817A 14.5 6.6 7.9 59 20 78 1921 10.2 1473.0 3.2 apog 03:09 8-5817A 14.5 6.9 7.6 60 23 75 1925 14.8 1478.0 3.3 apog 03:18 8-5817A 14.4 7.0 7.4 60 28 73 2045 17.7 1483.0 3.8 apog ---- Telescope Status ---- Top four FF petals are not closed all the way. The manual override pendant is still plugged in. Status at: 11:43Z Telescope stowed at: 121,30,00 mount Instrument mounted: Cartridge 17 Counterweights at: 285 units LN2 autofill systems: Connected and turned on. 180L LN2 dewar scales: Sp_01 149.80 lbs, 19.12 psi Sp_02 136.60 lbs, 20.14 psi ---- Software Used ---- getVersions, 2012-08-28 00:42:00 ----STUI software: STUI: 1.1.2b5 2012-06-19; alerts: v1_2_0; apo: v1_7; boss: v2_5_6; boss.daq: 1.3.2; boss.specMech: 3.0.1; gcamera: v1_2_9; guider: v1_3_22; hub: Tag: sdss3_v1_2_0; mcp: v6_6_15; mcp.plc: 28; mcp.azFiducialVersion: v1_106; mcp.altFiducialVersion: v1_106; mcp.rotFiducialVersion: v1_106; platedb: v1_0_5; sop: v1_2_13; sos: v1_2_0; sos.idlspec2d: v5_5_9; tcc: 2.14.0; apogee: ** FAILED ** apogeecal: ** FAILED ** apogeeql: v1_4_1 -----Other software sdssProcedure(sdss3): v3_06; ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 5.36 5.357 Axial B: 5.213 5.221 Axial C: 5.513 5.516 Trans D: 10.369 10.374 Lateral E: 10.6299 10.6299 Lateral F: 12.2555 12.2428 GALILS Commanded: 11300 -650 5500 21900 13500 13050 Actual: 11300 -650 5500 21900 13500 13050 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 612.35 1500.90 PrimOrient: 0.00 0.00 0.00 612.07 1500.38 SECONDARY: ---------- Focus: 0.00 Air temp: 18.4 Altitude: 30.3 MIGS TONIGHT NOMINAL Axial A: 7.04 7.041 Axial B: 7.054 7.059 Axial C: 7.037 7.041 Trans D: 0.331 0.33 GALILS Commanded: 1576550 1594600 1580000 -3550 -6650 Actual: 1576877 1594603 1580361 -3550 -6650 SETMIR VALUES SecDesOrient: 1257.00 3.00 5.00 0.00 115.81 SecOrient: 1257.16 2.92 4.92 -0.22 116.19