Subject: 2.5m obslog 20121206 (MJD 56268) From: doravetz@apo.nmsu.edu Date: Fri, 7 Dec 2012 12:14:43 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday December 06, 2012 (MJD 56268) ---- Observing Team ---- Moses Marchante Dan Oravetz ---- Observing Plan ---- BOSS all night: 6 Dec 2012 56268.0 0.46 01:10 12:40 23:11 10:44 BOSS 11.5 hours ---- Observing Summary ---- Lost the last two hours to clouds. Partly cloudy conditions for most of the time we were open. Observed the following BOSS fields: Cart. 10, 6177 - DONE Cart. 13, 6172 - Yellow b2 XSIGMA value. Cart. 14, 6254 - DONE; Yellow b2 XSIGMA value. Cart. 15, 6376 Cart. 16, 5792 We experienced two separate cases in which the altitude brake engaged during an exposure. In both cases, a few attempts at `tcc axis init' cleared the brake. The cause of the altitude brake engaging is unknown. We lost ~15-20 minutes of time between aborted exposures (cannot slew back to the field when an exposure is in-progress; Ticket #1722 filed) and time spent clearing the altitude axis. See log body for details. See Problems section for errors regarding bad collimator motor status and failed movements during Hartmanns. Note that it appeared all moves executed properly as the warnings/failures were "ignored" in STUI. Still, it's worth mentioning the errors. ---- Observing Log ---- Afternoon ========= 22:23Z Started the afternoon checkout. Checked email and changeNotes Checked 180-L dewars weight Cleaned APOGEE gang connector with air. Did 3-read dark Checked images Did APOGEE evening cals Checked the images Checked status of rain sensor Recorded the software versions Recorded and checked mirror numbers Did 'platedb showActive' All BOSS/APOGEE carts are ready Tested the actors Check calib lamps Guider/gcamera tests: a) gcamera status (simulate=off; temp=-40) b) gcamera dark time=20 c) guider status d) guider flat Spectro tests and focus a) guider loadCartridge b) boss exposure bias itime=0 c) boss exposure dark itime=20 d) sop hartmann 00151877 Predict blue camera ring movement of -5.2 degrees for spectro-1 Predict blue camera ring movement of 6.3 degrees for spectro-2 Predict (red) piston movement of -42 steps for spectro-1 Predict (red) piston movement of 128 steps for spectro-2 -- Status -- 23:26:23 ---- Enclosure = closed; cwPositions = 291 290 290 290; MCP instr = 10 (mounted); Guider cart= 10, plate= 6177, side= A (loaded); ------------------------------ motorPosition sp1: 18617, 19066, 18883; sp2: 33653, 33752, 34518; ------------------------------ Median spectrographs temperatures: Tsp1= 10.6, Tsp2= 10.1; Outside air temperature= 9.9; ------------------------------ Boss CCD Temp : sp1r0= -124.6 (-126.6); sp1b2= -99.6 (-100.0); sp2r0= -134.0 (-134.8); sp2b2= -100.8 (-100.0); sp1LN2: 10.0; sp2LN2: 10.0; ------------------------------ Checked that carts were in bay correctly; All BOSS carts are ready 23:30Z Opened doors/louvers; turned on fans Mounted first cart of the night. hub25m> df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 95G 17G 74G 19% / /dev/sda4 793G 284G 469G 38% /home /dev/sda1 99M 31M 63M 33% /boot tmpfs 5.9G 0 5.9G 0% /dev/shm sdssfiles1-p://data1/data/MARVELS 1.8T 516G 1.3T 29% /MARVELS /dev/drbd1 13T 11T 1.8T 86% /data ------------------------------------- Night ===== 00:02Z - Opened to partly cloudy skies. Force-filled spectrographs from 180L LN2 dewars. Checked telescope balance and fiducial crossings. Did not open the DIMM because of clouds. Cart. 10, 6177 ************** 00:26Z - GSOGTF. Partly cloudy. Seeing 1.2-1.4" FWHM. 00:28Z - Hartmanns. 00:28:42 boss exposure 4.0, file=151881 00:29:32 boss exposure 4.0, file=151882 00:30:28 hartSp1: r=-286, b=-1.0, txt=OK, sp1Temp = 8.6 00:30:28 sos.sp1AverageMove = 4634 00:30:40 motorPos.sp1.move: 4633, 4634, 4634 00:30:40 hartSp2: r=642, b=2.2, txt=OK, sp2Temp = 7.8 00:30:40 sos.sp2AverageMove = 1699 00:30:46 motorPos.sp2.move: 1701, 1699, 1699 00:31Z - Cals. 00:31:07 boss exposure 4.0, file=151883 00:32:42 boss exposure 30.0, file=151884 01:11Z - Science. 900s exposures. 01:11:59 boss exposure 900.0, file=151887 01:28:21 boss exposure 900.0, file=151888 01:44:43 boss exposure 900.0, file=151889 02:01:05 boss exposure 900.0, file=151890 02:17:27 boss exposure 900.0, file=151891 02:33:49 boss exposure 900.0, file=151892 02:50:10 boss exposure 900.0, file=151893 03:06:33 boss exposure 900.0, file=151894 03:24:07 boss exposure 900.0, file=151895 MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56268 0.24 0.53 0.33 0.65 900.8 1.76 6177-56268-01 56268 0.82 2.04 1.12 2.27 900.8 6.25 6177-56268-01 56268 0.45 1.02 0.64 1.20 900.8 3.31 6177-56268-01 56268 1.26 3.08 1.86 3.86 900.8 10.06 6177-56268-01 56268 0.63 1.66 1.02 1.95 900.8 5.27 6177-56268-01 56268 1.13 3.17 1.62 3.59 900.8 9.51 6177-56268-01 56268 2.45 7.11 3.19 8.04 900.8 20.80 6177-56268-01 56268 2.40 7.24 2.84 7.94 900.8 20.43 6177-56268-01 56268 2.44 7.48 3.11 8.18 900.8 21.20 6177-56268-01 --------------------------------------------------------------- s/n2= 11.83 33.33 15.74 37.68 8107.5 --> 98.59 Cart. 13, 6172 ************** 03:44Z - GSOGTF. Mostly clear. Seeing 1.3-1.5" FWHM. 03:48Z - Hartmanns. 03:46:17 boss exposure 4.0, file=151896 03:47:06 boss exposure 4.0, file=151897 03:48:12 hartSp2: r=702, b=2.4, txt=OK, sp2Temp = 6.7 03:48:12 sos.sp2AverageMove = -2202 03:48:20 motorPos.sp2.move: -2201, -2202, -2202 03:48:20 hartSp1: r=17, b=0.1, txt=OK, sp1Temp = 7.0 03:48:20 sos.sp1AverageMove = 1448 03:48:30 motorPos.sp1.move: 1448, 1448, 1449 03:48Z - Cals. 03:48:51 boss exposure 4.0, file=151898 03:50:26 boss exposure 30.0, file=151899 Yellow XSIGMA value for b2. 03:54Z - Science. 900s exposures. 03:54:18 boss exposure 900.0, file=151900 04:10:40 boss exposure 900.0, file=151901 04:27:01 boss exposure 900.0, file=151902 MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56268 3.07 6.48 3.53 7.59 900.8 20.67 6172-56268-01 56268 3.14 7.81 3.78 8.67 900.8 23.40 6172-56268-01 56268 2.63 6.30 3.08 6.70 900.8 18.71 6172-56268-01 --------------------------------------------------------------- s/n2= 8.84 20.59 10.39 22.96 2702.5 --> 62.78 Cart. 14, 6254 ************** 04:46Z - GSOGTF. Mostly clear. Seeing 1.4-1.7" FWHM. 04:48Z - Hartmanns. 04:48:12 boss exposure 4.0, file=151903 04:49:02 boss exposure 4.0, file=151904 04:49:59 hartSp2: r=947, b=3.2, txt=OK, sp2Temp = 6.4 04:49:59 sos.sp2AverageMove = -1166 04:50:05 motorPos.sp2.move: -1164, -1163, -1166 04:50:05 hartSp1: r=-493, b=-1.7, txt=OK, sp1Temp = 6.7 04:50:05 sos.sp1AverageMove = -2843 04:50:18 motorPos.sp1.move: -2843, -2843, -2839 04:50Z - Cals. 04:50:41 boss exposure 4.0, file=151905 04:52:19 boss exposure 30.0, file=151906 Yellow XSIGMA value for b2. 04:58Z - Science. 900s exposures. 04:58:46 boss exposure 900.0, file=151907 05:15:08 boss exposure 900.0, file=151908 05:31:32 boss exposure 900.0, file=151909 05:47:54 boss exposure 900.0, file=151910 MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56268 3.40 8.47 3.67 9.18 900.8 24.72 6254-56268-01 56268 3.04 7.34 3.30 7.94 900.8 21.62 6254-56268-01 56268 3.38 7.93 3.73 8.71 900.8 23.76 6254-56268-01 56268 3.55 8.30 3.98 8.61 900.8 24.44 6254-56268-01 --------------------------------------------------------------- s/n2= 13.38 32.04 14.68 34.44 3603.3 --> 94.54 Cart. 15, 6376 ************** 06:08Z - GSOGTF. Partly cloudy. Seeing 1.4-2.0" FWHM. 06:10Z - Hartmanns. 06:10:49 boss exposure 4.0, file=151911 06:11:38 boss exposure 4.0, file=151912 06:12:38 hartSp1: r=75, b=0.3, txt=OK, sp1Temp = 6.4 06:12:38 sos.sp1AverageMove = -529 06:12:43 motorPos.sp1.move: -530, -529, -527 06:12:43 hartSp2: r=438, b=1.5, txt=OK, sp2Temp = 6.2 06:12:43 sos.sp2AverageMove = -1938 06:12:48 motorPos.sp2.move: -1938, -1943, -1938 06:13Z - Cals. 06:13:08 boss exposure 4.0, file=151913 06:14:43 boss exposure 30.0, file=151914 06:20Z - Science. 900s exposures. 06:20:46 boss exposure 900.0, file=151915 06:37:08 boss exposure 900.0, file=151916 - Aborted because altitude brake engaged and we could not slew back to the field with an in-progress/paused BOSS exposure. Ticket #1722 was filed regarding this issue. 06:39Z - Altitude brake engaged. We were able to clear the brake after a few 'tcc axis init' attempts. Once cleared, we wanted to slew back to the field and resume the paused BOSS exposure, but we couldn't slew with an in-progress/paused BOSS exposure, so we aborted the exposure and slewed back to the field. Here are STUI errors associated with the altitude brake engaging: 06:39:37 APO.Moses 128 guider w text="TCC motion aborted guiding" 06:39:37 APO.Moses 128 guider f guideState="failed"; text="" 06:39:37 CmdDone: APO.Moses 128 guider on time=15.0 06:39:38 .tcc 0 tcc W AltStat=50.980700,0.000000,4861579213.60484,0x00001800; BadAltStatus; AltDTime=-0.1 06:39:49 .tcc 0 tcc W AltStat=50.980708,0.000000,4861579223.60490,0x00001800; BadAltStatus; AltDTime=-0.1 06:39:57 .hub 0 cmds d CmdQueued=2148357,1354862432.24,"APO.Moses",129,"guider",974,"on time=15.0" 06:39:57 APO.Moses 129 guider w text="TCC motion aborted guiding" 06:39:57 APO.Moses 129 guider f guideState="failed"; text="" 06:39:57 CmdDone: APO.Moses 129 guider on time=15.0 06:39:58 .tcc 0 tcc W AltStat=50.980708,0.000000,4861579233.60487,0x00001800; BadAltStatus; AltDTime=-0.1 06:40:08 .hub 0 cmds d CmdQueued=2148365,1354862443.60,"APO.Moses",130,"guider",975,"on time=15.0" 06:40:08 APO.Moses 130 guider w text="TCC motion aborted guiding" 06:40:08 APO.Moses 130 guider f guideState="failed"; text="" 06:40:08 CmdDone: APO.Moses 130 guider on time=15.0 06:53:27 boss exposure 900.0, file=151917 07:09:50 boss exposure 900.0, file=151918 07:26:12 boss exposure 900.0, file=151919 MJD b1 r1 b2 r2 Texp Sum Plugfile --------------------------------------------------------------- 56268 1.29 2.85 1.32 2.77 900.8 8.23 6376-56268-01 56268 0.42 0.72 0.43 0.75 900.8 2.33 6376-56268-01 56268 1.32 2.41 1.45 2.55 900.8 7.72 6376-56268-01 56268 2.59 5.26 2.91 5.54 900.8 16.30 6376-56268-01 --------------------------------------------------------------- s/n2= 5.62 11.24 6.11 11.62 3603.4 --> 34.59 Cart. 16, 5792 ************** 07:46Z - GSOGTF. Partly cloudy to mostly cloudy. Seeing 1.5-1.9" FWHM. 07:49Z - Hartmanns. 07:49:37 boss exposure 4.0, file=151920 07:50:25 boss exposure 4.0, file=151921 07:51:22 hartSp2: r=-318, b=-1.1, txt=OK, sp2Temp = 5.7 07:51:22 sos.sp2AverageMove = 738 07:51:28 motorPos.sp2.move: 738, 738, 738 07:51:28 hartSp1: r=90, b=0.3, txt=OK, sp1Temp = 6.3 07:51:28 sos.sp1AverageMove = -224 07:51:31 motorPos.sp1.move: -222, -224, -222 07:51Z - Cals. 07:51:52 boss exposure 4.0, file=151922 07:53:26 boss exposure 30.0, file=151923 07:57Z - Science. 900s exposures. 07:57:25 boss exposure 900.0, file=151924 08:13:47 boss exposure 900.0, file=151925 08:30:09 boss exposure 900.0, file=151926 - Altitude brake engaged. Guider stopped. After a few `tcc axis init' commands we cleared the axis, but were unable to slew back to the field with this exposure in-progress. Aborted the exposure and slewed back to field. 08:37:12 APO.Moses.sop 588 guider w text="TCC motion aborted guiding" 08:37:15 .tcc 0 tcc W AltStat=52.870984,0.000000,4861586270.13329,0x00001800; BadAltStatus; AltDTime=-0.1 08:37:25 .tcc 0 tcc W AltStat=52.871000,0.000000,4861586280.13322,0x00001800; BadAltStatus; AltDTime=-0.1 08:41:20 boss exposure 900.0, file=151928 - Declared bad. Clouds, low S/N. 09:00:35 boss exposure 900.0, file=151929 - Declared bad. Clouds, low S/N. 09:16:58 boss exposure 900.0, file=151930 - Declared bad. Clouds, low S/N. 09:33:20 boss exposure 900.0, file=151931 - Declared bad. Clouds, low S/N. After the last exposure, slewed to stow and closed the FF petals, waited for clouds to clear. 12:11Z - Called it a night. Closed with clouds still overhead and no end in sight before morning twilight. Started APOGEE morning cals and BOSS biases/dark at the telescope laptop. ---- Telescope Status ---- Status at: 12:12:26 Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 16 Counterweights at: 290, 291, 290, 291 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 260.70 lbs, 19.71 psi SP2 276.30 lbs, 20.40 psi ---- Software Used ---- getVersions, 2012-12-06 22:37:01 ----STUI software---- STUI: 1.1.3b3 2012-11-19 alerts: v1_2_1 apo: v1_7 boss: v2_5_13 boss.daq: 1.3.2 boss.specMech: 3.0.1 gcamera: v1_2_10 guider: v1_4_0 hub: Tag: sdss3_v1_2_0 mcp: v6_6_16 mcp.plc: 28 mcp.azFiducialVersion: v1_107 mcp.altFiducialVersion: v1_107 mcp.rotFiducialVersion: v1_107 platedb: v1_0_5 sop: v1_2_15 sos: v1_2_0 sos.idlspec2d: v5_5_9 tcc: 2.14.0 apogee: ** not availble ** apogeecal: ** not availble ** apogeeql: v1_4_1 ----Other software---- sdssProcedure(sdss3): v3_06 Setting up: idlspec2d Flavor: Linux64 Version: v5_6_1 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: start Setting up: |specflat Flavor: NULL Version: v1_19 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |platedb Flavor: Linux64 Version: v1_3_1 Setting up: |hooloovookit Flavor: Linux64 Version: v3_4_1 Setting up: |sqlalchemy Flavor: Linux64 Version: 0.7.7 Setting up: |scipy Flavor: Linux64 Version: 0.7.1 Setting up: |psycopg Flavor: Linux64 Version: 2.0.11 Setting up: |actorcore Flavor: Linux64 Version: v1_15_2 Setting up: |opscore Flavor: Linux64 Version: v1_15_1 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: trunk Setting up: |plc Flavor: Linux64 Version: v28_1 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_11 Setting up: |RO Flavor: Linux64 Version: RO-2.8.0 Setting up: |tron Flavor: Linux64 Version: sdss3_v1_1_9 Setting up: |idlutils Flavor: Linux64 Version: v5_5_8 Setting up: |idl Flavor: Linux64 Version: 7.1 Setting up: |dust Flavor: Linux64 Version: v0_1 Setting up: actorcore Flavor: Linux64 Version: v1_17 Setting up: |opscore Flavor: Linux64 Version: v1_16 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: trunk Setting up: |plc Flavor: Linux64 Version: v28_5 Setting up: |sdsstools Flavor: Linux64 Version: v4_33 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_12 Setting up: |RO Flavor: Linux64 Version: RO-2.8.0 Setting up: |tron Flavor: Linux64 Version: sdss3_v1_1_9 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 5.362 5.357 Axial B: 5.211 5.221 Axial C: 5.516 5.516 Trans D: 10.362 10.374 Lateral E: 10.6299 10.6299 Lateral F: 12.2682 12.2428 GALILS Commanded: 11300 -650 5500 21900 13500 13050 Actual: 11300 -650 5500 21900 13500 13050 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 612.35 1500.90 PrimOrient: 0.00 0.00 0.00 612.07 1500.38 SECONDARY: ---------- Focus: 0.00 Air temp: 10.5 Altitude: 30.1 MIGS TONIGHT NOMINAL Axial A: 7.04 7.041 Axial B: 7.052 7.059 Axial C: 7.037 7.041 Trans D: 0.328 0.33 GALILS Commanded: 1576550 1594600 1580000 -3550 -6650 Actual: 1576556 1594591 1580040 -3550 -6650 SETMIR VALUES SecDesOrient: 1257.00 3.00 5.00 0.00 115.81 SecOrient: 1256.99 3.02 5.01 -0.16 116.13 ---- Problems in Detail ---- Collimator motor STUI errors: 03:47:18 client.v896.sos 209 boss w text="Failure from sp1mech: Failed motor command 128 \"0MN,1MR447,2MR448,0WE50,WA100,0MF\r\" timed out" 03:47:19 client.v896.sos 209 boss w text='move failed; ignoring' 03:47:47 APO.Moses.sop 483 boss w text="value for motor status was bad: ['133', '133', 'NaN']" 4:25:44 APO.Moses.sop 499 boss w text="value for motor status was bad: ['133', '133', 'NaN']" 04:49:02 client.v896.sos 213 boss w text="Failure from sp1mech: Failed motor command 129 \"1MN,1MR-1000,1WE50,WA100,0MF\r\" timed out" 04:49:02 client.v896.sos 213 boss w text='move failed; ignoring' 04:49:02 .tcc 0 tcc I TCCStatus="TTT","NNN"; TCCPos=267.875,63.992,104.014; AxePos=267.876,63.993,104.011 04:49:02 .tcc 0 tcc I ObjObs=267.886432,-0.001997,4861572582.92369,63.948136,-0.003509,4861572582.92369 04:49:02 .tcc 0 tcc I SpiderInstAng=-75.946631,0.000295,4861572582.92369 04:49:02 client.v896.sos 213 boss i text="Response parsed." 04:49:02 client.v896.sos 213 boss i text="motors at [23695, 24146, 23961]" 04:49:02 client.v896.sos 213 boss i text="remaining move: [-1840, -1841, -1838]" 04:49:03 .boss 24294 boss : 04:49:04 client.v896.sos 213 boss i text='move done' 04:49:04 .tcc 0 tcc I TrackAdvTime=3.55 04:49:04 .mcp 0 mcp i cwPositions=291,291,290,291 04:49:05 client.v896.sos 213 boss i text="Response parsed." 04:49:05 client.v896.sos 213 boss i text="motors at [22697, 23148, 22958]" 04:49:05 client.v896.sos 213 boss i text="remaining move: [-842, -843, -835]" 04:49:06 client.v896.sos 213 boss i text='move done' 04:49:07 client.v896.sos 213 boss i text="Response parsed." 04:49:07 client.v896.sos 213 boss i text="motors at [21855, 22305, 22127]" 04:49:07 client.v896.sos 213 boss i text="remaining move: [0, 0, -4]" 04:51:44 APO.Moses.sop 520 boss w text="value for motor status was bad: ['NaN', '133', '132']"