Subject: 2.5m obslog 20150501 (SJD 57144) From: kgrabowski@apo.nmsu.edu Date: Sat, 2 May 2015 11:52:58 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday May 01, 2015 (SJD 57144) ---- Observing Team ---- Jon Brinkman (cool start test) John Parejko (cool start test) Kaike Pan (cool start test) Conor Sayres (tcc test) Dmitry Bizyaev Katie Grabowski ---- Observing Summary ---- During afternoon checkout, we had to restart mcp, tcc, boss-icc to move the telescope and fix the header keywords in the image files after the new tcc installed. For the first cartridge, we couldn't find guide stars with the new tcc. Conor restarted the primary mirror, and guide stars were found successfully. Cart 9, plate 8473, APOGEE, field=ORPHAN-4 2xABBA 2 missing, 4 faint Cart 8, plate 8474, APOGEE, field=ORPHAN-4 1xABBA 4 missing, 5 faint Cart 1, plate 7495, MaNGA Angle test completed 1xNSE Cart 7, plate 8576, APOGEE, field=M5PAL5 2xABBA+AB 1 missing, 6 faint Cart 6, plate 7781, APOGEE, field=020+12 2xABBA 2 missing, 7 faint Cart 5, plate 7526, APOGEE, field=049+00 2xABBA 4 missing, 4 faint Cart 2, plate 7782, APOGEE, field=049+00 1xABBA 4 missing, 3 faint ---- Observing Plan ---- Fri 1 MAY 2015 57144.0 0.95 02:23 11:38 09:58 19:16 Night APOGEE-2 ( 9.3 h) ---- Observing Log ---- Day tests: ========== Conor installed a new version of the TCC today with the tilts of the primary no longer hidden. JonB, JohnP, and Kaike ran cool start test on sdss4-hub, and it succeed with new current verion of tron (V3_1). JonB and Kaike run cool start on platedb, it takes more than 30 minutes to come back. We don't understand why it takes so long. After platedb comes back, we found that platedb actor was not running, restart the actor ok (shows the actor was running), but it didn't connect itself to hub. Then we restarted all actors (we think that tron is one that makes difference here), and disconnected STUI and reconnected it back. Everything is ok. However, we tried the 2nd time, everything went fine, and the system comeback in 2 minutes. So we think that the reason for the first time to take so long is due to disk check. If this is correct, we need to check the platedb disk in regular base. Afternoon: ========== Actors, software, hardware, telescope, guider, plates checked. Problem with APOGEE bundling: test exposures are not bundled. Restarted apogeeql actor at 00:34Z. It fixed the problem. Attempt to collimate with cart 3: 00:42:53 APO.dmbiz 30 sop e text='Failed to collimate BOSS spectrographs.' 00:42:53 APO.dmbiz 30 sop i stageState="collimateBoss.collimate","failed",0.0,0.0 00:42:53 APO.dmbiz 30 sop i collimateBossState="running","OK","failed","idle" 00:42:53 APO.dmbiz 30 sop i collimateBossStages="collimate","cleanup" 00:42:53 APO.dmbiz 30 sop i collimateBossState="failed","Failed to collimate BOSS for afternoon checkout","failed","idle" 00:42:53 APO.dmbiz 30 sop f text="Failed to collimate boss for afternoon checkout" 00:42:53 CmdDone: APO.dmbiz 30 sop collimateBoss Hartmanns analysis output: 00:42:53 Hartmann collimate output on cart #3 sp1: offset: r= None (None); b= None (None) sp2: offset: r= None (None); b= None (None) sp1: pred. move: spAverageMove= None sp2: pred. move: spAverageMove= None sp1: pred. spResiduals: r= None, b= None, txt= None, spTemp = 10.8 sp2: pred. spResiduals: r= None, b= None, txt= None, spTemp = 9.9 Again: 00:47:54 APO.dmbiz.sop 18 hartmann e text="r1 had error: Incorrect header values in fits file." 00:47:54 APO.dmbiz.sop 18 hartmann w text='r2: Only 0 of 4 Ne lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann w text='r2: Only 0 of 4 HgCd lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann e text="r2 had error: Incorrect header values in fits file." 00:47:54 APO.dmbiz.sop 18 hartmann w text='b1: Only 0 of 4 Ne lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann w text='b1: Only 0 of 4 HgCd lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann e text="b1 had error: Incorrect header values in fits file." 00:47:54 APO.dmbiz.sop 18 hartmann w text='b2: Only 0 of 4 Ne lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann w text='b2: Only 0 of 4 HgCd lamps turned on: 0 0 0 0 ' 00:47:54 APO.dmbiz.sop 18 hartmann e text="b2 had error: Incorrect header values in fits file." 00:47:54 APO.dmbiz.sop 18 hartmann e text="Collimation calculation failed! Collimation calculation failed for b2,r1,r2,b1." 00:47:54 APO.dmbiz.sop 18 hartmann i status="idle" 00:47:54 APO.dmbiz.sop 18 hartmann f text="collimation process failed" 00:47:54 CmdDone: APO.dmbiz.sop 18 hartmann collimate ignoreResiduals noSubFrame 00:47:54 APO.dmbiz 35 sop e text='Failed to collimate BOSS spectrographs.' The problem at the moment is that : 1. files are not being transferred from boss-icc to hub. 2. hartmann reduction sees lamps are off in the headers of Hartmanns exposures, although we double checked that lamps were on during the exposures. trying to catch Parejko, if not, we will restart boss-icc actor. We estarted mcp and tcc. It did not help to see true Arc lamp info in the headers. They continue to be 0 0 0 0 We restarted boss-icc, and this fixed the problem. Also restarted alerts actor. Collimation with cart 3: 01:22:53 Hartmann collimate output on cart #3 sp1: offset: r= 0 (In Focus); b= -5.2 (Out of focus) sp2: offset: r= 4734 (Out of focus); b= -10.1 (Out of focus) sp1: pred. move: spAverageMove= 835 sp2: pred. move: spAverageMove= 3974 sp1: pred. spResiduals: r= -835, b= -2.6, txt= OK, spTemp = 10.7 sp2: pred. spResiduals: r= 759, b= 2.4, txt= OK, spTemp = 9.9 Moving telescope: axes did not move. Restarted mcp at crate. Restarted tcc again. Telescope started moving. 01:15Z ventilation started. Cart 9 is mounted. Night: ====== 01:45Z enclosure off. Started LN2 filling. On first go to field from 60,60,60, the rotator stopped at 10 degrees. tcc axis init got it to final location. 01:43:56 loadCart: ct=9, pl=8473; field=ORPHAN-4 01:43:56 survey: APOGEE-2; lead: None 01:57:26 encl25m : open; 02:14:33 apogee.expose=apRaw-15820013, 10, A, Dark 02:16:21 apogee.expose=apRaw-15820014, 10, A, Dark 02:19:02 sop.gotoField = running; 02:20:30 sop.gotoField = failed; 02:21:25 sop.gotoField = running; 02:22:10 guider = on; 02:22:16 guider.expTime = 2.0; 02:22:29 sop.gotoField = done; No GS, tried steps of 10" in each direction, then spiral pattern. Moved away and then back to the field. We found one star in fiber 6, but no other stars, even as we increased the focus. Spiral pattern again. Still no luck finding stars, so Conor restarted the primary mirror. tcc set inst=spectro and tcc hub startNubs tcc Guide stars found in fibers! Clouds in the NW, seeing ~1.4. 02:59:35 apogee.expose=apRaw-15820015, 47, A, Object 03:07:59 apogee.expose=apRaw-15820016, 47, B, Object 03:16:19 apogee.expose=apRaw-15820017, 47, B, Object 03:24:46 apogee.expose=apRaw-15820018, 47, A, Object 03:33:06 apogee.expose=apRaw-15820019, 47, A, Object 03:41:29 apogee.expose=apRaw-15820020, 47, B, Object 03:49:49 apogee.expose=apRaw-15820021, 47, B, Object 03:58:17 apogee.expose=apRaw-15820022, 47, A, Object 04:06:55 apogee.expose=apRaw-15820023, 5, A, DomeFlat 04:09:32 mcp.gang=1 (Disconnected) 04:09:38 mcp.gang=12 (Podium: Dense) 04:10:21 apogee.expose=apRaw-15820024, 10, A, Dark 04:12:08 apogee.expose=apRaw-15820025, 10, A, Dark flat= /data/apogee/utr_cdr/57144/apRaw-15820023.fits master= /home/observer/bin/apRaw-03720068.fits nfibers= 300 average ratio= 0.728695909804 missing fibers (flat/master -------------------------------------------------------------------------------- 02:59 9-8473A 1.000326 -3217 -1350 195 236.8 79.5 13.3 10 193 1.5 apog 03:07 9-8473A 1.000322 -3179 -1321 190 240.3 78.0 13.3 12 192 1.4 apog 03:15 9-8473A 1.000323 -3188 -1326 192 242.9 76.5 13.3 10 193 1.5 apog 03:24 9-8473A 1.000326 -3220 -1344 197 244.8 74.9 13.4 11 204 1.6 apog 03:32 9-8473A 1.000323 -3188 -1313 201 246.2 73.3 13.3 14 192 1.6 apog 03:40 9-8473A 1.000329 -3246 -1356 202 247.3 71.7 13.3 13 187 1.4 apog 03:49 9-8473A 1.000327 -3226 -1335 205 248.1 70.0 13.4 15 191 1.4 apog 03:57 9-8473A 1.000320 -3163 -1277 200 248.6 68.4 13.5 14 189 1.5 apog 04:21 8-8474A 1.000326 -3220 -1312 210 249.4 63.8 13.2 15 209 1.2 apog 04:29 8-8474A 1.000324 -3198 -1276 224 249.5 62.1 13.1 13 213 1.1 apog 04:37 8-8474A 1.000337 -3319 -1358 237 249.5 60.5 13.0 11 179 1.4 apog 04:46 8-8474A 1.000355 -3510 -1465 284 249.4 58.8 12.0 12 153 1.6 apog 05:25 1-7495A 1.000271 -2672 -647 445 54.8 79.3 11.1 17 160 2.3 boss 05:42 1-7495A 1.000258 -2551 -559 436 38.3 81.8 11.0 16 157 1.7 boss 05:58 1-7495A 1.000244 -2408 -435 443 12.1 83.3 10.6 18 150 2.0 boss 06:34 7-8576A 1.000136 -1341 464 409 29.9 54.5 9.9 15 159 1.9 apog 06:42 7-8576A 1.000127 -1274 505 395 26.5 55.4 9.9 16 152 2.0 apog 06:50 7-8576A 1.000116 -1146 602 390 23.1 56.1 9.9 15 159 2.4 apog 06:59 7-8576A 1.000111 -1092 638 381 19.4 56.8 10.2 15 156 1.9 apog 07:07 7-8576A 1.000107 -1060 638 351 15.7 57.3 9.7 14 151 2.0 apog 07:16 7-8576A 1.000112 -1102 607 362 11.9 57.7 9.9 11 144 2.0 apog 07:24 7-8576A 1.000104 -1032 664 360 8.0 58.0 10.1 10 137 2.0 apog 07:32 7-8576A 1.000098 -968 709 355 4.0 58.2 9.9 6 113 2.2 apog 07:41 7-8576A 1.000092 -911 756 353 0.0 58.3 9.9 8 143 2.2 apog 07:49 7-8576A 1.000089 -882 780 353 -4.0 58.2 10.0 2 105 2.4 apog 08:12 6-7781A 1.000192 -1895 -18 344 41.3 42.5 10.2 1 124 2.8 apog 08:20 6-7781A 1.000171 -1685 115 309 38.9 43.7 11.9 1 141 2.5 apog 08:28 6-7781A 1.000154 -1516 262 320 36.4 44.7 11.1 2 188 1.8 apog 08:37 6-7781A 1.000130 -1280 422 288 33.8 45.8 10.9 6 193 1.7 apog 08:45 6-7781A 1.000127 -1251 434 279 31.1 46.7 10.7 8 193 2.2 apog 08:54 6-7781A 1.000119 -1175 510 295 28.3 47.6 10.2 6 194 1.6 apog 09:02 6-7781A 1.000116 -1146 520 282 25.5 48.4 10.9 11 198 1.5 apog 09:10 6-7781A 1.000116 -1149 512 279 22.5 49.1 9.8 4 209 1.4 apog 09:33 5-7526A 1.000127 -1255 385 257 66.3 54.8 11.3 13 182 1.5 apog 09:41 5-7526A 1.000127 -1255 395 271 64.0 56.4 11.0 9 186 1.4 apog 09:50 5-7526A 1.000123 -1220 426 277 61.7 57.9 11.1 12 183 1.4 apog 09:58 5-7526A 1.000122 -1200 437 277 59.1 59.5 11.0 10 181 1.4 apog 10:06 5-7526A 1.000123 -1210 437 290 56.3 61.0 10.9 13 188 1.4 apog 10:15 5-7526A 1.000117 -1159 477 290 53.3 62.4 10.9 11 190 1.4 apog 10:23 5-7526A 1.000112 -1108 525 299 50.0 63.8 10.9 13 204 1.3 apog 10:31 5-7526A 1.000112 -1105 527 301 46.4 65.1 10.6 10 194 1.5 apog 10:54 2-7782A 1.000180 -1774 46 311 16.9 43.3 10.6 14 218 1.8 apog 11:02 2-7782A 1.000161 -1589 204 317 14.1 43.8 10.6 11 222 1.6 apog 11:11 2-7782A 1.000179 -1767 59 321 11.3 44.2 10.3 12 231 1.5 apog 11:19 2-7782A 1.000165 -1627 172 321 8.5 44.5 10.6 8 187 1.5 apog ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 02:59 9-8473A 13.3 -7.2 20.5 23 10 193 704 7.4 805 1.5 apog 03:07 9-8473A 13.3 -7.2 20.5 23 12 192 689 7.9 801 1.4 apog 03:15 9-8473A 13.3 -7.3 20.6 23 10 193 725 6.7 802 1.5 apog 03:24 9-8473A 13.4 -7.4 20.8 22 11 204 653 6.0 802 1.6 apog 03:32 9-8473A 13.3 -7.5 20.8 22 14 192 714 63.8 804 1.6 apog 03:40 9-8473A 13.3 -7.6 20.9 22 13 187 741 16.0 804 1.4 apog 03:49 9-8473A 13.4 -7.6 21.0 22 15 191 806 11.3 801 1.4 apog 03:57 9-8473A 13.5 -7.7 21.2 22 14 189 737 21.5 804 1.5 apog 04:21 8-8474A 13.2 -7.6 20.8 22 15 209 817 119.7 815 1.2 apog 04:29 8-8474A 13.1 -7.8 20.9 22 13 213 830 40.5 801 1.1 apog 04:37 8-8474A 13.0 -7.8 20.8 22 11 179 811 11.7 802 1.4 apog 04:46 8-8474A 12.0 -6.9 18.9 26 12 153 779 8.4 802 1.6 apog 05:25 1-7495A 11.1 -5.5 16.6 30 17 160 846 9.8 802 2.3 boss 05:42 1-7495A 11.0 -5.4 16.4 31 16 157 909 8.1 801 1.7 boss 05:58 1-7495A 10.6 -4.9 15.5 33 18 150 905 7.7 801 2.0 boss 06:34 7-8576A 9.9 -4.4 14.3 36 15 159 855 8.1 803 1.9 apog 06:42 7-8576A 9.9 -4.3 14.2 36 16 152 885 8.3 802 2.0 apog 06:50 7-8576A 9.9 -4.4 14.3 36 15 159 890 6.9 804 2.4 apog 06:59 7-8576A 10.2 -5.7 15.9 32 15 156 870 8.1 803 1.9 apog 07:07 7-8576A 9.7 -5.1 14.8 34 14 151 842 8.7 802 2.0 apog 07:16 7-8576A 9.9 -4.7 14.6 35 11 144 810 7.3 801 2.0 apog 07:24 7-8576A 10.1 -4.7 14.8 35 10 137 892 7.8 802 2.0 apog 07:32 7-8576A 9.9 -5.1 15.0 34 6 113 833 7.9 802 2.2 apog 07:41 7-8576A 9.9 -4.9 14.8 34 8 143 771 9.1 801 2.2 apog 07:49 7-8576A 10.0 -5.1 15.1 34 2 105 875 8.2 801 2.4 apog 08:12 6-7781A 10.2 -6.4 16.6 30 1 124 784 9.5 802 2.8 apog 08:20 6-7781A 11.9 -8.5 20.4 23 1 141 700 7.0 803 2.5 apog 08:28 6-7781A 11.1 -7.4 18.5 26 2 188 707 8.7 802 1.8 apog 08:37 6-7781A 10.9 -7.8 18.7 26 6 193 717 8.4 803 1.7 apog 08:45 6-7781A 10.7 -6.6 17.3 29 8 193 664 8.3 802 2.2 apog 08:54 6-7781A 10.2 -6.8 17.0 29 6 194 755 8.2 802 1.6 apog 09:02 6-7781A 10.9 -7.8 18.7 26 11 198 728 8.1 802 1.5 apog 09:10 6-7781A 9.8 -6.7 16.5 30 4 209 722 10.4 802 1.4 apog 09:33 5-7526A 11.3 -7.4 18.7 26 13 182 654 6.7 803 1.5 apog 09:41 5-7526A 11.0 -7.4 18.4 26 9 186 625 7.7 802 1.4 apog 09:50 5-7526A 11.1 -7.4 18.5 26 12 183 1036 7.8 802 1.4 apog 09:58 5-7526A 11.0 -7.3 18.3 27 10 181 645 7.9 802 1.4 apog 10:06 5-7526A 10.9 -7.4 18.3 26 13 188 638 7.8 803 1.4 apog 10:15 5-7526A 10.9 -7.2 18.1 27 11 190 642 7.1 802 1.4 apog 10:23 5-7526A 10.9 -7.2 18.1 27 13 204 582 7.8 802 1.3 apog 10:31 5-7526A 10.6 -7.2 17.8 27 10 194 636 8.0 803 1.5 apog 10:54 2-7782A 10.6 -7.3 17.9 27 14 218 620 7.6 802 1.8 apog 11:02 2-7782A 10.6 -7.3 17.9 27 11 222 643 8.4 803 1.6 apog 11:11 2-7782A 10.3 -7.4 17.7 28 12 231 672 7.8 803 1.5 apog 11:19 2-7782A 10.6 -7.7 18.3 26 8 187 702 7.5 802 1.5 apog ---- Telescope Status ---- 01:15Z Started ventilation 01:57Z encl25m : open; 11:38Z encl25m : closed No interlocks bypassed Status at: 11:48Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 4 Counterweights at: 459 439 437 441 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 198.3 lbs, 22.21 psi SP2 212.5 lbs, 19.10 psi ---- Software Used ---- STUI : 1.6.0 alerts : trunk+svn149374 apo : trunk+svn158476 boss : v3_6 -boss.daq : FAILED -boss.specMec : 3.0.4 gcamera : v2_1 guider : v3_1 hartmann : v1_4_3 hub : Tag: sdss4_v3_0 mcp : v6_6_18 -mcp.plc : 31 -mcp.azFiduci : v1_114 -mcp.altFiduc : v1_114 -mcp.rotFiduc : v1_114 platedb : v2_3 sop : v3_1_3 tcc : 1.1.0 apogee : not availble apogeecal : not availble apogeeql : v1_5_9 -- Other software sdssProcedure : v3_06 APO-local : trunk ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000; MIGS TONIGHT NOMINAL Axial A: 0.031 0.028 Axial B: -0.002 -0.007 Axial C: -0.02 -0.027 Trans D: -0.013 -0.019 Lateral E: 10.7061 10.7061 Lateral F: 12.319 12.319 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.0 -17.47 11.84 635.9 916.8 PrimOrient: 0.0 -17.47 11.84 636.03 916.38 SECONDARY: ---------- Focus: 0.0000 Air temp: 18.4 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -7.063 -7.063 Axial B: -7.116 -7.117 Axial C: -0.047 -0.046 Trans D: -0.013 -0.016 GALILS Commanded: 1601550 1594850 1625450 1400 -2000 Actual: 1581375 1579221 1590213 1400 -2000 SETMIR VALUES SecDesOrient: 1257.0 -3.8 0.0 0.0 9.58 SecOrient: 1256.98 -3.56 0.03 0.02 9.27 PRIMARY: -------- Scale: 1.000000; MIGS TONIGHT NOMINAL Axial A: 0.032 0.028 Axial B: -0.001 -0.007 Axial C: -0.019 -0.027 Trans D: -0.013 -0.019 Lateral E: 10.7061 10.7061 Lateral F: 12.3063 12.319 GALILS Commanded: 10850 -450 5750 13050 14750 14300 Actual: 10850 -450 5750 13050 14750 14300 SETMIR VALUES PrimDesOrient: 0.0 -17.47 11.84 635.9 916.8 PrimOrient: 0.0 -17.47 11.84 636.03 916.38 SECONDARY: ---------- Focus: 0.0000 Air temp: 17.1 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -7.063 -7.063 Axial B: -7.116 -7.117 Axial C: -0.048 -0.046 Trans D: -0.013 -0.016 GALILS Commanded: 1600350 1593750 1626200 1400 -2000 Actual: 1581299 1578773 1590660 1400 -2000 SETMIR VALUES SecDesOrient: 1257.0 -3.8 0.0 0.0 9.58 SecOrient: 1256.97 -3.82 -0.02 -0.01 9.45 ---- Problems in Detail ---- 6:24:32 .mcp 0 mcp i needIack=true 06:24:33 .tcc 0 tcc i TCCPos=33.800101,53.396130,207.807633; AxePos=33.799747,53.396240,207.807390; ObjInstAng=0.000000,0.000000,4937264490.5593624; SpiderInstAng=27.812137,-0.004895,4937264678.8811378 06:24:33 .tcc 0 tcc i AxisCmdState=Tracking,Tracking,Tracking; AxisErrCode=OK,OK,OK; AxisNoTrack=FFF 06:24:34 .mcp 0 mcp i cwPositions=439,439,438,438 06:24:34 APO.dmbiz 373 sop e text="Failed to turn guider decentering off." 06:24:34 APO.dmbiz 373 sop i stageState="gotoField.guider","failed",0.0,0.0 06:24:34 APO.dmbiz 373 sop i stageState="gotoField.guider","running",0.0,0.0 06:24:34 APO.dmbiz 373 sop i text="expectedDuration=0" 06:24:34 APO.dmbiz 373 sop i stageState="gotoField.guider","failed",0.0,0.0 06:24:34 APO.dmbiz 373 sop i gotoFieldState="running","OK","done","failed","pending" 06:24:34 APO.dmbiz 373 sop i gotoFieldStages="slew","guider","cleanup" 06:24:34 APO.dmbiz 373 sop i gotoFieldState="failed","failed to start the guider","done","failed","pending" 06:24:34 APO.dmbiz 373 sop i gotoField_flatTime=30,30; gotoField_arcTime=4,4; gotoField_guiderFlatTime=0.5,0.5; gotoField_guiderTime=5.0,5.0 06:24:35 APO.dmbiz 373 sop f text="Failed to start the guider" 06:24:35 CmdDone: APO.dmbiz 373 sop gotoField guiderFlatTime=0.5 guiderTime=5.0 06:24:38 .tcc 0 tcc i TCCPos=33.769346,53.405837,207.783316; AxePos=33.769026,53.405936,207.783122; ObjInstAng=0.000000,0.000000,4937264490.5593624; SpiderInstAng=27.787657,-0.004897,4937264683.8811378 06:24:38 .tcc 0 tcc i AxisCmdState=Tracking,Tracking,Tracking; AxisErrCode=OK,OK,OK; AxisNoTrack=FFF 06:25:59 CmdStarted: APO.dmbiz 375 guider on time=3 06:25:59 APO.dmbiz 375 guider w text="FF petals aren't all open; aborting guiding" 06:25:59 APO.dmbiz 375 guider i cartridgeLoaded=7,8576,A,57144,1 06:25:59 APO.dmbiz 375 guider i survey="APOGEE-2","None" 06:25:59 APO.dmbiz 375 guider i guideState=off 06:25:59 APO.dmbiz 375 guider i text="The guider is off" 06:25:59 APO.dmbiz 375 guider i text="Decentering is off" 06:25:59 APO.dmbiz 375 guider i gprobeBits=0x10,0x00,0x00,0x08,0x00,0x08,0x00,0x10,0x10,0x00,0x04,0x08,0x00,0x0d,0x00,0x10,0x06 06:25:59 APO.dmbiz 375 guider i guideEnable=True,True,True 06:25:59 APO.dmbiz 375 guider i expTime=3 06:25:59 APO.dmbiz 375 guider i stack=1 06:25:59 APO.dmbiz 375 guider i scales=217.736,1,26,1 06:25:59 APO.dmbiz 375 guider i pid=rot,0.5,250,0,-1,1 06:25:59 APO.dmbiz 375 guider i pid=scale,0.2,0,0,-1,7 06:25:59 APO.dmbiz 375 guider i pid=raDec,0.6,50,0,-1,1 06:25:59 APO.dmbiz 375 guider i pid=focus,0.1,0,0,-1,1 06:25:59 APO.dmbiz 375 guider w refractionBalance=1.0 06:25:59 APO.dmbiz 375 guider f guideState="failed"; text="Not ok to guide in current state." 06:25:59 CmdDone: APO.dmbiz 375 guider on time=3 06:25:59 .sop 0 sop w text="loadCartridge fired cart=7 survey=sopActor.APOGEE surveyMode=None" 06:25:59 .sop 0 sop i survey="APOGEE-2","None" 06:25:59 .sop 0 sop i version="v3_1_3" 06:25:59 .sop 0 sop i bypassNames=axes,ffs,gangToCart,gangToPodium,guiderDark,isApogee,isApogeeLead,isApogeeMangaDither,isApogeeMangaStare,isBoss,isMangaDither,isMangaStare,lamp_ff,lamp_hgcd,lamp_ne,slewToField 06:25:59 .sop 0 sop i bypassedNames 06:25:59 .sop 0 sop i text="apogeeGang: gang on cartridge" 06:25:59 .sop 0 sop i surveyCommands=gotoField,doApogeeScience,doApogeeSkyFlats,gotoGangChange,gotoInstrumentChange,doApogeeDomeFlat 06:27:43 CmdStarted: APO.dmbiz 377 guider setDecenter decenterRA=0 decenterDec=0 decenterRot=0 06:27:43 APO.dmbiz 377 guider f UNPARSEDTEXT="Guider cannot apply a decenter in Rotation (yet)." 06:27:43 CmdDone: APO.dmbiz 377 guider setDecenter decenterRA=0 decenterDec=0 decenterRot=0 06:27:43 .tcc 0 tcc i TCCPos=32.611097,53.762605,206.865173; AxePos=32.610878,53.762684,206.864862; ObjInstAng=0.000000,0.000000,4937264728.2312622; SpiderInstAng=26.868864,-0.005005,4937264869.4569607 06:27:43 .tcc 0 tcc i AxisCmdState=Tracking,Tracking,Tracking; AxisErrCode=OK,OK,OK; AxisNoTrack=FFF 06:27:48 .tcc 0 tcc i TCCPos=32.579374,53.772139,206.839963; AxePos=32.579232,53.772214,206.839813; ObjInstAng=0.000000,0.000000,4937264728.2312622; SpiderInstAng=26.843834,-0.005008,4937264874.4569607 06:27:52 CmdStarted: APO.dmbiz 378 guider setDecenter decenterRA=0 decenterDec=0 06:27:52 APO.dmbiz 378 guider f text='Decentered guiding must be enabled before location can be specified.' 06:27:52 CmdDone: APO.dmbiz 378 guider setDecenter decenterRA=0 decenterDec=0 06:27:53 .mcp 0 mcp i aliveAt=1430548072 06:27:53 .tcc 0 tcc i AzTrackAdvTime=20,1.17,1.24,1.21,0.02 6:28:18 .tcc 0 tcc i AxisCmdState=Tracking,Tracking,Tracking; AxisErrCode=OK,OK,OK; AxisNoTrack=FFF 06:28:21 .alerts 0 alerts i alert=tcc.heartbeat,critical,"The TCC's been dead for at least 805s",disabled,noack,"" 06:28:22 CmdStarted: APO.dmbiz 380 guider mangaDither ditherPos=C 06:28:22 APO.dmbiz 380 guider f text='Decentered guiding must be enabled before location can be specified.' 06:28:22 CmdDone: APO.dmbiz 380 guider mangaDither ditherPos=C 06:28:23 .tcc 0 tcc i TCCPos=32.358916,53.838041,206.664677; AxePos=32.358794,53.838126,206.664479; ObjInstAng=0.000000,0.000000,4937264728.2312622; SpiderInstAng=26.668217,-0.005028,4937264909.4569607