Subject: 2.5m obslog 20210302 (SJD 59276) From: doravetz@apo.nmsu.edu Date: Wed, 3 Mar 2021 12:48:03 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday March 02, 2021 (SJD 59276) ---- Observing Team ---- Viktor Malanushenko Dan Oravetz ---- Observing Plan ---- Tue 02 Mar 2021 59276 BHM until 05:00 (2.9 h), then MWM (7.6 h) ---- Observing Summary ---- Clear sky, variable seeing. 1, 15016 - 4xBOSS @ 900s + 8xAPOGEE @ 46 reads, COMPLETE Missing fibers: [211, 273] Faint fibers: ['1 - 21', '23 - 28', '30 - 60', '121 - 150', 194, 227, '242 - 246', 253, 255, '260 - 261', '266 - 267', '271 - 272', '274 - 276', '279 - 283', '285 - 299'] 3, 15254 - 6xBOSS @ 900s + 13xAPOGEE @ 46 reads, not done Missing fibers: [211, 273] Faint fibers: ['121 - 150', 156, 177, 271, '274 - 276', 278, 283, '287 - 295', 299] 5, 15286, RV_NGC2420_btx - 4xBOSS @ 900s + 8xAPOGEE @ 46 reads, not done Missing fibers: [211, 273] Faint fibers: [12, 14, '16 - 17', '31 - 60', 104, 106, '115 - 117', '121 - 140', 142, '147 - 150', 154, '158 - 159', 161, 164, 179, '181 - 210'] 7, 15285, RV_195+18 - 4xBOSS @ 900s + 8xAPOGEE @ 46 reads, not done Missing fibers: [211, 273] Faint fibers: [10, '121 - 150', 173, 196, '212 - 240'] 2, 15193, RV_247+62_btx - 4xBOSS @ 900s + 8xAPOGEE @ 46 reads, not done Missing fibers: [38, 57, 59, 137, 190, 198, 211, 259, 273] Faint fibers: ['61 - 73', '75 - 90', '121 - 136', '138 - 150', 153, '161 - 162', 166, '169 - 173', '175 - 180', '212 - 240'] 8, 15199, RV_K2EB_C06_314+48_btx - 4xBOSS @ 900s + 8xAPOGEE @ 46 reads, not done Missing fibers: [35, 184, 211, 227, 273] Faint fibers: ['121 - 180', '212 - 213', '219 - 220', '222 - 225', '228 - 240', '271 - 272', '274 - 276', '279 - 300'] 4, 15201, RV_335+61_btx - 3xBOSS @ 900s + 6xAPOGEE @ 46 reads, not done Missing fibers: [20, 39, 151, 186, 193, 211, 241, 273, 278] Faint fibers: [1, '4 - 5', '7 - 8', 10, 12, 15, '18 - 19', '21 - 24', '26 - 27', 29, '31 - 38', '40 - 60', '121 - 123', '125 - 128', 133, '135 - 136', 140, 148, '152 - 154', '156 - 163', '165 - 170', 172, '175 - 183', 185, '187 - 190', 192, '194 - 197', 199, '206 - 208'] 9, 15202, RV_000+60 - 3xBOSS @ 900s + 6xAPOGEE @ 46 reads, not done Missing fibers: [36, 211, 245, 273] Faint fibers: ['121 - 150', '181 - 210', '212 - 240', '271 - 272', '274 - 276', '279 - 300'] Notes ===== (1) AZ went out of closed loop while we were tracking the field on cartridge 3 in the middle of observations. The problem was a wind_az_fault which was resolved via power-cycling the wind baffle. See Problems section for details. Exposures 326477 (BOSS) and 37140027 (APOGEE) were aborted when AZ went out of closed loop and we were troubleshooting. BHM lost 25 minutes to this problem *not* including the aborted exposure time which would be an additional 10 minutes. (2) No problems with the instrument lift or latches. We covered up the amber lights on the back of the latches with black tape. (3) 1um dust: sum=9112.50 ---- Observing Log ---- ============================================================================ AFTERNOON CHECKOUT ============================================================================ [observer@sdss4-hub ~]$ df -h Filesystem Size Used Avail Use% Mounted on /dev/vda2 7.7G 6.5G 891M 89% / tmpfs 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M 133M 52M 73% /boot /dev/vdb 19G 8.8G 9.1G 49% /exports/hub-local /dev/vdd 688G 612G 77G 89% /home /dev/vdc1 11T 11T 751G 94% /data 10.25.1.230:/data 21T 384M 21T 1% /sdss5_data --Test Actors, 23:12:42 - ok -- APOGEE Short Dark - 23:14:58 - ok -- sop doBossCalibs nbias=1 ndark=1 darktime=20, files=326457, 326458 - ok -- guider dark - ok 23:23Z APOGEE evenig cals started 23:24:20 sop collimateBoss: 23:27:01 Hartmann collimate output on cart #1 sp1: offset: r= 1649 (Out of focus); b= -9.3 (Out of focus) sp1: pred. move: spAverageMove= 2302 sp1: pred. resid: r= -653, b= -2.0, txt= OK, spTemp = 3.5 ---------- motorPosition sp1: -105, -91, -42; ---------- Median spectrographs temperatures: Tsp1= 3.5 Outside air temperature= 6.2; ---------- BOSS collimation was checked with cart 1. No adjustment was made. ---------- sop doBossCalibs nflat=1 narc=1 - files=326461,326462 -- ok ---------- 23:54:54 - APOGEE evening cals finished and checked. ---------- 00:02Z Mounted cart 1 and started ventilation. ============================================================================ NIGHT ============================================================================ 01:09:55 - Opened. Mostly clear. Force-filled BOSS spectrograph. [APOGEE] darks: 01:13:29 apogee.expose=apRaw-37140009, 10, A, Dark 01:15:16 apogee.expose=apRaw-37140010, 10, A, Dark ************** Cart. 1, 15016 ************** 01:26:53Z - gotoField. GSOGTF. Mostly clear. Seeing: 1.2-1.4" FWHM [BOSS] hartmanns: 01:29:02 boss exposure 4.0, file=326463 01:29:40 boss exposure 4.0, file=326464 01:30:28 sp1.motor.move= 3779, 3778, 3778 01:30:28 Hartmann collimate output on cart #1 sp1: offset: r= 3958 (Out of focus); b= -11.3 (Out of focus) sp1: pred. move: spAverageMove= 3778 sp1: pred. resid: r= 179, b= 0.6, txt= OK, spTemp = 3.3 [BOSS] cals: 01:30:47 boss exposure 4.0, file=326465 01:32:15 boss exposure 25.0, file=326466 MWM/BHM science exposures: 01:38:20 apogee.expose=apRaw-37140011, 46, A, Object 01:38:27 boss exposure 900.0, file=326467 01:46:30 apogee.expose=apRaw-37140012, 46, A, Object 01:54:41 apogee.expose=apRaw-37140013, 46, A, Object 01:54:48 boss exposure 900.0, file=326468 02:02:50 apogee.expose=apRaw-37140014, 46, A, Object 02:11:02 apogee.expose=apRaw-37140015, 46, A, Object 02:11:08 boss exposure 900.0, file=326469 02:19:11 apogee.expose=apRaw-37140016, 46, A, Object 02:27:22 apogee.expose=apRaw-37140017, 46, A, Object 02:27:28 boss exposure 900.0, file=326470 02:35:32 apogee.expose=apRaw-37140018, 46, A, Object [APOGEE] dome flat: 02:44:54 apogee.expose=apRaw-37140019, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140019.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [211, 273] Faint fibers: ['1 - 21', '23 - 28', '30 - 60', '121 - 150', 194, 227, '242 - 246', 253, 255, '260 - 261', '266 - 267', '271 - 272', '274 - 276', '279 - 283', '285 - 299'] [APOGEE] darks: 02:46:44 apogee.expose=apRaw-37140020, 10, A, Dark 02:48:31 apogee.expose=apRaw-37140021, 10, A, Dark ************** Cart. 3, 15254 ************** 02:50:45Z - gotoField. GSOGTF. Clear. Seeing: 1.1-1.8" FWHM [BOSS] hartmanns: 02:53:09 boss exposure 4.0, file=326471 02:53:47 boss exposure 4.0, file=326472 02:54:30 sp1.motor.move= 201, 201, 201 02:54:30 Hartmann collimate output on cart #3 sp1: offset: r= 659 (In Focus); b= 0.8 (In Focus) sp1: pred. move: spAverageMove= 201 sp1: pred. resid: r= 458, b= 1.4, txt= OK, spTemp = 2.5 [BOSS] cals: 02:54:49 boss exposure 4.0, file=326473 02:56:16 boss exposure 25.0, file=326474 MWM/BHM science exposures: 03:00:12 apogee.expose=apRaw-37140022, 46, A, Object 03:00:20 boss exposure 900.0, file=326475 03:08:22 apogee.expose=apRaw-37140023, 46, A, Object 03:16:34 apogee.expose=apRaw-37140024, 46, A, Object 03:16:41 boss exposure 900.0, file=326476 03:24:44 apogee.expose=apRaw-37140025, 46, A, Object 03:32:54 apogee.expose=apRaw-37140026, 46, A, Object 03:33:01 boss exposure 900.0, file=326477 -- aborted due to AZ problem 03:39Z - AZ went out of closed loop during the exposure sequence. See Problems section for details. 03:41:04 apogee.expose=apRaw-37140027, 46, A, Object -- aborted due to AZ problem Resumed science: 04:02:02 apogee.expose=apRaw-37140028, 46, A, Object 04:02:08 boss exposure 900.0, file=326478 04:10:11 apogee.expose=apRaw-37140029, 46, A, Object 04:18:22 apogee.expose=apRaw-37140030, 46, A, Object 04:18:29 boss exposure 900.0, file=326479 04:26:32 apogee.expose=apRaw-37140031, 46, A, Object 04:34:42 apogee.expose=apRaw-37140032, 46, A, Object 04:34:49 boss exposure 900.0, file=326480 04:42:52 apogee.expose=apRaw-37140033, 46, A, Object 04:51:08 apogee.expose=apRaw-37140034, 46, A, Object 04:51:14 boss exposure 900.0, file=326481 04:59:17 apogee.expose=apRaw-37140035, 46, A, Object [APOGEE] dome flat: 05:07:53 apogee.expose=apRaw-37140036, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140036.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [211, 273] Faint fibers: ['121 - 150', 156, 177, 271, '274 - 276', 278, 283, '287 - 295', 299] [APOGEE] darks: 05:10:18 apogee.expose=apRaw-37140037, 10, A, Dark 05:12:05 apogee.expose=apRaw-37140038, 10, A, Dark ****************************** Cart. 5, 15286, RV_NGC2420_btx ****************************** 05:15:01Z - gotoField. GSOGTF. Clear. Seeing: 1.1-2.2" FWHM [BOSS] hartmanns: 05:17:04 boss exposure 4.0, file=326482 05:17:42 boss exposure 4.0, file=326483 05:18:31 sp1.motor.move= 1338, 1338, 1339 05:18:31 Hartmann collimate output on cart #5 sp1: offset: r= 1649 (Out of focus); b= -3.2 (In Focus) sp1: pred. move: spAverageMove= 1338 sp1: pred. resid: r= 310, b= 1.0, txt= OK, spTemp = 1.5 [BOSS] cals: 05:18:50 boss exposure 4.0, file=326484 05:20:17 boss exposure 25.0, file=326485 MWM/BHM science exposures: 05:22:08 apogee.expose=apRaw-37140039, 46, A, Object 05:22:15 boss exposure 900.0, file=326486 05:30:18 apogee.expose=apRaw-37140040, 46, A, Object 05:38:28 apogee.expose=apRaw-37140041, 46, A, Object 05:38:35 boss exposure 900.0, file=326487 05:46:38 apogee.expose=apRaw-37140042, 46, A, Object 05:54:49 apogee.expose=apRaw-37140043, 46, A, Object 05:54:56 boss exposure 900.0, file=326488 06:02:58 apogee.expose=apRaw-37140044, 46, A, Object 06:11:10 apogee.expose=apRaw-37140045, 46, A, Object 06:11:16 boss exposure 900.0, file=326489 06:19:19 apogee.expose=apRaw-37140046, 46, A, Object [APOGEE] dome flat: 06:28:20 apogee.expose=apRaw-37140047, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140047.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [211, 273] Faint fibers: [12, 14, '16 - 17', '31 - 60', 104, 106, '115 - 117', '121 - 140', 142, '147 - 150', 154, '158 - 159', 161, 164, 179, '181 - 210'] [APOGEE] darks: 06:30:12 apogee.expose=apRaw-37140048, 10, A, Dark 06:32:00 apogee.expose=apRaw-37140049, 10, A, Dark ************************* Cart. 7, 15285, RV_195+18 ************************* 06:34:10Z - gotoField. GSOGTF. Clear. Seeing: 1.5-2.0" FWHM [BOSS] hartmanns: 06:36:03 boss exposure 4.0, file=326490 06:36:43 boss exposure 4.0, file=326491 06:37:29 sp1.motor.move= -3384, -3384, -3383 06:37:29 Hartmann collimate output on cart #7 sp1: offset: r= -3298 (Out of focus); b= 10.9 (Out of focus) sp1: pred. move: spAverageMove= -3384 sp1: pred. resid: r= 86, b= 0.3, txt= OK, spTemp = 1.4 [BOSS] cals: 06:37:47 boss exposure 4.0, file=326492 06:39:16 boss exposure 25.0, file=326493 MWM/BHM science exposures: 06:41:10 apogee.expose=apRaw-37140050, 46, A, Object 06:41:17 boss exposure 900.0, file=326494 06:49:19 apogee.expose=apRaw-37140051, 46, A, Object 06:57:30 apogee.expose=apRaw-37140052, 46, A, Object 06:57:37 boss exposure 900.0, file=326495 07:05:39 apogee.expose=apRaw-37140053, 46, A, Object 07:13:51 apogee.expose=apRaw-37140054, 46, A, Object 07:14:02 boss exposure 900.0, file=326496 07:22:01 apogee.expose=apRaw-37140055, 46, A, Object 07:30:15 apogee.expose=apRaw-37140056, 46, A, Object 07:30:22 boss exposure 900.0, file=326497 07:38:25 apogee.expose=apRaw-37140057, 46, A, Object [APOGEE] dome flat: 07:46:47 apogee.expose=apRaw-37140058, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140058.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [211, 273] Faint fibers: [10, '121 - 150', 173, 196, '212 - 240'] [APOGEE] darks: 07:50:05 apogee.expose=apRaw-37140059, 10, A, Dark 07:51:53 apogee.expose=apRaw-37140060, 10, A, Dark ***************************** Cart. 2, 15193, RV_247+62_btx ***************************** 07:54:07Z - gotoField. GSOGTF. Clear. Seeing: 1.4-1.9" FWHM [BOSS] hartmanns: 07:56:05 boss exposure 4.0, file=326498 07:56:43 boss exposure 4.0, file=326499 07:57:24 sp1.motor.move= -284, -285, -285 07:57:24 Hartmann collimate output on cart #2 sp1: offset: r= 329 (In Focus); b= 2.8 (In Focus) sp1: pred. move: spAverageMove= -285 sp1: pred. resid: r= 614, b= 1.9, txt= OK, spTemp = 1.1 [BOSS] cals: 07:57:43 boss exposure 4.0, file=326500 07:59:10 boss exposure 25.0, file=326501 MWM/BHM science exposures: 08:02:19 apogee.expose=apRaw-37140061, 46, A, Object 08:02:26 boss exposure 900.0, file=326502 08:10:31 apogee.expose=apRaw-37140062, 46, A, Object 08:18:50 apogee.expose=apRaw-37140063, 46, A, Object 08:18:51 boss exposure 900.0, file=326503 08:26:59 apogee.expose=apRaw-37140064, 46, A, Object 08:35:11 apogee.expose=apRaw-37140065, 46, A, Object 08:35:11 boss exposure 900.0, file=326504 08:43:20 apogee.expose=apRaw-37140066, 46, A, Object 08:51:31 apogee.expose=apRaw-37140067, 46, A, Object 08:51:31 boss exposure 900.0, file=326505 08:59:41 apogee.expose=apRaw-37140068, 46, A, Object [APOGEE] dome flat: 09:07:56 apogee.expose=apRaw-37140069, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140069.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [38, 57, 59, 137, 190, 198, 211, 259, 273] Faint fibers: ['61 - 73', '75 - 90', '121 - 136', '138 - 150', 153, '161 - 162', 166, '169 - 173', '175 - 180', '212 - 240'] [APOGEE] darks: 09:10:08 apogee.expose=apRaw-37140070, 10, A, Dark 09:11:56 apogee.expose=apRaw-37140071, 10, A, Dark ************************************** Cart. 8, 15199, RV_K2EB_C06_314+48_btx ************************************** 09:14:03Z - gotoField. GSOGTF. Clear. Seeing: 1.6-2.3"" FWHM [BOSS] hartmanns: 09:16:12 boss exposure 4.0, file=326506 09:16:50 boss exposure 4.0, file=326507 09:17:33 sp1.motor.move= -281, -281, -281 09:17:33 Hartmann collimate output on cart #8 sp1: offset: r= 659 (In Focus); b= 3.8 (In Focus) sp1: pred. move: spAverageMove= -281 sp1: pred. resid: r= 940, b= 2.9, txt= OK, spTemp = 1.4 [BOSS] cals: 09:17:51 boss exposure 4.0, file=326508 09:19:20 boss exposure 25.0, file=326509 MWM/BHM science exposures: 09:23:09 apogee.expose=apRaw-37140072, 46, A, Object 09:23:16 boss exposure 900.0, file=326510 09:31:19 apogee.expose=apRaw-37140073, 46, A, Object 09:39:31 apogee.expose=apRaw-37140074, 46, A, Object 09:39:37 boss exposure 900.0, file=326511 09:47:40 apogee.expose=apRaw-37140075, 46, A, Object 09:55:52 apogee.expose=apRaw-37140076, 46, A, Object 09:56:02 boss exposure 900.0, file=326512 10:04:02 apogee.expose=apRaw-37140077, 46, A, Object 10:12:16 apogee.expose=apRaw-37140078, 46, A, Object 10:12:23 boss exposure 900.0, file=326513 10:20:25 apogee.expose=apRaw-37140079, 46, A, Object [APOGEE] dome flat: 10:28:56 apogee.expose=apRaw-37140080, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140080.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [35, 184, 211, 227, 273] Faint fibers: ['121 - 180', '212 - 213', '219 - 220', '222 - 225', '228 - 240', '271 - 272', '274 - 276', '279 - 300'] [APOGEE] darks: 10:31:37 apogee.expose=apRaw-37140081, 10, A, Dark 10:33:24 apogee.expose=apRaw-37140082, 10, A, Dark ***************************** Cart. 4, 15201, RV_335+61_btx ***************************** 10:35:45Z - gotoField. GSOGTF. Clear. Seeing: 1.6-2.1" FWHM [BOSS] hartmanns: 10:37:42 boss exposure 4.0, file=326514 10:38:19 boss exposure 4.0, file=326515 10:39:02 sp1.motor.move= 856, 856, 857 10:39:02 Hartmann collimate output on cart #4 sp1: offset: r= 1649 (Out of focus); b= -0.2 (In Focus) sp1: pred. move: spAverageMove= 856 sp1: pred. resid: r= 792, b= 2.5, txt= OK, spTemp = 1.4 [BOSS] cals: 10:39:21 boss exposure 4.0, file=326516 10:40:48 boss exposure 25.0, file=326517 MWM/BHM science exposures: 10:42:44 apogee.expose=apRaw-37140083, 46, A, Object 10:42:51 boss exposure 900.0, file=326518 10:50:53 apogee.expose=apRaw-37140084, 46, A, Object 10:59:06 apogee.expose=apRaw-37140085, 46, A, Object 10:59:12 boss exposure 900.0, file=326519 11:07:15 apogee.expose=apRaw-37140086, 46, A, Object 11:15:26 apogee.expose=apRaw-37140087, 46, A, Object 11:15:33 boss exposure 900.0, file=326520 11:23:35 apogee.expose=apRaw-37140088, 46, A, Object [APOGEE] dome flat: 11:32:05 apogee.expose=apRaw-37140089, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140089.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [20, 39, 151, 186, 193, 211, 241, 273, 278] Faint fibers: [1, '4 - 5', '7 - 8', 10, 12, 15, '18 - 19', '21 - 24', '26 - 27', 29, '31 - 38', '40 - 60', '121 - 123', '125 - 128', 133, '135 - 136', 140, 148, '152 - 154', '156 - 163', '165 - 170', 172, '175 - 183', 185, '187 - 190', 192, '194 - 197', 199, '206 - 208'] [APOGEE] darks: 11:33:39 apogee.expose=apRaw-37140090, 10, A, Dark 11:35:26 apogee.expose=apRaw-37140091, 10, A, Dark ************************* Cart. 9, 15202, RV_000+60 ************************* 11:37:57Z - gotoField. GSOGTF. Clear. Seeing: " FWHM [BOSS] hartmanns: 11:39:47 boss exposure 4.0, file=326521 11:40:25 boss exposure 4.0, file=326522 11:41:08 sp1.motor.move= -1912, -1912, -1912 11:41:08 Hartmann collimate output on cart #9 sp1: offset: r= -1319 (Out of focus); b= 7.9 (Out of focus) sp1: pred. move: spAverageMove= -1912 sp1: pred. resid: r= 593, b= 1.9, txt= OK, spTemp = 1.7 [BOSS] cals: 11:41:27 boss exposure 4.0, file=326523 11:42:54 boss exposure 25.0, file=326524 MWM/BHM science exposures: 11:45:29 apogee.expose=apRaw-37140092, 46, A, Object 11:45:35 boss exposure 900.0, file=326525 11:53:38 apogee.expose=apRaw-37140093, 46, A, Object 12:01:49 apogee.expose=apRaw-37140094, 46, A, Object 12:01:56 boss exposure 900.0, file=326526 12:09:58 apogee.expose=apRaw-37140095, 46, A, Object 12:18:12 apogee.expose=apRaw-37140096, 46, A, Object 12:18:19 boss exposure 900.0, file=326527 12:26:23 apogee.expose=apRaw-37140097, 46, A, Object [APOGEE] dome flat: 12:34:58 apogee.expose=apRaw-37140098, 5, A, DomeFlat flat= /data/apogee/utr_cdr/59276/apRaw-37140098.fits master= apRaw-21180043.fits nfibers= 300 Missing fibers: [36, 211, 245, 273] Faint fibers: ['121 - 150', '181 - 210', '212 - 240', '271 - 272', '274 - 276', '279 - 300'] [APOGEE] darks: 12:36:43 apogee.expose=apRaw-37140099, 10, A, Dark 12:38:31 apogee.expose=apRaw-37140100, 10, A, Dark 12:45Z - Closed. Mounted cartridge 2. Started morning calibrations. ---- BOSS Spectrograph Collimation Summary ---- Time Cart TSP1 R1 B1 Move1 B1Resid ================================================= 01:31 1-15016A 3.3 3958 -11.3 3778 0.6 02:55 3-15254A 2.5 659 0.8 201 1.4 05:19 5-15286A 1.5 1649 -3.2 1338 1.0 06:38 7-15285A 1.4 -3298 10.9 -3384 0.3 07:58 2-15193A 1.1 329 2.8 -285 1.9 09:18 8-15199A 1.4 659 3.8 -281 2.9 10:39 4-15201A 1.4 1649 -0.2 856 2.5 11:41 9-15202A 1.7 -1319 7.9 -1912 1.9 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9300 -4.9280 Axial B: -4.6710 -4.6660 Axial C: -5.7760 -5.7770 Trans D: -4.3730 -4.3890 Lateral E: 0.3745 0.3750 Lateral F: 0.5690 0.5675 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 6.22 Altitude: 30.000035067407072 MIGS TONIGHT NOMINAL Axial A: -9.4410 -9.4420 Axial B: -9.4060 -9.4070 Axial C: -9.4820 -9.4960 Trans D: 0.0460 0.0420 GALILS Commanded: 4623700 4608550 4666900 -2000 -6600 Actual: 4603980 4585795 4632176 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3657.01 -13.96 -2.89 12.7 114.17 ---- Telescope Offsets and Scale ---- Time Cart Az Alt Rot objOff guideRot calibOff guideRMS ================================================================================ 01:14 1-15016A 121.0 30.0 -0.0 (0.0,0.0) 0.0 ( 0, 0, 0) 99.999 01:38 1-15016A 93.9 59.7 255.1 (8.3,2.5) 29.1 ( 0, 0, 0) 0.409 01:51 1-15016A 92.5 62.2 255.4 (7.9,3.7) 30.5 ( 0, 0, 0) 0.339 02:03 1-15016A 91.0 64.7 255.5 (8.5,3.9) 29.3 ( 0, 0, 0) 0.303 02:15 1-15016A 89.4 67.3 255.6 (8.9,4.1) 4.3 ( 0, 0, 0) 0.373 02:27 1-15016A 87.6 69.8 255.4 (9.1,4.3) 0.6 ( 0, 0, 0) 0.281 02:39 1-15016A 85.5 72.4 254.9 (9.3,4.6) -1.1 ( 0, 0, 0) 0.312 03:00 3-15254A 44.2 47.3 215.9 (6.9,4.5) 0.2 ( 0, 0, 0) 1.200 03:12 3-15254A 40.5 49.0 213.1 (7.7,5.1) 2.0 ( 0, 0, 0) 0.436 03:24 3-15254A 36.5 50.6 210.0 (9.3,4.3) -4.1 ( 0, 0, 0) 0.371 03:37 3-15254A 32.2 52.0 206.6 (10.8,3.6) -4.4 ( 0, 0, 0) 0.322 04:02 3-15254A 22.3 54.5 198.6 (0.0,0.0) 0.0 ( 0, 0, 0) 3.739 04:14 3-15254A 17.3 55.3 194.5 (10.5,0.7) 13.3 ( 0, 0, 0) 0.394 04:26 3-15254A 12.0 56.0 190.1 (10.8,0.8) 11.1 ( 0, 0, 0) 0.201 04:38 3-15254A 6.6 56.4 185.6 (11.5,0.4) 11.2 ( 0, 0, 0) 0.265 04:50 3-15254A 1.2 56.6 181.0 (11.7,-0.6) 8.5 ( 0, 0, 0) 0.343 05:03 3-15254A -4.4 56.5 176.3 (12.5,0.1) 4.4 ( 0, 0, 0) 0.262 05:22 5-15286A 297.2 68.0 126.8 (4.3,-0.9) 25.7 ( 0, 0, 0) 0.395 05:34 5-15286A 293.1 65.7 124.1 (4.5,-1.2) 27.9 ( 0, 0, 0) 0.445 05:46 5-15286A 289.5 63.4 121.9 (4.8,-0.6) 27.8 ( 0, 0, 0) 0.601 05:58 5-15286A 286.3 60.9 120.2 (5.3,0.7) 28.9 ( 0, 0, 0) 0.355 06:11 5-15286A 283.6 58.5 118.9 (6.3,1.3) 28.9 ( 0, 0, 0) 0.345 06:23 5-15286A 281.1 56.0 117.9 (6.4,2.4) 30.7 ( 0, 0, 0) 0.347 06:41 7-15285A 272.0 50.9 113.5 (4.5,6.9) 30.3 ( 0, 0, 0) 0.434 06:53 7-15285A 270.3 48.4 113.4 (6.6,7.6) 32.8 ( 0, 0, 0) 0.403 07:05 7-15285A 268.7 45.8 113.4 (6.4,7.8) 41.2 ( 0, 0, 0) 0.331 07:18 7-15285A 267.1 43.3 113.5 (7.1,8.1) 39.2 ( 0, 0, 0) 0.373 07:30 7-15285A 265.6 40.7 113.8 (7.5,8.6) 44.9 ( 0, 0, 0) 0.295 07:42 7-15285A 264.2 38.2 114.1 (7.9,9.0) 54.6 ( 0, 0, 0) 0.326 08:02 2-15193A -13.2 66.5 168.7 (3.2,2.6) -88.1 ( 0, 0, 0) 0.421 08:14 2-15193A -20.4 65.8 162.6 (4.3,2.5) -92.2 ( 0, 0, 0) 0.295 08:27 2-15193A -27.1 64.8 157.1 (3.6,1.4) -90.0 ( 0, 0, 0) 0.292 08:39 2-15193A -33.3 63.5 152.0 (3.1,0.7) -86.4 ( 0, 0, 0) 0.340 08:51 2-15193A -38.9 62.0 147.5 (2.9,-0.1) -78.1 ( 0, 0, 0) 0.257 09:03 2-15193A -44.0 60.3 143.6 (2.7,-0.1) -73.2 ( 0, 0, 0) 0.266 09:23 8-15199A 6.2 43.2 185.2 (7.6,4.4) 9.7 ( 0, 0, 0) 0.512 09:35 8-15199A 2.2 43.4 181.8 (8.8,5.0) 7.8 ( 0, 0, 0) 0.432 09:47 8-15199A -1.9 43.4 178.3 (9.5,5.6) 11.5 ( 0, 0, 0) 0.390 10:00 8-15199A -5.9 43.2 174.8 (10.5,5.6) 7.0 ( 0, 0, 0) 0.354 10:12 8-15199A -9.9 42.9 171.3 (11.0,6.1) 12.3 ( 0, 0, 0) 0.348 10:24 8-15199A -13.9 42.4 167.9 (11.6,6.1) 18.6 ( 0, 0, 0) 0.411 10:43 4-15201A -16.2 58.9 166.3 (9.5,3.9) 17.4 ( 0, 0, 0) 0.651 10:55 4-15201A -21.7 58.1 161.7 (10.6,3.0) 13.3 ( 0, 0, 0) 0.536 11:07 4-15201A -27.0 57.0 157.4 (10.7,2.8) 11.9 ( 0, 0, 0) 0.761 11:19 4-15201A -32.0 55.8 153.4 (10.9,2.5) 12.1 ( 0, 0, 0) 0.406 11:31 4-15201A -36.6 54.3 149.7 (10.4,2.2) 14.9 ( 0, 0, 0) 0.359 11:46 9-15202A -30.7 62.8 154.1 (9.1,2.6) -25.9 ( 0, 0, 0) 0.365 11:58 9-15202A -36.3 61.4 149.6 (9.6,2.0) -29.2 ( 0, 0, 0) 0.407 12:10 9-15202A -41.5 59.8 145.5 (9.5,1.1) -31.4 ( 0, 0, 0) 0.336 ---- Focus Log ---- Time Cart Scale M1 M2 Focus Az Alt Temp Wind Dir FWHM ================================================================================ 01:14 1-15016A 0.0 0 3658 0 121.0 30.0 4.5 6 221 2.4 01:38 1-15016A 70.0 -691 3117 136 93.9 59.7 2.7 5 192 1.4 01:51 1-15016A 76.0 -748 3063 135 92.5 62.2 2.5 6 187 1.2 02:03 1-15016A 73.0 -716 3103 151 91.0 64.7 2.5 5 196 1.2 02:15 1-15016A 56.0 -557 3228 152 89.4 67.3 2.3 7 194 1.2 02:27 1-15016A 53.0 -522 3280 182 87.6 69.8 1.7 6 208 1.3 02:39 1-15016A 55.0 -544 3272 195 85.5 72.4 1.2 8 190 1.2 03:00 3-15254A 162.0 -1599 2446 180 44.2 47.3 -0.4 6 185 1.8 03:12 3-15254A 163.0 -1611 2445 195 40.5 49.0 0.0 4 186 1.6 03:24 3-15254A 125.0 -1235 2731 175 36.5 50.6 0.6 5 186 1.5 03:37 3-15254A 86.0 -850 3008 136 32.2 52.0 0.2 6 196 1.4 04:02 3-15254A 86.0 -850 3005 141 22.3 54.5 -0.2 7 186 1.3 04:14 3-15254A 69.0 -681 3160 159 17.3 55.3 -0.6 5 184 1.8 04:26 3-15254A 59.0 -582 3236 155 12.0 56.0 -0.6 9 197 1.1 04:38 3-15254A 37.0 -363 3386 124 6.6 56.4 2.2 10 214 1.2 04:50 3-15254A 1.0 -9 3586 33 1.2 56.6 2.9 9 225 1.1 05:03 3-15254A -16.0 159 3686 -7 -4.4 56.5 2.6 7 212 1.5 05:22 5-15286A -16.0 159 3652 -31 297.2 68.0 2.3 11 233 1.2 05:34 5-15286A -40.0 391 3810 -53 293.1 65.7 2.2 14 229 1.1 05:46 5-15286A -27.0 270 3720 -47 289.5 63.4 2.3 11 210 2.2 05:58 5-15286A -14.0 137 3632 -30 286.3 60.9 2.0 11 206 1.3 06:11 5-15286A -9.0 92 3614 -18 283.6 58.5 2.1 5 217 1.9 06:23 5-15286A 12.0 -121 3465 1 281.1 56.0 1.7 8 259 1.3 06:41 7-15285A 16.0 -162 3486 42 272.0 50.9 0.6 7 214 1.8 06:53 7-15285A 46.0 -455 3293 83 270.3 48.4 0.6 15 237 2.0 07:05 7-15285A 46.0 -455 3297 78 268.7 45.8 0.5 11 239 1.5 07:18 7-15285A 81.0 -796 3017 73 267.1 43.3 0.9 12 235 1.5 07:30 7-15285A 98.0 -965 2886 71 265.6 40.7 1.2 11 247 2.0 07:42 7-15285A 110.0 -1089 2786 52 264.2 38.2 1.4 13 254 1.8 08:02 2-15193A 26.0 -257 3397 72 -13.2 66.5 1.3 13 263 1.4 08:14 2-15193A 22.0 -213 3435 74 -20.4 65.8 1.7 11 276 1.6 08:27 2-15193A 14.0 -136 3483 54 -27.1 64.8 1.8 14 279 1.4 08:39 2-15193A -4.0 41 3576 -1 -33.3 63.5 2.2 11 276 1.9 08:51 2-15193A -6.0 57 3579 -11 -38.9 62.0 2.0 13 284 1.6 09:03 2-15193A -4.0 41 3561 -23 -44.0 60.3 2.1 16 301 1.9 09:23 8-15199A 130.0 -1184 2573 -49 6.2 43.2 1.9 14 286 2.0 09:35 8-15199A 110.0 -1098 2616 -81 2.2 43.4 2.1 18 292 1.7 09:47 8-15199A 106.0 -1044 2633 -103 -1.9 43.4 2.4 13 280 1.6 10:00 8-15199A 124.0 -1223 2510 -80 -5.9 43.2 2.0 16 287 1.8 10:12 8-15199A 123.0 -1210 2543 -58 -9.9 42.9 1.9 11 305 2.2 10:24 8-15199A 137.0 -1353 2450 -35 -13.9 42.4 1.9 12 308 2.3 10:43 4-15201A 113.0 -1114 2591 -40 -16.2 58.9 2.3 10 285 1.6 10:55 4-15201A 82.0 -812 2778 -105 -21.7 58.1 2.5 17 297 1.9 11:07 4-15201A 90.0 -891 2708 -113 -27.0 57.0 2.5 15 300 2.1 11:19 4-15201A 98.0 -965 2679 -85 -32.0 55.8 2.3 12 315 1.5 11:31 4-15201A 97.0 -958 2647 -125 -36.6 54.3 2.9 13 295 1.9 11:46 9-15202A 47.0 -465 3047 -114 -30.7 62.8 2.8 19 296 2.1 11:58 9-15202A 57.0 -560 3006 -79 -36.3 61.4 3.0 20 306 1.8 12:10 9-15202A 54.0 -528 3038 -75 -41.5 59.8 2.6 19 289 1.7 ---- Telescope Status ---- Status at close: Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 2 Counterweights at: 447 450 447 446 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 207 lbs, 21.1 psi ---- Software Used ---- Get Versions, 03/02/21, 23:24:04 --- STUI software --- STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.4 hartmann : 1.8.0 hub : v4.2.4 mcp : 1.12-12-g222b -mcp.plc : 34 -mcp.azFiduci : v1_144 -mcp.altFiduc : v1_144 -mcp.rotFiduc : v1_144 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.5 --- Other versions --- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.2 autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk exported ---- APOGEE Data Summary ---- [observer@sdss4-hub ~]$ list_ap -m 59275 -morning APOGEE data list, mjd=59275, morning raw_data: /data/apogee/utr_cdr/59275/apRaw-*.fits archive: /data/apogee/archive/59275/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59275/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59275 1 12:36 37130090 Dark 60 A 13.0 1-15016 a-b-c - - 59275 2 12:47 37130091 Dark 60 A 13.0 1-15016 a-b-c - - 59275 3 12:58 37130092 Dark 60 A 13.0 1-15016 a-b-c - - 59275 4 13:09 37130093 QuarFlat 10 A 13.0 1-15016 a-b-c - 45 59275 5 13:10 37130094 QuarFlat 10 A 13.0 1-15016 a-b-c - 45 59275 6 13:12 37130095 QuarFlat 10 A 13.0 1-15016 a-b-c - 45 59275 7 13:14 37130096 Arc-Thar 12 A 13.0 1-15016 a-b-c -1.46 - 59275 8 13:16 37130097 Arc-Thar 12 A 13.0 1-15016 a-b-c -1.46 - 59275 9 13:18 37130098 Arc-Une 40 A 13.0 1-15016 a-b-c - - 59275 10 13:25 37130099 Arc-Une 40 A 13.0 1-15016 a-b-c - - 59275 11 13:33 37130100 Dark 30 A 13.0 1-15016 a-b-c - - 59275 12 13:38 37130101 InteFlat 30 A 13.0 1-15016 a-b-c - 0 59275 13 13:43 37130102 InteFlat 30 A 13.0 1-15016 a-b-c - 0 59275 14 13:49 37130103 InteFlat 30 A 13.0 1-15016 a-b-c - 0 59275 15 13:54 37130104 Dark 30 A 13.0 1-15016 a-b-c - - -------------------------------------------------------------------------------- APOGEE data list, mjd=59276, all raw_data: /data/apogee/utr_cdr/59276/apRaw-*.fits archive: /data/apogee/archive/59276/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59276/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59276 1 23:13 37140001 Dark 3 A 13.0 1-15016 a-b-c - - 59276 2 23:23 37140002 Dark 60 A 13.0 1-15016 a-b-c - - 59276 3 23:33 37140003 QuarFlat 10 A 13.0 1-15016 a-b-c - 47 59276 4 23:35 37140004 Arc-Thar 12 A 13.0 1-15016 a-b-c -1.48 - 59276 5 23:37 37140005 Arc-Thar 12 A 13.0 1-15016 a-b-c -1.48 - 59276 6 23:40 37140006 Arc-Une 40 A 13.0 1-15016 a-b-c - - 59276 7 23:47 37140007 Arc-Une 40 A 13.0 1-15016 a-b-c - - 59276 8 23:54 37140008 Dark 60 A 13.0 1-15016 a-b-c - - 59276 9 01:13 37140009 Dark 10 A 13.0 1-15016 a-b-c - - 59276 10 01:15 37140010 Dark 10 A 13.0 1-15016 a-b-c - - 59276 11 01:38 37140011 Object 46 A 13.0 1-15016 a-b-c -1.40 - 59276 12 01:46 37140012 Object 46 A 13.0 1-15016 a-b-c -1.42 - 59276 13 01:54 37140013 Object 46 A 13.0 1-15016 a-b-c -1.46 - 59276 14 02:02 37140014 Object 46 A 13.0 1-15016 a-b-c -1.45 - 59276 15 02:10 37140015 Object 46 A 13.0 1-15016 a-b-c -1.46 - 59276 16 02:18 37140016 Object 46 A 13.0 1-15016 a-b-c -1.43 - 59276 17 02:27 37140017 Object 46 A 13.0 1-15016 a-b-c -1.46 - 59276 18 02:35 37140018 Object 46 A 13.0 1-15016 a-b-c -1.46 - 59276 19 02:44 37140019 DomeFlat 5 A 13.0 1-15016 a-b-c - 31 59276 20 02:46 37140020 Dark 10 A 13.0 1-15016 a-b-c - - 59276 21 02:48 37140021 Dark 10 A 13.0 1-15016 a-b-c - - 59276 22 03:00 37140022 Object 46 A 13.0 3-15254 a-b-c -1.41 - 59276 23 03:08 37140023 Object 46 A 13.0 3-15254 a-b-c -1.40 - 59276 24 03:16 37140024 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 25 03:24 37140025 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 26 03:32 37140026 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 27 03:40 37140027 Object 46 A 13.0 3-15254 a-b-c -1.50 - 59276 28 04:01 37140028 Object 46 A 13.0 3-15254 a-b-c -1.41 - 59276 29 04:10 37140029 Object 46 A 13.0 3-15254 a-b-c -1.43 - 59276 30 04:18 37140030 Object 46 A 13.0 3-15254 a-b-c -1.41 - 59276 31 04:26 37140031 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 32 04:34 37140032 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 33 04:42 37140033 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 34 04:50 37140034 Object 46 A 13.0 3-15254 a-b-c -1.42 - 59276 35 04:59 37140035 Object 46 A 13.0 3-15254 a-b-c -1.41 - 59276 36 05:07 37140036 DomeFlat 5 A 13.0 3-15254 a-b-c - 33 59276 37 05:10 37140037 Dark 10 A 13.0 3-15254 a-b-c - - 59276 38 05:11 37140038 Dark 10 A 13.0 3-15254 a-b-c - - 59276 39 05:21 37140039 Object 46 A 13.0 5-15286 a-b-c -1.43 - 59276 40 05:30 37140040 Object 46 A 13.0 5-15286 a-b-c -1.44 - 59276 41 05:38 37140041 Object 46 A 13.0 5-15286 a-b-c -1.46 - 59276 42 05:46 37140042 Object 46 A 13.0 5-15286 a-b-c -1.43 - 59276 43 05:54 37140043 Object 46 A 13.0 5-15286 a-b-c -1.42 - 59276 44 06:02 37140044 Object 46 A 13.0 5-15286 a-b-c -1.43 - 59276 45 06:10 37140045 Object 46 A 13.0 5-15286 a-b-c -1.43 - 59276 46 06:19 37140046 Object 46 A 13.0 5-15286 a-b-c -1.42 - 59276 47 06:28 37140047 DomeFlat 5 A 13.0 5-15286 a-b-c - 28 59276 48 06:30 37140048 Dark 10 A 13.0 5-15286 a-b-c - - 59276 49 06:31 37140049 Dark 10 A 13.0 5-15286 a-b-c - - 59276 50 06:40 37140050 Object 46 A 13.0 7-15285 a-b-c -1.43 - 59276 51 06:49 37140051 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 52 06:57 37140052 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 53 07:05 37140053 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 54 07:13 37140054 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 55 07:21 37140055 Object 46 A 13.0 7-15285 a-b-c -1.41 - 59276 56 07:30 37140056 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 57 07:38 37140057 Object 46 A 13.0 7-15285 a-b-c -1.42 - 59276 58 07:46 37140058 DomeFlat 5 A 13.0 7-15285 a-b-c - 39 59276 59 07:49 37140059 Dark 10 A 13.0 7-15285 a-b-c - - 59276 60 07:51 37140060 Dark 10 A 13.0 7-15285 a-b-c - - 59276 61 08:02 37140061 Object 46 A 13.0 2-15193 a-b-c -1.44 - 59276 62 08:10 37140062 Object 46 A 13.0 2-15193 a-b-c -1.43 - 59276 63 08:18 37140063 Object 46 A 13.0 2-15193 a-b-c -1.44 - 59276 64 08:26 37140064 Object 46 A 13.0 2-15193 a-b-c -1.43 - 59276 65 08:34 37140065 Object 46 A 13.0 2-15193 a-b-c -1.43 - 59276 66 08:42 37140066 Object 46 A 13.0 2-15193 a-b-c -1.45 - 59276 67 08:51 37140067 Object 46 A 13.0 2-15193 a-b-c -1.44 - 59276 68 08:59 37140068 Object 46 A 13.0 2-15193 a-b-c -1.44 - 59276 69 09:07 37140069 DomeFlat 5 A 13.0 2-15193 a-b-c - 30 59276 70 09:09 37140070 Dark 10 A 13.0 2-15193 a-b-c - - 59276 71 09:11 37140071 Dark 10 A 13.0 2-15193 a-b-c - - 59276 72 09:22 37140072 Object 46 A 13.0 8-15199 a-b-c -1.44 - 59276 73 09:31 37140073 Object 46 A 13.0 8-15199 a-b-c -1.40 - 59276 74 09:39 37140074 Object 46 A 13.0 8-15199 a-b-c -1.42 - 59276 75 09:47 37140075 Object 46 A 13.0 8-15199 a-b-c -1.43 - 59276 76 09:55 37140076 Object 46 A 13.0 8-15199 a-b-c -1.42 - 59276 77 10:03 37140077 Object 46 A 13.0 8-15199 a-b-c -1.42 - 59276 78 10:12 37140078 Object 46 A 13.0 8-15199 a-b-c -1.43 - 59276 79 10:20 37140079 Object 46 A 13.0 8-15199 a-b-c -1.43 - 59276 80 10:28 37140080 DomeFlat 5 A 13.0 8-15199 a-b-c - 22 59276 81 10:31 37140081 Dark 10 A 13.0 8-15199 a-b-c - - 59276 82 10:33 37140082 Dark 10 A 13.0 8-15199 a-b-c - - 59276 83 10:42 37140083 Object 46 A 13.0 4-15201 a-b-c -1.47 - 59276 84 10:50 37140084 Object 46 A 13.0 4-15201 a-b-c -1.46 - 59276 85 10:58 37140085 Object 46 A 13.0 4-15201 a-b-c -1.45 - 59276 86 11:07 37140086 Object 46 A 13.0 4-15201 a-b-c -1.45 - 59276 87 11:15 37140087 Object 46 A 13.0 4-15201 a-b-c -1.47 - 59276 88 11:23 37140088 Object 46 A 13.0 4-15201 a-b-c -1.45 - 59276 89 11:31 37140089 DomeFlat 5 A 13.0 4-15201 a-b-c - 35 59276 90 11:33 37140090 Dark 10 A 13.0 4-15201 a-b-c - - 59276 91 11:35 37140091 Dark 10 A 13.0 4-15201 a-b-c - - 59276 92 11:45 37140092 Object 46 A 13.0 9-15202 a-b-c -1.45 - 59276 93 11:53 37140093 Object 46 A 13.0 9-15202 a-b-c -1.44 - 59276 94 12:01 37140094 Object 46 A 13.0 9-15202 a-b-c -1.44 - 59276 95 12:09 37140095 Object 46 A 13.0 9-15202 a-b-c -1.45 - 59276 96 12:18 37140096 Object 46 A 13.0 9-15202 a-b-c -1.45 - 59276 97 12:26 37140097 Object 46 A 13.0 9-15202 a-b-c -1.45 - 59276 98 12:34 37140098 DomeFlat 5 A 13.0 9-15202 a-b-c - 44 59276 99 12:36 37140099 Dark 10 A 13.0 9-15202 a-b-c - - 59276 100 12:38 37140100 Dark 10 A 13.0 9-15202 a-b-c - - -------------------------------------------------------------------------------- ---- BOSS Data Summary ---- Reading FITS from /data/spectro/59276/ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n time filename crt plt flav Shu Dth exp colA colB colC Hrt b1 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:15 b1-00326457 1 15016 bia Clo C 0.0 -2407 -2391 -2344 23:15 r1-00326457 1 15016 bia Clo C 0.0 -2407 -2391 -2344 2 23:16 b1-00326458 1 15016 dar Clo C 20.0 -2407 -2391 -2344 23:16 r1-00326458 1 15016 dar Clo C 20.0 -2407 -2391 -2344 3 23:24 b1-00326459 1 15016 arc Lef C 4.1 -2407 -2391 -2344 HART 23:24 r1-00326459 1 15016 arc Lef C 4.1 -2407 -2391 -2344 HART 4 23:25 b1-00326460 1 15016 arc Rig C 4.1 -2407 -2391 -2344 HART 23:25 r1-00326460 1 15016 arc Rig C 4.1 -2407 -2391 -2344 HART 5 23:30 b1-00326461 1 15016 fla Out C 25.1 -105 -91 -42 23:30 r1-00326461 1 15016 fla Out C 25.1 -105 -91 -42 6 23:33 b1-00326462 1 15016 arc Out C 4.1 -105 -91 -42 23:33 r1-00326462 1 15016 arc Out C 4.1 -105 -91 -42 7 01:29 b1-00326463 1 15016 arc Lef C 4.1 -105 -91 -42 HART 01:29 r1-00326463 1 15016 arc Lef C 4.1 -105 -91 -42 HART 8 01:29 b1-00326464 1 15016 arc Rig C 4.1 -105 -91 -42 HART 01:29 r1-00326464 1 15016 arc Rig C 4.1 -105 -91 -42 HART 9 01:30 b1-00326465 1 15016 arc Out C 4.1 3674 3687 3736 01:30 r1-00326465 1 15016 arc Out C 4.1 3674 3687 3736 10 01:32 b1-00326466 1 15016 fla Out C 25.1 3674 3687 3736 01:32 r1-00326466 1 15016 fla Out C 25.1 3674 3687 3736 11 01:38 b1-00326467 1 15016 sci Out C 900.1 3674 3687 3736 01:38 r1-00326467 1 15016 sci Out C 900.1 3674 3687 3736 12 01:54 b1-00326468 1 15016 sci Out C 900.1 3674 3687 3736 01:54 r1-00326468 1 15016 sci Out C 900.1 3674 3687 3736 13 02:11 b1-00326469 1 15016 sci Out C 900.1 3674 3687 3736 02:11 r1-00326469 1 15016 sci Out C 900.1 3674 3687 3736 14 02:27 b1-00326470 1 15016 sci Out C 900.1 3674 3687 3736 02:27 r1-00326470 1 15016 sci Out C 900.1 3674 3687 3736 15 02:53 b1-00326471 3 15254 arc Lef C 4.1 3674 3687 3736 HART 02:53 r1-00326471 3 15254 arc Lef C 4.1 3674 3687 3736 HART 16 02:53 b1-00326472 3 15254 arc Rig C 4.1 3674 3687 3736 HART 02:53 r1-00326472 3 15254 arc Rig C 4.1 3674 3687 3736 HART 17 02:54 b1-00326473 3 15254 arc Out C 4.1 3875 3888 3937 02:54 r1-00326473 3 15254 arc Out C 4.1 3875 3888 3937 18 02:56 b1-00326474 3 15254 fla Out C 25.1 3875 3888 3937 02:56 r1-00326474 3 15254 fla Out C 25.1 3875 3888 3937 19 03:00 b1-00326475 3 15254 sci Out C 900.1 3875 3888 3937 03:00 r1-00326475 3 15254 sci Out C 900.1 3875 3888 3937 20 03:16 b1-00326476 3 15254 sci Out C 900.1 3875 3888 3937 03:16 r1-00326476 3 15254 sci Out C 900.1 3875 3888 3937 21 03:33 b1-00326477 3 15254 sci Out C 592.8 3875 3888 3937 03:33 r1-00326477 3 15254 sci Out C 592.8 3875 3888 3937 22 04:02 b1-00326478 3 15254 sci Out C 900.1 3875 3888 3937 04:02 r1-00326478 3 15254 sci Out C 900.1 3875 3888 3937 23 04:18 b1-00326479 3 15254 sci Out C 900.1 3875 3888 3937 04:18 r1-00326479 3 15254 sci Out C 900.1 3875 3888 3937 24 04:34 b1-00326480 3 15254 sci Out C 900.1 3875 3888 3937 04:34 r1-00326480 3 15254 sci Out C 900.1 3875 3888 3937 25 04:51 b1-00326481 3 15254 sci Out C 900.1 3875 3888 3937 04:51 r1-00326481 3 15254 sci Out C 900.1 3875 3888 3937 26 05:17 b1-00326482 5 15286 arc Lef C 4.1 3875 3888 3937 HART 05:17 r1-00326482 5 15286 arc Lef C 4.1 3875 3888 3937 HART 27 05:17 b1-00326483 5 15286 arc Rig C 4.1 3875 3888 3937 HART 05:17 r1-00326483 5 15286 arc Rig C 4.1 3875 3888 3937 HART 28 05:18 b1-00326484 5 15286 arc Out C 4.1 5213 5226 5276 05:18 r1-00326484 5 15286 arc Out C 4.1 5213 5226 5276 29 05:20 b1-00326485 5 15286 fla Out C 25.1 5213 5226 5276 05:20 r1-00326485 5 15286 fla Out C 25.1 5213 5226 5276 30 05:22 b1-00326486 5 15286 sci Out C 900.1 5213 5226 5276 05:22 r1-00326486 5 15286 sci Out C 900.1 5213 5226 5276 31 05:38 b1-00326487 5 15286 sci Out C 900.1 5213 5226 5276 05:38 r1-00326487 5 15286 sci Out C 900.1 5213 5226 5276 32 05:54 b1-00326488 5 15286 sci Out C 900.1 5213 5226 5276 05:54 r1-00326488 5 15286 sci Out C 900.1 5213 5226 5276 33 06:11 b1-00326489 5 15286 sci Out C 900.1 5213 5226 5276 06:11 r1-00326489 5 15286 sci Out C 900.1 5213 5226 5276 34 06:36 b1-00326490 7 15285 arc Lef C 4.1 5213 5226 5276 HART 06:36 r1-00326490 7 15285 arc Lef C 4.1 5213 5226 5276 HART 35 06:36 b1-00326491 7 15285 arc Rig C 4.1 5213 5226 5276 HART 06:36 r1-00326491 7 15285 arc Rig C 4.1 5213 5226 5276 HART 36 06:37 b1-00326492 7 15285 arc Out C 4.1 1829 1842 1893 06:37 r1-00326492 7 15285 arc Out C 4.1 1829 1842 1893 37 06:39 b1-00326493 7 15285 fla Out C 25.1 1829 1842 1893 06:39 r1-00326493 7 15285 fla Out C 25.1 1829 1842 1893 38 06:41 b1-00326494 7 15285 sci Out C 900.0 1829 1842 1893 06:41 r1-00326494 7 15285 sci Out C 900.0 1829 1842 1893 39 06:57 b1-00326495 7 15285 sci Out C 900.1 1829 1842 1893 06:57 r1-00326495 7 15285 sci Out C 900.1 1829 1842 1893 40 07:14 b1-00326496 7 15285 sci Out C 900.1 1829 1842 1893 07:14 r1-00326496 7 15285 sci Out C 900.1 1829 1842 1893 41 07:30 b1-00326497 7 15285 sci Out C 900.1 1829 1842 1893 07:30 r1-00326497 7 15285 sci Out C 900.1 1829 1842 1893 42 07:56 b1-00326498 2 15193 arc Lef C 4.1 1829 1842 1893 HART 07:56 r1-00326498 2 15193 arc Lef C 4.1 1829 1842 1893 HART 43 07:56 b1-00326499 2 15193 arc Rig C 4.1 1829 1842 1893 HART 07:56 r1-00326499 2 15193 arc Rig C 4.1 1829 1842 1893 HART 44 07:57 b1-00326500 2 15193 arc Out C 4.1 1545 1557 1608 07:57 r1-00326500 2 15193 arc Out C 4.1 1545 1557 1608 45 07:59 b1-00326501 2 15193 fla Out C 25.1 1545 1557 1608 07:59 r1-00326501 2 15193 fla Out C 25.1 1545 1557 1608 46 08:02 b1-00326502 2 15193 sci Out C 900.1 1545 1557 1608 08:02 r1-00326502 2 15193 sci Out C 900.1 1545 1557 1608 47 08:18 b1-00326503 2 15193 sci Out C 900.1 1545 1557 1608 08:18 r1-00326503 2 15193 sci Out C 900.1 1545 1557 1608 48 08:35 b1-00326504 2 15193 sci Out C 900.1 1545 1557 1608 08:35 r1-00326504 2 15193 sci Out C 900.1 1545 1557 1608 49 08:51 b1-00326505 2 15193 sci Out C 900.1 1545 1557 1608 08:51 r1-00326505 2 15193 sci Out C 900.1 1545 1557 1608 50 09:16 b1-00326506 8 15199 arc Lef C 4.1 1545 1557 1608 HART 09:16 r1-00326506 8 15199 arc Lef C 4.1 1545 1557 1608 HART 51 09:16 b1-00326507 8 15199 arc Rig C 4.1 1545 1557 1608 HART 09:16 r1-00326507 8 15199 arc Rig C 4.1 1545 1557 1608 HART 52 09:17 b1-00326508 8 15199 arc Out C 4.1 1264 1276 1327 09:17 r1-00326508 8 15199 arc Out C 4.1 1264 1276 1327 53 09:19 b1-00326509 8 15199 fla Out C 25.1 1264 1276 1327 09:19 r1-00326509 8 15199 fla Out C 25.1 1264 1276 1327 54 09:23 b1-00326510 8 15199 sci Out C 900.1 1264 1276 1327 09:23 r1-00326510 8 15199 sci Out C 900.1 1264 1276 1327 55 09:39 b1-00326511 8 15199 sci Out C 900.1 1264 1276 1327 09:39 r1-00326511 8 15199 sci Out C 900.1 1264 1276 1327 56 09:56 b1-00326512 8 15199 sci Out C 900.1 1264 1276 1327 09:56 r1-00326512 8 15199 sci Out C 900.1 1264 1276 1327 57 10:12 b1-00326513 8 15199 sci Out C 900.1 1264 1276 1327 10:12 r1-00326513 8 15199 sci Out C 900.1 1264 1276 1327 58 10:37 b1-00326514 4 15201 arc Lef C 4.1 1264 1276 1327 HART 10:37 r1-00326514 4 15201 arc Lef C 4.1 1264 1276 1327 HART 59 10:38 b1-00326515 4 15201 arc Rig C 4.1 1264 1276 1327 HART 10:38 r1-00326515 4 15201 arc Rig C 4.1 1264 1276 1327 HART 60 10:39 b1-00326516 4 15201 arc Out C 4.1 2120 2132 2184 10:39 r1-00326516 4 15201 arc Out C 4.1 2120 2132 2184 61 10:40 b1-00326517 4 15201 fla Out C 25.1 2120 2132 2184 10:40 r1-00326517 4 15201 fla Out C 25.1 2120 2132 2184 62 10:42 b1-00326518 4 15201 sci Out C 900.0 2120 2132 2184 10:42 r1-00326518 4 15201 sci Out C 900.0 2120 2132 2184 63 10:59 b1-00326519 4 15201 sci Out C 900.1 2120 2132 2184 10:59 r1-00326519 4 15201 sci Out C 900.1 2120 2132 2184 64 11:15 b1-00326520 4 15201 sci Out C 900.1 2120 2132 2184 11:15 r1-00326520 4 15201 sci Out C 900.1 2120 2132 2184 65 11:39 b1-00326521 9 15202 arc Lef C 4.1 2120 2132 2184 HART 11:39 r1-00326521 9 15202 arc Lef C 4.1 2120 2132 2184 HART 66 11:40 b1-00326522 9 15202 arc Rig C 4.1 2120 2132 2184 HART 11:40 r1-00326522 9 15202 arc Rig C 4.1 2120 2132 2184 HART 67 11:41 b1-00326523 9 15202 arc Out C 4.1 208 220 272 11:41 r1-00326523 9 15202 arc Out C 4.1 208 220 272 68 11:42 b1-00326524 9 15202 fla Out C 25.1 208 220 272 11:42 r1-00326524 9 15202 fla Out C 25.1 208 220 272 69 11:45 b1-00326525 9 15202 sci Out C 900.1 208 220 272 11:45 r1-00326525 9 15202 sci Out C 900.1 208 220 272 70 12:01 b1-00326526 9 15202 sci Out C 900.1 208 220 272 12:01 r1-00326526 9 15202 sci Out C 900.1 208 220 272 71 12:18 b1-00326527 9 15202 sci Out C 900.1 208 220 272 12:18 r1-00326527 9 15202 sci Out C 900.1 208 220 272 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - ---- Weather Log ---- Time Cart Temp DP Diff Humid Wind Dir 1umDst IRSCSig IRSCm ================================================================================ 01:14 1-15016A 4.5 -22.2 26.7 12 6 221 292 4.3 562.0 01:38 1-15016A 2.7 -23.6 26.3 12 5 192 342 4.3 562.0 01:51 1-15016A 2.5 -23.5 26.0 12 6 187 381 3.5 330.0 02:03 1-15016A 2.5 -23.8 26.3 12 5 196 463 3.1 330.0 02:15 1-15016A 2.3 -23.7 26.0 12 7 194 482 3.0 330.0 02:27 1-15016A 1.7 -23.5 25.2 13 6 208 505 2.4 330.0 02:39 1-15016A 1.2 -23.3 24.5 14 8 190 503 3.2 330.0 03:00 3-15254A -0.4 -21.4 21.0 18 6 185 543 3.1 330.0 03:12 3-15254A 0.0 -22.3 22.3 16 4 186 552 3.1 330.0 03:24 3-15254A 0.6 -25.3 25.9 12 5 186 475 3.8 328.0 03:37 3-15254A 0.2 -25.4 25.6 12 6 196 507 2.5 330.0 04:02 3-15254A -0.2 -18.5 18.3 23 7 186 585 2.9 331.0 04:14 3-15254A -0.6 -18.6 18.0 24 5 184 536 2.9 330.0 04:26 3-15254A -0.6 -18.6 18.0 24 9 197 611 3.3 330.0 04:38 3-15254A 2.2 -24.2 26.4 12 10 214 500 3.1 330.0 04:50 3-15254A 2.9 -23.7 26.6 12 9 225 640 3.0 330.0 05:03 3-15254A 2.6 -23.8 26.4 12 7 212 435 2.6 330.0 05:22 5-15286A 2.3 -23.9 26.2 12 11 233 666 2.9 330.0 05:34 5-15286A 2.2 -23.9 26.1 12 14 229 780 14.4 236.0 05:46 5-15286A 2.3 -23.8 26.1 12 11 210 925 3.6 250.0 05:58 5-15286A 2.0 -23.8 25.8 12 11 206 850 3.1 330.0 06:11 5-15286A 2.1 -23.8 25.9 12 5 217 748 3.0 330.0 06:23 5-15286A 1.7 -23.7 25.4 13 8 259 972 2.9 330.0 06:41 7-15285A 0.6 -19.0 19.6 21 7 214 1228 3.8 316.0 06:53 7-15285A 0.6 -18.1 18.7 23 15 237 1214 2.6 330.0 07:05 7-15285A 0.5 -18.1 18.6 23 11 239 1043 8.6 330.0 07:18 7-15285A 0.9 -18.9 19.8 21 12 235 1060 10.3 203.0 07:30 7-15285A 1.2 -18.4 19.6 21 11 247 1098 2.9 330.0 07:42 7-15285A 1.4 -18.6 20.0 20 13 254 875 2.6 330.0 08:02 2-15193A 1.3 -18.0 19.3 22 13 263 897 3.1 330.0 08:14 2-15193A 1.7 -17.5 19.2 22 11 276 837 3.1 330.0 08:27 2-15193A 1.8 -16.7 18.5 23 14 279 923 2.8 330.0 08:39 2-15193A 2.2 -15.4 17.6 25 11 276 1065 2.6 330.0 08:51 2-15193A 2.0 -15.3 17.3 26 13 284 1041 3.1 330.0 09:03 2-15193A 2.1 -15.2 17.3 26 16 301 1062 3.3 330.0 09:23 8-15199A 1.9 -15.2 17.1 26 14 286 1022 3.3 330.0 09:35 8-15199A 2.1 -15.1 17.2 26 18 292 986 3.1 330.0 09:47 8-15199A 2.4 -15.1 17.5 26 13 280 1022 3.2 330.0 10:00 8-15199A 2.0 -15.1 17.1 27 16 287 1014 3.2 330.0 10:12 8-15199A 1.9 -14.9 16.8 27 11 305 1088 3.1 330.0 10:24 8-15199A 1.9 -15.3 17.2 26 12 308 978 2.8 330.0 10:43 4-15201A 2.3 -15.3 17.6 26 10 285 1092 2.2 330.0 10:55 4-15201A 2.5 -15.7 18.2 24 17 297 1064 3.8 330.0 11:07 4-15201A 2.5 -16.3 18.8 23 15 300 1010 3.3 330.0 11:19 4-15201A 2.3 -16.3 18.6 23 12 315 946 3.5 330.0 11:31 4-15201A 2.9 -16.6 19.5 22 13 295 1053 3.5 330.0 11:46 9-15202A 2.8 -16.7 19.5 22 19 296 1042 3.5 330.0 11:58 9-15202A 3.0 -16.3 19.3 22 20 306 1140 3.1 330.0 12:10 9-15202A 2.6 -16.3 18.9 23 19 289 1124 3.3 330.0 ---- Problems in Detail ---- AZ out of closed loop at 03:39Z =============================== While tracking the field on cartridge 3 and exposing, AZ suddenly went out of closed loop. 03:39:39 .tcc 0 tcc w BadAzStatus; AzStat=31.323641,0.000000,5121459579.76788,0x00000800; AzDTime=0.04 Nothing looks unusual command-wise in the MCP logs before AZ went out of closed loop. The +MOVE commands from the guider and the PVTs look OK: 2021-03-03 03:39:34.631 frTCC:ALT +MOVE -0.0000364 -0.0000000 2021-03-03 03:39:34.631 toTCC: OK 2021-03-03 03:39:34.632 frTCC:AZ +MOVE -0.0003872 -0.0000000 2021-03-03 03:39:34.632 toTCC: OK 2021-03-03 03:39:34.672 frTCC:ROT +MOVE -0.0003065 0.0000000 2021-03-03 03:39:34.672 toTCC: OK 2021-03-03 03:39:34.714 altitude add frame pos 52.359924 vel 0.001813 end_time 13183.164000 2021-03-03 03:39:34.714 frTCC:ALT MOVE 52.3599239 0.0018127 13183.16400 2021-03-03 03:39:34.714 toTCC: OK 2021-03-03 03:39:34.754 azimuth add frame pos 31.001091 vel -0.006164 end_time 13183.164000 2021-03-03 03:39:34.754 frTCC:AZ MOVE 31.0010908 -0.0061637 13183.16400 2021-03-03 03:39:34.754 toTCC: OK 2021-03-03 03:39:34.794 rotator add frame pos 205.669634 vel -0.004928 end_time 13183.164000 2021-03-03 03:39:34.794 frTCC:ROT MOVE 205.6696337 -0.0049285 13183.16400 2021-03-03 03:39:34.794 toTCC: OK 2021-03-03 03:39:34.834 frTCC:ALT +MOVE 0.0000000 0.0000000 2021-03-03 03:39:34.834 toTCC: OK 2021-03-03 03:39:34.874 frTCC:AZ +MOVE 0.0000000 0.0000000 2021-03-03 03:39:34.874 toTCC: OK 2021-03-03 03:39:34.914 frTCC:ROT +MOVE 0.0008869 0.0000000 2021-03-03 03:39:34.914 toTCC: OK 2021-03-03 03:39:34.954 frTCC:ALT STATUS 2021-03-03 03:39:34.967 toTCC:52.345282 0.001814 13174.954123 0 0.000000 OK 2021-03-03 03:39:34.994 frTCC:AZ STATUS 2021-03-03 03:39:35.004 toTCC:31.135996 -0.006160 13174.994366 0 0.000000 OK 2021-03-03 03:39:35.034 frTCC:ROT STATUS 2021-03-03 03:39:35.042 toTCC:205.713913 -0.004924 13175.034136 0 0.000000 OK Then AZ reports "bad az state 14" which means ABORT - expected for an axis that's disabled with the brakes on as AZ was after going out of closed loop. 2021-03-03 03:39:36.727 MGT: bad az state 14 2021-03-03 03:39:36.727 amp_mgt set azimuth brake 2021-03-03 03:39:36.727 MGT: wait 2 sec 2021-03-03 03:39:36.860 azimuth cmd frame break 2021-03-03 03:39:36.861 azimuth frame_break: frames left=3 2021-03-03 03:39:36.862 azimuth stp_frame 2021-03-03 03:39:38.560 tbrakes azimuth controller idle 2021-03-03 03:39:38.560 axis azimuth brake_on 2021-03-03 03:39:39.668 altitude add frame pos 52.368978 vel 0.001811 end_time 13188.164000 2021-03-03 03:39:39.668 frTCC:ALT MOVE 52.3689785 0.0018111 13188.16400 2021-03-03 03:39:39.668 toTCC: OK 2021-03-03 03:39:39.669 azimuth add frame pos 30.970266 vel -0.006166 end_time 13188.164000 2021-03-03 03:39:39.669 frTCC:AZ MOVE 30.9702659 -0.0061663 13188.16400 2021-03-03 03:39:39.669 toTCC: OK 2021-03-03 03:39:39.679 azimuth reposition caused frame break 2021-03-03 03:39:39.679 azimuth restart no frames to process 2021-03-03 03:39:39.709 rotator add frame pos 205.645871 vel -0.004931 end_time 13188.164000 2021-03-03 03:39:39.709 frTCC:ROT MOVE 205.6458709 -0.0049312 13188.16400 2021-03-03 03:39:39.709 toTCC: OK 2021-03-03 03:39:39.768 frTCC:AZ STATUS 2021-03-03 03:39:39.779 toTCC:31.323641 0.000000 13179.767880 2048 0.000000 OK 2021-03-03 03:39:39.808 frTCC:ROT STATUS 2021-03-03 03:39:39.817 toTCC:205.691034 -0.004927 13179.808241 0 0.000000 OK 2021-03-03 03:39:39.849 frTCC:ALT STATUS 2021-03-03 03:39:39.860 toTCC:52.354137 0.001812 13179.849078 0 0.000000 OK 2021-03-03 03:39:40.679 azimuth stp_frame 2021-03-03 03:39:44.669 altitude add frame pos 52.378025 vel 0.001809 end_time 13193.164000 2021-03-03 03:39:44.669 frTCC:ALT MOVE 52.3780250 0.0018095 13193.16400 2021-03-03 03:39:44.669 toTCC: OK 2021-03-03 03:39:44.669 azimuth add frame pos 30.939428 vel -0.006169 end_time 13193.164000 2021-03-03 03:39:44.669 frTCC:AZ MOVE 30.9394284 -0.0061692 13193.16400 2021-03-03 03:39:44.669 toTCC: OK 2021-03-03 03:39:44.679 azimuth reposition caused frame break 2021-03-03 03:39:44.679 azimuth restart no frames to process We tried to re-init the axes a few times and although AZ would clear, when we sent subsequent 'gotoField' commands or 'track' commands, AZ immediately went out of closed loop again. We verified that AZ was nowhere near its end of range as far as position limits are concerned. We stopped the exposure sequence and went down to the lower enclosure to investigate. In the lower enclosure, the Glentek amplifiers were fine - after a 'tcc axis init' all the status LEDs on the amplifiers were green. There were also no slips reported on the chassis. With the axes live and clear, we watched the Interlocks menu and we saw that when we tried to move the wind_az_ready was red. We expanded that logic tree and saw that wind_az_fault was red. We went back downstairs and power-cycled the wind baffle. The wind_az_fault was green after the power-cycle and so was wind_az_fault. We tried a quick test move with a 'track' command and AZ behaved normally. 04:03Z - We slewed back to the field, restarted guiding, and resumed science.