Subject: 2.5m obslog 20210423 (SJD 59328) From: dgatlin@apo.nmsu.edu Date: Sat, 24 Apr 2021 11:59:56 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday April 23, 2021 (SJD 59328) ---- Observing Team ---- Karen Kinemuchi Dylan Gatlin Katie Grabowski Conor Sayres (online for tcc) Jeff Hagan (on call for mcp) Fred Mrozek (on site for mcp) ---- Observing Plan ---- Fri 23 Apr 2021 59328 0.88 02:15 11:46 09:21 18:54 --- KK MWM ( 9.5 h) ---- Observing Summary ---- We didn't open at sunset due to engineering issues. MWM lost 1.5 hrs due to engineering. After that, we got good signal on the rest of the plates and finished 2. Cart 2, plate 15348, field RV_120+60, 8x46rds, 4x900s, not done Missing fibers: [ 38 57 59 190 198 211 259 273] Faint fibers: ['137' '151 - 173' '175 - 180'] Cart 3, plate 15274, field RV_046+48, 8x46rds, 4x900s, not done Missing fibers: [211, 273] Faint fibers: [123, 162, 177, 179] Cart 4, plate 15201, field RV_335+61_btx, 8x46rds, 4x900s, not done Missing fibers: [20, 39, 151, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 123', 128, 136, 177, 284] Cart 5, plate 15273, field RV_120+30, 8x46rds, 4x900s, not done Missing fibers: [211, 273] Faint fibers: ['91 - 95', 97, '99 - 101', '103 - 104', 106, '108 - 120', '121 - 123', 125, '127 - 128', '133 - 134', '136 - 137', '139 - 140', '147 - 148', '151 - 156', '158 - 164', '166 - 170', '172 - 173', '175 - 180', '181 - 210'] Cart 7, plate 15331, field YSO_054, 8x46rds, 4x900s, done Missing fibers: [98, 211, 273] Faint fibers: [121, 123, 136, 195] Cart 8, plate 15342, field GG_027, 10x46rds, 5x900s, done Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180', 227] Notes: - In the afternoon, we were dealing with some issues with tcc and the mirror status. This was resolved close to sunset, but afternoon checkout tasks still needed to be done. We ran into a separate issue with the MCP during test slews, which kept us closed until 03:08Z. More explanation in the problems in detail section. - After opening, the flat field pedals opened on their own. - Cart 3 has no acquisition fibers. We got pretty lucky because we would have had GSOGTF, so searching didn't take too long. - Rotation angle on the acquisition fibers on cart 5 are incorrect, it seems like they're 180deg off. - Acquisition fiber #11 on cart 7 is gone - Integrated Dust Counts: ~13200 dust-hrs - Telescope is still ventilating for the fiducial tables. Day staff has already arrived. ---- Observing Log ---- 21:59Z Radar and clouds nearby. AFTERNOON CHECKOUT: =================== 23:32Z Started evening cals. 23:48Z TCC does not appear to have the semaphore. Called JeffH to find out what is going on. Apparently work was done on the MCP today. Call Conor to check on tcc restart. telrun and hub startNubs did not cleanly restart tcc, but the added command of "tcc axis connect" got things back. However, the mirror controllers and collimation were disconnected. Restarting the tcc was not clean, nor were the instructions helpful when different controllers are not responding. Called Conor again to work out why the restart did not work. Solution is to run telstop first before telrun when restarting tcc. It is unclear when or why tcc stopped running today (it must have happened before night staff came in). There was no real notification or warning in STUI that the tcc was not running, other than the mcp not showing who owned the semaphore. !! If work was being done on mcp/tcc systems, please let the on-duty observers know so we can be prepared to troubleshoot or restart systems. 00:52Z Still cloudy with radar nearby. Delaying ventilation. 01:45Z Grabbed mirror numbers - ok; gcamera/guider prep - done BOSS SPECTROGRAPH CALIBS: 01:52:27 boss exposure 0.0, file=329950 01:53:47 boss exposure 20.0, file=329951 SoS is alive. BOSS COLLIMATION: ================= 01:56:38 boss exposure 4.0, file=329952 01:57:51 boss exposure 4.0, file=329953 01:59:15 sp1.motor.move= 1812, 1811, 1812 01:59:15 Hartmann collimate output on cart #8 sp1: offset: r= 989 (In Focus); b= -8.3 (Out of focus) sp1: pred. move: spAverageMove= 1812 sp1: pred. resid: r= -823, b= -2.6, txt= OK, spTemp = 5.9 motorPosition sp1: 5009, 4995, 5096; ---------- Median spectrographs temperatures: Tsp1= 5.9 Outside air temperature= 5.6; ---------- Blue ring was not adjusted. It is in spec. BOSS CALS: 02:00:16 boss exposure 25.0, file=329954 02:03:02 boss exposure 4.0, file=329955 Disk check: df -kh Filesystem Size Used Avail Use% Mounted on /dev/vda2 7.7G 6.5G 913M 88% / tmpfs 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M 133M 52M 73% /boot /dev/vdb 19G 8.8G 9.1G 49% /exports/hub-local /dev/vdd 688G 605G 84G 88% /home /dev/vdc1 11T 7.1T 3.7T 66% /data 10.25.1.230:/data 21T 11T 9.7T 52% /sdss5_data Skies are clearing and radar is dissipating. Will go to ventilate cautiously (there is some virga to the west). Evening cals finished and inspected - ok. 02:15Z Ventilation begins. 02:48Z We are having trouble moving the telescope. Releasing the brakes, Az and Alt brakes come on, and Altitude slips up by 30 arcminutes each time. (30.0 -> 30.6 -> 31.3 -> 32.0). Called Fred to see why Alt is unstable. We also suspect the AZ OCL is also occurring at the same time. 03:13Z MCP bug was discovered which caused problems with telescope motion. More explanation in the problems in detail section. 03:08:41 encl25m : open; ### Cart 2, Plate 15348, BHM&MWM No GSOGTF, mostly clear # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 03:24:50 37660009 Dark A 10 a-b-c 0.0 59328 03:26:37 37660010 Dark A 10 a-b-c 0.0 59328 03:44:02 37660011 Object A 46 a-b-c 1.4 59328 03:52:11 37660012 Object A 46 a-b-c 1.4 59328 04:00:22 37660013 Object A 46 a-b-c 1.3 59328 04:08:31 37660014 Object A 46 a-b-c 1.2 59328 04:16:42 37660015 Object A 46 a-b-c 1.3 59328 04:24:52 37660016 Object A 46 a-b-c 1.3 59328 04:33:02 37660017 Object A 46 a-b-c 1.5 59328 04:41:12 37660018 Object A 46 a-b-c 1.4 59328 04:49:33 37660019 Domeflat A 5 a-b-c 0.0 59328 04:51:09 37660020 Dark A 10 a-b-c 0.0 59328 04:52:57 37660021 Dark A 10 a-b-c 0.0 2021-04-24 04:49:33.682 Missing fibers: [ 38 57 59 190 198 211 259 273] Faint fibers: ['137' '151 - 173' '175 - 180'] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 03:33:20 00329956 Hart C r1-b1 4 Left 59328 03:33:58 00329957 Hart C r1-b1 4 Right 59328 03:34:58 00329958 Arc C r1-b1 4 Open 59328 03:36:26 00329959 Flat C r1-b1 25 Open 59328 03:44:20 00329960 Science C r1-b1 900 Open 59328 04:00:40 00329961 Science C r1-b1 900 Open 59328 04:17:01 00329962 Science C r1-b1 900 Open 59328 04:33:22 00329963 Science C r1-b1 900 Open 03:34:39 sp1.motor.move= 1326, 1325, 1324 03:34:40 Hartmann collimate output on cart #2 sp1: offset: r= 659 (In Focus); b= -6.2 (Out of focus) sp1: pred. move: spAverageMove= 1325 sp1: pred. resid: r= -666, b= -2.1, txt= OK, spTemp = 4.2 ### Cart 3, Plate 15274, BHM&MWM # GSOGTF, but there was no acquisition fiber, clear # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 05:08:17 37660022 Object A 46 a-b-c 1.3 59328 05:16:26 37660023 Object A 46 a-b-c 1.5 59328 05:24:37 37660024 Object A 46 a-b-c 1.4 59328 05:32:46 37660025 Object A 46 a-b-c 1.3 59328 05:40:58 37660026 Object A 46 a-b-c 1.5 59328 05:49:07 37660027 Object A 46 a-b-c 1.3 59328 05:57:18 37660028 Object A 46 a-b-c 1.4 59328 06:05:28 37660029 Object A 46 a-b-c 1.3 59328 06:13:53 37660030 Domeflat A 5 a-b-c 0.0 59328 06:15:32 37660031 Dark A 10 a-b-c 0.0 59328 06:17:20 37660032 Dark A 10 a-b-c 0.0 2021-04-24 06:13:53.537 Missing fibers: [211, 273] Faint fibers: [123, 162, 177, 179] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 04:57:05 00329964 Hart C r1-b1 4 Left 59328 04:57:43 00329965 Hart C r1-b1 4 Right 59328 04:58:47 00329966 Arc C r1-b1 4 Open 59328 05:00:14 00329967 Flat C r1-b1 25 Open 59328 05:08:35 00329968 Science C r1-b1 900 Open 59328 05:24:56 00329969 Science C r1-b1 900 Open 59328 05:41:16 00329970 Science C r1-b1 900 Open 59328 05:57:37 00329971 Science C r1-b1 900 Open 04:58:29 sp1.motor.move= -2568, -2567, -2566 04:58:29 Hartmann collimate output on cart #3 sp1: offset: r= -2308 (Out of focus); b= 8.9 (Out of focus) sp1: pred. move: spAverageMove= -2568 sp1: pred. resid: r= 260, b= 0.8, txt= OK, spTemp = 4.1 ### Cart 4, Plate 15201, BHM&MWM GSOGTF, clear # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 06:28:29 37660033 Object A 46 a-b-c 0.9 59328 06:36:38 37660034 Object A 46 a-b-c 1.0 59328 06:44:54 37660035 Object A 46 a-b-c 0.9 59328 06:53:03 37660036 Object A 46 a-b-c 1.0 59328 07:01:14 37660037 Object A 46 a-b-c 1.0 59328 07:09:23 37660038 Object A 46 a-b-c 1.0 59328 07:17:34 37660039 Object A 46 a-b-c 1.1 59328 07:25:44 37660040 Object A 46 a-b-c 1.3 59328 07:34:08 37660041 Domeflat A 5 a-b-c 0.0 59328 07:35:40 37660042 Dark A 10 a-b-c 0.0 59328 07:37:27 37660043 Dark A 10 a-b-c 0.0 2021-04-24 07:34:08.584 Missing fibers: [20, 39, 151, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 123', 128, 136, 177, 284] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 06:21:47 00329972 Hart C r1-b1 4 Left 59328 06:22:25 00329973 Hart C r1-b1 4 Right 59328 06:23:26 00329974 Arc C r1-b1 4 Open 59328 06:24:53 00329975 Flat C r1-b1 25 Open 59328 06:28:51 00329976 Science C r1-b1 900 Open 59328 06:45:12 00329977 Science C r1-b1 900 Open 59328 07:01:33 00329978 Science C r1-b1 900 Open 59328 07:17:54 00329979 Science C r1-b1 900 Open 06:23:07 sp1.motor.move= 1828, 1828, 1828 06:23:07 Hartmann collimate output on cart #4 sp1: offset: r= 2308 (Out of focus); b= -4.2 (Out of focus) sp1: pred. move: spAverageMove= 1828 sp1: pred. resid: r= 479, b= 1.5, txt= OK, spTemp = 3.8 ### Cart 5, Plate 15273, BHM&MWM # GSOGTF, clear # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 07:49:11 37660044 Object A 46 a-b-c 1.5 59328 07:57:21 37660045 Object A 46 a-b-c 1.6 59328 08:05:31 37660046 Object A 46 a-b-c 1.7 59328 08:13:41 37660047 Object A 46 a-b-c 1.6 59328 08:21:53 37660048 Object A 46 a-b-c 1.6 59328 08:30:02 37660049 Object A 46 a-b-c 1.4 59328 08:38:13 37660050 Object A 46 a-b-c 1.5 59328 08:46:23 37660051 Object A 46 a-b-c 1.4 59328 08:54:43 37660052 Domeflat A 5 a-b-c 0.0 59328 08:56:12 37660053 Dark A 10 a-b-c 0.0 59328 08:57:59 37660054 Dark A 10 a-b-c 0.0 2021-04-24 08:54:43.814 Missing fibers: [211, 273] Faint fibers: ['91 - 95', 97, '99 - 101', '103 - 104', 106, '108 - 120', '121 - 123', 125, '127 - 128', '133 - 134', '136 - 137', '139 - 140', '147 - 148', '151 - 156', '158 - 164', '166 - 170', '172 - 173', '175 - 180', '181 - 210'] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 07:41:29 00329980 Hart C r1-b1 4 Left 59328 07:42:07 00329981 Hart C r1-b1 4 Right 59328 07:43:05 00329982 Arc C r1-b1 4 Open 59328 07:44:33 00329983 Flat C r1-b1 25 Open 59328 07:49:30 00329984 Science C r1-b1 900 Open 59328 08:05:51 00329985 Science C r1-b1 900 Open 59328 08:22:12 00329986 Science C r1-b1 900 Open 59328 08:38:32 00329987 Science C r1-b1 900 Open 07:42:46 sp1.motor.move= 33, 33, 32 07:42:46 Hartmann collimate output on cart #5 sp1: offset: r= 0 (In Focus); b= -0.2 (In Focus) sp1: pred. move: spAverageMove= 32 sp1: pred. resid: r= -32, b= -0.1, txt= OK, spTemp = 3.5 ### Cart 7, Plate 15331, BHM&MWM # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 09:09:01 37660055 Object A 46 a-b-c 1.4 59328 09:17:10 37660056 Object A 46 a-b-c 1.2 59328 09:25:21 37660057 Object A 46 a-b-c 1.2 59328 09:33:31 37660058 Object A 46 a-b-c 1.4 59328 09:41:42 37660059 Object A 46 a-b-c 1.3 59328 09:49:51 37660060 Object A 46 a-b-c 1.3 59328 09:58:17 37660061 Domeflat A 5 a-b-c 0.0 59328 10:00:07 37660062 Dark A 10 a-b-c 0.0 59328 10:01:55 37660063 Dark A 10 a-b-c 0.0 2021-04-24 09:58:17.023 Missing fibers: [98, 211, 273] Faint fibers: [121, 123, 136, 195] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 09:03:01 00329988 Hart C r1-b1 4 Left 59328 09:03:39 00329989 Hart C r1-b1 4 Right 59328 09:04:44 00329990 Arc C r1-b1 4 Open 59328 09:06:11 00329991 Flat C r1-b1 25 Open 59328 09:09:19 00329992 Science C r1-b1 900 Open 59328 09:25:40 00329993 Science C r1-b1 900 Open 59328 09:42:00 00329994 Science C r1-b1 900 Open 09:04:25 sp1.motor.move= -2246, -2246, -2244 09:04:25 Hartmann collimate output on cart #7 sp1: offset: r= -2308 (Out of focus); b= 6.8 (Out of focus) sp1: pred. move: spAverageMove= -2246 sp1: pred. resid: r= -61, b= -0.2, txt= OK, spTemp = 3.5 ### Cart 8, plate 15342, MWM&BHM # GSOGTF, clear # APOGEE MJD UTC Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59328 10:12:41 37660064 Object A 46 a-b-c 1.8 59328 10:20:51 37660065 Object A 46 a-b-c 1.8 59328 10:29:03 37660066 Object A 46 a-b-c 1.8 59328 10:37:12 37660067 Object A 46 a-b-c 2.0 59328 10:45:23 37660068 Object A 46 a-b-c 1.6 59328 10:53:33 37660069 Object A 46 a-b-c 1.8 59328 11:01:44 37660070 Object A 46 a-b-c 1.6 59328 11:09:53 37660071 Object A 46 a-b-c 2.1 59328 11:18:04 37660072 Object A 46 a-b-c 1.7 59328 11:26:13 37660073 Object A 46 a-b-c 1.4 59328 11:34:35 37660074 Domeflat A 5 a-b-c 0.0 59328 11:36:33 37660075 Dark A 10 a-b-c 0.0 59328 11:38:21 37660076 Dark A 10 a-b-c 0.0 Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180', 227] # BOSS MJD UTC Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 10:07:12 00329995 Hart C r1-b1 4 Left 59328 10:07:51 00329996 Hart C r1-b1 4 Right 59328 10:08:52 00329997 Arc C r1-b1 4 Open 59328 10:10:19 00329998 Flat C r1-b1 25 Open 59328 10:13:00 00329999 Science C r1-b1 900 Open 59328 10:29:22 00330000 Science C r1-b1 900 Open 59328 10:45:42 00330001 Science C r1-b1 900 Open 59328 11:02:02 00330002 Science C r1-b1 900 Open 59328 11:18:23 00330003 Science C r1-b1 900 Open 10:08:31 sp1.motor.move= 205, 204, 206 10:08:31 Hartmann collimate output on cart #8 sp1: offset: r= 989 (In Focus); b= 1.8 (In Focus) sp1: pred. move: spAverageMove= 205 sp1: pred. resid: r= 783, b= 2.5, txt= OK, spTemp = 3.3 # Closed the telescope and left ventilation on because we want to take a fiducial table during the morning. Day staff is already here. Cals started, cart 1 is loaded ---- BOSS Spectrograph Collimation Summary ---- --- Hartmann --- Time Cart TSP1 R1 B1 Move1 B1Resid ================================================================================ 01:59 8-15342A 5.9 989 -8.3 1812 -2.6 03:35 2-15348A 4.2 659 -6.2 1325 -2.1 04:59 3-15274A 4.1 -2308 8.9 -2568 0.8 06:23 4-15201A 3.8 2308 -4.2 1828 1.5 07:43 5-15273A 3.5 0 -0.2 32 -0.1 09:05 7-15331A 3.5 -2308 6.8 -2246 -0.2 10:09 8-15342A 3.3 989 1.8 205 2.5 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9280 -4.9280 Axial B: -4.6690 -4.6660 Axial C: -5.7680 -5.7770 Trans D: -4.3190 -4.3890 Lateral E: 0.3745 0.3750 Lateral F: 0.5705 0.5675 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 5.89 Altitude: 30.000035067407072 MIGS TONIGHT NOMINAL Axial A: -9.4410 -9.4420 Axial B: -9.4070 -9.4070 Axial C: -9.4840 -9.4960 Trans D: 0.0430 0.0420 GALILS Commanded: 4619050 4601950 4668100 -2000 -6600 Actual: 4603905 4585732 4632245 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3656.99 -14.05 -2.88 12.7 114.23 ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) SOP Time Cart Az Alt Rot objOff guideRot calibOff guideRMS ================================================================================ 03:44 2-15348A 146.7 56.8 -57.9 (8.4,10.4) -85.8 ( 0, 0, 0) 0.411 04:00 2-15348A 149.1 58.6 -52.4 (7.7,11.5) -83.4 ( 0, 0, 0) 0.376 04:17 2-15348A 152.0 60.3 -46.5 (7.2,12.6) -87.6 ( 0, 0, 0) 0.375 04:33 2-15348A 155.4 61.8 -40.1 (6.1,14.0) -89.3 ( 0, 0, 0) 0.677 04:50 2-15348A 159.3 63.2 -33.2 (5.1,15.8) -89.3 ( 0, 0, 0) 0.413 05:08 3-15274A 100.4 41.0 249.3 (2.4,2.9) 22.7 ( 0, 0, 0) 0.495 05:25 3-15274A 98.7 44.4 250.0 (3.1,3.6) 24.1 ( 0, 0, 0) 0.401 05:41 3-15274A 96.9 47.8 250.7 (4.5,3.7) 28.8 ( 0, 0, 0) 0.328 05:57 3-15274A 95.2 51.2 251.3 (5.9,4.0) 32.9 ( 0, 0, 0) 0.349 06:14 3-15274A 93.3 54.6 251.7 (7.5,4.0) 40.4 ( 0, 0, 0) 0.334 06:28 4-15201A 8.4 59.6 186.9 (9.7,2.9) 12.3 ( 0, 0, 0) 0.425 06:45 4-15201A 0.2 59.8 180.0 (10.4,3.8) 14.8 ( 0, 0, 0) 0.480 07:01 4-15201A -7.9 59.6 173.2 (11.2,3.8) 13.5 ( 0, 0, 0) 0.531 07:18 4-15201A -15.8 58.9 166.6 (11.6,3.8) 16.3 ( 0, 0, 0) 0.480 07:34 4-15201A -23.3 57.8 160.4 (12.3,3.0) 24.2 ( 0, 0, 0) 0.480 07:49 5-15273A 179.2 36.7 -11.1 (-3.6,-3.2) 42.9 ( 0, 0, 0) 0.788 08:06 5-15273A 179.5 36.7 -6.7 (-4.0,-3.1) 55.6 ( 0, 0, 0) 0.324 08:22 5-15273A 179.9 36.7 -2.4 (-3.9,-3.4) 58.4 ( 0, 0, 0) 0.249 08:38 5-15273A 180.2 36.7 1.9 (-3.6,-3.1) 60.1 ( 0, 0, 0) 0.350 08:55 5-15273A 180.6 36.7 6.2 (-3.3,-3.0) 33.6 ( 0, 0, 0) 0.356 09:09 7-15331A 85.8 60.8 249.0 (3.7,4.4) 31.5 ( 0, 0, 0) 0.470 09:25 7-15331A 82.9 64.3 248.3 (3.5,6.1) 29.8 ( 0, 0, 0) 0.385 09:39 7-15331A 80.2 67.0 247.3 (3.7,6.9) 30.0 ( 0, 0, 0) 0.364 09:58 7-15331A 75.3 71.0 244.9 (4.3,7.6) 28.5 ( 0, 0, 0) 0.362 10:13 8-15342A 11.9 61.6 189.8 (9.2,6.4) 25.1 ( 0, 0, 0) 0.389 10:29 8-15342A 3.2 62.0 182.5 (10.8,8.3) 6.3 ( 0, 0, 0) 0.640 10:46 8-15342A -5.5 62.0 175.1 (11.7,8.8) 1.7 ( 0, 0, 0) 0.372 11:02 8-15342A -14.0 61.4 168.0 (12.7,8.5) 4.7 ( 0, 0, 0) 0.367 11:18 8-15342A -22.1 60.3 161.3 (13.3,7.8) 20.2 ( 0, 0, 0) 0.399 11:35 8-15342A -29.6 58.8 155.1 (13.4,6.0) 30.2 ( 0, 0, 0) 0.387 ---- Focus Log ---- --- Focus --- Time Cart Scale M1 M2 Focus Az Alt Temp Wind Dir FWHM ================================================================================ 03:44 2-15348A 160.0 -1579 2477 225 146.7 56.8 5.6 16 290 1.3 04:00 2-15348A 144.0 -1420 2586 207 149.1 58.6 5.9 11 299 1.3 04:17 2-15348A 112.0 -1108 2802 167 152.0 60.3 5.9 18 285 1.3 04:33 2-15348A 95.0 -936 2931 159 155.4 61.8 5.7 14 273 1.5 04:50 2-15348A 76.0 -745 3050 141 159.3 63.2 5.7 9 279 1.4 05:08 3-15274A 314.0 -3099 1113 67 100.4 41.0 5.6 12 268 1.4 05:25 3-15274A 287.0 -2831 1309 53 98.7 44.4 5.4 9 263 1.4 05:41 3-15274A 261.0 -2577 1513 60 96.9 47.8 5.3 7 268 1.5 05:57 3-15274A 235.0 -2322 1710 56 95.2 51.2 5.2 2 281 1.4 06:14 3-15274A 211.0 -2076 1889 43 93.3 54.6 5.4 5 314 1.5 06:28 4-15201A 149.0 -1471 2350 11 8.4 59.6 4.9 6 266 0.9 06:45 4-15201A 130.0 -1280 2489 -3 0.2 59.8 5.0 5 264 1.0 07:01 4-15201A 126.0 -1248 2516 -2 -7.9 59.6 5.0 8 262 1.1 07:18 4-15201A 126.0 -1248 2517 -3 -15.8 58.9 5.1 11 296 1.1 07:34 4-15201A 120.0 -1184 2571 -3 -23.3 57.8 5.0 6 265 1.2 07:49 5-15273A 120.0 -1181 2649 -1 179.2 36.7 4.9 5 277 1.5 08:06 5-15273A 142.0 -1404 2467 2 179.5 36.7 4.6 5 269 1.7 08:22 5-15273A 150.0 -1481 2416 13 179.9 36.7 4.5 7 277 1.6 08:38 5-15273A 146.0 -1443 2447 13 180.2 36.7 4.5 5 264 1.6 08:55 5-15273A 144.0 -1420 2464 10 180.6 36.7 4.4 8 301 1.4 09:09 7-15331A 203.0 -2003 1903 12 85.8 60.8 4.4 7 308 1.5 09:25 7-15331A 212.0 -2089 1835 26 82.9 64.3 4.3 5 322 1.2 09:39 7-15331A 205.0 -2025 1880 30 80.2 67.0 3.6 1 284 1.3 09:58 7-15331A 193.0 -1904 1984 32 75.3 71.0 3.8 2 338 1.3 10:13 8-15342A 191.0 -1885 2047 61 11.9 61.6 2.5 9 23 1.9 10:29 8-15342A 196.0 -1933 2011 65 3.2 62.0 2.5 2 334 1.7 10:46 8-15342A 192.0 -1895 2043 64 -5.5 62.0 3.5 3 347 1.6 11:02 8-15342A 192.0 -1901 2037 61 -14.0 61.4 2.7 8 7 1.5 11:18 8-15342A 195.0 -1920 2020 60 -22.1 60.3 3.0 3 54 1.7 11:35 8-15342A 189.0 -1869 2044 37 -29.6 58.8 2.9 8 37 1.4 ---- Telescope Status ---- 01:35Z Started ventilation 03:08:41 encl25m : open; 11:44:42 encl25m : closed; No interlocks bypassed Status at: 1:51:57Z Telescope stowed at: 121.0, 30.0, -0.0 mount Instrument mounted: 1 Counterweights at: 447.0, 449.6, 445.9, 447.1 LN2 autofill systems: Connected and turned on 180L LN2 dewar scale: SP1 205.0 lbs, 17.0 psi ---- Software Used ---- Get Versions, 04/23/21, 23:32:46 -- STUI software: STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.4 hartmann : 1.8.0 hub : v4.2.4 mcp : 2.0-7-g8799 -mcp.plc : 34 -mcp.azFiduci : v1_144 -mcp.altFiduc : v1_144 -mcp.rotFiduc : v1_144 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.5 -- done -- Home Disk Hogs (GB): manga 104.743 eboss 91.0882 sdss3 27.1813 observer 24.4226 apogee 19.5444 logging 13.7947 Filesystem Size Used Avail Use% Mounted on /dev/vdd 688G 605G 84G 88% /home /dev/vdc1 11T 7.1T 3.8T 66% /data Setting up: idlspec2d Flavor: Linux64 Version: v5_7_12 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_20 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_6_7 Setting up: |sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: |psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: |idl Flavor: Linux64 Version: 7.1 Setting up: |dust Flavor: Linux64 Version: v0_1 Setting up: |photolog Flavor: Linux64 Version: trunk Setting up: actorcore Flavor: Linux64 Version: v4_1_8 Setting up: |opscore Flavor: Linux64 Version: v2_5 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: master Setting up: |plc Flavor: Linux64 Version: v30_2 Setting up: |sdsstools Flavor: Linux64 Version: v4_33 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.6.9 -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.3 autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk exported ---- APOGEE Data Summary ---- list_ap -m 59327 -morning APOGEE data list, mjd=59327, morning raw_data: /data/apogee/utr_cdr/59327/apRaw-*.fits archive: /data/apogee/archive/59327/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59327/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59327 1 11:36 37650078 Dark 60 A 13.0 8-15342 a-b-c - - 59327 2 11:47 37650079 Dark 60 A 13.0 8-15342 a-b-c - - 59327 3 11:58 37650080 Dark 60 A 13.0 8-15342 a-b-c - - 59327 4 12:09 37650081 QuarFlat 10 A 13.0 8-15342 a-b-c - 61 59327 5 12:10 37650082 QuarFlat 10 A 13.0 8-15342 a-b-c - 61 59327 6 12:12 37650083 QuarFlat 10 A 13.0 8-15342 a-b-c - 61 59327 7 12:14 37650084 Arc-Thar 12 A 13.0 8-15342 a-b-c -1.46 - 59327 8 12:16 37650085 Arc-Thar 12 A 13.0 8-15342 a-b-c -1.46 - 59327 9 12:18 37650086 Arc-Une 40 A 13.0 8-15342 a-b-c - - 59327 10 12:25 37650087 Arc-Une 40 A 13.0 8-15342 a-b-c - - 59327 11 12:33 37650088 Dark 30 A 13.0 8-15342 a-b-c - - 59327 12 12:38 37650089 InteFlat 30 A 13.0 8-15342 a-b-c - 0 59327 13 12:43 37650090 InteFlat 30 A 13.0 8-15342 a-b-c - 0 59327 14 12:49 37650091 InteFlat 30 A 13.0 8-15342 a-b-c - 0 59327 15 12:54 37650092 Dark 30 A 13.0 8-15342 a-b-c - - -------------------------------------------------------------------------------- MJD UTC Cart Exposure Type Dith Reads Arch Seeing -------------------------------------------------------------------------------- 59327 23:28:47 8-15342 37660001 Dark A 3 a-b-c 0.0 59327 23:32:23 8-15342 37660002 Dark A 60 a-b-c 0.0 59327 23:43:15 8-15342 37660003 Quartzflat A 10 a-b-c 0.0 59327 23:45:06 8-15342 37660004 ThAr Arc A 12 a-b-c 0.0 59327 23:47:15 8-15342 37660005 ThAr Arc A 12 a-b-c 0.0 59327 23:49:27 8-15342 37660006 UNe Arc A 40 a-b-c 0.0 59327 23:56:33 8-15342 37660007 UNe Arc A 40 a-b-c 0.0 59328 00:03:58 8-15342 37660008 Dark A 60 a-b-c 0.0 59328 03:24:50 2-15348 37660009 Dark A 10 a-b-c 0.0 59328 03:26:37 2-15348 37660010 Dark A 10 a-b-c 0.0 59328 03:44:02 2-15348 37660011 Object A 46 a-b-c 1.4 59328 03:52:11 2-15348 37660012 Object A 46 a-b-c 1.4 59328 04:00:22 2-15348 37660013 Object A 46 a-b-c 1.3 59328 04:08:31 2-15348 37660014 Object A 46 a-b-c 1.2 59328 04:16:42 2-15348 37660015 Object A 46 a-b-c 1.3 59328 04:24:52 2-15348 37660016 Object A 46 a-b-c 1.3 59328 04:33:02 2-15348 37660017 Object A 46 a-b-c 1.5 59328 04:41:12 2-15348 37660018 Object A 46 a-b-c 1.4 59328 04:49:33 2-15348 37660019 Domeflat A 5 a-b-c 0.0 59328 04:51:09 2-15348 37660020 Dark A 10 a-b-c 0.0 59328 04:52:57 2-15348 37660021 Dark A 10 a-b-c 0.0 59328 05:08:17 3-15274 37660022 Object A 46 a-b-c 1.3 59328 05:16:26 3-15274 37660023 Object A 46 a-b-c 1.5 59328 05:24:37 3-15274 37660024 Object A 46 a-b-c 1.4 59328 05:32:46 3-15274 37660025 Object A 46 a-b-c 1.3 59328 05:40:58 3-15274 37660026 Object A 46 a-b-c 1.5 59328 05:49:07 3-15274 37660027 Object A 46 a-b-c 1.3 59328 05:57:18 3-15274 37660028 Object A 46 a-b-c 1.4 59328 06:05:28 3-15274 37660029 Object A 46 a-b-c 1.3 59328 06:13:53 3-15274 37660030 Domeflat A 5 a-b-c 0.0 59328 06:15:32 3-15274 37660031 Dark A 10 a-b-c 0.0 59328 06:17:20 3-15274 37660032 Dark A 10 a-b-c 0.0 59328 06:28:29 4-15201 37660033 Object A 46 a-b-c 0.9 59328 06:36:38 4-15201 37660034 Object A 46 a-b-c 1.0 59328 06:44:54 4-15201 37660035 Object A 46 a-b-c 0.9 59328 06:53:03 4-15201 37660036 Object A 46 a-b-c 1.0 59328 07:01:14 4-15201 37660037 Object A 46 a-b-c 1.0 59328 07:09:23 4-15201 37660038 Object A 46 a-b-c 1.0 59328 07:17:34 4-15201 37660039 Object A 46 a-b-c 1.1 59328 07:25:44 4-15201 37660040 Object A 46 a-b-c 1.3 59328 07:34:08 4-15201 37660041 Domeflat A 5 a-b-c 0.0 59328 07:35:40 4-15201 37660042 Dark A 10 a-b-c 0.0 59328 07:37:27 4-15201 37660043 Dark A 10 a-b-c 0.0 59328 07:49:11 5-15273 37660044 Object A 46 a-b-c 1.5 59328 07:57:21 5-15273 37660045 Object A 46 a-b-c 1.6 59328 08:05:31 5-15273 37660046 Object A 46 a-b-c 1.7 59328 08:13:41 5-15273 37660047 Object A 46 a-b-c 1.6 59328 08:21:53 5-15273 37660048 Object A 46 a-b-c 1.6 59328 08:30:02 5-15273 37660049 Object A 46 a-b-c 1.4 59328 08:38:13 5-15273 37660050 Object A 46 a-b-c 1.5 59328 08:46:23 5-15273 37660051 Object A 46 a-b-c 1.4 59328 08:54:43 5-15273 37660052 Domeflat A 5 a-b-c 0.0 59328 08:56:12 5-15273 37660053 Dark A 10 a-b-c 0.0 59328 08:57:59 5-15273 37660054 Dark A 10 a-b-c 0.0 59328 09:09:01 7-15331 37660055 Object A 46 a-b-c 1.4 59328 09:17:10 7-15331 37660056 Object A 46 a-b-c 1.2 59328 09:25:21 7-15331 37660057 Object A 46 a-b-c 1.2 59328 09:33:31 7-15331 37660058 Object A 46 a-b-c 1.4 59328 09:41:42 7-15331 37660059 Object A 46 a-b-c 1.3 59328 09:49:51 7-15331 37660060 Object A 46 a-b-c 1.3 59328 09:58:17 7-15331 37660061 Domeflat A 5 a-b-c 0.0 59328 10:00:07 7-15331 37660062 Dark A 10 a-b-c 0.0 59328 10:01:55 7-15331 37660063 Dark A 10 a-b-c 0.0 59328 10:12:41 8-15342 37660064 Object A 46 a-b-c 1.8 59328 10:20:51 8-15342 37660065 Object A 46 a-b-c 1.8 59328 10:29:03 8-15342 37660066 Object A 46 a-b-c 1.8 59328 10:37:12 8-15342 37660067 Object A 46 a-b-c 2.0 59328 10:45:23 8-15342 37660068 Object A 46 a-b-c 1.6 59328 10:53:33 8-15342 37660069 Object A 46 a-b-c 1.8 59328 11:01:44 8-15342 37660070 Object A 46 a-b-c 1.6 59328 11:09:53 8-15342 37660071 Object A 46 a-b-c 2.1 59328 11:18:04 8-15342 37660072 Object A 46 a-b-c 1.7 59328 11:26:13 8-15342 37660073 Object A 46 a-b-c 1.4 59328 11:34:35 8-15342 37660074 Domeflat A 5 a-b-c 0.0 59328 11:36:33 8-15342 37660075 Dark A 10 a-b-c 0.0 59328 11:38:21 8-15342 37660076 Dark A 10 a-b-c 0.0 ThAr Offsets: ['-0.004'] UNe Offsets: ['0.024'] Object Offsets: Max: 0.07, Min: 0.00, Mean: 0.02 ---- BOSS Data Summary ---- MJD UTC Cart Exposure Type Dith SOS ETime Hart -------------------------------------------------------------------------------- 59328 01:52:27 8-15342 00329950 Bias C r1-b1 0 Closed 59328 01:53:47 8-15342 00329951 Dark C r1-b1 20 Closed 59328 01:56:38 8-15342 00329952 Hart C r1-b1 4 Left 59328 01:57:51 8-15342 00329953 Hart C r1-b1 4 Right 59328 02:00:16 8-15342 00329954 Flat C r1-b1 25 Open 59328 02:03:02 8-15342 00329955 Arc C r1-b1 4 Open 59328 03:33:20 2-15348 00329956 Hart C r1-b1 4 Left 59328 03:33:58 2-15348 00329957 Hart C r1-b1 4 Right 59328 03:34:58 2-15348 00329958 Arc C r1-b1 4 Open 59328 03:36:26 2-15348 00329959 Flat C r1-b1 25 Open 59328 03:44:20 2-15348 00329960 Science C r1-b1 900 Open 59328 04:00:40 2-15348 00329961 Science C r1-b1 900 Open 59328 04:17:01 2-15348 00329962 Science C r1-b1 900 Open 59328 04:33:22 2-15348 00329963 Science C r1-b1 900 Open 59328 04:57:05 3-15274 00329964 Hart C r1-b1 4 Left 59328 04:57:43 3-15274 00329965 Hart C r1-b1 4 Right 59328 04:58:47 3-15274 00329966 Arc C r1-b1 4 Open 59328 05:00:14 3-15274 00329967 Flat C r1-b1 25 Open 59328 05:08:35 3-15274 00329968 Science C r1-b1 900 Open 59328 05:24:56 3-15274 00329969 Science C r1-b1 900 Open 59328 05:41:16 3-15274 00329970 Science C r1-b1 900 Open 59328 05:57:37 3-15274 00329971 Science C r1-b1 900 Open 59328 06:21:47 4-15201 00329972 Hart C r1-b1 4 Left 59328 06:22:25 4-15201 00329973 Hart C r1-b1 4 Right 59328 06:23:26 4-15201 00329974 Arc C r1-b1 4 Open 59328 06:24:53 4-15201 00329975 Flat C r1-b1 25 Open 59328 06:28:51 4-15201 00329976 Science C r1-b1 900 Open 59328 06:45:12 4-15201 00329977 Science C r1-b1 900 Open 59328 07:01:33 4-15201 00329978 Science C r1-b1 900 Open 59328 07:17:54 4-15201 00329979 Science C r1-b1 900 Open 59328 07:41:29 5-15273 00329980 Hart C r1-b1 4 Left 59328 07:42:07 5-15273 00329981 Hart C r1-b1 4 Right 59328 07:43:05 5-15273 00329982 Arc C r1-b1 4 Open 59328 07:44:33 5-15273 00329983 Flat C r1-b1 25 Open 59328 07:49:30 5-15273 00329984 Science C r1-b1 900 Open 59328 08:05:51 5-15273 00329985 Science C r1-b1 900 Open 59328 08:22:12 5-15273 00329986 Science C r1-b1 900 Open 59328 08:38:32 5-15273 00329987 Science C r1-b1 900 Open 59328 09:03:01 7-15331 00329988 Hart C r1-b1 4 Left 59328 09:03:39 7-15331 00329989 Hart C r1-b1 4 Right 59328 09:04:44 7-15331 00329990 Arc C r1-b1 4 Open 59328 09:06:11 7-15331 00329991 Flat C r1-b1 25 Open 59328 09:09:19 7-15331 00329992 Science C r1-b1 900 Open 59328 09:25:40 7-15331 00329993 Science C r1-b1 900 Open 59328 09:42:00 7-15331 00329994 Science C r1-b1 900 Open 59328 10:07:12 8-15342 00329995 Hart C r1-b1 4 Left 59328 10:07:51 8-15342 00329996 Hart C r1-b1 4 Right 59328 10:08:52 8-15342 00329997 Arc C r1-b1 4 Open 59328 10:10:19 8-15342 00329998 Flat C r1-b1 25 Open 59328 10:13:00 8-15342 00329999 Science C r1-b1 900 Open 59328 10:29:22 8-15342 00330000 Science C r1-b1 900 Open 59328 10:45:42 8-15342 00330001 Science C r1-b1 900 Open 59328 11:02:02 8-15342 00330002 Science C r1-b1 900 Open 59328 11:18:23 8-15342 00330003 Science C r1-b1 900 Open 59328 11:48:10 1-15350 00330004 Bias C r1-b1 0 Closed 59328 11:49:29 1-15350 00330005 Bias C r1-b1 0 Closed ---- Weather Log ---- --- Weather --- Time Cart Temp DP Diff Humid Wind Dir 1umDst IRSCSig IRSCm ================================================================================ 03:44 2-15348A 5.6 -7.4 13.0 38 16 290 1568 2.6 334.0 04:00 2-15348A 5.9 -7.4 13.3 37 11 299 1676 2.7 334.0 04:17 2-15348A 5.9 -7.4 13.3 37 18 285 1598 2.6 334.0 04:33 2-15348A 5.7 -7.4 13.1 38 14 273 1664 3.3 333.0 04:50 2-15348A 5.7 -7.2 12.9 39 9 279 1682 2.6 334.0 05:08 3-15274A 5.6 -6.7 12.3 41 12 268 1636 3.2 334.0 05:25 3-15274A 5.4 -6.3 11.7 42 9 263 1588 2.6 334.0 05:41 3-15274A 5.3 -6.2 11.5 43 7 268 1709 3.3 333.0 05:57 3-15274A 5.2 -6.1 11.3 44 2 281 1632 3.0 334.0 06:14 3-15274A 5.4 -6.6 12.0 41 5 314 1734 3.5 333.0 06:28 4-15201A 4.9 -6.7 11.6 42 6 266 1654 2.9 333.0 06:45 4-15201A 5.0 -6.7 11.7 42 5 264 1719 2.7 333.0 07:01 4-15201A 5.0 -7.2 12.2 41 8 262 1830 2.8 333.0 07:18 4-15201A 5.1 -7.3 12.4 40 11 296 1728 3.2 333.0 07:34 4-15201A 5.0 -7.3 12.3 40 6 265 1603 3.3 333.0 07:49 5-15273A 4.9 -7.2 12.1 41 5 277 1611 2.8 333.0 08:06 5-15273A 4.6 -6.9 11.5 43 5 269 1615 5.8 305.0 08:22 5-15273A 4.5 -6.8 11.3 43 7 277 1585 2.5 333.0 08:38 5-15273A 4.5 -6.8 11.3 43 5 264 1575 2.5 333.0 08:55 5-15273A 4.4 -6.6 11.0 44 8 301 1550 2.7 333.0 09:09 7-15331A 4.4 -6.6 11.0 44 7 308 1401 2.5 333.0 09:25 7-15331A 4.3 -6.7 11.0 44 5 322 1283 2.4 333.0 09:39 7-15331A 3.6 -6.7 10.3 46 1 284 1409 2.3 333.0 09:58 7-15331A 3.8 -6.8 10.6 45 2 338 1290 2.9 333.0 10:13 8-15342A 2.5 -7.4 9.9 47 9 23 1411 3.0 333.0 10:29 8-15342A 2.5 -6.8 9.3 50 2 334 1392 2.3 333.0 10:46 8-15342A 3.5 -6.6 10.1 47 3 347 1521 2.4 333.0 11:02 8-15342A 2.7 -7.1 9.8 48 8 7 1499 2.9 334.0 11:18 8-15342A 3.0 -6.8 9.8 48 3 54 1548 2.7 333.0 11:35 8-15342A 2.9 -6.8 9.7 49 8 37 1584 3.0 333.0 ---- Problems in Detail ---- Around sunset, we attempted to run test slews and the brakes wouldn't stay clear. They would clear for an instant and the telescope would drift, but they wouldn't stay clear. We called Fred to site and inspected the MCP interlocks. We traced the issue to the mcp_ok interlock, which is triggered by the MCP watchdog timer. We called Jeff, and followed his recommendation to cycle the amplifiers. Jeff restarted an MCP process which interacts with the amplifiers and sets the watchdog interlock (amp_mgt). One of the two fixed the issue, Jeff believes it was an issue with the MCP process.