Subject: 2.5m obslog 20201031 (SJD 59154) From: ccarter@apo.nmsu.edu Date: Sun, 1 Nov 2020 12:20:55 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday October 31, 2020 (SJD 59154) ---- Observing Team ---- Kaike Pan Christian Carter Jose Sanchez-Gallego (remote STUI support) John Donor (remote scheduling support) ---- Observing Plan ---- Sat 31 OCT 2020 59154.0 1.00 01:07 12:27 20:47 08:09 FSC KP Likely FSC Engineering -- else APOGEE-2 (11.3 h) ---- Observing Summary ---- Happy Halloween! Marginally productive night; we battled spooky clouds that got the best of us for part of the night. Observed seven APOGEE-2 plates but several are likely unusable. APOGEE-2 lost a total of 2.4 hours to weather. First night on sky with repaired MCP power supply and no MCP crashes/faults. APOGEE-2 ======== Cart 4; Plate 11270; Field K19_076+07_btx; APOGEE-only; Complete! APOGEE: 2xDAB Missing fibers: [20, 39, 62, 151, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 123', '125 - 127', '152 - 154', 156, '158 - 159', '161 - 162', '166 - 170', 175, 177, '179 - 183', 185, '187 - 192', '194 - 197', 199, 204] Cart 3; Plate 12765; Field FL_2020; APOGEE-led; Incomplete APOGEE: 2xABBA Missing fibers: [8, 211, 242, 245, 256, 273] Faint fibers: [123, '151 - 180', '271 - 272', '274 - 276', '278 - 297', 299] Cart 5; Plate 12760; Field N752_btx; APOGEE-only; Incomplete APOGEE: 2xDAB + DB Missing fibers: [211, 273] Faint fibers: ['121 - 143', '145 - 210', 259, 261] Cart 6; Plate 12761; Field N752_btx; APOGEE-only; Incomplete APOGEE: 2xDAB Missing fibers: [15, 105, 181, 211, 273] Faint fibers: ['1 - 14', '16 - 30', 34, '151 - 180'] Cart 1; Plate 12137; Field K2_C4_172-20_btx; APOGEE-only; Incomplete APOGEE: 2xBAAB Missing fibers: [211, 273] Faint fibers: ['1 - 13', '15 - 24', '26 - 30', 55, '57 - 60', '151 - 180', 227, '244 - 245', 261, 267] Cart 7; Plate 7951; Field N188; APOGEE-only; Incomplete APOGEE: 1xBAAB Missing fibers: [211, 273] Faint fibers: [123, '126 - 127', 129, 136, '151 - 163', '166 - 173', '175 - 180', '212 - 240'] Cart 9; Plate 11861; Field NGC2632_btx; APOGEE-only; Incomplete APOGEE: 2xBAAB + BA Missing fibers: [36, 211, 245, 273] Faint fibers: ['121 - 150', '181 - 210', '212 - 240', '271 - 272', '274 - 276', '279 - 300'] Notes: ====== (1) We encountered a minor(?) issue where the telescope seemed to overshoot ALT=90 before a cartridge change. See Problems in Detail. (2) During opening we encountered the same problem the engineers did earlier today: the STUI Telescope Controls GUI refused to slew to (60,60,60) and claimed that the enclosure was on while we were open. We were able to slew using TCC commands from within STUI. (3) We noticed that the auto-populated default number of exposures in SOP are wrong for APOGEE observations: SOP defaults to 4 dither pairs for DAB plates and 2 dither pairs for ABBA plates. (4) During afternoon checkout we attempted to take BOSS cals with Cart 9. The SOP GUI did not offer options to take BOSS cals and sop doBossCalibs commands did not take cals. Called Jose. We figure that plate 11861 does not have any BOSS fibers plugged even though Cart 9 is no longer an APOGEE-only Cart. Jose advised and restarted SOP; we believe there are no outstanding issues. ---- Observing Log ---- Afternoon: ========== restarted tcc with the test version, checked and confirmed NCORR=00 for the secondary. We homed/relaxed mirrors. We saved tonight's mirror numbers as new nominal MIGs. motorPosition sp1: 11669, 12820, 12243; ---------- Median spectrographs temperatures: Tsp1= 8.0 Outside air temperature= 10.2; We restarted SOS. Disk space: ========== Filesystem Size Used Avail Use% Mounted on /dev/vda2 7.7G 6.7G 699M 91% / tmpfs 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M 133M 52M 73% /boot /dev/vdb 19G 8.8G 9.1G 49% /exports/hub-local /dev/vdd 688G 581G 108G 85% /home /dev/vdc1 11T 7.2T 3.6T 67% /data 23:30Z: started ventilation. Night: ====== ##################### 00:39:31 Load Cart 4, Plate 11270; Field K19_076+07_btx; APOGEE-only APOGEE: 2xDAB First science exposure: 00:54:42 apogee.expose=apRaw-35920009, 94, A, Object Final science exposure: 01:44:48 apogee.expose=apRaw-35920012, 94, A, Object 02:02:06 apogee.expose=apRaw-35920013, 5, A, DomeFlat 02:04:43 apogee.expose=apRaw-35920014, 10, A, Dark 02:06:31 apogee.expose=apRaw-35920015, 10, A, Dark Missing fibers: [20, 39, 62, 151, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 123', '125 - 127', '152 - 154', 156, '158 - 159', '161 - 162', '166 - 170', 175, 177, '179 - 183', 185, '187 - 192', '194 - 197', 199, 204] ##################### 02:08:10 Load Cart 3, Plate 12765; Field FL_2020; APOGEE-only APOGEE: 2xABBA First science exposure: 02:15:52 apogee.expose=apRaw-35920016, 47, A, Object Final science exposure: 03:14:35 apogee.expose=apRaw-35920023, 47, A, Object 03:23:12 apogee.expose=apRaw-35920024, 5, A, DomeFlat 03:25:42 apogee.expose=apRaw-35920025, 10, A, Dark 03:27:29 apogee.expose=apRaw-35920026, 10, A, Dark Missing fibers: [8, 211, 242, 245, 256, 273] Faint fibers: [123, '151 - 180', '271 - 272', '274 - 276', '278 - 297', 299] ##################### 03:28:39 Load Cart 5, Plate 12760; Field N752_btx; APOGEE-only APOGEE: 2xDAB + DB First science exposure: 03:34:55 apogee.expose=apRaw-35920027, 94, A, Object Final science exposure: 04:41:59 apogee.expose=apRaw-35920031, 94, B, Object 04:58:51 apogee.expose=apRaw-35920032, 5, B, DomeFlat 05:00:47 apogee.expose=apRaw-35920033, 10, B, Dark 05:02:35 apogee.expose=apRaw-35920034, 10, B, Dark Missing fibers: [211, 273] Faint fibers: ['121 - 143', '145 - 210', 259, 261] ##################### 05:10:15 Load Cart 6; Plate 12761; Field N752_btx; APOGEE-only APOGEE: 2xDAB First science exposure: 05:16:01 apogee.expose=apRaw-35920035, 94, B, Object Final science exposure: 06:06:09 apogee.expose=apRaw-35920038, 94, B, Object 06:23:05 apogee.expose=apRaw-35920039, 5, B, DomeFlat 06:25:26 apogee.expose=apRaw-35920040, 10, B, Dark 06:27:13 apogee.expose=apRaw-35920041, 10, B, Dark Missing fibers: [15, 105, 181, 211, 273] Faint fibers: ['1 - 14', '16 - 30', 34, '151 - 180'] ##################### 06:29:36 Load Cart 1; Plate 12137; Field K2_C4_172-20_btx; APOGEE-only APOGEE: 2xBAAB First science exposure: 06:37:04 apogee.expose=apRaw-35920042, 47, B, Object Final science exposure: 07:35:48 apogee.expose=apRaw-35920049, 47, B, Object 07:44:22 apogee.expose=apRaw-35920050, 5, B, DomeFlat 07:46:30 apogee.expose=apRaw-35920051, 10, B, Dark 07:48:18 apogee.expose=apRaw-35920052, 10, B, Dark Missing fibers: [211, 273] Faint fibers: ['1 - 13', '15 - 24', '26 - 30', 55, '57 - 60', '151 - 180', 227, '244 - 245', 261, 267] ##################### 07:51:39 Load Cart 7; Plate 7951; Field N188; APOGEE-only APOGEE: 1xBAAB First science exposure: 07:58:34 apogee.expose=apRaw-35920053, 47, B, Object Final science exposure: 08:23:46 apogee.expose=apRaw-35920056, 47, B, Object 08:32:46 apogee.expose=apRaw-35920057, 5, B, DomeFlat Missing fibers: [211, 273] Faint fibers: [123, '126 - 127', 129, 136, '151 - 163', '166 - 173', '175 - 180', '212 - 240'] Attempted 2xABBA but finally succumbed to the clouds around 08:35Z. Parked at gang change and engaged telescope brakes (control room e-stop) to protect against MCP crash. Weather improved in time for us to attempt Cart 9. ##################### 10:13:54 Load Cart 9; Plate 11861; Field NGC2632_btx; APOGEE-only APOGEE: 2xBAAB + BA First science exposure: 10:23:08 apogee.expose=apRaw-35920060, 47, B, Object Final science exposure: 11:38:37 apogee.expose=apRaw-35920069, 47, A, Object 11:47:12 apogee.expose=apRaw-35920070, 5, A, DomeFlat 11:49:01 apogee.expose=apRaw-35920071, 10, A, Dark 11:50:49 apogee.expose=apRaw-35920072, 10, A, Dark Missing fibers: [36, 211, 245, 273] Faint fibers: ['121 - 150', '181 - 210', '212 - 240', '271 - 272', '274 - 276', '279 - 300'] Not a single exposure on Cart 9 appears usable. Closing up for the night. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9310 -4.9310 Axial B: -4.6660 -4.6660 Axial C: -5.7830 -5.7830 Trans D: -4.4340 -4.4340 Lateral E: 0.3745 0.3745 Lateral F: 0.5715 0.5715 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 5.06 Altitude: 30.00005840078799 MIGS TONIGHT NOMINAL Axial A: -9.4550 -9.4550 Axial B: -9.4200 -9.4200 Axial C: -9.4970 -9.4970 Trans D: 0.0380 0.0380 GALILS Commanded: 4637750 4626350 4689000 -2000 -6550 Actual: 4603835 4585681 4632239 -2000 -6550 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3656.96 -14.01 -2.85 12.11 113.59 ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Inst Az Alt Rot objArcOff guideRot calibOff -------------------------------------------------------------------------------- 12:13 8-15018A 121.0 30.0 0.0 ( 0.0, 0.0) ( 0.0) ( 0.0, 0.0, 0.0) ---- Focus Log ---- --- Focus --- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 12:13 8-15018A 1.000000 0 3656 0 121.0 30.0 -99.0 15 86 nan ---- Telescope Status ---- 23:30Z Started ventilation 23:40Z encl25m : open 12:05Z encl25m : closed No interlocks bypassed Status at: 12:18Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 8 Counterweights at: 510 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 206 lbs, 21.1 psi SP2 N/A lbs, N/A psi ---- Software Used ---- -- STUI software: STUI : 1.7.10 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.8.1 hartmann : 1.8.0 hub : v4.2.4 mcp : 1.12-12-g222b -mcp.plc : 34 -mcp.azFiduci : v1_144 -mcp.altFiduc : v1_144 -mcp.rotFiduc : v1_144 platedb : 2.8.0 sop : 4.0.1 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev APO-local : trunk -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_7 petunia : git autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk exported ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 12:13 8-15018A -99.0 -99.0 0.0 999 15 86 313 50.3 346 nan ---- Problems in Detail ---- Commanded ALT=90 slew sent the telescope to ALT=92 ================================================== Shortly after 05:02Z we began changing to Cart 6. We weren't able to seat the ALT lock pin and discovered that the telescope had come to rest close to ALT=92 degrees. We used the MCP to take the semaphore and commanded a slew to ALT=90, but this produced the same issue (telescope came to a stop close to ALT=91). We then used the MCP to slew the telescope to ALT=85, then 90. This worked as expected. We used the MCP to halt the ALT axis before pressing the e-stop and had no trouble setting or removing the ALT lock pin. The same issue was encountered for every cart change for the remainder of the night. Just as John Downey has instructed, it's become important to manually set the brakes before engaging the e-stop and proceeding with cart changes. In the few moments between the e-stop and when the breaks engage the telescope drifts by as much as two degrees. We suspect this is a counterweight issue.