Subject: 2.5m obslog 20211025 (SJD 59513) From: asimmons@apo.nmsu.edu Date: Tue, 26 Oct 2021 10:28:39 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday October 25, 2021 (SJD 59513) ---- Observing Team ---- Audrey Oravetz Karen Kinemuchi (R) Kaike Pan (FSC support) Aiden Gray (FSC support) ---- Observing Plan ---- FSC work ---- Observing Summary ---- We opened for the first few hours of the night to gather images with the FSC with Aidan. We are no longer seeing the apogeeql alerts when taking APOGEE images. We are still witnessing the odd shifting when issuing a tcc trac/pterr command versus tcc track commands, even after switching the tcc back to the sdss4 machine and implementing the newest pointing model taken yesterday with Kaike's analysis. ---- Observing Log ---- Afternoon: ========== There was a sticky SP1LN2Empty warning alert upon arrival. boss ackErrors and another camCheck proved everything was ok and cleared the alert. This alert was spawned during daytime work. Actors pinging ok, except for ecamera and fliswarm which are supposed to be disconnected. The FSC is mounted on the telescope. Test slews completed. The balance is acceptable at counterweight values of around 560,560,575,575. APOGEE cals and BOSS cals were collected. 2:52:24 boss exposure 0.0, file=334657 22:54:04 boss exposure 20.0, file=334658 (observers39) [observer@sdss5-hub: ~]$ list_ap APOGEE data list, mjd=59513, all raw_data: /data/apogee/utr_cdr/59513/apRaw-*.fits archive: /data/apogee/archive/59513/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59513/ap2D-a-*.fits.fz ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59513 1 23:02 39510001 Dark 60 A 13.0 ------- a-b-c - - 59513 2 23:04 39510002 QuarFlat 10 A 13.0 ------- a-b-c - 98 59513 3 23:06 39510003 Arc---- 12 A 13.0 ------- a-b-c - - 59513 4 23:08 39510004 Arc---- 12 A 13.0 ------- a-b-c - - 59513 5 23:16 39510005 Arc---- 40 A 13.0 ------- a-b-c - - 59513 6 23:23 39510006 Arc---- 40 A 13.0 ------- a-b-c - - 59513 7 23:34 39510007 Dark 60 A 13.0 ------- a-b-c - - 59513 8 23:40 39510008 Arc---- 30 A 13.0 ------- a-b-c - - FPI 59513 9 23:57 39510009 Arc---- 30 A 13.0 ------- a-b-c - - FPI ------------------------------------------------------------------------------ The secondary mirror was found in an intermediate state of moving. The Countdown timer within the Mirror status window ws 51k+ seconds. I telneted into M2 and discovered that its current status is 'DONE', but the galils are still attempting to move to my designated foc=0 scale=1 destination. I attempted to restart the controllers with systemctl ... of the sec25m, but it crashed both the prim25m and the tcc as well. I am unable to get them back up. The mirror controllers and tcc were stopped on sdss5, and a telstop telrun was initiated on sdss4 successfully. Mirrors numbers were retaken. Everything is normal again. Set the instrument block for the FSC camera, tcc set instr=fsccam. Restarted optidew and humid since they were stale. Discovered that the MCP and TPM logs were not being created ever since a server restart on Oct 19. Two out of the four processed worked, but the tpm_logger and mcp_archive were not found. We need an updated procedure. Contacted Dmitry for assistance. 23:56Z - Started ventilating. Ran Dmitry's task of taking an internal flat with the sparse port. Night: ====== 00:45Z - Opened the enclosure and started a fill. 01:30Z - Slewed to an fk5 waited for parties to arrive for FSC tests. 02:00Z - Moved to fk5 stars within magnitude range of 12.3 - 12.7. Aidan kindly showed us how to set up the FSC servers by sharing his screen. We focused. 03:00Z - Was in the middle of a rotation of the t-axis when we lost the star completely. Slewed to an easier position to see inside of the focal plane. The cover that is anchored by one screw was extremely loose and slid right over the lens. The cover was taped back very gently, with extra caution not to touch the corrector or FSC lens. 03:25Z - Needed to refocus. The mirror needed to move by 175 microns. Aidan collected the images he needed to find the center of the chip. Tested the slew window. Unfortunately we still see the shifting behavior, about 26" to the left just like before. 04:29Z - We closed the telescope since we have no additional tasks for tonight. Stopped ventilating. Started cals. Will plan on sticking around and monitoring the BOSS cameras. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 4 MIGS TONIGHT NOMINAL Axial A: 0.0050 0.0040 Axial B: 0.0940 0.0310 Axial C: -0.1950 -0.1180 Trans D: -0.0446 -0.0362 Lateral E: 0.3315 0.3315 Lateral F: 0.5350 0.5340 GALILS Commanded: 14350 -2550 4400 50700 -8800 -8400 Actual: 14350 -2550 4400 50700 -8800 -8400 SETMIR VALUES PrimDesOrient: 0 PrimOrient: 0 SECONDARY: ---------- Focus: 48 Air temp: 14.50 Altitude: 30.000633957517266 MIGS TONIGHT NOMINAL Axial A: -9.4390 -9.4440 Axial B: -9.4660 -9.4730 Axial C: -9.5010 -9.5010 Trans D: 0.1010 0.1000 GALILS Commanded: 4620650 4614000 4637950 -50 -3450 Actual: 4606972 4607413 4606935 -50 -3450 SETMIR VALUES SecDesOrient: 0 SecOrient: 0 ---- Telescope Status ---- 00:15Z Started ventilation 00:36Z encl25m : open 04:36Z encl25m : closed No interlocks bypassed Status at: 04:36Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = FSC Counterweights at: 555 555 575 575 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 202 lbs, 19 psi ---- Software Used ---- Get Versions, 10/25/21, 23:06:51 -- STUI software: STUI : 1.7.13 alerts : 2.1.6 apo : 3.0.0 boss : 6.0.1-alpha.0 -boss.specMec : 3.0.4 guider : 4.0.0 ecamera : FAILED fliswarm : FAILED hartmann : 2.0.0 hub : 5.0.0a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_147 -mcp.altFiduc : v1_147 -mcp.rotFiduc : v1_147 sop : 0.1.0-alpha.0 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.9 -- done --