Subject: 2.5m obslog 20211103 (SJD 59522) From: dmbiz@apo.nmsu.edu Date: Thu, 4 Nov 2021 10:33:41 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday November 03, 2021 (SJD 59522) ---- Observing Team ---- Dmitry Bizyaev Dylan Gatlin (R) Aidan Gray (remotely, FSC tests) Shane Thomas (on site, FSC connection debugging in the evening) Tracey Fernandez (remotely, FSC connection debugging in the evening) ---- Observing Plan ---- FSC focal plane scans ---- Observing Summary ---- Clear night Notes: - In the evening Ryan reported that they "moved as many of the OM1 fibers from their regular connection locations to the new Fiber/Ethernet switch Issues have now come up trying to communicate with the DAQ. Dan O. Is working with José to try to figure out where the communication drop is happening. Later Dylan said that there was an OSError: No route to host, but Ryan changed some wires around a couple times and got it to work. As a result, no problems were noticed in the evening. - The 120 phone on the podium can make calls, but attempts to call it from on site or off site bring up Busy signal. Power cycling the phone did not help. - in the middle of the FSC tuning in the evening connection to the FSC computer was broken. It turned out that another device, a new terminal server set up around 13:30 MST today stole the ip address. It took time to understand what's gong on, to find and power off the device (in the lower enclosure, same rack with the Xyplex, the Perle IOLAN device). Thanks to Shane and Tracey for responses and suggestions in after hours! As a result, we were able to restore connection to the FSC computer. To that time the wind direction has changed to NE, seeing got worse than at the evening and unstable, and Aidan's tests appeared inefficient. - In the day time conversation Jose said that now the weather information is propagated to tcc. Also, the warning about the weather info not getting to the tcc disappeared. We tried to move telescope with track/pterr and track RA,Dec commands, and the star comes to the same place on the CCD within ~1" scatter. - dust accumulated: 2.3K - The "2.5 Air" information on the weather page looks got stuck at unrealistic values. ---- Observing Log ---- Afternoon --------- Checked all relevant equipment. No problems discovered. FSC is turned on. Aidan planned to log in by 4:00Z. 23:32Z started ventilation Night ----- 00:41Z enclosure open 01:40Z the FSC was turned on, and we were able to take an image. In the middle of turning things the connection to the FSC was interrupted, with a message @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY! Someone could be eavesdropping on you right now (man-in-the-middle attack)! A pretty long investigation has shown that: - aroud 13:30 MST a new terminal server was st up by Tracey. The server has got ip address 10.25.1.160, exactly what the FSC has. Around 01:40Z the server was activated. Our attempts to connect to the same ip address lead to asking for login/password and their rejecting. We were able to connect to the server via www and see its make and model. It is not the FSC computer. We were able to find the terminal server in the lower enclosure. By Shane and Tracey recommendation the TS was powered off and disconnected. After turning off, the FSC was power cycled, but was not seen on the network any way. Shane recommended to wait at least 30 min until the router cache flushes. After 30 minutes the FSC got seen, and we, and Aidan, were able to connect to it. 06:00Z Aidan started his tests with the FSC with the "i'" filter. Our M2 focus provides a ~ 20 pix FWHM (1.5"). We have a NE wind, and 3.5m has 2" seeing, so this is the best that we can get. Aidan: the seeing is bad and unstable. We turned telescope down the wind. It did not help to improve the seeing. Aidan cannot perform his measurements efficiently with this seeing. Done for tonight. == APO tests == Next, we performed tests to see difference between the telescope pointing using track/pterr command and track RA,Dec tcc track/pterr 240, 55 obs /rotty=obj /rota=0 /magRange=(11,12) ra, dec = 6.802567, 43.361647 Center at 1582 , 936 tcc track 6.802567,43.361647 icrs: 1592, 941 again the same command: 1596 , 931 again the same command: 1596 , 941 again the same command: 1596 , 936 Given the pixel size of 0.075", the star comes to the same place with both commands. 07:32Z enclosure closed APOGEE calibrations started ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0050 0.0040 Axial B: 0.0070 0.0310 Axial C: -0.1210 -0.1180 Trans D: -0.0358 -0.0362 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5340 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 10.78 Altitude: 29.99915228782906 MIGS TONIGHT NOMINAL Axial A: -9.6520 -9.4440 Axial B: -9.6640 -9.4730 Axial C: -9.6980 -9.5010 Trans D: 0.1090 0.1000 GALILS Commanded: 4881850 4878050 4898400 -50 -3450 Actual: 4859255 4859243 4859167 -50 -3450 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.0 0.01 -0.02 -0.02 42.86 ---- Telescope Status ---- 23:32Z Started ventilation 00:41Z encl25m : open 07:32Z encl25m : closed No interlocks bypassed Status at: 10:34Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = FSC Counterweights at: 559/577 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 211 lbs, 20 psi ---- Software Used ---- STUI : 1.7.13 alerts : 2.1.6 apo : 3.0.0 boss : 6.0.1-alpha.0 -boss.specMec : 3.0.4 guider : 4.0.0 ecamera : FAILED fliswarm : FAILED hartmann : FAILED hub : 5.0.0a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_147 -mcp.altFiduc : v1_147 -mcp.rotFiduc : v1_147 sop : 0.1.0-alpha.0 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.9 /dev/sdb1 2.0T 94G 2.0T 5% /home 10.25.1.230:/data 21T 16T 5.0T 76% /data ---- APOGEE Data Summary ---- Last morning: 59521 10 11:25 39590010 Dark 60 A 13.0 ------- a-b-c - - 59521 11 11:36 39590011 Dark 60 A 13.0 ------- a-b-c - - 59521 12 11:46 39590012 Dark 60 A 13.0 ------- a-b-c - - 59521 13 11:48 39590013 QuarFlat 10 A 13.0 - a-b-c - 99 59521 14 11:50 39590014 QuarFlat 10 A 13.0 - a-b-c - 99 59521 15 11:52 39590015 QuarFlat 10 A 13.0 - a-b-c - 100 59521 16 11:54 39590016 Arc-Thar 12 A 13.0 - a-b-c 0.45 - 59521 17 12:01 39590017 Arc-Une 40 A 13.0 - a-b-c - - 59521 18 12:03 39590018 Arc-Thar 12 A 13.0 - a-b-c 0.45 - 59521 19 12:11 39590019 Arc-Une 40 A 13.0 - a-b-c - - 59521 20 12:16 39590020 Dark 30 A 13.0 ------- a-b-c - - 59521 21 12:21 39590021 InteFlat 30 A 13.0 ------- a-b-c - 279 59521 22 12:27 39590022 InteFlat 30 A 13.0 ------- a-b-c - 280 59521 23 12:32 39590023 InteFlat 30 A 13.0 ------- a-b-c - 279 59521 24 12:37 39590024 Dark 30 A 13.0 ------- a-b-c - - This evening: ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59522 1 23:18 39600001 Arc---- 3 A 13.0 - a-b-c - - 59522 2 23:31 39600002 Dark 60 A 13.0 ------- a-b-c - - 59522 3 23:33 39600003 QuarFlat 10 A 13.0 - a-b-c - 100 59522 4 23:35 39600004 Arc-Thar 12 A 13.0 - a-b-c 0.44 - 59522 5 23:42 39600005 Arc-Une 40 A 13.0 - a-b-c - - 59522 6 23:44 39600006 Arc-Thar 12 A 13.0 - a-b-c 0.44 - 59522 7 23:51 39600007 Arc-Une 40 A 13.0 - a-b-c - - 59522 8 00:02 39600008 Dark 60 A 13.0 ------- a-b-c - - 59522 9 00:26 39600009 Arc---- 30 A 13.0 - a-b-c - - FPI ------------------------------------------------------------------------------ APOGEE data list, mjd=59522, all raw_data: /data/apogee/utr_cdr/59522/apRaw-*.fits archive: /data/apogee/archive/59522/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59522/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59522 1 23:18 39600001 Arc---- 3 A 13.0 - a-b-c - - 59522 2 23:31 39600002 Dark 60 A 13.0 ------- a-b-c - - 59522 3 23:33 39600003 QuarFlat 10 A 13.0 - a-b-c - 100 59522 4 23:35 39600004 Arc-Thar 12 A 13.0 - a-b-c 0.44 - 59522 5 23:42 39600005 Arc-Une 40 A 13.0 - a-b-c - - 59522 6 23:44 39600006 Arc-Thar 12 A 13.0 - a-b-c 0.44 - 59522 7 23:51 39600007 Arc-Une 40 A 13.0 - a-b-c - - 59522 8 00:02 39600008 Dark 60 A 13.0 ------- a-b-c - - 59522 9 00:26 39600009 Arc---- 30 A 13.0 - a-b-c - - FPI 59522 10 07:46 39600010 Dark 60 A 13.0 ------- a-b-c - - 59522 11 07:56 39600011 Dark 60 A 13.0 ------- a-b-c - - 59522 12 08:07 39600012 Dark 60 A 13.0 ------- a-b-c - - 59522 13 08:09 39600013 QuarFlat 10 A 13.0 - a-b-c - 99 59522 14 08:11 39600014 QuarFlat 10 A 13.0 - a-b-c - 99 59522 15 08:13 39600015 QuarFlat 10 A 13.0 - a-b-c - 99 59522 16 08:15 39600016 Arc-Thar 12 A 13.0 - a-b-c 0.45 - 59522 17 08:22 39600017 Arc-Une 40 A 13.0 - a-b-c - - 59522 18 08:24 39600018 Arc-Thar 12 A 13.0 - a-b-c 0.45 - 59522 19 08:31 39600019 Arc-Une 40 A 13.0 - a-b-c - - 59522 20 08:37 39600020 Dark 30 A 13.0 ------- a-b-c - - 59522 21 08:42 39600021 InteFlat 30 A 13.0 ------- a-b-c - 280 59522 22 08:47 39600022 InteFlat 30 A 13.0 ------- a-b-c - 280 59522 23 08:53 39600023 InteFlat 30 A 13.0 ------- a-b-c - 280 59522 24 08:58 39600024 Dark 30 A 13.0 ------- a-b-c - - ------------------------------------------------------------------------------