Date: Thu, 20 Mar 2025 22:26:05 -0000 Subject: Re: [sloan-25mlog 7723] 2.5m obslog 20250319 (SJD 60754) From: cscoresby@apo.nmsu.edu Yes, I checked with Mark on the 3.5m and he said they experienced a similar interruption. Torrie was also on-site and noticed the interruption as well. I did not see any sign of interruption at the telescope podium computer, but I imagine that runs on different networks/connections (?); STUI was non-responsive due to the memory leak issue so I couldn't see if it had disconnected, but the TPM there was working as normally. -Conner > Conner: Did you check with 35m Observer whether they experienced similar > internet connection interrupt last night? Thanks > >> 1. There was a strange network blip around 11:10Z, which appears to have >> been site-wide to the observatory. >> Actor 'apogeeql' raised a heartbeat error, and that was successfully >> triaged with a restart of the actor. Shortly thereafter, I noticed >> that STUI had disconnected; HAL/Boson got hung on Clean-Up Autopilot >> phase; the ssh connections were closed with "Broken pipe"; and the TPM >> status monitor showed "TPM Unavailable". Simple enough, restarting, >> reconnecting, or reinitializing these things brought them back to >> normal. There was no significant impact to observations that I could >> see. > > Looks like that the flux level on FPI #2 is unstable. > >> >> >> num field design config exptype dithpix nread relflux okay >> dx dy sigx sigy fpi1 fpi2 >> -------- ------ ------ ------ ------------ ------- ----- ------- ---- >> ------- ------- ------ ------ ---- ---- >> 51920001 101373 713084 19955 DARK 13.5 3 67 True >> -- -- -- -- -- -- >> 51920002 101373 713084 19955 DARK 13.5 60 -25 True >> -- -- -- -- -- -- >> 51920003 -999 -999 19956 QUARTZFLAT 13.5 10 103 True >> -- -0.27 -- 0.87 -- -- >> 51920004 -999 -999 19956 ARCLAMP-THAR 13.5 12 96 True >> 2.02 0.54 1.06 0.89 -- -- >> 51920005 -999 -999 19956 ARCLAMP-UNE 13.5 40 108 True >> 1.59 0.41 1.09 0.87 -- -- >> 51920006 -999 -999 19956 ARCLAMP-THAR 13.0 12 90 True >> 1.46 0.51 1.05 0.88 -- -- >> 51920007 -999 -999 19956 ARCLAMP-UNE 13.0 40 105 True >> 1.04 0.35 1.09 0.91 -- -- >> 51920008 -999 -999 19956 DARK 13.0 60 3 True >> -- -- -- -- -- -- >> 51920009 -999 -999 19956 FPI 13.0 30 218 True >> 12.92 0.31 1.15 0.87 -- -- >> 51920010 -999 -999 19956 FPI 13.5 30 217 True >> -11.19 0.33 1.16 0.88 -- -- >> 51920011 -999 -999 19956 DOMEFLAT 13.5 5 115 True >> -- -0.26 -- 0.84 -- -- >> 51920012 -999 -999 19956 DOMEFLAT 13.5 5 113 True >> -- -0.26 -- 0.86 -- -- >> 51920013 -999 -999 19956 DOMEFLAT 13.5 5 110 True >> -- -0.26 -- 0.86 -- -- >> 51920014 103987 715563 19957 OBJECT 13.5 35 67 True >> 1.98 -0.26 1.67 0.86 159 141 >> 51920015 103987 715563 19957 OBJECT 13.0 35 79 True >> 1.47 -0.25 1.70 0.86 167 144 >> 51920016 103064 714646 19958 OBJECT 13.0 43 83 True >> 1.46 -0.25 1.75 0.86 170 145 >> 51920017 103064 714646 19958 OBJECT 13.5 43 80 True >> 1.99 -0.25 1.75 0.86 161 142 >> 51920018 103064 714646 19958 OBJECT 13.5 43 81 True >> 1.97 -0.26 1.75 0.86 160 144 >> 51920019 103064 714646 19958 OBJECT 13.0 43 81 True >> 1.45 -0.25 1.75 0.86 168 146 >> 51920020 103064 714647 19959 OBJECT 13.0 43 76 True >> 1.47 -0.26 1.73 0.90 167 148 >> 51920021 103064 714647 19959 OBJECT 13.5 43 68 True >> 1.96 -0.25 1.75 0.85 164 143 >> 51920022 103064 714648 19960 OBJECT 13.5 43 68 True >> 1.97 -0.25 1.75 0.85 160 143 >> 51920023 103064 714648 19960 OBJECT 13.0 43 68 True >> 1.46 -0.24 1.75 0.86 166 141 >> 51920024 103064 714649 19961 OBJECT 13.0 43 55 True >> 1.45 -0.24 1.75 0.86 148 123 >> 51920025 103064 714649 19961 OBJECT 13.5 43 47 True >> 1.98 -0.24 1.75 0.84 149 123 >> 51920026 112360 697390 19962 OBJECT 13.5 43 49 True >> 1.96 -0.23 1.74 0.85 162 139 >> 51920027 112360 697390 19962 OBJECT 13.0 43 51 True >> 1.47 -0.24 1.74 0.90 161 145 >> 51920028 112360 697391 19963 OBJECT 13.0 43 57 True >> 1.46 -0.23 1.74 0.89 167 143 >> 51920029 112360 697391 19963 OBJECT 13.5 43 60 True >> 1.98 -0.23 1.75 0.84 164 141 >> 51920030 112360 697391 19963 OBJECT 13.5 43 63 True >> 1.98 -0.23 1.74 0.85 163 141 >> 51920031 112360 697391 19963 OBJECT 13.0 43 60 True >> 1.46 -0.23 1.75 0.86 158 141 >> 51920032 112360 697392 19964 OBJECT 13.0 43 63 True >> 1.46 -0.23 1.75 0.86 161 141 >> 51920033 112360 697392 19964 OBJECT 13.5 43 62 True >> 1.98 -0.23 1.76 0.85 161 -- >> 51920034 112360 697393 19965 OBJECT 13.5 43 61 True >> 1.98 -0.23 1.75 0.84 159 139 >> 51920035 112360 697393 19965 OBJECT 13.0 43 71 True >> 1.46 -0.23 1.74 0.90 168 141 >> 51920036 112360 697393 19965 OBJECT 13.0 43 68 True >> 1.46 -0.23 1.75 0.87 166 141 >> 51920037 112360 697393 19965 OBJECT 13.5 43 70 True >> 1.98 -0.23 1.76 0.85 160 142 >> 51920038 112360 697394 19966 OBJECT 13.5 43 67 True >> 1.97 -0.22 1.75 0.85 162 141 >> 51920039 112360 697394 19966 OBJECT 13.0 43 63 True >> 1.45 -0.22 1.75 0.87 160 142 >> 51920040 112360 697395 19967 OBJECT 13.0 43 54 True >> 1.45 -0.22 1.74 0.86 161 144 >> 51920041 112360 697395 19967 OBJECT 13.5 43 54 True >> 1.97 -0.22 1.75 0.85 158 142 >> 51920042 112360 697396 19968 OBJECT 13.5 43 57 True >> 1.99 -0.21 1.74 0.84 163 141 >> 51920043 112360 697396 19968 OBJECT 13.0 43 58 True >> 1.46 -0.22 1.74 0.85 159 142 >> 51920044 101099 712978 19969 OBJECT 13.0 35 70 True >> 1.45 -0.22 1.73 0.86 159 72 >> 51920045 101099 712978 19969 OBJECT 13.5 35 65 True >> 1.97 -0.22 1.74 0.85 160 71 >> 51920046 101333 713047 19970 OBJECT 13.5 35 48 True >> 1.97 -0.22 1.68 0.85 159 69 >> 51920047 101333 713047 19970 OBJECT 13.0 35 49 True >> 1.46 -0.23 1.69 0.90 155 71 >> 51920048 101641 713588 19971 OBJECT 13.0 35 47 True >> 1.46 -0.21 1.73 0.90 161 70 >> 51920049 101641 713588 19971 OBJECT 13.5 35 50 True >> 1.97 -0.20 1.74 0.83 157 70 >> 51920050 101626 713578 19972 OBJECT 13.0 35 42 True >> 1.46 -0.20 1.74 0.86 159 69 >> 51920051 101626 713578 19972 OBJECT 13.5 35 38 True >> 1.96 -0.21 1.75 0.84 159 68 >> 51920052 101321 713038 19973 OBJECT 13.0 35 37 True >> 1.46 -0.21 1.74 0.86 158 69 >> 51920053 101321 713038 19973 OBJECT 13.5 35 36 True >> 1.96 -0.20 1.75 0.84 150 54 >> 51920054 102593 714402 19974 OBJECT 13.0 35 73 True >> 1.55 -0.21 1.65 0.89 159 68 >> 51920055 102593 714402 19974 OBJECT 13.5 35 66 True >> 2.05 -0.21 1.46 0.89 162 71 >> 51920056 102609 714411 19975 OBJECT 13.0 35 48 True >> 1.46 -0.19 1.75 0.85 159 69 >> 51920057 102609 714411 19975 OBJECT 13.5 35 49 True >> 1.98 -0.21 1.75 0.84 160 68 >> 51920058 102612 714414 19976 OBJECT 13.5 35 46 True >> 1.98 -0.20 1.75 0.85 157 58 >> 51920059 102612 714414 19976 OBJECT 13.0 35 48 True >> 1.46 -0.20 1.73 0.90 155 48 >> 51920060 103168 714773 19977 OBJECT 13.0 35 70 True >> 1.46 -0.20 1.75 0.87 163 69 >> 51920061 103168 714773 19977 OBJECT 13.5 35 78 True >> 1.98 -0.19 1.75 0.85 161 69 >> 51920062 103200 714811 19978 OBJECT 13.0 35 76 True >> 1.46 -0.19 1.73 0.85 157 68 >> 51920063 103200 714811 19978 OBJECT 13.5 35 79 True >> 1.98 -0.19 1.75 0.84 161 72 >> 51920064 103212 714825 19979 OBJECT 13.0 35 84 True >> 1.48 -0.19 1.71 0.87 159 70 >> 51920065 103212 714825 19979 OBJECT 13.5 35 79 True >> 1.99 -0.20 1.70 0.87 162 69 >> 51920066 100023 711321 19980 OBJECT 13.0 35 87 True >> 1.45 -0.20 1.75 0.89 159 69 >> 51920067 100023 711321 19980 OBJECT 13.5 35 85 True >> 1.97 -0.20 1.75 0.85 161 69 >> 51920071 100522 712175 19982 OBJECT 13.5 35 99 True >> 1.97 -0.19 1.76 0.85 161 71 >> 51920072 103239 715008 19983 OBJECT 13.5 35 92 True >> 1.97 -0.19 1.76 0.85 166 67 >> 51920073 103239 715008 19983 OBJECT 13.0 35 94 True >> 1.47 -0.19 1.74 0.90 163 70 >> 51920074 100138 711440 19984 OBJECT 13.0 35 104 True >> 1.51 -0.18 1.68 0.88 162 71 >> 51920075 100138 711440 19984 OBJECT 13.5 35 109 True >> 2.03 -0.18 1.69 0.86 165 69 >> 51920076 100138 711440 19984 DOMEFLAT 13.5 5 114 True >> -- -0.20 -- 0.87 -- -- >> 51920077 100138 711440 19984 DOMEFLAT 13.5 5 109 True >> -- -0.17 -- 0.85 -- -- >> 51920078 100138 711440 19984 DOMEFLAT 13.5 5 111 True >> -- -0.21 -- 0.88 -- -- > >