Subject: 2.5m obslog 20230911 (SJD 60199) From: kpan@apo.nmsu.edu Date: Tue, 12 Sep 2023 11:05:10 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday September 11, 2023 (SJD 60199) ---- Observing Team ---- Kaike Pan ---- Observing Plan ---- Shakedown tasks. R1 is on the vacuum pump, communication to b1 fails. B1 needs a bypass manually fill every two hours. ---- Observing Summary ---- It rained for a while. Clouds, nearby radar, and high humidity for entire night. Completed a set of fvc rotator scan data. The rotator stuck at 80 degree during the 2nd set of scan data. Notes: 1.Robot air temperature approaches the limit, 40 C, after being turned on for 3 hours. The ambient temperature is not that warm, at 10.5 C. Coolant rates are lower than usual. The FPS flow rate at 5.1 L/min (compare to 7.3 L/min), GFA loop flow rate is at 1.1 L/min (compare to 1.6 L/min). Pressures are lower than their normal values. Supply pressure and return pressure are at 23.1 and 17.2 psi tonight (compare their normal values of 40 and 29 psi). 2. The rotator stuck at 80 degrees during fvc rotator scan test. The axis could not be initialized from tcc neither via MCP. Power cycled the amplifier made no difference. ---- Engineering Issues ---- 1. Coolant rates are lower than usual. The FPS flow rate at 5.1 L/min (compare to 7.3 L/min), GFA loop flow rate is at 1.1 L/min (compare to 1.6 L/min). Pressures are lower than their normal values. Supply pressure and return pressure are at 23.1 and 17.2 psi tonight (compare their normal values of 40 and 29 psi). 2. The rotator stuck at 80 degrees during fvc rotator scan test. The axis could not be initialized from tcc neither via MCP. Power cycled the amplifier made no difference. ---- Observing Log ---- Afternoon: ========== Mike and Conor are working on fvc setup, do focus sweeps. Fill b1 at 00:18Z. Night: ======== 03:30Z: John informed me that Jose fixed communication issue on b1 while r1 is removed from the telescope. The vent soleniod is plugged back to b1, and tested and confirmed startFillSequence command starting and completed successfully. 05:35Z: Visual confirmed auto-fill to b1 camera successfully launched and completed. Fill the 10L dewar to prepare for Conor's fvc rotator scan, as described below: --- 1. configure for a safe random robot reconfiguration (“jaeger configuration random”) 2. move the rotator from 0, 360 in 10 degree increments (0, 10, 20, …, 350, 360) 3. at each rotator angle take 3 fvc images (“jaeger fvc loop —no-apply —fbi-level 4”) 4. additionally take 3 more fvc images at a higher fbi level (“jaeger fvc loop —fbi-level 6”) 5. after the full rotator sweep is finished send robots home (“jaeger configuration reverse”) ---- 06:00Z: disconnected LN2 line, power on FPS for the test. 06:15Z: jaeger configuration random 06:18Z: tcc track 121, 90 mount/rota=0 /rotty=mount, tcc axis stop jaeger fvc loop --no-apply --fbi-level 4 three times: image 64-66 jaeger fvc loop --no-apply --fbi-level 6 three times: image 67-69 Rot=10 deg, level 4: 70-72 level 6: 73-75 Rot=20 deg, level 4: 76-78 level 6: 79-81 Rot=30 deg, level 4: 82-84 level 6: 85-87 Rot=40 deg, level 4: 88-90 level 6: 91-93 Rot=50 deg, level 4: 94-96 level 6: 97-99 Rot=60 deg, level 4: 100-102 level 6: 103-105 Rot=70 deg, level 4: 106-108 level 6: 109-111 Rot=80 deg, level 4: 112-114 level 6: 115-117 Rot=90 deg, level 4: 118-120 level 6: 121-123 Rot=100 deg, level 4: 124-126 level 6: 127-129 Rot=110 deg, level 4: 130-132 level 6: 133-135 Rot=120 deg, level 4: 136-138 level 6: 139-141 Rot=130 deg, level 4: 142-144 level 6: 145-147 Rot=140 deg, level 4: 148-150 level 6: 151-153 Rot=150 deg, level 4: 154-156 level 6: 157-159 Rot=160 deg, level 4: 160-162 level 6: 163-165 Rot=170 deg, level 4: 166-168 level 6: 169-171 Rot=180 deg, level 4: 172-174 level 6: 175-177 Rot=190 deg, level 4: 178-180 level 6: 181-183 Rot=200 deg, level 4: 184-186 level 6: 187-189 Rot=210 deg, level 4: 190-192 level 6: 193-195 Rot=220 deg, level 4: 196-198 level 6: 199-201 Rot=230 deg, level 4: 202-204 level 6: 205-207 Rot=240 deg, level 4: 208-210 level 6: 211-213 Rot=250 deg, level 4: 214-216 level 6: 217-219 Rot=260 deg, level 4: 220-222 level 6: 223-225 Rot=270 deg, level 4: 226-228 level 6: 229-231 Rot=280 deg, level 4: 232-234 level 6: 235-237 Rot=290 deg, level 4: 238-240 level 6: 241-243 Rot=300 deg, level 4: 244-246 level 6: 247-249 Rot=310 deg, level 4: 250-252 level 6: 253-255 Rot=320 deg, level 4: 256-258 level 6: 259-261 Rot=330 deg, level 4: 262-264 level 6: 265-267 Rot=340 deg, level 4: 268-270 level 6: 271-273 Rot=350 deg, level 4: 274-276 level 6: 277-279 Rot=360 deg, level 4: 280-282 level 6: 283-285 jaeger configuration reverse Robot air temperature approach 38 C. Power FPS off. 10:00Z: Robot air dropped to 26 C. Start the 2nd set of rotator scan data. I don't have time to finish a completed set with incremental 10 degrees. Will use 20 deg incremental. 10:06:57 CmdDone: OBSERVER.kpan 557 jaeger configuration random. fvc image 286-291 were taken before the configuration random completed. Redo take the fvc images for this rotator angle. Rot=0 deg, level 4: 292-294 level 6: 295-297 Rot=20 deg, level 4: 298-300 level 6: 301-303 Rot=40 deg, level 4: 304-306 level 6: 307-309 Rot=60 deg, level 4: 310-312 level 6: 313-315 Rot=80 deg, level 4: 316-318 level 6: 319-321 Rotator stuck at 80 degrees. The axis could not be initialized with tcc or from MCP. Power cycled the amplifier made no different. Visual check didn't find anything. Give it up. ---- Telescope Status ---- N/A Started ventilation N/A encl25m : open N/A encl25m : closed No interlocks bypassed Status at: 11:15 Telescope stowed at: 121.0, 90.0, 80.0 mount Instrument mounted: FPS Counterweights at: LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 272 lbs, 19.1 psi FPS Status ========== CP10 Loop = 5.12 L/min GFA Loop = 1.14 L/min Supply pressure = 23.3 psi Return pressure = 17.2 psi Chiller Status ============== Set temperarature = 22.0 C Flow = 2.9 Gpm ---- Software Used ---- STUI : 1.7.18b1 alerts : 2.3.0 boss : 6.0.2-alpha.0 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.4.0 jaeger : 1.4.1a0 kaiju : 1.3.1 coordio : 1.7.1 fps_calibrati : 2023.07.27 cherno : 0.6.3 astrometrynet : 0.93 hal : 0.6.0b5 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 35 -mcp.azFiduci : v1_149 -mcp.altFiduc : v1_149 -mcp.rotFiduc : v1_149 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.20 sdss-obstools : 3.9.3 TPM : 1.2-31-gd7eb MCP : 2.1-1-ge461 PLC : V35 Fiducials : v1_149 idlspec2d : v6_1_0 Kronos : 1.6.2a roboscheduler : 1.4.0 /dev/sdb1 2.0T 290G 1.8T 15% /home /dev/sdd1 22T 8.8T 13T 43% /data Boson : 0.3.2 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 60199 Fill night time in Hours below *=*=*= Total bright time : 0.3 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 0.3 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 9.2 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 4.6 *=*=*= Dark time lost to weather : 4.6 *=*=*= Dark time lost to technical issues : 0