Subject: 2.5m obslog 20240102 (SJD 60312) From: kpan@apo.nmsu.edu Date: Wed, 3 Jan 2024 10:12:34 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday January 02, 2024 (SJD 60312) ---- Observing Team ---- Kaike Pan Jose Sanches-Gallego (robot 275 is not connected issue) ---- Observing Plan ---- Tue 02 Jan 2024 60312 0.58 01:06 01:21 12:53 01:07 12:40 --- dark until 06:25 ( 5.1 h), then bright ( 6.7 h, w/ 0.3 h for 12 deg design) ---- Observing Summary ---- The night was lost to an issue on robot 275. "jaeger power on" with errors: JaegerError: Some positioners do not match fiberAssignments.csv. It seems that somehow robot 275 now identified itself as 2000. Jose spent a couple of hours on this. He hacks the software: discard all message from robot ID 2000, and take disable robot 275. The hack allows robots to move fine. However, since we don't understand why robot 275 misidentifies itself, not sure if other weird things could happen, both Jose and I don't want to put robots on risk, decided not to observe tonight until we consult with OSU and EPFL personnel. We may need to disconnect robot 275 tomorrow. ---- Engineering Issues ---- Robot 275 misidentified itself as 2000. Jose will discuss possible fixes with relevant personnel. One possible approach could be disconnect it from the daisy chain. ---- Observing Log ---- Afternoon: ========== Checked BOSS collimation. No adjustment made. Took and checked APOGEE evening cal. Powered on FPS, checked fvc scattered light. GFA baises and darks are taken. Checked found that exposure numbers on GFA4 is out of synchronization. It starts from #2, exposure numbers on GFA4 is +1 comparing with other. Try to take one exposure on GFA1,2,3,5,6 with fliswarm talk -n gfa1 expose --bias --count 1, but taking one exposure on GFA3, GFA4 also gets one. Then I tried to restart fliswarm, which didn't fix the issue. Then I tried to power off GFAs and power back on. The command jaeger power on -gfa failed with errors: 23:55:38 .tcc 0 tcc W Text="number keys does not match number of values" 23:55:54 .jaeger 0 jaeger w text="Positioner 275 is in fiberAssigments but not connected. (JaegerUserWarning)" 23:55:54 .jaeger 0 jaeger w text="Positioner 2000 is connected but not in fiberAssigments. (JaegerUserWarning)" 23:55:54 OBSERVER.kpan 185 jaeger f error="Command 'power on --gfas' failed because of an uncaught error 'JaegerError: Some positioners do not match fiberAssignments.csv.'. See traceback in the log for more information." 23:55:54 CmdDone: OBSERVER.kpan 185 jaeger power on --gfas jaeger reload failed with error: 195 jaeger f error="Initialisation failed: Some positioners do not match fiberAssignments.csv." 00:07:44 CmdDone: OBSERVER.kpan 195 jaeger reload Called Jose who is not by a computer. Night: ====== 01:20Z: open, filled 10L dewar. Wait for Jose to fix the the issue: robot 275 is not connected. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.5030 0.5050 Axial B: -0.2000 -0.1950 Axial C: -0.1160 -0.1100 Trans D: 1.9050 1.9140 Lateral E: 0.3395 0.3395 Lateral F: 0.5460 0.5460 GALILS Commanded: 5650 1750 8800 -4500 -3400 -3100 Actual: 5650 1750 8800 -4500 -3400 -3100 SETMIR VALUES PrimDesOrient: 0.0 44.5 -7.8 -427.0 -2433.9 PrimOrient: 1.07 44.57 -7.9 -426.41 -2433.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 0.00 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -1.0490 -1.0360 Axial B: -1.0610 -1.0720 Axial C: -1.0990 -1.1070 Trans D: -0.0350 -0.0470 GALILS Commanded: 5908000 5827950 5967400 -1500 -7250 Actual: 5883687 5811756 5906244 -1500 -7250 SETMIR VALUES SecDesOrient: 4657.0 -24.5 -17.5 18.0 125.41 SecOrient: 4657.02 -24.48 -17.5 17.69 125.24 ---- Telescope Status ---- 00:00Z Started ventilation 00:20Z encl25m : open 04:50Z encl25m : closed No interlocks bypassed Status at: 10:20Z Telescope Position: 121.0, 29.9, -0.0 mount Instrument mounted: FPS Counterweights at: 694.1, 696.5, 713.7, 713.7 LN2 autofill systems: Connected and turned on 180L LN2 dewar scale: SP1 252.0 lbs, 23.4 psi Chiller Flow: 7.40 L/min to FPS, 2.31 L/min to GFAs, 5.2/6.0 gpm total Chiller Temp: 1.0C No chiller alarms ---- Software Used ---- STUI : 1.7.18b1 alerts : 2.3.0 boss : 6.0.2 -boss.specMec : 3.0.4 apo : 4.0.0 fliswarm : 0.5.0 jaeger : 1.6.0 kaiju : 1.3.1 coordio : 1.9.0 fps_calibrati : 2023.12.08+eebcf2b cherno : 0.6.3 astrometrynet : 0.93 hal : 0.7.3 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1-1-ge461 -mcp.plc : 35 -mcp.azFiduci : v1_149 -mcp.altFiduc : v1_149 -mcp.rotFiduc : v1_149 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.20 Boson : 0.3.2 sdss-obstools : 3.9.3 TPM : 1.2-31-gd7eb MCP : 2.1-1-ge461 PLC : V35 Fiducials : v1_149 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 60312 Fill night time in Hours below *=*=*= Total bright time : 6.7 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 0 *=*=*= Bright time lost to technical issues : 6.7 *=*=*= Total dark time : 5.1 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 5.1