APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Wednesday June 24, 2026 (SJD 61216) ---- Observing Team ---- Dan Oravetz ---- Observing Plan ---- Wed 24 Jun 2026 61216 bright until 08:30 (6.2 h, w/ 1.3 h for 8 deg design), then dark (2.1 h) ---- Observing Summary ---- The night was cloudy with a lot of widespread radar returns, some intermittent rain, and some occasional surrounding lightning. Completed the "Testing (Manually) Disabled Robots" task of the Cloudy Night Tasks. This involved enabling the three manually-disabled robots and loading and executing ten different designs, five of which were completed at stow with the other five completed at 121,30,180. In summary, 1339 complained of a collision during the second configuration, 885 complained during the 7th, and 1190 made it through all ten without any issues. As a result, we'll leave 1190 ENABLED going forward for now. ---- Engineering Issues ---- There was some noticeable play in the IEB cover latches after the robot testing at 121,30,180. I took some pictures of the latch positions, then re-secured the latches, and emailed day staff. ---- Observing Log ---- ============================================================================ AFTERNOON CHECKOUT ============================================================================ All systems alive and responsive. Restarted cherno. Disk space: Filesystem Size Used Avail Use% Mounted on /dev/sdb1 2.0T 511G 1.6T 25% /home /dev/sdd1 22T 15T 6.5T 69% /data FPS powered on. Positioners are home/folded: 21:43:19 CmdStarted: APO.doravetz 44 jaeger unwind --status 21:43:20 APO.doravetz 44 jaeger i folded=T 21:43:40 APO.doravetz 45 jaeger : permanently_disabled=463,463,463,647,986; manually_disabled=1051,1190,1339 Loaded a manual folded configuration: 21:44:13 CmdStarted: APO.doravetz 46 jaeger configuration load --from-positions 21:44:15 APO.doravetz 46 jaeger d text="Resetting cherno offsets." 21:44:15 APO.doravetz 46 jaeger d text="Focal plane scale: 1.0." 21:44:15 APO.doravetz 46 jaeger d configuration_loaded=27085,-999,-999,-999.0,-999.0,0,-999.0,-999.0,/home/sdss5/software/sdsscore/main/apo/summary_files/027XXX/0270XX/confSummary-27085.par,F 21:44:20 APO.doravetz 46 jaeger i configuration_snapshot=/data/logs/jaeger/configuration_snapshots/61216/configuration_snapshot_61216_27085.pdf 21:44:20 APO.doravetz 46 jaeger d design_preloaded=-999 21:44:20 APO.doravetz 46 jaeger : text="Configuration 27085 loaded." 21:44:20 CmdDone: APO.doravetz 46 jaeger configuration load --from-positions Took a '--no-apply' FVC image: 21:46:29 FVC Loop fvc_rms= 33.35 fvc_deltarms= 33.55 fvc_filename=/data/fcam/61216/fimg-fvc1n-0001.fits fvc_perc_90= 45.20 fvc_percent_reached= 4.60 fvc iterations= 1 Scattered-light check: 21:46:45 CmdStarted: APO.doravetz 48 fliswarm talk -n fvc expose 50 No evidence of light artifacts. GFA biases, darks, and flat: 21:57:24 CmdStarted: APO.doravetz 52 fliswarm talk -c gfa expose --bias --count 10 21:58:28 CmdStarted: APO.doravetz 53 fliswarm talk -c gfa expose --dark --count 5 5 21:59:34 CmdStarted: APO.doravetz 54 fliswarm talk -c gfa expose --flat 1 Exercised positioners: 21:59:56 CmdStarted: APO.doravetz 55 jaeger configuration random --danger 22:01:35 APO.doravetz 55 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/61216/trajectory-61216-0001.json 22:01:35 CmdDone: APO.doravetz 55 jaeger configuration random --danger 22:01:40 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/61215/fps_snapshot_61215_0074.pdf 22:02:15 CmdStarted: APO.doravetz 56 jaeger configuration reverse BOSS hartmanns, arc, flat: 22:09:21 BOSS expNum=402862, expTime= 4.0s 22:10:01 BOSS expNum=402863, expTime= 4.0s 22:10:42 sp1.motor.move= 23, 21, 23 22:10:42 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= -2.2 (In Focus) sp1: pred. move: spAverageMove= 24 sp1: pred. resid: r= -683, b= -2.1, txt= OK, spTemp = 11.4 22:11:00 BOSS expNum=402864, expTime= 4.0s 22:12:35 BOSS expNum=402865, expTime= 25.0s Ventilation delayed first due to spiking dust counts and then some nearby rain and lots of clouds with associated radar returns. ============================================================================ NIGHT ============================================================================ Did not open at sunset due to clouds and radar returns (including a couple of actual rain drops materializing from these clouds). I did go ahead and force-fill the BOSS LN2 dewars so we're set to go if things clear up. 05:00Z - Still closed. Lots and lots of thick threatening clouds and radar returns around. The rain sensor is disabled at the moment because of earlier raindrops. Testing Disabled Robots *********************** manually_disabled=1051,1190,1339 Enabled the three manually_disabled robots. Telescope currently at 121,30,0. Going to test 5 configurations + reverses here, then move ROT to 180 deg and do another 5 cycles. Here's the planned Run Commands input for the first 5 cycles: jaeger configuration load 755251 jaeger configuration execute jaeger configuration reverse jaeger configuration load 752685 jaeger configuration execute jaeger configuration reverse jaeger configuration load 756280 jaeger configuration execute jaeger configuration reverse jaeger configuration load 756342 jaeger configuration execute jaeger configuration reverse jaeger configuration load 752706 jaeger configuration execute jaeger configuration reverse **************************************************************** 05:07:33 Field-Design-Configuration: 103236-755251-27086 **************************************************************** 05:08:36 CmdStarted: jaeger configuration execute 05:09:26 CmdDone: jaeger configuration execute 05:12:25 CmdStarted: jaeger configuration reverse 05:13:15 CmdDone: jaeger configuration reverse **************************************************************** 05:14:21 Field-Design-Configuration: 100523-752685-27087 **************************************************************** 05:14:26 CmdStarted: jaeger configuration execute 05:15:14 CmdDone: jaeger configuration execute 05:15:14 CmdStarted: jaeger configuration reverse 05:15:26 Jaeger collision: 1339 05:15:26 .jaeger 0 jaeger e text="A collision was detected in positioner 1339. Sending SEND_TRAJECTORY_ABORT and locking the FPS." 05:15:26 .jaeger 0 jaeger w text="Locking the FPS. (JaegerUserWarning)" 05:15:27 .jaeger 0 jaeger e locked=T; locked_by=1339; locked_axes=beta; locked_alpha=157.21555709838867; locked_beta=107.32322931289673 Recovered using the usual jaeger commands ('unlock', 'explode 10', and 'unwind'). Disabled 1339 and continued on to keep testing the other two robots. *************************************************************** 05:20:54 Field-Design-Configuration: 104409-756280-27088 **************************************************************** 05:21:00 CmdStarted: jaeger configuration execute 05:21:48 CmdDone: jaeger configuration execute 05:21:48 CmdStarted: jaeger configuration reverse 05:22:35 CmdDone: jaeger configuration reverse **************************************************************** 05:24:02 Field-Design-Configuration: 104413-756342-27089 **************************************************************** 05:24:07 CmdStarted: jaeger configuration execute 05:25:14 CmdDone: jaeger configuration execute 05:25:14 CmdStarted: jaeger configuration reverse 05:26:20 CmdDone: jaeger configuration reverse **************************************************************** 05:27:57 Field-Design-Configuration: 100525-752706-27090 **************************************************************** 05:28:02 CmdStarted: jaeger configuration execute 05:29:27 CmdDone: jaeger configuration execute 05:29:27 CmdStarted: jaeger configuration reverse 05:30:56 CmdDone: jaeger configuration reverse Slewed ROT to 180 deg. **************************************************************** 05:35:09 Field-Design-Configuration: 104199-756043-27091 **************************************************************** 05:35:13 CmdStarted: jaeger configuration execute 05:36:00 CmdDone: jaeger configuration execute 05:36:00 CmdStarted: jaeger configuration reverse 05:36:46 CmdDone: jaeger configuration reverse **************************************************************** 05:38:01 Field-Design-Configuration: 100489-752519-27092 **************************************************************** 05:38:05 CmdStarted: jaeger configuration execute 05:38:41 Jaeger collision: 885 05:38:41 .jaeger 0 jaeger e text="A collision was detected in positioner 885. Sending SEND_TRAJECTORY_ABORT and locking the FPS." 05:38:41 .jaeger 0 jaeger w text="Locking the FPS. (JaegerUserWarning)" 05:38:42 .jaeger 0 jaeger i fps_status=0x14 05:38:43 .jaeger 0 jaeger e locked=T; locked_by=885; locked_axes=alpha; locked_alpha=10.002561584115028; locked_beta=170.00230193138123 Recovered using the usual jaeger commands ('unlock', 'explode 10', and 'unwind'). Disabled 885 and continued on to keep testing. **************************************************************** 05:48:03 Field-Design-Configuration: 104664-757339-27093 **************************************************************** 05:48:07 CmdStarted: jaeger configuration execute 05:48:56 CmdDone: jaeger configuration execute 05:48:56 CmdStarted: jaeger configuration reverse 05:49:43 CmdDone: jaeger configuration reverse **************************************************************** 05:50:58 Field-Design-Configuration: 100450-752219-27094 **************************************************************** 05:51:04 CmdStarted: jaeger configuration execute 05:52:04 CmdDone: jaeger configuration execute 05:52:04 CmdStarted: jaeger configuration reverse 05:53:03 CmdDone: jaeger configuration reverse **************************************************************** 05:54:00 Field-Design-Configuration: 100989-753361-27095 **************************************************************** 05:54:04 CmdStarted: jaeger configuration execute 05:54:56 CmdDone: jaeger configuration execute 05:54:56 CmdStarted: jaeger configuration reverse 05:55:46 CmdDone: jaeger configuration reverse In summary, 1339 complained of a collision during the second configuration, 885 complained during the 7th, and 1190 made it through all ten without any issues. As a result, we'll leave 1190 ENABLED going forward now. 07:09Z - Still clouded-out. Lots of scattered radar returns. 07:33Z - Another quick raining event. 10:31Z - Called it a night. APOGEE morning cals started. FPS powered-off. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0110 0.0030 Axial B: -0.0240 -0.0300 Axial C: -0.0180 -0.0280 Trans D: -0.0140 -0.0230 Lateral E: 0.3400 0.3400 Lateral F: 0.5475 0.5475 GALILS Commanded: 8450 -1050 8800 22100 -2000 -1700 Actual: 8450 -1050 8800 22100 -2000 -1700 SETMIR VALUES PrimDesOrient: 0.0 2.03 16.67 -410.97 -787.67 PrimOrient: 1.06 2.03 16.67 -410.97 -787.67 SECONDARY: ---------- Focus: 0.0000 Air temp: 0.00 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -7.6380 -7.6400 Axial B: -7.5290 -7.5350 Axial C: -7.5300 -7.5270 Trans D: 0.2010 0.1960 GALILS Commanded: 2236550 2229400 2227500 -1750 -1750 Actual: 2215603 2225480 2199464 -1750 -1750 SETMIR VALUES SecDesOrient: 1757.0 7.9 1.5 -39.3 35.42 SecOrient: 1756.96 7.86 1.51 -38.71 35.79 ---- Telescope Status ---- Status at close: Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: manually adjusted for telescope balance w/ FPS LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 158 lbs, 22 psi FPS Status ========== CP10 Loop = 7.60 L/min GFA Loop = 2.26 L/min Supply pressure = 43.5 psi Return pressure = 29.7 psi Chiller Status ============== Set temperarature = 18.6 C Flow = 5.0 Gpm ---- Software Used ---- STUI : 1.7.21 alerts : 2.3.0 boss : 6.0.5a1 -boss.specMec : 3.0.4 apo : 4.1.0 fliswarm : 0.6.0 jaeger : 1.11.2a1 kaiju : 1.4.1 coordio : 1.18.1 fps_calibrati : 2025.12.04 cherno : 1.2.2 astrometrynet : 0.93 hal : 1.4.1 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.3.1 -mcp.plc : 35 -mcp.azFiduci : v1_153 -mcp.altFiduc : v1_153 -mcp.rotFiduc : v1_153 tcc : 1.4.0 apogee : not available apogeecal : not available apogeeql : v1_7_0dev boson : 0.6.1 sdss-obstools : 3.9.3 TPM : 1.2-31-gd7eb MCP : 2.3.1 PLC : V35 Fiducials : v1_153 idlspec2d : v6_2_1 Kronos : 2.1.0a roboscheduler : 2.1.0 ---- APOGEE Data Summary ---- Morning Cals ============ (observers39) [observer@sdss5-hub: ~]$ check_ap 61215 num field design config exptype dithpix nread relflux okay dx dy sigx sigy fpi1 fpi2 -------- ------ ------ ------ ------------ ------- ----- ------- ----- ------- ------- ------ ------ ---- ---- 56530072 100450 752218 27084 DARK 13.5 60 13 True -- -- -- -- -- -- 56530073 100450 752218 27084 DARK 13.5 60 15 True -- -- -- -- -- -- 56530074 100450 752218 27084 DARK 13.5 60 7 True -- -- -- -- -- -- 56530075 100450 752218 27084 QUARTZFLAT 13.5 10 112 True -- 0.78 -- 0.85 -- -- 56530076 100450 752218 27084 QUARTZFLAT 13.5 10 114 True -- 0.78 -- 0.86 -- -- 56530077 100450 752218 27084 QUARTZFLAT 13.5 10 113 True -- 0.78 -- 0.85 -- -- 56530078 100450 752218 27084 ARCLAMP-THAR 13.5 12 1 False -3.22 -4.99 1.47 0.96 -- -- 56530079 100450 752218 27084 ARCLAMP-UNE 13.5 40 1 True 4.28 -4.96 0.30 0.81 -- -- 56530080 100450 752218 27084 ARCLAMP-THAR 13.0 12 1 False -3.97 -5.08 1.18 0.86 -- -- 56530081 100450 752218 27084 ARCLAMP-UNE 13.0 40 2 True -9.51 -4.96 0.30 0.91 -- -- 56530082 100450 752218 27084 DARK 13.0 30 37 False -- -- -- -- -- -- 56530083 100450 752218 27084 INTERNALFLAT 13.0 30 96 True -- -- -- -- -- -- 56530084 100450 752218 27084 INTERNALFLAT 13.0 30 96 True -- -- -- -- -- -- 56530085 100450 752218 27084 INTERNALFLAT 13.0 30 96 True -- -- -- -- -- -- 56530086 100450 752218 27084 DARK 13.0 30 250 True -- -- -- -- -- -- 56530087 100450 752218 27084 FPI 13.0 30 246 True 11.85 -5.01 1.12 0.89 -- -- 56530088 100450 752218 27084 FPI 13.5 30 243 True 0.05 -5.03 1.12 0.89 -- -- num exptype nread mtp1 mtp2 mtp3 mtp4 mtp5 mtp6 mtp7 mtp8 mtp9 mtp10 -------- ---------- ----- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----- 56530075 QUARTZFLAT 10 75 83 90 102 100 95 97 100 100 92 56530076 QUARTZFLAT 10 78 86 91 102 100 96 97 100 100 93 56530077 QUARTZFLAT 10 78 86 91 102 100 96 97 100 100 93 (observers39) [observer@sdss5-hub: ~]$ list_ap -m 61215 APOGEE data list, mjd=61215, all raw_data: /data/apogee/utr_cdr/61215/apRaw-*.fits archive: /data/apogee/archive/61215/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/61215/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 61215 72 11:37 56530072 Dark 60 B 13.5 ---------- a-b-c - - 61215 73 11:48 56530073 Dark 60 B 13.5 ---------- a-b-c - - 61215 74 11:58 56530074 Dark 60 B 13.5 ---------- a-b-c - - 61215 75 12:00 56530075 QuarFlat 10 B 13.5 ---------- a-b-c - 104 61215 76 12:02 56530076 QuarFlat 10 B 13.5 ---------- a-b-c - 104 61215 77 12:04 56530077 QuarFlat 10 B 13.5 ---------- a-b-c - 104 61215 78 12:06 56530078 Arc-Thar 12 B 13.5 ---------- a-b-c 2.45 103 61215 79 12:13 56530079 Arc-Une 40 B 13.5 ---------- a-b-c 2.47 95 61215 80 12:16 56530080 Arc-Thar 12 A 13.0 ---------- a-b-c 1.95 103 61215 81 12:23 56530081 Arc-Une 40 A 13.0 ---------- a-b-c 1.94 97 61215 82 12:28 56530082 Dark 30 A 13.0 ---------- a-b-c - - 61215 83 12:34 56530083 InteFlat 30 A 13.0 ---------- a-b-c - - 61215 84 12:39 56530084 InteFlat 30 A 13.0 ---------- a-b-c - - 61215 85 12:44 56530085 InteFlat 30 A 13.0 ---------- a-b-c - - 61215 86 12:50 56530086 Dark 30 A 13.0 ---------- a-b-c - - 61215 87 12:56 56530087 Arc---- 30 A 13.0 ---------- a-b-c - 98 FPI A 61215 88 13:01 56530088 Arc---- 30 B 13.5 ---------- a-b-c - 99 FPI B ------------------------------------------------------------------------------ Night ===== (observers39) [observer@sdss5-hub: ~]$ check_ap 61216 num field design config exptype dithpix nread relflux okay dx dy sigx sigy fpi1 fpi2 -------- ------ ------ ------ ------------ ------- ----- ------- ----- ------- ------- ------ ------ ---- ---- 56540001 100450 752218 27084 DARK 13.5 3 67 True -- -- -- -- -- -- 56540002 -999 -999 27085 DARK 13.5 60 -22 True -- -- -- -- -- -- 56540003 -999 -999 27085 QUARTZFLAT 13.5 10 110 True -- 0.69 -- 0.85 -- -- 56540004 -999 -999 27085 ARCLAMP-THAR 13.5 12 1 False -3.25 -5.06 1.13 0.85 -- -- 56540005 -999 -999 27085 ARCLAMP-UNE 13.5 40 4 True -9.07 -5.15 1.42 0.81 -- -- 56540006 -999 -999 27085 ARCLAMP-THAR 13.0 12 0 False -4.00 1.62 1.09 0.82 -- -- 56540007 -999 -999 27085 ARCLAMP-UNE 13.0 40 2 True -9.48 -5.01 0.30 0.87 -- -- 56540008 -999 -999 27085 DARK 13.0 60 2 True -- -- -- -- -- -- 56540009 -999 -999 27085 FPI 13.0 30 243 True 11.86 -5.11 1.13 0.89 -- -- 56540010 -999 -999 27085 FPI 13.5 30 240 True 0.04 -5.13 1.11 0.88 -- -- num exptype nread mtp1 mtp2 mtp3 mtp4 mtp5 mtp6 mtp7 mtp8 mtp9 mtp10 -------- ---------- ----- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----- 56540003 QUARTZFLAT 10 74 82 91 102 101 96 97 100 100 92 (observers39) [observer@sdss5-hub: ~]$ list_ap APOGEE data list, mjd=61216, all raw_data: /data/apogee/utr_cdr/61216/apRaw-*.fits archive: /data/apogee/archive/61216/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/61216/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 61216 1 21:41 56540001 Dark 3 B 13.5 ---------- a-b-c - - 61216 2 22:33 56540002 Dark 60 B 13.5 ---------- a-b-c - - 61216 3 22:35 56540003 QuarFlat 10 B 13.5 ---------- a-b-c - 104 61216 4 22:37 56540004 Arc-Thar 12 B 13.5 ---------- a-b-c 2.45 101 61216 5 22:44 56540005 Arc-Une 40 B 13.5 ---------- a-b-c 2.46 96 61216 6 22:46 56540006 Arc-Thar 12 A 13.0 ---------- a-b-c 1.93 101 61216 7 22:54 56540007 Arc-Une 40 A 13.0 ---------- a-b-c 1.94 97 61216 8 23:05 56540008 Dark 60 A 13.0 ---------- a-b-c - - 61216 9 23:10 56540009 Arc---- 30 A 13.0 ---------- a-b-c - 97 FPI A 61216 10 23:15 56540010 Arc---- 30 B 13.5 ---------- a-b-c - 97 FPI B ------------------------------------------------------------------------------ ---- BOSS Data Summary ---- Reading FITS from /data/spectro//61216 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 21:41 b1-00402859 ----------- ---- bia Clo 0.0 9064 9096 9118 2 21:41 r1-00402859 ----------- ---- bia Clo 0.0 9064 9096 9118 3 22:07 r1-00402860 -999--999 27085 arc Lef 4.1 9064 9096 9118 HART 4 22:07 b1-00402860 -999--999 27085 arc Lef 4.1 9064 9096 9118 HART 5 22:08 b1-00402861 -999--999 27085 arc Rig 4.1 9064 9096 9118 HART 6 22:08 r1-00402861 -999--999 27085 arc Rig 4.1 9064 9096 9118 HART 7 22:09 b1-00402862 -999--999 27085 arc Lef 4.1 6484 6517 6538 HART 8 22:09 r1-00402862 -999--999 27085 arc Lef 4.1 6484 6517 6538 HART 9 22:10 b1-00402863 -999--999 27085 arc Rig 4.1 6484 6517 6538 HART 10 22:10 r1-00402863 -999--999 27085 arc Rig 4.1 6484 6517 6538 HART 11 22:11 b1-00402864 -999--999 27085 arc Out 4.1 6507 6538 6561 12 22:11 r1-00402864 -999--999 27085 arc Out 4.1 6507 6538 6561 13 22:12 b1-00402865 -999--999 27085 fla Out 25.1 6507 6538 6561 14 22:12 r1-00402865 -999--999 27085 fla Out 25.1 6507 6538 6561 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 61216 Fill night time in Hours below *=*=*= Total bright time : 6.2 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 6.2 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 2.1 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 2.1 *=*=*= Dark time lost to technical issues : 0