From: "Donor, John" Subject: Re: [sloan-25mlog 6075] Re: 2.5m obslog 20220514 (SJD 59714) Date: Tue, 17 May 2022 16:37:14 +0000 --_000_1c0e338d2d474443bfe7b9469f8f7a66tcuedu_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable It's probably possible to check which designs have been observed in a night= when the queue is refreshed. I have a gut feeling that there might be an i= ssue there, but I can't figure out what it might be, so I'll find some time= to jump down that rabbit hole soon. -John ________________________________ From: Dylan Gatlin Sent: Monday, May 16, 2022 9:42:54 PM To: Dmitry Bizyaev; Donor, John Cc: obs-report-25m@apo.nmsu.edu Subject: Re: [sloan-25mlog 6075] Re: 2.5m obslog 20220514 (SJD 59714) [EXTERNAL EMAIL WARNING] DO NOT CLICK LINKS or open attachments unless you = recognize the sender and know the content is safe. Here's how you can reproduce it. 1. Load a configuration from the queue 2. Reload the queue 3. Start observing the loaded configuration If I didn't reload the queue, then that design would have been grayed out (= in the history) because Kronos knows the design is already loaded. Since we= reloaded the queue, Kronos showed the design as the next design. Maybe during the queue reload procedure, it should check if the first item = in the queue is already loaded? On May 16, 2022 11:43:06 PM UTC, Dmitry Bizyaev wrote: Hi John, I'd like to confirm that the design was loaded first from HAL gui first, but then robots seriously collided, FPS locked, and we had to disable one robot and re-issue the load command with --no-clone from command line in STUI. After the design was finished and marked in green by Kronos, it still proposed it for the further observations on top of the design chioces. Dmitry Hey Dylan, I've been thinking about the issue you mentioned and I can't quite wrap my head around it. You clicked the queue refresh button (at the top, in the r= ed header box) but the same old design was still in the queue? And you had NO= T loaded that design with HAL? One thing that could have happened is Kronos decided the design left in th= e queue was the best to observe in the last slot of the night? Let me know if you want to talk more about it. -John ________________________________ From: sloan-25mlog on behalf of dgatlin@apo.nmsu.edu Sent: Sunday, May 15, 2022 6:28:57 AM To: obs-report-25m@apo.nmsu.edu Subject: [sloan-25mlog 6073] 2.5m obslog 20220514 (SJD 59714) [EXTERNAL EMAIL WARNING] DO NOT CLICK LINKS or open attachments unless you recognize the sender and know the content is safe. APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday May 14, 2022 (SJD 59714) ---- Observing Team ---- Dmitry Bizyaev Dylan Gatlin ---- Observing Plan ---- Please observe from the queue until about 11:00 local and then complete BO= SS telescope dithers on designs 35996, 36020, 36018 Jos=C3=A9 has requested quick guider offset test, which you could do on th= e first dither field. ---- Observing Summary ---- It was a clear night. We completed 3 dither fields, some bright fields, an= d we had a critical alert with the Robot Air that resolved itself. We did a qu= ick guide offsets test, there's a table of results in the main log. Observed: ________________________________ Time Field-Design Cadence APOGEE BOSS Completi= on 02:51:12 101164-42965 bright_8x2_v1 1xAB 1x900s DONE 03:16:25 101191-43544 bright_8x4_v1 4xAB 4x900s DONE 04:49:31 20965-35996 bright_1x1 (dither) No APOGEE 13x300s DONE 07:06:46 20989-36020 bright_1x1 (dither) No APOGEE 13x300s DONE 09:00:23 20987-36018 bright_1x1 (dither) No APOGEE 13x300s DONE 10:47:45 100563-40114 bright_single_77x1_v1 1xAB 1x900s DONE APOGEE Dome Flats Missing Fibers: [] Faint fibers: [] Average Throughput: 0.967 Notes: - We disabled fiber 1340 and fiber 444 tonight. 1340 has been causing prob= lems for several days, but 444 is a new problem maker. - We had a critical alert due to the robot air temperature. There seems to= be an altitude dependence on the temperature, mostly at high altitude. We recommend that dither fields stay below 80deg in altitude to avoid hittin= g the limit until we are back on the new chiller. We may also want to remove th= e IEB cover again. - We encountered an interesting bug in Kronos. After we loaded the last de= sign of a field, we refreshed the queue, hoping for a single-design field. Bec= ause the loaded design was still unobserved, it never disappeared from the Kro= nos queue, even though we observed it and finished it. When we refreshed the queue, it cleared. It's not a major bug, although it confused us for a bit. - We noticed that at the end of the night, the FPI fibers weren't visible. Please take a close look at it in this morning's cals. In the evening, it looked fine. - Integrated Dust Counts: ~13000 dust-hrs ---- Observing Log ---- Afternoon ________________________________ All systems found responsive. 00:47:20 Hartmann collimate output sp1: offset: r=3D -659 (In Focus); b=3D -4.2 (Out of focus) sp1: pred. move: spAverageMove=3D 345 sp1: pred. resid: r=3D -1004, b=3D -3.1, txt=3D OK, spTemp =3D 9.8 The blue ring settings look ok. FVC image: field=3D-999 design =3D-999 cfg=3D5303 image /data/fcam/59714/p= roc-fimg- fvc1n-0001.fits" 00:54Z started ventilation Night ________________________________ 02:15:37 Jaeger collision: 1340 We disabled the fiber and reloaded the configuration ### Field -999 # APOGEE MJD UTC Design-Config Exposure Type Dith Reads Arch Seein= g ________________________________ 59714 02:06:29 -999-5305 41520010 Domeflat A 5 a-b-c 0.0 59714 02:08:07 -999-5305 41520011 Domeflat A 5 a-b-c 0.0 59714 02:09:43 -999-5305 41520012 Domeflat A 5 a-b-c 0.0 2022-05-15 02:06:29.309 Missing fibers: [] Faint fibers: [74] Average Throughput: 0.98 2022-05-15 02:08:07.148 Missing fibers: [] Faint fibers: [] Average Throughput: 0.98 2022-05-15 02:09:43.294 Missing fibers: [] Faint fibers: [] Average Throughput: 0.98 ### Field 101164 # APOGEE MJD UTC Design-Config Exposure Type Dith Reads Arch Seein= g ________________________________ 59714 02:51:12 42965-5308 41520013 Object A 43 a-b-c 1.8 59714 02:58:53 42965-5308 41520014 Object B 43 a-b-c 1.7 # BOSS MJD UTC Design-Config Exposure Type SOS ETime Hart ________________________________ 59714 02:26:08 42965-5308 00341765 Hart r1-b1 4 Left 59714 02:26:48 42965-5308 00341766 Hart r1-b1 4 Right 59714 02:27:48 42965-5308 00341767 Arc r1-b1 4 Open 59714 02:29:26 42965-5308 00341768 Flat r1-b1 25 Open 59714 02:51:31 42965-5308 00341769 Science r1-b1 900 Open 2022-05-15T02:26:08 r1 Steps: 329, b1 Ring: -4.2 Average Move: 839, Residuals: -1.6, Temp: 9.6 ### Field 101191 # APOGEE MJD UTC Design-Config Exposure Type Dith Reads Arch Seein= g ________________________________ 59714 03:16:25 43544-5309 41520015 Object B 43 a-b-c 2.0 59714 03:24:11 43544-5309 41520016 Object A 43 a-b-c 1.9 59714 03:37:38 43545-5310 41520017 Object A 43 a-b-c 2.3 59714 03:45:19 43545-5310 41520018 Object B 43 a-b-c 1.7 59714 03:59:16 43546-5311 41520019 Object B 43 a-b-c 1.7 59714 04:07:02 43546-5311 41520020 Object A 43 a-b-c 1.9 59714 04:20:37 43547-5312 41520021 Object A 43 a-b-c 1.6 59714 04:28:18 43547-5312 41520022 Object B 43 a-x-x 1.7 # BOSS MJD UTC Design-Config Exposure Type SOS ETime Hart ________________________________ 59714 03:09:42 43544-5309 00341770 Hart r1-b1 4 Left 59714 03:10:23 43544-5309 00341771 Hart r1-b1 4 Right 59714 03:11:23 43544-5309 00341772 Arc r1-b1 4 Open 59714 03:13:00 43544-5309 00341773 Flat r1-b1 25 Open 59714 03:16:43 43544-5309 00341774 Science r1-b1 900 Open 59714 03:37:57 43545-5310 00341775 Science r1-b1 900 Open 59714 03:59:35 43546-5311 00341776 Science r1-b1 900 Open 59714 04:20:56 43547-5312 00341777 Science r1-b1 900 Open 2022-05-15T03:09:42 r1 Steps: 0, b1 Ring: -1.2 Average Move: 192, Residuals: -0.6, Temp: 9.6 # Started dither fields 04:38:55 Config Loaded: 20965-35996-5313 # Tried re-enabling fiber 1340 04:40:36 Config Loaded: 20965-35996-5314 04:40:53 Jaeger collision: 1340 04:42:51 Config Loaded: 20965-35996-5315 04:45:00 CmdStarted: OBSERVER.dmbiz 131 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 # FVC images 12-13 04:46:03 OBSERVER.dmbiz 131 jaeger d fvc_filename=3D/data/fcam/59714/fimg-= fvc1n- 0013.fits 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_rms=3D31.56 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_deltarms=3D10.2 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_perc_90=3D8.9 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_percent_reached=3D62.6 04:46:25 CmdDone: OBSERVER.dmbiz 131 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 04:49:31 boss exposure 4.0, file=3D341778 04:50:12 boss exposure 4.0, file=3D341779 04:50:53 sp1.motor.move=3D 358, 359, 358 04:50:53 Hartmann collimate output sp1: offset: r=3D 329 (In Focus); b=3D -1.2 (In Focus) sp1: pred. move: spAverageMove=3D 357 sp1: pred. resid: r=3D -28, b=3D -0.1, txt=3D OK, spTemp =3D 9.6 04:51:12 boss exposure 4.0, file=3D341780 04:52:44 boss exposure 25.0, file=3D341781 Before the first dither, we did an offset test requested by Jose where we apply 60" in RA, then 60" in dec, then 60" in rot to verify the behavior of our guider offsets. Offsets Guider Images ________________________________ 0 0 0 231-232 60 0 0 242-243 0 60 0 252-253 0 0 60 261-262 -60 0 0 269-270 0 -60 0 278-279 0 0 -60 290-291 0 0 0 295-296 05:25:27 boss exposure 300.0, file=3D341782 # Undithered exposure 05:31:51 CmdStarted: OBSERVER.dmbiz 151 cherno offset -0.74 0.36 0 05:32:50 boss exposure 300.0, file=3D341783 05:38:54 CmdStarted: OBSERVER.dmbiz 153 cherno offset -0.27 -0.20 0 05:39:53 boss exposure 300.0, file=3D341784 05:45:56 CmdStarted: OBSERVER.dmbiz 155 cherno offset -0.72 -0.26 0 05:46:55 boss exposure 300.0, file=3D341785 05:52:59 CmdStarted: OBSERVER.dmbiz 157 cherno offset 0.73 0.63 0 05:53:58 boss exposure 300.0, file=3D341786 06:00:02 CmdStarted: OBSERVER.dmbiz 159 cherno offset -0.38 0.85 0 06:01:01 boss exposure 300.0, file=3D341787 06:07:08 CmdStarted: OBSERVER.dmbiz 161 cherno offset -0.12 0.02 0 06:08:07 boss exposure 300.0, file=3D341788 06:14:11 CmdStarted: OBSERVER.dmbiz 163 cherno offset -0.35 0.47 0 06:15:12 boss exposure 300.0, file=3D341789 06:21:16 CmdStarted: OBSERVER.dmbiz 165 cherno offset 0.44 -0.57 0 06:22:15 boss exposure 300.0, file=3D341790 06:28:19 CmdStarted: OBSERVER.dmbiz 167 cherno offset -0.46 0.16 0 06:29:18 boss exposure 300.0, file=3D341791 06:35:21 CmdStarted: OBSERVER.dmbiz 169 cherno offset 0.42 0.84 0 06:36:20 boss exposure 300.0, file=3D341792 06:42:24 CmdStarted: OBSERVER.dmbiz 171 cherno offset -0.63 0.33 0 06:43:23 boss exposure 300.0, file=3D341793 06:49:27 CmdStarted: OBSERVER.dmbiz 173 cherno offset 0.83 0.44 0 06:50:28 boss exposure 300.0, file=3D341794 06:55:34 CmdStarted: OBSERVER.dmbiz 176 cherno offset Midway through this test, we crossed the meridian. At high altitudes, the cooler pressure rises. Around an altitude of 83deg, the Robot Air (sensor RTD8) raised a critical alert for hitting 40degC. Robot Air is usually the highest temperature sensor during the night. It would seem that with the backup chiller we're using now, it got a little too hot. At 45degC, the system automatically shuts down. As we crossed the meridian and began to descend altitude, the temperature slowly began to drop, and the alert cleared. Critical jaeger.alert_robot_temp_warning at 2022-05-15 06:08:53 UT found 07:01:20 Config Loaded: 20989-36020-5316 07:02:17 CmdStarted: OBSERVER.dmbiz 184 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 # FVC images 14-15 07:03:21 OBSERVER.dmbiz 184 jaeger d fvc_filename=3D/data/fcam/59714/fimg-= fvc1n- 0015.fits 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_rms=3D22.2 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_deltarms=3D22.66 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_perc_90=3D8.9 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_percent_reached=3D58.8 07:03:43 CmdDone: OBSERVER.dmbiz 184 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 07:06:46 boss exposure 4.0, file=3D341795 07:07:26 boss exposure 4.0, file=3D341796 07:08:07 sp1.motor.move=3D -614, -616, -616 07:08:07 Hartmann collimate output sp1: offset: r=3D -329 (In Focus); b=3D 2.8 (In Focus) sp1: pred. move: spAverageMove=3D -614 sp1: pred. resid: r=3D 285, b=3D 0.9, txt=3D OK, spTemp =3D 9.3 07:08:27 boss exposure 4.0, file=3D341797 07:09:59 boss exposure 25.0, file=3D341798 07:13:37 boss exposure 300.0, file=3D341799 # parent configuration 07:19:28 CmdStarted: OBSERVER.dmbiz 190 cherno offset -0.22 0.93 0 07:20:27 boss exposure 300.0, file=3D341800 07:26:31 CmdStarted: OBSERVER.dmbiz 192 cherno offset 0.29 -0.23 0 07:27:30 boss exposure 300.0, file=3D341801 07:33:33 CmdStarted: OBSERVER.dmbiz 194 cherno offset 0.86 -0.35 0 07:34:32 boss exposure 300.0, file=3D341802 07:40:36 CmdStarted: OBSERVER.dmbiz 196 cherno offset -0.32 0.33 0 07:41:35 boss exposure 300.0, file=3D341803 07:47:39 CmdStarted: OBSERVER.dmbiz 198 cherno offset -0.12 0.80 0 07:48:38 boss exposure 300.0, file=3D341804 07:54:42 CmdStarted: OBSERVER.dmbiz 200 cherno offset 0.52 0.38 0 07:55:41 boss exposure 300.0, file=3D341805 08:01:44 CmdStarted: OBSERVER.dmbiz 202 cherno offset -0.57 0.38 0 08:02:43 boss exposure 300.0, file=3D341806 08:08:47 CmdStarted: OBSERVER.dmbiz 204 cherno offset -0.42 -0.60 0 08:09:46 boss exposure 300.0, file=3D341807 08:15:49 CmdStarted: OBSERVER.dmbiz 206 cherno offset -0.12 0.93 0 08:16:48 boss exposure 300.0, file=3D341808 08:22:53 CmdStarted: OBSERVER.dmbiz 208 cherno offset 0.55 -0.38 0 08:23:51 boss exposure 300.0, file=3D341809 08:29:55 CmdStarted: OBSERVER.dmbiz 210 cherno offset -0.21 0.04 0 08:30:54 boss exposure 300.0, file=3D341810 08:36:57 CmdStarted: OBSERVER.dmbiz 212 cherno offset -0.51 -0.50 0 08:37:56 boss exposure 300.0, file=3D341811 08:49:24 Config Loaded: 20987-36018-5319 08:50:33 CmdStarted: OBSERVER.dmbiz 223 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 # FVC images 16-17 08:51:37 OBSERVER.dmbiz 223 jaeger d fvc_filename=3D/data/fcam/59714/fimg-= fvc1n- 0017.fits 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_rms=3D14.13 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_deltarms=3D26.46 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_perc_90=3D9.1 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_percent_reached=3D60.4 08:52:00 CmdDone: OBSERVER.dmbiz 223 jaeger fvc loop --max-iterations 4 --target- 90-percentile 10 08:54:02 boss exposure 4.0, file=3D341812 08:54:42 boss exposure 4.0, file=3D341813 08:55:24 sp1.motor.move=3D 361, 362, 363 08:55:24 Hartmann collimate output sp1: offset: r=3D 659 (In Focus); b=3D -0.2 (In Focus) sp1: pred. move: spAverageMove=3D 361 sp1: pred. resid: r=3D 297, b=3D 0.9, txt=3D OK, spTemp =3D 9.3 08:55:42 boss exposure 4.0, file=3D341814 08:57:15 boss exposure 25.0, file=3D341815 09:00:23 boss exposure 300.0, file=3D341816 # Undithered 09:06:51 CmdStarted: OBSERVER.dmbiz 227 cherno offset 0.49 -0.45 0 09:07:50 boss exposure 300.0, file=3D341817 09:13:54 CmdStarted: OBSERVER.dmbiz 229 cherno offset 0.15 -0.13 0 09:14:53 boss exposure 300.0, file=3D341818 09:20:56 CmdStarted: OBSERVER.dmbiz 231 cherno offset 0.52 -0.51 0 09:21:55 boss exposure 300.0, file=3D341819 09:27:59 CmdStarted: OBSERVER.dmbiz 233 cherno offset -0.45 -0.09 0 09:28:58 boss exposure 300.0, file=3D341820 09:35:02 CmdStarted: OBSERVER.dmbiz 235 cherno offset -0.31 -0.17 0 09:36:02 boss exposure 300.0, file=3D341821 09:42:09 CmdStarted: OBSERVER.dmbiz 237 cherno offset 0.35 -0.52 0 09:43:08 boss exposure 300.0, file=3D341822 09:49:11 CmdStarted: OBSERVER.dmbiz 239 cherno offset 0.31 0.13 0 09:50:13 boss exposure 300.0, file=3D341823 09:56:17 CmdStarted: OBSERVER.dmbiz 241 cherno offset -0.57 -0.34 0 09:57:16 boss exposure 300.0, file=3D341824 10:03:20 CmdStarted: OBSERVER.dmbiz 243 cherno offset 0.91 0.39 0 10:04:19 boss exposure 300.0, file=3D341825 10:10:22 CmdStarted: OBSERVER.dmbiz 245 cherno offset -0.79 0.01 0 10:11:21 boss exposure 300.0, file=3D341826 10:17:25 CmdStarted: OBSERVER.dmbiz 247 cherno offset 0.66 0.47 0 10:18:24 boss exposure 300.0, file=3D341827 10:24:28 CmdStarted: OBSERVER.dmbiz 249 cherno offset 0.34 -0.51 0 ### Field 100563 # APOGEE MJD UTC Design-Config Exposure Type Dith Reads Arch Seein= g ________________________________ 59714 10:47:45 40115-5329 41520023 Object B 43 a-b-c 1.8 59714 10:55:30 40115-5329 41520024 Object A 43 a-b-c 1.5 59714 11:04:58 40115-5329 41520025 Domeflat A 5 a-b-c 0.0 59714 11:06:23 40115-5329 41520026 Domeflat A 5 a-b-c 0.0 59714 11:08:22 40115-5329 41520027 Domeflat A 5 a-b-c 0.0 2022-05-15 11:04:58.430 Missing fibers: [] Faint fibers: [] Average Throughput: 0.96 2022-05-15 11:06:23.329 Missing fibers: [] Faint fibers: [74] Average Throughput: 0.95 2022-05-15 11:08:22.480 Missing fibers: [] Faint fibers: [24, 74] Average Throughput: 0.95 11:15:17 encl25m : closed; ---- Mirror Numbers ---- PRIMARY: ________________________________ Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0090 0.0040 Axial B: 0.0070 0.0030 Axial C: -0.1220 -0.1150 Trans D: -0.0331 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ________________________________ Focus: 0.0000 Air temp: 20.67 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: -9.6670 -9.6710 Axial C: -9.7000 -9.6970 Trans D: 0.1140 0.1140 GALILS Commanded: 4881300 4875250 4902900 0 -3400 Actual: 4859186 4859217 4859287 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.0 -0.03 0.01 0.0 41.66 ---- Telescope Status ---- 01:00Z Started ventilation Opened at 02:01:16 Closed at 11:15:17 Status at: 1:23:04Z Telescope Position: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 682.2, 684.4, 702.3, 701.6 LN2 autofill systems: Connected and turned on 180L LN2 dewar scale: SP1 159.0 lbs, 17.6 psi Chiller Flow: 5.14 L/min to FPS, 1.38 L/min to GFAs, nan/nan gpm total Chiller Temp: nanC No chiller alarms ---- Software Used ---- TUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.15.2-alpha.0 kaiju : 1.2.4-alpha.0 coordio : 1.4.0-alpha.0 fps_calibrati : APO.2022.04.21+e0e43d5 cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.13 --------------Other Versions-------------- sdss-obstools : 3.7.14 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V34 Fiducials : v1_148 idlspec2d : v6_0_7 Kronos : 1.3.1a roboscheduler : 1.2.2a /dev/sdb1 2.0T 174G 1.9T 9% /home 10.25.1.230:/data 21T 17T 3.2T 85% /data ---- APOGEE Data Summary ---- MJD UTC Design-Config Exposure Type Dith Reads Arch ________________________________ 59714 00:33:31 40114-5304 41520001 Arc A 3 a-b-c 59714 00:35:38 40114-5304 41520002 Dark A 60 a-b-c 59714 00:46:37 40114-5304 41520003 Quartzflat A 10 a-b-c 59714 00:48:37 40114-5304 41520004 ThAr Arc B 12 a-b-c 59714 00:50:50 -999-5305 41520005 UNe Arc B 40 a-b-c 59714 00:58:07 -999-5305 41520006 ThAr Arc A 12 a-b-c 59714 01:00:20 -999-5305 41520007 UNe Arc A 40 a-b-c 59714 01:07:46 -999-5305 41520008 Dark A 60 a-b-c 59714 01:18:38 -999-5305 41520009 FPI Lamp A 30 a-b-c 59714 02:06:29 -999-5305 41520010 Domeflat A 5 a-b-c 59714 02:08:07 -999-5305 41520011 Domeflat A 5 a-b-c 59714 02:09:43 -999-5305 41520012 Domeflat A 5 a-b-c 59714 02:51:12 42965-5308 41520013 Object A 43 a-b-c 59714 02:58:53 42965-5308 41520014 Object B 43 a-b-c 59714 03:16:25 43544-5309 41520015 Object B 43 a-b-c 59714 03:24:11 43544-5309 41520016 Object A 43 a-b-c 59714 03:37:38 43545-5310 41520017 Object A 43 a-b-c 59714 03:45:19 43545-5310 41520018 Object B 43 a-b-c 59714 03:59:16 43546-5311 41520019 Object B 43 a-b-c 59714 04:07:02 43546-5311 41520020 Object A 43 a-b-c 59714 04:20:37 43547-5312 41520021 Object A 43 a-b-c 59714 04:28:18 43547-5312 41520022 Object B 43 a-b-c 59714 10:47:45 40115-5329 41520023 Object B 43 a-b-c 59714 10:55:30 40115-5329 41520024 Object A 43 a-b-c 59714 11:04:58 40115-5329 41520025 Domeflat A 5 a-b-c 59714 11:06:23 40115-5329 41520026 Domeflat A 5 a-b-c 59714 11:08:22 40115-5329 41520027 Domeflat A 5 a-b-c ThAr Offsets: ['-0.51'] UNe Offsets: ['-0.51'] Object Offsets: Max: 0.54, Min: 0.48, Mean: 0.50 ---- eBOSS Data Summary ---- MJD UTC Design-Config Exposure Type SOS ETime Hart ________________________________ 59714 00:33:41 40114-5304 00341761 Bias r1-b1 0 Closed 59714 00:38:06 40114-5304 00341762 Dark r1-b1 20 Closed 59714 00:45:56 40114-5304 00341763 Hart r1-b1 4 Left 59714 00:46:39 40114-5304 00341764 Hart r1-b1 4 Right 59714 02:26:08 42965-5308 00341765 Hart r1-b1 4 Left 59714 02:26:48 42965-5308 00341766 Hart r1-b1 4 Right 59714 02:27:48 42965-5308 00341767 Arc r1-b1 4 Open 59714 02:29:26 42965-5308 00341768 Flat r1-b1 25 Open 59714 02:51:31 42965-5308 00341769 Science r1-b1 900 Open 59714 03:09:42 43544-5309 00341770 Hart r1-b1 4 Left 59714 03:10:23 43544-5309 00341771 Hart r1-b1 4 Right 59714 03:11:23 43544-5309 00341772 Arc r1-b1 4 Open 59714 03:13:00 43544-5309 00341773 Flat r1-b1 25 Open 59714 03:16:43 43544-5309 00341774 Science r1-b1 900 Open 59714 03:37:57 43545-5310 00341775 Science r1-b1 900 Open 59714 03:59:35 43546-5311 00341776 Science r1-b1 900 Open 59714 04:20:56 43547-5312 00341777 Science r1-b1 900 Open 59714 04:49:31 35996-5315 00341778 Hart r1-b1 4 Left 59714 04:50:12 35996-5315 00341779 Hart r1-b1 4 Right 59714 04:51:12 35996-5315 00341780 Arc r1-b1 4 Open 59714 04:52:44 35996-5315 00341781 Flat r1-b1 25 Open 59714 05:25:27 35996-5315 00341782 Science r1-b1 300 Open 59714 05:32:50 35996-5315 00341783 Science r1-b1 300 Open 59714 05:39:53 35996-5315 00341784 Science r1-b1 300 Open 59714 05:46:55 35996-5315 00341785 Science r1-b1 300 Open 59714 05:53:58 35996-5315 00341786 Science r1-b1 300 Open 59714 06:01:01 35996-5315 00341787 Science r1-b1 300 Open 59714 06:08:07 35996-5315 00341788 Science r1-b1 300 Open 59714 06:15:12 35996-5315 00341789 Science r1-b1 300 Open 59714 06:22:15 35996-5315 00341790 Science r1-b1 300 Open 59714 06:29:18 35996-5315 00341791 Science r1-b1 300 Open 59714 06:36:20 35996-5315 00341792 Science r1-b1 300 Open 59714 06:43:23 35996-5315 00341793 Science r1-b1 300 Open 59714 06:50:27 35996-5315 00341794 Science r1-b1 300 Open 59714 07:06:46 36020-5316 00341795 Hart r1-b1 4 Left 59714 07:07:26 36020-5316 00341796 Hart r1-b1 4 Right 59714 07:08:27 36020-5316 00341797 Arc r1-b1 4 Open 59714 07:09:59 36020-5316 00341798 Flat r1-b1 25 Open 59714 07:13:37 36020-5316 00341799 Science r1-b1 300 Open 59714 07:20:27 36020-5316 00341800 Science r1-b1 300 Open 59714 07:27:30 36020-5316 00341801 Science r1-b1 300 Open 59714 07:34:32 36020-5316 00341802 Science r1-b1 300 Open 59714 07:41:35 36020-5316 00341803 Science r1-b1 300 Open 59714 07:48:38 36020-5316 00341804 Science xx-b1 300 Open 59714 07:55:41 36020-5316 00341805 Science r1-b1 300 Open 59714 08:02:43 36020-5316 00341806 Science xx-b1 300 Open 59714 08:09:46 36020-5316 00341807 Science r1-b1 300 Open 59714 08:16:48 36020-5316 00341808 Science r1-b1 300 Open 59714 08:23:51 36020-5316 00341809 Science r1-b1 300 Open 59714 08:30:54 36020-5316 00341810 Science r1-b1 300 Open 59714 08:37:56 36020-5316 00341811 Science r1-b1 300 Open 59714 08:54:02 36018-5319 00341812 Hart r1-b1 4 Left 59714 08:54:42 36018-5319 00341813 Hart r1-b1 4 Right 59714 08:55:42 36018-5319 00341814 Arc r1-b1 4 Open 59714 08:57:14 36018-5319 00341815 Flat r1-b1 25 Open 59714 09:00:23 36018-5319 00341816 Science r1-b1 300 Open 59714 09:07:50 36018-5319 00341817 Science r1-b1 300 Open 59714 09:14:53 36018-5319 00341818 Science r1-b1 300 Open 59714 09:21:55 36018-5319 00341819 Science r1-b1 300 Open 59714 09:28:58 36018-5319 00341820 Science r1-b1 300 Open 59714 09:36:02 36018-5319 00341821 Science r1-b1 300 Open 59714 09:43:08 36018-5319 00341822 Science r1-b1 300 Open 59714 09:50:13 36018-5319 00341823 Science r1-b1 300 Open 59714 09:57:16 36018-5319 00341824 Science r1-b1 300 Open 59714 10:04:19 36018-5319 00341825 Science r1-b1 300 Open 59714 10:11:21 36018-5319 00341826 Science r1-b1 300 Open 59714 10:18:24 36018-5319 00341827 Science r1-b1 300 Open 59714 10:25:28 36018-5319 00341828 Science r1-b1 300 Open 59714 10:41:32 40115-5329 00341829 Hart r1-b1 4 Left 59714 10:42:13 40115-5329 00341830 Hart r1-b1 4 Right 59714 10:43:16 40115-5329 00341831 Arc r1-b1 4 Open 59714 10:44:49 40115-5329 00341832 Flat r1-b1 25 Open 59714 10:48:03 40115-5329 00341833 Science r1-b1 900 Open ---- BOSS Spectrographs Collimation ---- Time Field-Design Temp R off B off Move Resid ________________________________ 00:47:17 nan-nan 9.8 -659 -4.2 345 -3.1 02:27:25 101164-42965 9.6 329 -4.2 839 -1.6 03:11:01 101191-43544 9.7 0 -1.2 192 -0.6 04:50:50 20965-35996 9.6 329 -1.2 357 -0.1 07:08:04 20989-36020 9.3 -329 2.8 -614 0.9 08:55:20 20987-36018 9.3 659 -0.2 361 0.9 10:42:51 100563-40115 9.0 329 2.8 -285 1.9 ---- Time Tracking ---- *=3D*=3D*=3D Observatory: APO *=3D*=3D*=3D MJD: 59714 Fill night time in Hours below *=3D*=3D*=3D Total bright time : 0 *=3D*=3D*=3D Bright time, queued observations : 0 *=3D*=3D*=3D Bright time, commissioning/engineering: 0 *=3D*=3D*=3D Bright time lost to weather : 0 *=3D*=3D*=3D Bright time lost to technical issues : 0 *=3D*=3D*=3D Total dark time : 0 *=3D*=3D*=3D Dark time, queued observations : 0 *=3D*=3D*=3D Dark time, commissioning/engineering : 0 *=3D*=3D*=3D Dark time lost to weather : 0 *=3D*=3D*=3D Dark time lost to technical issues : 0 ________________________________ Logs of Nightly APO Activities https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html print('-Dylan Gatlin') --_000_1c0e338d2d474443bfe7b9469f8f7a66tcuedu_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable It's probably possible to check which designs have been observed in a ni= ght when the queue is refreshed. I have a gut feeling that there might be a= n issue there, but I can't figure out what it might be, so I'll find some t= ime to jump down that rabbit hole soon. -John From: Dylan Gatlin Sent: Monday, May 16, 2022 9:42:54 PM To: Dmitry Bizyaev; Donor, John Cc: obs-report-25m@apo.nmsu.edu Subject: Re: [sloan-25mlog 6075] Re: 2.5m obslog 20220514 (SJD 59714= ) [EXTERNAL EMAIL WARNI= NG] DO NOT CLICK LINKS or open attachments unless you recogni= ze the sender and know the content is safe. Here's how you can reproduce it. 1. Load a configuration from the queue 2. Reload the queue 3. Start observing the loaded configuration If I didn't reload the queue, then that design would have been grayed out (= in the history) because Kronos knows the design is already loaded. Since we= reloaded the queue, Kronos showed the design as the next design. Maybe during the queue reload procedure, it should check if the first item = in the queue is already loaded? On May 16, 2022 11:43:06 PM UTC, Dmitry Bizyaev = wrote: Hi John,I'd like to confirm that the= design was loaded first from HAL gui first,but then robots seriously c= ollided, FPS locked, and we had todisable one robot and re-issue the lo= ad command with --no-clonefrom command line in STUI. After the design w= as finished and markedin green by Kronos, it still proposed it for the = furtherobservations on top of the design chioces.Dmitry= Hey Dylan, = I've been thinking about the issue you mentioned and I can't quite wrap my head around it. You clicked the queue refresh button (at the top, in th= e red header box) but the same old design was still in the queue? And y= ou had NOT loaded that design with HAL? One thing that coul= d have happened is Kronos decided the design left in the queue was the = best to observe in the last slot of the night? Let me know if y= ou want to talk more about it. -John From: sloan-25mlog on behalf of dgatlin@apo.nmsu.edu Sent: Sunday, May 15, 2022 6:28:57 AM To: ob= s-report-25m@apo.nmsu.edu Subject: [sloan-25mlog 6073] 2.5m obslog 2022= 0514 (SJD 59714) [EXTERNAL EMAIL WARNING] DO NOT CLICK LINKS or ope= n attachments unless you recognize the sender and know the content is s= afe. APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG = Saturday May 14, 2022 (SJD = 59714) ---- Observing Team ---- Dmitry Bizyaev Dylan G= atlin ---- Observing Plan ---- Please observe from the = queue until about 11:00 local and then complete BOSS telescope dithers= on designs 35996, 36020, 36018 Jos=C3=A9 has requested quick guide= r offset test, which you could do on the first dither field. ---- Observing Summary ---- It was a clear night. We completed 3= dither fields, some bright fields, and we had a critical alert with t= he Robot Air that resolved itself. We did a quick guide offsets test, = there's a table of results in the main log. Observed: T= ime Field-Design Cadence APOGEE BOSS Completion= 02:51:12 101164-42965 bright_8x2_v1 1xAB 1x900s DONE= 03:16:25 101191-43544 bright_8x4_v1 4xAB 4x900s DONE= 04:49:31 20965-35996 bright_1x1 (dither) No APOGEE 13x300s DONE= 07:06:46 20989-36020 bright_1x1 (dither) No APOGEE 13x300s DONE= 09:00:23 20987-36018 bright_1x1 (dither) No APOGEE 13x300s DONE= 10:47:45 100563-40114 bright_single_77x1_v1 1xAB 1x900s DONE= APOGEE Dome Flats Missing Fibers: [] Faint fibers: [] Aver= age Throughput: 0.967 Notes: - We disabled fiber 1340 and f= iber 444 tonight. 1340 has been causing problems for several days, but= 444 is a new problem maker. - We had a critical alert due to the r= obot air temperature. There seems to be an altitude dependence on the = temperature, mostly at high altitude. We recommend that dither fields = stay below 80deg in altitude to avoid hitting the limit until we a= re back on the new chiller. We may also want to remove the IEB cov= er again. - We encountered an interesting bug in Kronos. After we l= oaded the last design of a field, we refreshed the queue, hoping for a= single-design field. Because the loaded design was still unobserved, = it never disappeared from the Kronos queue, even though we observed it= and finished it. When we refreshed the queue, it cleared. It's no= t a major bug, although it confused us for a bit. - We noticed that= at the end of the night, the FPI fibers weren't visible. Please take = a close look at it in this morning's cals. In the evening, it looked f= ine. - Integrated Dust Counts: ~13000 dust-hrs ---- Obs= erving Log ---- Afternoon All systems found responsive.= 00:47:20 Hartmann collimate output sp1: offset: r=3D -659 (In Focu= s); b=3D -4.2 (Out of focus) sp1: pred. move: spAverageMove=3D 345 sp1: pred. resid: r=3D -1004, b=3D -3.1, txt=3D OK, spTemp =3D 9.8 The blue ring settings look ok. FVC image: field=3D-999 desi= gn =3D-999 cfg=3D5303 image /data/fcam/59714/proc-fimg- fvc1n-0001.fits= " 00:54Z started ventilation Night 02:15:37 Jaege= r collision: 1340 We disabled the fiber and reloaded the configurat= ion ### Field -999 # APOGEE MJD UTC Design-Confi= g Exposure Type Dith Reads Arch Seeing 59714 02:06:29 -999-= 5305 41520010 Domeflat A 5 a-b-c 0.0 59714 02:08:07 -99= 9-5305 41520011 Domeflat A 5 a-b-c 0.0 59714 02:09:43 -= 999-5305 41520012 Domeflat A 5 a-b-c 0.0 2022-05-15 0= 2:06:29.309 Missing fibers: [] Faint fibers: [74] Average Throu= ghput: 0.98 2022-05-15 02:08:07.148 Missing fibers: [] Fain= t fibers: [] Average Throughput: 0.98 2022-05-15 02:09:43.294 Missing fibers: [] Faint fibers: [] Average Throughput: 0.98= ### Field 101164 # APOGEE MJD UTC Design-Config Exp= osure Type Dith Reads Arch Seeing 59714 02:51:12 42965-5308 = 41520013 Object A 43 a-b-c 1.8 59714 02:58:53 42965-530= 8 41520014 Object B 43 a-b-c 1.7 # BOSS MJD UT= C Design-Config Exposure Type SOS ETime Hart 59714 02:26:08 = 42965-5308 00341765 Hart r1-b1 4 Left 59714 02:26:48 42965-53= 08 00341766 Hart r1-b1 4 Right 59714 02:27:48 42965-5308 00= 341767 Arc r1-b1 4 Open 59714 02:29:26 42965-5308 00341768 F= lat r1-b1 25 Open 59714 02:51:31 42965-5308 00341769 Science r= 1-b1 900 Open 2022-05-15T02:26:08 r1 Steps: 329, b1 Ring: -4.2 Average Move: 839, Residuals: -1.6, Temp: 9.6 ### Field 1= 01191 # APOGEE MJD UTC Design-Config Exposure Type = Dith Reads Arch Seeing 59714 03:16:25 43544-5309 41520015 Objec= t B 43 a-b-c 2.0 59714 03:24:11 43544-5309 41520016 Obj= ect A 43 a-b-c 1.9 59714 03:37:38 43545-5310 41520017 O= bject A 43 a-b-c 2.3 59714 03:45:19 43545-5310 41520018= Object B 43 a-b-c 1.7 59714 03:59:16 43546-5311 415200= 19 Object B 43 a-b-c 1.7 59714 04:07:02 43546-5311 4152= 0020 Object A 43 a-b-c 1.9 59714 04:20:37 43547-5312 41= 520021 Object A 43 a-b-c 1.6 59714 04:28:18 43547-5312 = 41520022 Object B 43 a-x-x 1.7 # BOSS MJD UTC = Design-Config Exposure Type SOS ETime Hart 59714 03:09:42 4354= 4-5309 00341770 Hart r1-b1 4 Left 59714 03:10:23 43544-5309 = 00341771 Hart r1-b1 4 Right 59714 03:11:23 43544-5309 003417= 72 Arc r1-b1 4 Open 59714 03:13:00 43544-5309 00341773 Flat = r1-b1 25 Open 59714 03:16:43 43544-5309 00341774 Science r1-b1= 900 Open 59714 03:37:57 43545-5310 00341775 Science r1-b1 900 O= pen 59714 03:59:35 43546-5311 00341776 Science r1-b1 900 Open = 59714 04:20:56 43547-5312 00341777 Science r1-b1 900 Open 2022-05-= 15T03:09:42 r1 Steps: 0, b1 Ring: -1.2 Average Move: 192, Resi= duals: -0.6, Temp: 9.6 # Started dither fields 04:38:55 Confi= g Loaded: 20965-35996-5313 # Tried re-enabling fiber 1340 04:40:36 = Config Loaded: 20965-35996-5314 04:40:53 Jaeger collision: 1340 0= 4:42:51 Config Loaded: 20965-35996-5315 04:45:00 CmdStarted: OBSER= VER.dmbiz 131 jaeger fvc loop --max-iterations 4 --target-90-percentil= e 10 # FVC images 12-13 04:46:03 OBSERVER.dmbiz 131 jaeger d fvc_f= ilename=3D/data/fcam/59714/fimg-fvc1n- 0013.fits 04:46:10 OBSERVER.= dmbiz 131 jaeger i fvc_rms=3D31.56 04:46:10 OBSERVER.dmbiz 131 jaeger i= fvc_deltarms=3D10.2 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_perc_90= =3D8.9 04:46:10 OBSERVER.dmbiz 131 jaeger i fvc_percent_reached=3D62.6 04:46:25 CmdDone: OBSERVER.dmbiz 131 jaeger fvc loop --max-iterations 4= --target-90-percentile 10 04:49:31 boss exposure 4.0, fil= e=3D341778 04:50:12 boss exposure 4.0, file=3D341779 04:50:53 = sp1.motor.move=3D 358, 359, 358 04:50:53 Hartmann collimate output= sp1: offset: r=3D 329 (In Focus); b=3D -1.2 (In Focus) sp1: pre= d. move: spAverageMove=3D 357 sp1: pred. resid: r=3D -28, b=3D -0.1,= txt=3D OK, spTemp =3D 9.6 04:51:12 boss exposure 4.0, file=3D34178= 0 04:52:44 boss exposure 25.0, file=3D341781 Before the firs= t dither, we did an offset test requested by Jose where we apply 6= 0" in RA, then 60" in dec, then 60" in rot to verify the beh= avior of our guider offsets. Offsets Guider Images = 0 0 0 231-232 60 0 0 242-243 0 60 0 252-25= 3 0 0 60 261-262 -60 0 0 269-270 0 -60 0 = 278-279 0 0 -60 290-291 0 0 0 295-296 05:25= :27 boss exposure 300.0, file=3D341782 # Undithered exposure 05:31:5= 1 CmdStarted: OBSERVER.dmbiz 151 cherno offset -0.74 0.36 0 05:32:50 b= oss exposure 300.0, file=3D341783 05:38:54 CmdStarted: OBSERVER.dmbiz = 153 cherno offset -0.27 -0.20 0 05:39:53 boss exposure 300.0, file=3D= 341784 05:45:56 CmdStarted: OBSERVER.dmbiz 155 cherno offset -0.72 -0.2= 6 0 05:46:55 boss exposure 300.0, file=3D341785 05:52:59 CmdStart= ed: OBSERVER.dmbiz 157 cherno offset 0.73 0.63 0 05:53:58 boss exposur= e 300.0, file=3D341786 06:00:02 CmdStarted: OBSERVER.dmbiz 159 cherno = offset -0.38 0.85 0 06:01:01 boss exposure 300.0, file=3D341787 0= 6:07:08 CmdStarted: OBSERVER.dmbiz 161 cherno offset -0.12 0.02 0 06:08= :07 boss exposure 300.0, file=3D341788 06:14:11 CmdStarted: OBSERVER.= dmbiz 163 cherno offset -0.35 0.47 0 06:15:12 boss exposure 300.0, fi= le=3D341789 06:21:16 CmdStarted: OBSERVER.dmbiz 165 cherno offset 0.44 = -0.57 0 06:22:15 boss exposure 300.0, file=3D341790 06:28:19 CmdS= tarted: OBSERVER.dmbiz 167 cherno offset -0.46 0.16 0 06:29:18 boss ex= posure 300.0, file=3D341791 06:35:21 CmdStarted: OBSERVER.dmbiz 169 ch= erno offset 0.42 0.84 0 06:36:20 boss exposure 300.0, file=3D341792 06:42:24 CmdStarted: OBSERVER.dmbiz 171 cherno offset -0.63 0.33 0 0= 6:43:23 boss exposure 300.0, file=3D341793 06:49:27 CmdStarted: OBSER= VER.dmbiz 173 cherno offset 0.83 0.44 0 06:50:28 boss exposure 300.0,= file=3D341794 06:55:34 CmdStarted: OBSERVER.dmbiz 176 cherno offset Midway through this test, we crossed the meridian. At high altitudes,= the cooler pressure rises. Around an altitude of 83deg, the Robot= Air (sensor RTD8) raised a critical alert for hitting 40degC. Rob= ot Air is usually the highest temperature sensor during the night. It = would seem that with the backup chiller we're using now, it got a litt= le too hot. At 45degC, the system automatically shuts down. As we cros= sed the meridian and began to descend altitude, the temperature slowly= began to drop, and the alert cleared. Critical jaeger.alert= _robot_temp_warning at 2022-05-15 06:08:53 UT found 07:01:20 C= onfig Loaded: 20989-36020-5316 07:02:17 CmdStarted: OBSERVER.dmbiz = 184 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 # FV= C images 14-15 07:03:21 OBSERVER.dmbiz 184 jaeger d fvc_filename=3D= /data/fcam/59714/fimg-fvc1n- 0015.fits 07:03:28 OBSERVER.dmbiz 184 = jaeger i fvc_rms=3D22.2 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_deltar= ms=3D22.66 07:03:28 OBSERVER.dmbiz 184 jaeger i fvc_perc_90=3D8.9 0= 7:03:28 OBSERVER.dmbiz 184 jaeger i fvc_percent_reached=3D58.8 07:03:43= CmdDone: OBSERVER.dmbiz 184 jaeger fvc loop --max-iterations 4 --targ= et-90-percentile 10 07:06:46 boss exposure 4.0, file=3D341795 07:07:26 boss exposure 4.0, file=3D341796 07:08:07 sp1.motor.mo= ve=3D -614, -616, -616 07:08:07 Hartmann collimate output sp1: = offset: r=3D -329 (In Focus); b=3D 2.8 (In Focus) sp1: pred. move: = spAverageMove=3D -614 sp1: pred. resid: r=3D 285, b=3D 0.9, txt=3D O= K, spTemp =3D 9.3 07:08:27 boss exposure 4.0, file=3D341797 07:= 09:59 boss exposure 25.0, file=3D341798 07:13:37 boss exposure = 300.0, file=3D341799 # parent configuration 07:19:28 CmdStarted: OBSE= RVER.dmbiz 190 cherno offset -0.22 0.93 0 07:20:27 boss exposure 300.= 0, file=3D341800 07:26:31 CmdStarted: OBSERVER.dmbiz 192 cherno offset = 0.29 -0.23 0 07:27:30 boss exposure 300.0, file=3D341801 07:33:33= CmdStarted: OBSERVER.dmbiz 194 cherno offset 0.86 -0.35 0 07:34:32 bo= ss exposure 300.0, file=3D341802 07:40:36 CmdStarted: OBSERVER.dmbiz 1= 96 cherno offset -0.32 0.33 0 07:41:35 boss exposure 300.0, file=3D34= 1803 07:47:39 CmdStarted: OBSERVER.dmbiz 198 cherno offset -0.12 0.80 0= 07:48:38 boss exposure 300.0, file=3D341804 07:54:42 CmdStarted:= OBSERVER.dmbiz 200 cherno offset 0.52 0.38 0 07:55:41 boss exposure = 300.0, file=3D341805 08:01:44 CmdStarted: OBSERVER.dmbiz 202 cherno off= set -0.57 0.38 0 08:02:43 boss exposure 300.0, file=3D341806 08:0= 8:47 CmdStarted: OBSERVER.dmbiz 204 cherno offset -0.42 -0.60 0 08:09:4= 6 boss exposure 300.0, file=3D341807 08:15:49 CmdStarted: OBSERVER.dm= biz 206 cherno offset -0.12 0.93 0 08:16:48 boss exposure 300.0, file= =3D341808 08:22:53 CmdStarted: OBSERVER.dmbiz 208 cherno offset 0.55 -0= .38 0 08:23:51 boss exposure 300.0, file=3D341809 08:29:55 CmdSta= rted: OBSERVER.dmbiz 210 cherno offset -0.21 0.04 0 08:30:54 boss expo= sure 300.0, file=3D341810 08:36:57 CmdStarted: OBSERVER.dmbiz 212 cher= no offset -0.51 -0.50 0 08:37:56 boss exposure 300.0, file=3D341811 08:49:24 Config Loaded: 20987-36018-5319 08:50:33 CmdStarte= d: OBSERVER.dmbiz 223 jaeger fvc loop --max-iterations 4 --target-90-p= ercentile 10 # FVC images 16-17 08:51:37 OBSERVER.dmbiz 223 jaeger= d fvc_filename=3D/data/fcam/59714/fimg-fvc1n- 0017.fits 08:51:44 O= BSERVER.dmbiz 223 jaeger i fvc_rms=3D14.13 08:51:44 OBSERVER.dmbiz 223 = jaeger i fvc_deltarms=3D26.46 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_= perc_90=3D9.1 08:51:44 OBSERVER.dmbiz 223 jaeger i fvc_percent_reached= =3D60.4 08:52:00 CmdDone: OBSERVER.dmbiz 223 jaeger fvc loop --max-iter= ations 4 --target- 90-percentile 10 08:54:02 boss exposure= 4.0, file=3D341812 08:54:42 boss exposure 4.0, file=3D341813 08:55:24 sp1.motor.move=3D 361, 362, 363 08:55:24 Hartmann collimat= e output sp1: offset: r=3D 659 (In Focus); b=3D -0.2 (In Focus)= sp1: pred. move: spAverageMove=3D 361 sp1: pred. resid: r=3D 297= , b=3D 0.9, txt=3D OK, spTemp =3D 9.3 08:55:42 boss exposure 4.0, f= ile=3D341814 08:57:15 boss exposure 25.0, file=3D341815 09:00:23= boss exposure 300.0, file=3D341816 # Undithered 09:06:51 CmdStarted= : OBSERVER.dmbiz 227 cherno offset 0.49 -0.45 0 09:07:50 boss exposure= 300.0, file=3D341817 09:13:54 CmdStarted: OBSERVER.dmbiz 229 cherno o= ffset 0.15 -0.13 0 09:14:53 boss exposure 300.0, file=3D341818 09= :20:56 CmdStarted: OBSERVER.dmbiz 231 cherno offset 0.52 -0.51 0 09:21:= 55 boss exposure 300.0, file=3D341819 09:27:59 CmdStarted: OBSERVER.d= mbiz 233 cherno offset -0.45 -0.09 0 09:28:58 boss exposure 300.0, fi= le=3D341820 09:35:02 CmdStarted: OBSERVER.dmbiz 235 cherno offset -0.31= -0.17 0 09:36:02 boss exposure 300.0, file=3D341821 09:42:09 Cmd= Started: OBSERVER.dmbiz 237 cherno offset 0.35 -0.52 0 09:43:08 boss e= xposure 300.0, file=3D341822 09:49:11 CmdStarted: OBSERVER.dmbiz 239 c= herno offset 0.31 0.13 0 09:50:13 boss exposure 300.0, file=3D341823 09:56:17 CmdStarted: OBSERVER.dmbiz 241 cherno offset -0.57 -0.34 0= 09:57:16 boss exposure 300.0, file=3D341824 10:03:20 CmdStarted: OBS= ERVER.dmbiz 243 cherno offset 0.91 0.39 0 10:04:19 boss exposure 300.= 0, file=3D341825 10:10:22 CmdStarted: OBSERVER.dmbiz 245 cherno offset = -0.79 0.01 0 10:11:21 boss exposure 300.0, file=3D341826 10:17:25= CmdStarted: OBSERVER.dmbiz 247 cherno offset 0.66 0.47 0 10:18:24 bos= s exposure 300.0, file=3D341827 10:24:28 CmdStarted: OBSERVER.dmbiz 24= 9 cherno offset 0.34 -0.51 0 ### Field 100563 # APOGEE = MJD UTC Design-Config Exposure Type Dith Reads Arch Seeing= 59714 10:47:45 40115-5329 41520023 Object B 43 a-b-c 1= .8 59714 10:55:30 40115-5329 41520024 Object A 43 a-b-c = 1.5 59714 11:04:58 40115-5329 41520025 Domeflat A 5 a-b-= c 0.0 59714 11:06:23 40115-5329 41520026 Domeflat A 5 a-= b-c 0.0 59714 11:08:22 40115-5329 41520027 Domeflat A 5 = a-b-c 0.0 2022-05-15 11:04:58.430 Missing fibers: [] Faint= fibers: [] Average Throughput: 0.96 2022-05-15 11:06:23.329 Missing fibers: [] Faint fibers: [74] Average Throughput: 0.95 2022-05-15 11:08:22.480 Missing fibers: [] Faint fibers: [24,= 74] Average Throughput: 0.95 11:15:17 encl25m : closed; ---- Mirror Numbers ---- PRIMARY: Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0090 0.0040 Axial B: 0.0070 0.0030 Axial C: -0.1220 -0.1150 = Trans D: -0.0331 -0.0338 Lateral E: 0.3315 0.3315 Lat= eral F: 0.5345 0.5350 GALILS Commanded: 12500 -1600 530= 0 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 Prim= Orient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: Focus: = 0.0000 Air temp: 20.67 Altitude: 30.0 MIGS = TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: = -9.6670 -9.6710 Axial C: -9.7000 -9.6970 Trans D: = 0.1140 0.1140 GALILS Commanded: 4881300 4875250 4902900 0 -340= 0 Actual: 4859186 4859217 4859287 0 -3400 SETMIR VALUES = SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.0 -0.03 0.01 = 0.0 41.66 ---- Telescope Status ---- 01:00Z Started= ventilation Opened at 02:01:16 Closed at 11:15:17 Status a= t: 1:23:04Z Telescope Position: 121.0, 30.0, 0.0 mount Instrum= ent mounted: FPS Counterweights at: 682.2, 684.4, 702.3, 701.6 LN= 2 autofill systems: Connected and turned on 180L LN2 dewar scale: SP1= 159.0 lbs, 17.6 psi Chiller Flow: 5.14 L/min to FPS, 1.38 L/min to = GFAs, nan/nan gpm total Chiller Temp: nanC No chiller alarms ---- Software Used ---- TUI : 1.7.17b1 a= lerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger = : 0.15.2-alpha.0 kaiju : 1.2.4-alpha.0 coordio : 1.4= .0-alpha.0 fps_calibrati : APO.2022.04.21+e0e43d5 cherno = : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.= 2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 3= 4 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc := v1_148 tcc : 1.4.0 apogee : not availble apog= eecal : not availble apogeeql : v1_7_0dev STUIAdditions : = 3.1.13 --------------Other Versions-------------- sdss-obst= ools : 3.7.14 TPM : 1.2-31-gd7eb MCP = : 2.1 PLC : V34 Fiducials : v1_14= 8 idlspec2d : v6_0_7 Kronos : 1.3.1a rob= oscheduler : 1.2.2a /dev/sdb1 2.0T 174G 1.9T= 9% /home 10.25.1.230:/data 21T 17T 3.2T 85% /data ---- APOGEE Data Summary ---- MJD UTC Design-Config Ex= posure Type Dith Reads Arch 59714 00:33:31 40114-5304 415200= 01 Arc A 3 a-b-c 59714 00:35:38 40114-5304 41520002 = Dark A 60 a-b-c 59714 00:46:37 40114-5304 41520003 Qua= rtzflat A 10 a-b-c 59714 00:48:37 40114-5304 41520004 ThAr A= rc B 12 a-b-c 59714 00:50:50 -999-5305 41520005 UNe Arc = B 40 a-b-c 59714 00:58:07 -999-5305 41520006 ThAr Arc = A 12 a-b-c 59714 01:00:20 -999-5305 41520007 UNe Arc A = 40 a-b-c 59714 01:07:46 -999-5305 41520008 Dark A = 60 a-b-c 59714 01:18:38 -999-5305 41520009 FPI Lamp A = 30 a-b-c 59714 02:06:29 -999-5305 41520010 Domeflat A 5 = a-b-c 59714 02:08:07 -999-5305 41520011 Domeflat A 5 a-b= -c 59714 02:09:43 -999-5305 41520012 Domeflat A 5 a-b-c 59714 02:51:12 42965-5308 41520013 Object A 43 a-b-c= 59714 02:58:53 42965-5308 41520014 Object B 43 a-b-c 59= 714 03:16:25 43544-5309 41520015 Object B 43 a-b-c 59714= 03:24:11 43544-5309 41520016 Object A 43 a-b-c 59714 03= :37:38 43545-5310 41520017 Object A 43 a-b-c 59714 03:45= :19 43545-5310 41520018 Object B 43 a-b-c 59714 03:59:16= 43546-5311 41520019 Object B 43 a-b-c 59714 04:07:02 4= 3546-5311 41520020 Object A 43 a-b-c 59714 04:20:37 4354= 7-5312 41520021 Object A 43 a-b-c 59714 04:28:18 43547-5= 312 41520022 Object B 43 a-b-c 59714 10:47:45 40115-5329= 41520023 Object B 43 a-b-c 59714 10:55:30 40115-5329 = 41520024 Object A 43 a-b-c 59714 11:04:58 40115-5329 415= 20025 Domeflat A 5 a-b-c 59714 11:06:23 40115-5329 415200= 26 Domeflat A 5 a-b-c 59714 11:08:22 40115-5329 41520027 = Domeflat A 5 a-b-c ThAr Offsets: ['-0.51'] UNe Offsets: = ['-0.51'] Object Offsets: Max: 0.54, Min: 0.48, Mean: 0.50 ---- eBOSS Data Summary ---- MJD UTC Design-Config Expos= ure Type SOS ETime Hart 59714 00:33:41 40114-5304 00341761 Bias= r1-b1 0 Closed 59714 00:38:06 40114-5304 00341762 Dark = r1-b1 20 Closed 59714 00:45:56 40114-5304 00341763 Hart r1-b1= 4 Left 59714 00:46:39 40114-5304 00341764 Hart r1-b1 4 = Right 59714 02:26:08 42965-5308 00341765 Hart r1-b1 4 Left 59714 02:26:48 42965-5308 00341766 Hart r1-b1 4 Right 597= 14 02:27:48 42965-5308 00341767 Arc r1-b1 4 Open 59714 02:2= 9:26 42965-5308 00341768 Flat r1-b1 25 Open 59714 02:51:31 4= 2965-5308 00341769 Science r1-b1 900 Open 59714 03:09:42 43544-53= 09 00341770 Hart r1-b1 4 Left 59714 03:10:23 43544-5309 00= 341771 Hart r1-b1 4 Right 59714 03:11:23 43544-5309 00341772= Arc r1-b1 4 Open 59714 03:13:00 43544-5309 00341773 Flat = r1-b1 25 Open 59714 03:16:43 43544-5309 00341774 Science r1-b= 1 900 Open 59714 03:37:57 43545-5310 00341775 Science r1-b1 900= Open 59714 03:59:35 43546-5311 00341776 Science r1-b1 900 Open 59714 04:20:56 43547-5312 00341777 Science r1-b1 900 Open 5971= 4 04:49:31 35996-5315 00341778 Hart r1-b1 4 Left 59714 04:50= :12 35996-5315 00341779 Hart r1-b1 4 Right 59714 04:51:12 3= 5996-5315 00341780 Arc r1-b1 4 Open 59714 04:52:44 35996-53= 15 00341781 Flat r1-b1 25 Open 59714 05:25:27 35996-5315 00= 341782 Science r1-b1 300 Open 59714 05:32:50 35996-5315 00341783 = Science r1-b1 300 Open 59714 05:39:53 35996-5315 00341784 Science= r1-b1 300 Open 59714 05:46:55 35996-5315 00341785 Science r1-b1= 300 Open 59714 05:53:58 35996-5315 00341786 Science r1-b1 300 = Open 59714 06:01:01 35996-5315 00341787 Science r1-b1 300 Open 59714 06:08:07 35996-5315 00341788 Science r1-b1 300 Open 59714= 06:15:12 35996-5315 00341789 Science r1-b1 300 Open 59714 06:22:= 15 35996-5315 00341790 Science r1-b1 300 Open 59714 06:29:18 359= 96-5315 00341791 Science r1-b1 300 Open 59714 06:36:20 35996-5315= 00341792 Science r1-b1 300 Open 59714 06:43:23 35996-5315 0034= 1793 Science r1-b1 300 Open 59714 06:50:27 35996-5315 00341794 Sc= ience r1-b1 300 Open 59714 07:06:46 36020-5316 00341795 Hart = r1-b1 4 Left 59714 07:07:26 36020-5316 00341796 Hart r1-b1 = 4 Right 59714 07:08:27 36020-5316 00341797 Arc r1-b1 4 O= pen 59714 07:09:59 36020-5316 00341798 Flat r1-b1 25 Open= 59714 07:13:37 36020-5316 00341799 Science r1-b1 300 Open 59714 = 07:20:27 36020-5316 00341800 Science r1-b1 300 Open 59714 07:27:3= 0 36020-5316 00341801 Science r1-b1 300 Open 59714 07:34:32 3602= 0-5316 00341802 Science r1-b1 300 Open 59714 07:41:35 36020-5316 = 00341803 Science r1-b1 300 Open 59714 07:48:38 36020-5316 00341= 804 Science xx-b1 300 Open 59714 07:55:41 36020-5316 00341805 Sci= ence r1-b1 300 Open 59714 08:02:43 36020-5316 00341806 Science x= x-b1 300 Open 59714 08:09:46 36020-5316 00341807 Science r1-b1 = 300 Open 59714 08:16:48 36020-5316 00341808 Science r1-b1 300 Ope= n 59714 08:23:51 36020-5316 00341809 Science r1-b1 300 Open 5= 9714 08:30:54 36020-5316 00341810 Science r1-b1 300 Open 59714 08= :37:56 36020-5316 00341811 Science r1-b1 300 Open 59714 08:54:02 = 36018-5319 00341812 Hart r1-b1 4 Left 59714 08:54:42 36018-= 5319 00341813 Hart r1-b1 4 Right 59714 08:55:42 36018-5319 = 00341814 Arc r1-b1 4 Open 59714 08:57:14 36018-5319 003418= 15 Flat r1-b1 25 Open 59714 09:00:23 36018-5319 00341816 Scie= nce r1-b1 300 Open 59714 09:07:50 36018-5319 00341817 Science r1= -b1 300 Open 59714 09:14:53 36018-5319 00341818 Science r1-b1 3= 00 Open 59714 09:21:55 36018-5319 00341819 Science r1-b1 300 Open= 59714 09:28:58 36018-5319 00341820 Science r1-b1 300 Open 59= 714 09:36:02 36018-5319 00341821 Science r1-b1 300 Open 59714 09:= 43:08 36018-5319 00341822 Science r1-b1 300 Open 59714 09:50:13 = 36018-5319 00341823 Science r1-b1 300 Open 59714 09:57:16 36018-5= 319 00341824 Science r1-b1 300 Open 59714 10:04:19 36018-5319 0= 0341825 Science r1-b1 300 Open 59714 10:11:21 36018-5319 00341826= Science r1-b1 300 Open 59714 10:18:24 36018-5319 00341827 Scienc= e r1-b1 300 Open 59714 10:25:28 36018-5319 00341828 Science r1-b= 1 300 Open 59714 10:41:32 40115-5329 00341829 Hart r1-b1 4= Left 59714 10:42:13 40115-5329 00341830 Hart r1-b1 4 Right 59714 10:43:16 40115-5329 00341831 Arc r1-b1 4 Open 597= 14 10:44:49 40115-5329 00341832 Flat r1-b1 25 Open 59714 10:4= 8:03 40115-5329 00341833 Science r1-b1 900 Open ---- BOSS= Spectrographs Collimation ---- Time Field-Design Temp R of= f B off Move Resid 00:47:17 nan-nan 9.8 -659 -4.2 3= 45 -3.1 02:27:25 101164-42965 9.6 329 -4.2 839 -1.6= 03:11:01 101191-43544 9.7 0 -1.2 192 -0.6 04:50:50 20= 965-35996 9.6 329 -1.2 357 -0.1 07:08:04 20989-36020 = 9.3 -329 2.8 -614 0.9 08:55:20 20987-36018 9.3 659 = -0.2 361 0.9 10:42:51 100563-40115 9.0 329 2.8 -285 = 1.9 ---- Time Tracking ---- *=3D*=3D*=3D Observa= tory: APO *=3D*=3D*=3D MJD: 59714 Fill night time in Hours b= elow *=3D*=3D*=3D Total bright time : 0 *=3D*= =3D*=3D Bright time, queued observations : 0 *=3D*=3D*=3D Bright t= ime, commissioning/engineering: 0 *=3D*=3D*=3D Bright time lost to weat= her : 0 *=3D*=3D*=3D Bright time lost to technical issues : = 0 *=3D*=3D*=3D Total dark time : 0 *=3D*= =3D*=3D Dark time, queued observations : 0 *=3D*=3D*=3D Dark tim= e, commissioning/engineering : 0 *=3D*=3D*=3D Dark time lost to weathe= r : 0 *=3D*=3D*=3D Dark time lost to technical issues : = 0 Logs of Nightly APO Activities https://trac.sd= ss.org/tracmailman/browser/private/sloan-25mlog/index.html print('-Dylan Gatlin') --_000_1c0e338d2d474443bfe7b9469f8f7a66tcuedu_--