Subject: 2.5m obslog 20220430 (SJD 59700) From: asimmons@apo.nmsu.edu Date: Sun, 1 May 2022 11:35:41 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday April 30, 2022 (SJD 59700) ---- Observing Team ---- Dylan Gatlin Audrey Oravetz ---- Observing Plan ---- Observe from queue until about 10:30. If clear, proceed with dithers as described below, otherwise keep observing from queue! If it is clear would like to try to complete three APOGEE telescope dither sequences on designs 35961, 35987, 35993. These should follow the sequence (thanks to Dan for sending!). Slew to 121,70,190 then halt the axes. Load the design: 'jaeger configuration load [...]' Execute the design: 'jaeger configuration execute' Corrective fvc loop: 'jaeger fvc loop --max-iterations 4 [...]' 5x 'jaeger fvc loop --no-apply' hal goto-field w/ slew, arcs, flat, hartmanns, acquire guide stages (likely can skip the hartmanns and boss cals for the APOGEE dither fields) Once guiding stabilizes, expose APOGEE for 30 reads jaeger configuration dither 0.06 tcc axis stop Corrective fvc loop: 'jaeger fvc loop --max-iterations 4 [...]' 5x 'jaeger fvc loop --no-apply' hal goto-field w/ slew, acquire, guide stages Now do the 12x telescope dithers: Repeat the following 12 times: 'cherno offset [...]' Once guiding stabilizes, expose APOGEE for 30 reads End with 'cherno offset -0.3 -0.3 -432' ---- Observing Summary ---- The dust remained elevated throughout most of the night, a loss of 7.5hrs. We opened though the last hour and observed: 10:15:40 Config Loaded: 101199-43705-5101; 3x900 + 3xAB - DONE Notes: - In the afternoon when running the fvc loop, I ran a fliswarm reconnect. This caused the fvc loop to hang, which required a jaeger restart. - The OPTIDEW was restarted 3-4 times throughout the night, each time failing after a few minutes. ---- Engineering Issues ---- We collected about 4000 dust hours whilst open tonight. Combined with yesterday's dust, the mirror definitely needs cleaned. ---- Observing Log ---- Mirror numbers in spec APOGEE cals started BOSS cals taken 00:05:22 sp1.motor.move= -302, -302, -302 00:05:22 Hartmann collimate output sp1: offset: r= -989 (In Focus); b= -1.2 (In Focus) sp1: pred. move: spAverageMove= -302 sp1: pred. resid: r= -687, b= -2.2, txt= OK, spTemp = 8.0 Blue ring not adjusted I first tried the to take an afternoon fvc loop with configuration 5099. However, mid-loop, I ran `fliswarm reconnect`, not realizing this would also reconnect the fvc. The reconnect started right after an exposure finished, but it caused the fvc lamps to stay on and hung the fvc loop. After restarting jaeger, the afternoon fvc loop was done correctly with config 5100. High dust, will delay ventilation until sunset Night: ====== Restarted the TPM processes, but it didn't take long for the weather info to stop updating again (about 30 mins). The dust did not settled below 6000 counts for most of the night until... 10:10Z - Opened the enclosure. 10:15:40 Config Loaded: 101199-43705-5101 10:17:02 sp1.motor.move= None, None, None 10:17:10 boss exposure 4.0, file=341026 10:17:50 boss exposure 4.0, file=341027 10:18:33 sp1.motor.move= 1812, 1813, 1812 10:18:33 Hartmann collimate output sp1: offset: r= 989 (In Focus); b= -8.3 (Out of focus) sp1: pred. move: spAverageMove= 1812 sp1: pred. resid: r= -823, b= -2.6, txt= OK, spTemp = 7.2 10:18:52 boss exposure 4.0, file=341028 10:20:46 boss exposure 25.0, file=341029 10:18:36 APO.dgatlin_boson.jaeger 786 jaeger i text="FVC iteration 1" 10:19:16 APO.dgatlin_boson.jaeger 786 jaeger d fvc_filename=/data/fcam/59700/fimg-fvc1n-0003.fits 10:19:22 APO.dgatlin_boson.jaeger 786 jaeger i fvc_rms=41.0 10:19:22 APO.dgatlin_boson.jaeger 786 jaeger i fvc_perc_90=57.4 10:19:22 APO.dgatlin_boson.jaeger 786 jaeger i fvc_percent_reached=2.9 10:19:38 APO.dgatlin_boson.jaeger 786 jaeger i text="FVC iteration 2" 10:19:58 APO.dgatlin_boson.jaeger 786 jaeger d fvc_filename=/data/fcam/59700/fimg-fvc1n-0004.fits 10:20:04 APO.dgatlin_boson.jaeger 786 jaeger i fvc_rms=16.1 10:20:04 APO.dgatlin_boson.jaeger 786 jaeger i fvc_deltarms=24.9 10:20:04 APO.dgatlin_boson.jaeger 786 jaeger i fvc_perc_90=9.4 10:20:04 APO.dgatlin_boson.jaeger 786 jaeger i fvc_percent_reached=59.0 10:29:25 apogee.expose=apRaw-41380010, 43, A, Object 10:29:32 boss exposure 900.0, file=341030 10:37:06 apogee.expose=apRaw-41380011, 43, B, Object 10:47:05 apogee.expose=apRaw-41380012, 43, B, Object 10:47:12 boss exposure 900.0, file=341031 10:54:51 apogee.expose=apRaw-41380013, 43, A, Object 11:03:43 apogee.expose=apRaw-41380014, 43, A, Object 11:03:51 boss exposure 900.0, file=341032 11:11:24 apogee.expose=apRaw-41380015, 43, B, Object 11:20:03 apogee.expose=apRaw-41380016, 5, B, DomeFlat 11:21:27 apogee.expose=apRaw-41380017, 5, B, DomeFlat 11:22:52 apogee.expose=apRaw-41380018, 5, B, DomeFlat 11:21Z - Closed enclosure and stopped ventilating. Stopped the FPS. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0060 0.0040 Axial B: 0.0030 0.0030 Axial C: -0.1180 -0.1150 Trans D: -0.0336 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 15.50 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: -9.6660 -9.6710 Axial C: -9.6980 -9.6970 Trans D: 0.1090 0.1140 GALILS Commanded: 4884300 4878400 4905700 -50 -3450 Actual: 4859199 4859243 4859161 -50 -3450 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3856.98 0.02 -0.0 -0.0 42.86 ---- Telescope Status ---- Status at: 11:23Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 680/710 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 129 lbs, 21 psi FPS Status ========== CP10 Loop = 7.09 L/min GFA Loop = 1.74 L/min Supply pressure = 41.0 psi Return pressure = 28.3 psi Chiller Status ============== Set temperarature = 8.6 C Flow = 3.4 Gpm ---- Software Used ---- -- STUI software: STUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.15.2-alpha.0 kaiju : 1.2.4-alpha.0 coordio : 1.4.1-alpha.1 fps_calibrati : APO.2022.04.21+71d56e9 cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.13 -- done -- --------------Other Versions-------------- sdss-obstools : 3.7.14 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V34 Fiducials : v1_148 idlspec2d : v6_0_7 Kronos : 1.2.1 roboscheduler : 1.2.2a /dev/sdb1 2.0T 173G 1.9T 9% /home 10.25.1.230:/data 21T 18T 2.2T 90% /data ---- APOGEE Data Summary ---- MJD UTC Design-Config Exposure Type Dith Reads Arch -------------------------------------------------------------------------------- 59699 09:49:47 36004-5098 41370025 Dark B 60 a-b-c 59699 10:00:25 36004-5098 41370026 Dark B 60 a-b-c 59699 10:11:03 36004-5098 41370027 Dark B 60 a-b-c 59699 10:21:55 36004-5098 41370028 Quartzflat B 10 a-b-c 59699 10:23:43 36004-5098 41370029 Quartzflat B 10 a-b-c 59699 10:25:31 36004-5098 41370030 Quartzflat B 10 a-b-c 59699 10:27:24 36004-5098 41370031 ThAr Arc B 12 a-b-c 59699 10:29:37 36004-5098 41370032 UNe Arc B 40 a-b-c 59699 10:36:54 36004-5098 41370033 ThAr Arc A 12 a-b-c 59699 10:39:07 36004-5098 41370034 UNe Arc A 40 a-b-c 59699 10:46:23 36004-5098 41370035 Dark A 30 a-b-c 59699 10:51:43 36004-5098 41370036 Internalflat A 30 a-b-c 59699 10:57:03 36004-5098 41370037 Internalflat A 30 a-b-c 59699 11:02:23 36004-5098 41370038 Internalflat A 30 a-b-c 59699 11:07:54 36004-5098 41370039 Dark A 30 a-b-c 59699 11:13:28 36004-5098 41370040 FPI Lamp A 30 a-b-c ThAr Offsets: ['-0.49', '0.51', '-0.50'] UNe Offsets: ['-0.51', '0.53', '-0.51'] Object Offsets: Max: 0.51, Min: 0.19, Mean: 0.44 APOGEE data list, mjd=59700, all raw_data: /data/apogee/utr_cdr/59700/apRaw-*.fits archive: /data/apogee/archive/59700/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59700/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59700 1 23:45 41380001 Dark 3 A 13.0 ---------- a-b-c - - 59700 2 23:57 41380002 Dark 60 A 13.0 ---------- a-b-c - - 59700 3 23:59 41380003 QuarFlat 10 A 13.0 ---------- a-b-c - - 59700 4 00:01 41380004 Arc-Thar 12 B 13.5 ---------- a-b-c 1.93 - 59700 5 00:09 41380005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59700 6 00:11 41380006 Arc-Thar 12 A 13.0 ---------- a-b-c 1.54 - 59700 7 00:18 41380007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59700 8 00:29 41380008 Dark 60 A 13.0 ---------- a-b-c - - 59700 9 00:35 41380009 Arc---- 30 A 13.0 ---------- a-b-c - 99 FPI 59700 10 10:36 41380010 Object 43 A 13.0 43705-5101 a-b-c 1.43 - 59700 11 10:44 41380011 Object 43 B 13.5 43705-5101 a-b-c 1.94 - 59700 12 10:54 41380012 Object 43 B 13.5 43705-5101 a-b-c 1.95 - 59700 13 11:02 41380013 Object 43 A 13.0 43705-5101 a-b-c 1.44 - 59700 14 11:10 41380014 Object 43 A 13.0 43705-5101 a-b-c 1.43 - 59700 15 11:18 41380015 Object 43 B 13.5 43705-5101 a-b-c 1.95 - 59700 16 11:20 41380016 DomeFlat 5 B 13.5 43705-5101 a-b-c - 136 cannot read file : /data/apogee/quickred/59700/apq-41380017.fits cannot read file : /data/apogee/utr_cdr/59700/apRaw-41380018.fits ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59700 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:47 b1-00341020 ----------- ---- bia Clo 0.0 987 1115 -293 2 23:47 r1-00341020 ----------- ---- bia Clo 0.0 987 1115 -293 3 23:49 b1-00341021 ----------- ---- dar Clo 20.0 987 1115 -293 4 23:49 r1-00341021 ----------- ---- dar Clo 20.0 987 1115 -293 5 00:03 b1-00341022 36004-20973 5098 arc Lef 4.1 987 1115 -293 HART 6 00:03 r1-00341022 36004-20973 5098 arc Lef 4.1 987 1115 -293 HART 7 00:04 b1-00341023 36004-20973 5098 arc Rig 4.1 987 1115 -293 HART 8 00:04 r1-00341023 36004-20973 5098 arc Rig 4.1 987 1115 -293 HART 9 00:08 b1-00341024 36004-20973 5098 arc Out 4.1 685 813 -595 10 00:08 r1-00341024 36004-20973 5098 arc Out 4.1 685 813 -595 11 00:10 r1-00341025 36004-20973 5098 fla Out 25.1 685 813 -595 12 00:10 b1-00341025 36004-20973 5098 fla Out 25.1 685 813 -595 13 10:17 r1-00341026 43705-101199 5101 arc Lef 4.1 685 813 -595 HART 14 10:17 b1-00341026 43705-101199 5101 arc Lef 4.1 685 813 -595 HART 15 10:17 r1-00341027 43705-101199 5101 arc Rig 4.1 685 813 -595 HART 16 10:17 b1-00341027 43705-101199 5101 arc Rig 4.1 685 813 -595 HART 17 10:18 r1-00341028 43705-101199 5101 arc Out 4.1 2497 2626 1217 18 10:18 b1-00341028 43705-101199 5101 arc Out 4.1 2497 2626 1217 19 10:20 r1-00341029 43705-101199 5101 fla Out 25.1 2497 2626 1217 20 10:20 b1-00341029 43705-101199 5101 fla Out 25.1 2497 2626 1217 21 10:29 r1-00341030 43705-101199 5101 sci Out 900.1 2497 2626 1217 22 10:29 b1-00341030 43705-101199 5101 sci Out 900.1 2497 2626 1217 23 10:47 b1-00341031 43705-101199 5101 sci Out 900.1 2497 2626 1217 24 10:47 r1-00341031 43705-101199 5101 sci Out 900.1 2497 2626 1217 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 00:05:10 7.5 -989 -1.2 -302 -2.2 10:18:20 6.6 989 -8.3 1812 -2.6 ---- Weather Log ---- Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma 18:00 12.6 -18.1 10.0 207.8 8405 18:15 14.8 -15.1 11.5 245.0 dpDep 18:30 14.1 -14.6 14.0 224.9 8228 18:45 12.9 -14.6 10.8 246.3 8226 19:00 16.3 -13.1 14.7 253.1 8167 19:15 12.6 -14.6 11.8 257.8 8170 19:30 17.4 -13.3 5.7 193.3 8112 19:45 14.8 -12.7 14.0 238.2 8350 20:00 16.4 -12.9 17.3 229.5 8094 20:15 14.5 -13.1 16.8 250.3 8573 20:30 15.3 -12.7 13.0 221.9 8729 20:45 16.5 -13.1 20.2 236.0 8761 21:00 15.5 -12.8 18.0 246.0 8585 21:15 15.8 -13.2 13.2 263.6 8143 21:30 15.7 -12.8 12.9 222.0 7322 21:45 13.5 -14.8 7.3 247.2 6993 22:00 15.5 -14.6 13.5 240.4 6857 22:15 17.3 -14.6 15.3 237.1 6351 22:30 14.4 -15.5 13.3 256.5 5986 22:45 16.7 -15.7 16.1 218.5 5766 23:00 15.0 -15.2 9.3 246.5 5773 23:15 14.6 -16.3 8.5 255.1 5322 23:30 15.5 -16.2 9.0 206.0 5653 23:45 14.4 -16.6 8.1 188.1 5558 00:00 14.1 -16.7 1.5 209.2 6078 00:15 13.5 -16.3 15.0 239.5 6073 00:30 14.4 -15.4 13.9 193.6 6230 00:45 14.6 -14.9 12.0 203.6 6451 01:00 13.3 -14.8 14.4 190.4 6495 01:15 12.7 -14.9 13.9 189.5 6651 01:30 11.7 -15.0 13.9 201.5 6338 01:45 10.9 -14.9 6.6 184.3 6288 02:00 10.6 -14.8 13.0 167.7 6546 02:15 10.5 -15.0 13.0 183.6 6322 02:30 9.8 -14.5 14.4 152.6 6424 02:45 9.5 -13.9 12.0 152.0 6394 03:00 9.6 -13.7 15.2 142.5 6621 03:15 9.3 -13.6 15.7 155.6 6330 03:30 9.1 -13.6 14.6 170.3 6243 03:45 10.0 -13.6 15.8 178.1 6601 04:00 10.2 -13.6 16.7 177.4 6947 04:15 10.5 -13.8 17.4 178.6 6831 04:30 10.4 -14.9 17.2 161.8 6415 04:45 10.2 -14.2 15.3 157.1 6166 05:00 9.9 -13.8 14.2 176.0 6148 05:15 9.4 -13.8 17.4 156.1 6117 05:30 9.2 -13.1 20.1 143.5 6174 05:45 9.4 -12.5 19.5 154.1 6094 06:00 9.2 -12.0 18.1 144.1 5950 06:15 9.6 -11.9 20.7 150.0 6168 06:30 9.4 -12.1 20.4 149.0 6227 06:45 9.4 -12.4 17.9 157.3 6253 07:00 9.3 -12.7 19.0 147.1 5908 07:15 9.0 -13.2 18.0 144.1 6106 07:30 9.0 -11.7 17.3 144.7 6794 07:45 8.9 -10.2 19.4 149.9 7162 08:00 8.9 -9.1 18.7 147.6 7110 08:15 9.0 -8.3 14.9 146.4 7044 08:30 9.1 -8.2 20.3 146.6 6996 08:45 9.3 -8.3 21.0 147.7 6990 09:00 9.2 -7.6 19.5 142.0 6719 09:15 9.0 -7.2 19.9 139.0 6563 09:30 8.8 -6.2 21.0 146.7 6397 09:45 8.8 -5.9 17.1 150.5 6166 10:00 8.8 -5.7 18.7 150.4 5826 10:15 8.6 -5.1 17.3 150.8 5859 10:30 8.8 -5.0 15.9 152.9 5550 166 10.32 10:45 8.4 -5.0 15.8 156.4 5584 151 6.12 11:00 9.1 -5.0 17.5 156.6 5417 88 11.05 11:15 8.7 -5.1 13.8 158.6 5232 112 10.87