Subject: 2.5m obslog 20220317 (SJD 59656) From: dmbiz@apo.nmsu.edu Date: Fri, 18 Mar 2022 11:40:06 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday March 17, 2022 (SJD 59656) ---- Observing Team ---- Karen Kinemuchi Dmitry Bizyaev ---- Observing Plan ---- https://wiki.sdss.org/display/COM/Commissioning+Nightly+Plan#CommissioningNightlyPlan-CommissioningNightlyPlan On March 17, made a change to a jaeger configuration file to adjust the scale slightly for the robots. Please restart jaeger before observing. If anything seems odd when observing, contact Jon/Jose! if conditions are stable (no clouds, reasonable seeing), observe commissioning designs 36200, 36196, 36197, 36200 (yes, a repeat), 36198, 36199, 36200 (again!), with single 900s BOSS exposures on each. These are all in the same location, but have different different robot designs and field ids, and will each require reconfigurations.→ Since they have different field ids, please obtain a BOSS arc and flat at each. If conditions are not good, skip it, or observe it later if it becomes clear. refresh the Kronos queue, and observe from the queue towards the end of the night, if conditions are stable and at least reasonably good, do a joint BOSS-APOGEE dither test on design 106935 following instructions on the observing instructions page (but relaxing the seeing requirement to 2 arcsec if necessary), take both BOSS (300s) and APOGEE (single 30 read) at each dither position. ---- Observing Summary ---- Clear night. We lost most of the night due to very high dust counts. Observed: Science Loaded Design Field Cfg 01:44:45 52792-103429 4045 A: AB(43) B: 900s DONE 02:21:53 52775-103427 4046 A: AB(43) B: 900s DONE 02:49:49 52776-103427 4047 A: AB(43) B: 900s DONE Commissioning 03:10:32 36200-21161 4048 B: 900s 03:34:28 36196-21157 4049 B: 900s 03:58:50 36197-21158 4050 B: 900s 04:22:39 36200-21161 4051 B: 900s Notes - dust collected: ~ 16K - Grafana did not show GFA temperature plots at the beginning of the night. Started showing as it should at 2:00Z, through the end of the night. We did not find a reason for the late start. - At the beginning of the night the APO weather page was shown with two blue links at the bottom (to color coding explanation and to Cyclope seeing monitor), but in an hour both links disappeared. http://weather.apo.nmsu.edu/cgi-bin/weather.py Update: at 4:40Z those links appeared again to the status page, seen from all computers at the same time. ---- Engineering Issues ---- None ---- Observing Log ---- 22:25Z Clear, but some lingering clouds on site 22:38:55 OBSERVER.holtz: we decided to implement a small adjustment to the scale used to position the robots. This will require a restart of jaeger, so can you please do that before starting tonight? If for any reason things seem to be worse with this, it's easy to change the parameter back. 22:41Z Jaeger actor restarted due to request from Holtz: AFTERNOON CHECKOUT: =================== 23:13Z Started apogee evening cals. grabbed mirror numbers - ok; BOSS spectrograph cals: 23:22:50 boss exposure 0.0, file=339023 23:24:23 boss exposure 20.0, file=339024 Hartmann: 23:26:27 boss exposure 4.0, file=339025 23:27:08 boss exposure 4.0, file=339026 23:27:52 sp1.motor.move= -1435, -1435, -1435 23:27:52 Hartmann collimate output sp1: offset: r= -1649 (Out of focus); b= 3.8 (In Focus) sp1: pred. move: spAverageMove= -1435 sp1: pred. resid: r= -214, b= -0.7, txt= OK, spTemp = 4.2 otorPosition sp1: -4729, -4578, -5966; ---------- Median spectrographs temperatures: Tsp1= 4.3 Outside air temperature= 4.3; Blue ring not adjusted, it is in spec. Cals: 23:29:12 boss exposure 4.0, file=339027 23:33:06 boss exposure 25.0, file=339028 00:10Z Ventilation begins 00:20Z Telescope ready. evening cals done 00:28:03 CmdStarted: OBSERVER.karen 98 jaeger unwind --status 00:28:03 OBSERVER.karen 98 jaeger > 00:28:03 OBSERVER.karen 98 jaeger i folded=T 00:28:03 OBSERVER.karen 98 jaeger : text="All positioners are folded." 00:28:03 CmdDone: OBSERVER.karen 98 jaeger unwind --status FPS is ready. NIGHT: ====== 01:20Z enclosure open The seeing was not stable and over 2", so we decided to start with science fields. ======== 01:44:45 Config Loaded: 52792-4045 01:55:47 Hartmann collimate output sp1: offset: r= 4288 (Out of focus); b= -11.3 (Out of focus) sp1: pred. move: spAverageMove= 3943 sp1: pred. resid: r= 344, b= 1.1, txt= OK, spTemp = 3.0 01:56:15 APO.apo.jaeger 6791 jaeger i text="[FVC]: RMS full fit 47.850 um." 01:56:56 APO.apo.jaeger 6791 jaeger i text="[FVC]: RMS full fit 15.240 um." 01:56:56 APO.apo.jaeger 6791 jaeger i fvc_perc_90=24.3 2:05:28 apogee.expose=apRaw-40940013, 43, A, Object 02:05:35 boss exposure 900.0, file=339033 02:13:09 apogee.expose=apRaw-40940014, 43, B, Object DONE ======== 02:21:53 Config Loaded: 52775-4046 02:25:36 Hartmann collimate output sp1: offset: r= 1649 (Out of focus); b= 2.8 (In Focus) sp1: pred. move: spAverageMove= 375 sp1: pred. resid: r= 1274, b= 4.0, txt= OK, spTemp = 2.3 02:26:20 APO.apo.jaeger 6822 jaeger i text="[FVC]: RMS full fit 46.180 um." 02:27:01 APO.apo.jaeger 6822 jaeger i text="[FVC]: RMS full fit 29.850 um." 02:27:01 APO.apo.jaeger 6822 jaeger i fvc_perc_90=24.8 02:30:34 boss exposure 900.0, file=339038 02:30:34 apogee.expose=apRaw-40940015, 43, A, Object 02:38:15 apogee.expose=apRaw-40940016, 43, B, Object DONE ======== 02:49:49 Config Loaded: 52776-4047 02:52:10 APO.apo.jaeger 6850 jaeger i text="[FVC]: RMS full fit 49.850 um." 02:52:50 APO.apo.jaeger 6850 jaeger i text="[FVC]: RMS full fit 21.580 um." 02:52:50 APO.apo.jaeger 6850 jaeger i fvc_perc_90=25.6 02:55:10 boss exposure 900.0, file=339039 02:55:11 apogee.expose=apRaw-40940017, 43, A, Object 03:02:52 apogee.expose=apRaw-40940018, 43, B, Object DONE Now the seeing is much better than at the beginning, so we start observing commissioning designs, according to the science plans. The seeing is between 1.4" and 1.6" for the commissioning exposures below (with a few very short spikes up to 2"). ======== 03:10:32 Config Loaded: 36200-4048 03:13:12 APO.apo.jaeger 6876 jaeger i text="[FVC]: RMS full fit 47.200 um." 03:13:51 APO.apo.jaeger 6876 jaeger i text="[FVC]: RMS full fit 14.890 um." 03:13:51 APO.apo.jaeger 6876 jaeger i fvc_perc_90=23.5 03:19:10 boss exposure 900.0, file=339042 ======== 03:34:28 Config Loaded: 36196-4049 03:37:01 APO.apo.jaeger 6904 jaeger i text="[FVC]: RMS full fit 47.830 um." 03:37:39 APO.apo.jaeger 6904 jaeger i text="[FVC]: RMS full fit 14.780 um." 03:37:39 APO.apo.jaeger 6904 jaeger i fvc_perc_90=24.0 03:43:24 boss exposure 900.0, file=339045 ======== 03:58:50 Config Loaded: 36197-4050 04:01:24 APO.apo.jaeger 6932 jaeger i text="[FVC]: RMS full fit 54.350 um." 04:02:04 APO.apo.jaeger 6932 jaeger i text="[FVC]: RMS full fit 15.160 um." 04:02:05 APO.apo.jaeger 6932 jaeger i fvc_perc_90=24.1 04:07:22 boss exposure 900.0, file=339048 ======== 04:22:39 Config Loaded: 36200-4051 04:25:02 APO.apo.jaeger 6960 jaeger i text="[FVC]: RMS full fit 49.650 um." 04:25:42 APO.apo.jaeger 6960 jaeger i text="[FVC]: RMS full fit 14.850 um." 04:25:42 APO.apo.jaeger 6960 jaeger i fvc_perc_90=25.5 04:30:56 boss exposure 900.0, file=339051 ~ 04:39Z the dust count hits 10K limit and climbs up. We decided to close. El Paso lights are not seen behind the dust, and Holloman lights are barely seen. 04:49Z enclosure closed. Ventilation stopped. The rest of the night was lost to very high dust counts. 11:20Z gave up. Started APOGEE morning calibrations. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0030 0.0040 Axial B: 0.0000 0.0030 Axial C: -0.1120 -0.1150 Trans D: -0.0341 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5350 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 4.67 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: -9.6680 -9.6710 Axial C: -9.6960 -9.6970 Trans D: 0.1050 0.1140 GALILS Commanded: 4892100 4891000 4915150 0 -3400 Actual: 4859205 4859211 4859211 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.0 0.01 0.0 0.0 41.64 ---- Telescope Status ---- 00:10Z Started ventilation 01:20Z encl25m : open 04:49Z encl25m : closed No interlocks bypassed Status at: 11:23Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: Instrument = FPS Counterweights at: 685 686 704 703 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 148 lbs, 21 psi FPS Status ========== CP10 Loop = 6.32 L/min GFA Loop = 2.32 L/min Supply pressure = 43.7 psi Return pressure = 22.9 psi Chiller Status ============== Set temperarature = 1.0 C Flow = 2.7 Gpm ---- Software Used ---- Get Versions, 03/17/22, 23:10:38 -- STUI software: STUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 guider : FAILED ecamera : FAILED apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.14.1-alpha.0 kaiju : 1.2.2-alpha.1 coordio : 1.2.2-alpha.1 fps_calibrati : APO.2021.12.25+960cb05 cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : FAILED STUIAdditions : 3.1.12 -- done -- --------------Other Versions-------------- sdss-obstools : 3.7.10 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V34 Fiducials : v1_148 idlspec2d : v6_0_5 Kronos : 1.1.2a roboscheduler : 1.1.1a /dev/sdb1 2.0T 166G 1.9T 9% /home 10.25.1.230:/data 21T 17T 4.0T 81% /data ---- APOGEE Data Summary ---- APOGEE data list, mjd=59656, all raw_data: /data/apogee/utr_cdr/59656/apRaw-*.fits archive: /data/apogee/archive/59656/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59656/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59656 1 23:11 40940001 Dark 3 A 13.0 ---------- a-b-c - - 59656 2 23:23 40940002 Dark 60 A 13.0 ---------- a-b-c - - 59656 3 23:25 40940003 QuarFlat 10 A 13.0 ---------- a-b-c - 100 59656 4 23:27 40940004 Arc-Thar 12 B 13.5 ---------- a-b-c 1.92 - 59656 5 23:34 40940005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59656 6 23:37 40940006 Arc-Thar 12 A 13.0 ---------- a-b-c 1.53 - 59656 7 23:44 40940007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59656 8 23:55 40940008 Dark 60 A 13.0 ---------- a-b-c - - 59656 9 00:00 40940009 Arc---- 30 A 13.0 ---------- a-b-c - - FPI 59656 10 01:46 40940010 DomeFlat 5 A 13.0 52792-4045 a-b-c - 131 59656 11 01:48 40940011 DomeFlat 5 A 13.0 52792-4045 a-b-c - 135 59656 12 01:51 40940012 DomeFlat 5 A 13.0 52792-4045 a-b-c - 137 59656 13 02:12 40940013 Object 43 A 13.0 52792-4045 a-b-c 1.42 - 59656 14 02:20 40940014 Object 43 B 13.5 52792-4045 a-b-c 1.93 - 59656 15 02:37 40940015 Object 43 A 13.0 52775-4046 a-b-c 1.41 - 59656 16 02:45 40940016 Object 43 B 13.5 52775-4046 a-b-c 1.93 - 59656 17 03:02 40940017 Object 43 A 13.0 52776-4047 a-b-c 1.41 - 59656 18 03:10 40940018 Object 43 B 13.5 52776-4047 a-b-c 1.93 - cannot read file : /data/apogee/utr_cdr/59656/apRaw-40940019.fits ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59656 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:22 r1-00339023 ----------- ---- bia Clo 0.0 -3294 -3143 -4531 2 23:22 b1-00339023 ----------- ---- bia Clo 0.0 -3294 -3143 -4531 3 23:24 b1-00339024 ----------- ---- dar Clo 20.0 -3294 -3143 -4531 4 23:24 r1-00339024 ----------- ---- dar Clo 20.0 -3294 -3143 -4531 5 23:26 b1-00339025 46819-101806 4044 arc Lef 4.1 -3294 -3143 -4531 HART 6 23:26 r1-00339025 46819-101806 4044 arc Lef 4.1 -3294 -3143 -4531 HART 7 23:27 b1-00339026 46819-101806 4044 arc Rig 4.1 -3294 -3143 -4531 HART 8 23:27 r1-00339026 46819-101806 4044 arc Rig 4.1 -3294 -3143 -4531 HART 9 23:29 b1-00339027 46819-101806 4044 arc Out 4.1 -4729 -4578 -5966 10 23:29 r1-00339027 46819-101806 4044 arc Out 4.1 -4729 -4578 -5966 11 23:33 b1-00339028 46819-101806 4044 fla Out 25.1 -4729 -4578 -5966 12 23:33 r1-00339028 46819-101806 4044 fla Out 25.1 -4729 -4578 -5966 13 01:54 r1-00339029 52792-103429 4045 arc Lef 4.1 -4729 -4578 -5966 HART 14 01:54 b1-00339029 52792-103429 4045 arc Lef 4.1 -4729 -4578 -5966 HART 15 01:54 b1-00339030 52792-103429 4045 arc Rig 4.1 -4729 -4578 -5966 HART 16 01:54 r1-00339030 52792-103429 4045 arc Rig 4.1 -4729 -4578 -5966 HART 17 01:56 b1-00339031 52792-103429 4045 arc Out 4.1 -786 -635 -2024 18 01:56 r1-00339031 52792-103429 4045 arc Out 4.1 -786 -635 -2024 19 01:57 b1-00339032 52792-103429 4045 fla Out 25.1 -786 -635 -2024 20 01:57 r1-00339032 52792-103429 4045 fla Out 25.1 -786 -635 -2024 21 02:05 b1-00339033 52792-103429 4045 sci Out 900.1 -786 -635 -2024 22 02:05 r1-00339033 52792-103429 4045 sci Out 900.1 -786 -635 -2024 23 02:24 r1-00339034 52775-103427 4046 arc Lef 4.1 -786 -635 -2024 HART 24 02:24 b1-00339034 52775-103427 4046 arc Lef 4.1 -786 -635 -2024 HART 25 02:24 b1-00339035 52775-103427 4046 arc Rig 4.1 -786 -635 -2024 HART 26 02:24 r1-00339035 52775-103427 4046 arc Rig 4.1 -786 -635 -2024 HART 27 02:25 r1-00339036 52775-103427 4046 arc Out 4.1 -412 -261 -1649 28 02:25 b1-00339036 52775-103427 4046 arc Out 4.1 -412 -261 -1649 29 02:27 r1-00339037 52775-103427 4046 fla Out 25.1 -412 -261 -1649 30 02:27 b1-00339037 52775-103427 4046 fla Out 25.1 -412 -261 -1649 31 02:30 r1-00339038 52775-103427 4046 sci Out 900.1 -412 -261 -1649 32 02:30 b1-00339038 52775-103427 4046 sci Out 900.1 -412 -261 -1649 33 02:55 r1-00339039 52776-103427 4047 sci Out 900.1 -412 -261 -1649 34 02:55 b1-00339039 52776-103427 4047 sci Out 900.1 -412 -261 -1649 35 03:15 b1-00339040 36200-21161 4048 arc Out 4.1 -412 -261 -1649 36 03:15 r1-00339040 36200-21161 4048 arc Out 4.1 -412 -261 -1649 37 03:16 r1-00339041 36200-21161 4048 fla Out 25.1 -412 -261 -1649 38 03:16 b1-00339041 36200-21161 4048 fla Out 25.1 -412 -261 -1649 39 03:19 b1-00339042 36200-21161 4048 sci Out 900.1 -412 -261 -1649 40 03:19 r1-00339042 36200-21161 4048 sci Out 900.1 -412 -261 -1649 41 03:38 r1-00339043 36196-21157 4049 arc Out 4.1 -412 -261 -1649 42 03:38 b1-00339043 36196-21157 4049 arc Out 4.1 -412 -261 -1649 43 03:40 r1-00339044 36196-21157 4049 fla Out 25.1 -412 -261 -1649 44 03:40 b1-00339044 36196-21157 4049 fla Out 25.1 -412 -261 -1649 45 03:43 r1-00339045 36196-21157 4049 sci Out 900.1 -412 -261 -1649 46 03:43 b1-00339045 36196-21157 4049 sci Out 900.1 -412 -261 -1649 47 04:03 r1-00339046 36197-21158 4050 arc Out 4.1 -412 -261 -1649 48 04:03 b1-00339046 36197-21158 4050 arc Out 4.1 -412 -261 -1649 49 04:04 r1-00339047 36197-21158 4050 fla Out 25.1 -412 -261 -1649 50 04:04 b1-00339047 36197-21158 4050 fla Out 25.1 -412 -261 -1649 51 04:07 r1-00339048 36197-21158 4050 sci Out 900.0 -412 -261 -1649 52 04:07 b1-00339048 36197-21158 4050 sci Out 900.0 -412 -261 -1649 53 04:26 r1-00339049 36200-21161 4051 arc Out 4.1 -412 -261 -1649 54 04:26 b1-00339049 36200-21161 4051 arc Out 4.1 -412 -261 -1649 55 04:28 b1-00339050 36200-21161 4051 fla Out 25.1 -412 -261 -1649 56 04:28 r1-00339050 36200-21161 4051 fla Out 25.1 -412 -261 -1649 57 04:30 b1-00339051 36200-21161 4051 sci Out 900.0 -412 -261 -1649 58 04:30 r1-00339051 36200-21161 4051 sci Out 900.0 -412 -261 -1649 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 23:27:40 3.7 -1649 3.8 -1435 -0.7 01:55:30 2.5 4288 -11.3 3943 1.1 02:25:30 2.1 1649 2.8 375 4.0