Subject: 2.5m obslog 20220517 (SJD 59717) From: asimmons@apo.nmsu.edu Date: Wed, 18 May 2022 10:08:53 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday May 17, 2022 (SJD 59717) ---- Observing Team ---- Katie Grabowski Audrey Oravetz Jose Sanchez-Gallego (support for the 3.5m) ---- Observing Plan ---- Please observe from the queue until about 11:00 local. After that, complete BOSS telescope dithers on 36004, 111265, 111269. Note that we are going to configure that at the observed position. ---- Observing Summary ---- Clear. A heavy smoke event occurred at 09:00Z, which caused us to close for the remainder of the night. We turned on the HVAC system to create the positive pressure difference and left it on at the end of the night. Observed: --------- Time field-dsgn-conf Design type BOSS/APOGEE exp complete? Comment =========================================================================== 02:23:49 101164-42965-5378 bright_8x2_v1 1XAB + 1x900 DONE 03:16:17 101160-42868-5381 bright_8x4_v1 1XAB + 1x900 DONE, VOoR*, disabled 1201 03:37:12 101160-42869-5382 bright_8x4_v1 1XAB + 1x900 DONE 04:05:22 101160-42870-5383 bright_8x4_v1 1XAB + 1x900 DONE 04:28:49 101160-42871-5384 bright_8x4_v1 1XAB + 1x900 DONE BOSS DITHER FIELDS: ------------------- 04:51:00 20973-36004-5385 12 points 06:46:49 21478-111265-5391 12 points NOTES: ====== *VOoR - "VALUE_OUT_OF_RANGE" error We had, what resembled a netburner error at the very start of the night, but the daq was responsive. Only the readout timed out. Reloading the controllers twice solved the problem. Robot 1340 was disabled for the entire night. Dust counts were around 15,000. ---- Engineering Issues ---- We turned on the HVAC system to create the positive pressure difference and left it on at the end of the night. ---- Observing Log ---- Afternoon: ========== All systems alive and responsive. 23:57Z- Started APOGEE cals 23:57:33 boss exposure 0.0, file=341937 23:59:28 boss exposure 20.0, file=341938 00:01:27 boss exposure 4.0, file=341939 00:02:08 boss exposure 4.0, file=341940 00:02:49 sp1.motor.move= -306, -306, -305 00:02:49 Hartmann collimate output sp1: offset: r= -1319 (Out of focus); b= -2.2 (In Focus) sp1: pred. move: spAverageMove= -306 sp1: pred. resid: r= -1013, b= -3.2, txt= OK, spTemp = 10.5 Did not adjust blue ring. 00:03:21 boss exposure 4.0, file=341941 00:04:54 boss exposure 25.0, file=341942 00:51:47 Config Loaded: -999--999-5377 Started an FVC loop --no-apply, but there was no output. Tried to start another one, but the previous command didn't finish. Did jaeger fvc loop --stop, started a new one with no further problems. 01:15:10 OBSERVER.kgrabow 107 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0001.fits 01:15:17 OBSERVER.kgrabow 107 jaeger i fvc_rms=38.39 01:15:17 OBSERVER.kgrabow 107 jaeger i fvc_perc_90=61.699999999999996 01:15:17 OBSERVER.kgrabow 107 jaeger i fvc_percent_reached=2.6 ---------- motorPosition sp1: 4041, 4181, 2807; ---------- Median spectrographs temperatures: Tsp1= 10.4 Outside air temperature= 16.9; ---------- Boss CCD Temp : sp1r0= -124.2 (-126.6); sp1b2= -99.6 (-100.0); sp1LN2: 10.0; ---------- 01:30Z- Started ventilation. Night: ======= 02:32:16 hal.hal 486 hartmann e text="Failed to take right hartmann exposure"; UNPARSEDTEXT="\"" 02:32:16 hal.hal 486 hartmann i status="idle" 02:32:16 hal.hal 486 hartmann f text="collimation process failed" 02:32:16 CmdDone: hal.hal 486 hartmann collimate ignoreResiduals 02:32:16 OBSERVER.kg 27 hal e error="Command hartmann collimate ignoreResiduals failed." 02:32:33 client.v3331.hartmann 29 boss e text="Readout timeout expired, aborting exposure." 02:32:49 CmdDone: OBSERVER.kgrabow 113 boss clearExposure 02:33:48 CmdStarted: OBSERVER.kgrabow 116 boss ping 02:33:48 OBSERVER.kgrabow 116 boss i text="sp1daq: OK" 02:33:48 OBSERVER.kgrabow 116 boss i text="sp1cam: OK" 02:33:48 OBSERVER.kgrabow 116 boss i text="Response parsed." 02:33:48 OBSERVER.kgrabow 116 boss i text="sp1mech: OK" 02:33:48 OBSERVER.kgrabow 116 boss : 02:33:48 CmdDone: OBSERVER.kgrabow 116 boss ping 02:33:09 CmdStarted: OBSERVER.kgrabow 114 boss reload controllers 02:35:37 OBSERVER.kgrabow 117 boss e text="sp1daq readout failed: timed out (>)." Repeated the recovery procedure for netburner, and it worked. 02:16:04 apogee.expose=apRaw-41550010, 5, A, DomeFlat 02:20:46 apogee.expose=apRaw-41550011, 5, A, DomeFlat 02:23:04 apogee.expose=apRaw-41550012, 5, A, DomeFlat === 02:23:49 Config Loaded: 101164-42965-5378 02:39:39 boss exposure 4.0, file=341947 02:40:19 boss exposure 4.0, file=341948 02:41:00 sp1.motor.move= 839, 842, 841 02:41:00 Hartmann collimate output sp1: offset: r= 329 (In Focus); b= -4.2 (Out of focus) sp1: pred. move: spAverageMove= 839 sp1: pred. resid: r= -510, b= -1.6, txt= OK, spTemp = 9.3 02:41:20 boss exposure 4.0, file=341949 02:42:55 boss exposure 25.0, file=341950 02:41:03 hal.hal 498 jaeger i text="FVC iteration 1" 02:41:24 hal.hal 498 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0002.fits 02:41:30 hal.hal 498 jaeger i fvc_rms=44.99 02:41:30 hal.hal 498 jaeger i fvc_perc_90=58.2 02:41:31 hal.hal 498 jaeger i fvc_percent_reached=3.5 02:41:46 hal.hal 498 jaeger i text="FVC iteration 2" 02:42:06 hal.hal 498 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0003.fits 02:42:13 hal.hal 498 jaeger i fvc_rms=8.41 02:42:13 hal.hal 498 jaeger i fvc_deltarms=36.58 02:42:13 hal.hal 498 jaeger i fvc_perc_90=9.0 02:42:13 hal.hal 498 jaeger i fvc_percent_reached=63.1 02:47:17 New-field overhead: 16:17:14 02:47:39 apogee.expose=apRaw-41550013, 43, A, Object 02:47:46 boss exposure 900.0, file=341951 02:55:20 apogee.expose=apRaw-41550014, 43, B, Object === 03:03:54 Config Loaded: 101160-42868-5379 03:04:35 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=9240 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:10:35 hal.hal 540 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 03:07:53 Config Loaded: 101160-42869-5380 03:04:35 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=9240 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:10:35 hal.hal 540 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" disabled robot 1201 ==== 03:16:17 Config Loaded: 101160-42868-5381 03:18:42 boss exposure 4.0, file=341952 03:20:14 boss exposure 25.0, file=341953 03:17:20 hal.hal 553 jaeger i text="FVC iteration 1" 03:17:40 hal.hal 553 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0004.fits 03:17:47 hal.hal 553 jaeger i fvc_rms=45.13 03:17:47 hal.hal 553 jaeger i fvc_perc_90=55.800000000000004 03:17:47 hal.hal 553 jaeger i fvc_percent_reached=3.1 03:18:03 hal.hal 553 jaeger i text="FVC iteration 2" 03:18:24 hal.hal 553 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0005.fits 03:18:30 hal.hal 553 jaeger i fvc_rms=36.06 03:18:30 hal.hal 553 jaeger i fvc_deltarms=9.07 03:18:30 hal.hal 553 jaeger i fvc_perc_90=9.6 03:18:30 hal.hal 553 jaeger i fvc_percent_reached=51.6 03:22:57 New-field overhead: 0:19:07 03:23:19 apogee.expose=apRaw-41550015, 43, B, Object 03:23:26 boss exposure 900.0, file=341954 03:31:05 apogee.expose=apRaw-41550016, 43, A, Object === 03:37:12 Config Loaded: 101160-42869-5382 03:42:21 boss exposure 4.0, file=341955 03:43:53 boss exposure 25.0, file=341956 03:41:43 hal.hal 587 jaeger i text="FVC iteration 1" 03:42:02 hal.hal 587 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0006.fits 03:42:09 hal.hal 587 jaeger i fvc_rms=41.43 03:42:09 hal.hal 587 jaeger i fvc_perc_90=53.0 03:42:09 hal.hal 587 jaeger i fvc_percent_reached=3.5 03:42:24 hal.hal 587 jaeger i text="FVC iteration 2" 03:42:43 hal.hal 587 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0007.fits 03:42:50 hal.hal 587 jaeger i fvc_rms=44.03 03:42:50 hal.hal 587 jaeger i fvc_deltarms=-2.6000000000000014 03:42:50 hal.hal 587 jaeger i fvc_perc_90=9.6 03:42:50 hal.hal 587 jaeger i fvc_percent_reached=54.7 03:49:25 Same-field overhead: 0:09:54 03:49:47 apogee.expose=apRaw-41550017, 43, A, Object 03:49:53 boss exposure 900.0, file=341957 03:57:28 apogee.expose=apRaw-41550018, 43, B, Object === 04:05:22 Config Loaded: 101160-42870-5383 04:07:15 hal.hal 622 jaeger i text="FVC iteration 1" 04:07:35 hal.hal 622 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0008.fits 04:07:43 hal.hal 622 jaeger i fvc_rms=41.45 04:07:43 hal.hal 622 jaeger i fvc_perc_90=62.6 04:07:43 hal.hal 622 jaeger i fvc_percent_reached=2.5 04:07:59 hal.hal 622 jaeger i text="FVC iteration 2" 04:08:19 hal.hal 622 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0009.fits 04:08:26 hal.hal 622 jaeger i fvc_rms=8.16 04:08:26 hal.hal 622 jaeger i fvc_deltarms=33.290000000000006 04:08:26 hal.hal 622 jaeger i fvc_perc_90=9.700000000000001 04:08:26 hal.hal 622 jaeger i fvc_percent_reached=54.8 04:12:16 Same-field overhead: 0:06:17 04:12:38 apogee.expose=apRaw-41550019, 43, B, Object 04:12:45 boss exposure 900.0, file=341958 04:20:24 apogee.expose=apRaw-41550020, 43, A, Object === 04:28:49 Config Loaded: 101160-42871-5384 04:30:44 hal.hal 647 jaeger i text="FVC iteration 1" 04:31:04 hal.hal 647 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0010.fits 04:31:11 hal.hal 647 jaeger i fvc_rms=40.33 04:31:11 hal.hal 647 jaeger i fvc_perc_90=57.0 04:31:11 hal.hal 647 jaeger i fvc_percent_reached=2.9 04:31:27 hal.hal 647 jaeger i text="FVC iteration 2" 04:31:47 hal.hal 647 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0011.fits 04:31:54 hal.hal 647 jaeger i fvc_rms=6.14 04:31:54 hal.hal 647 jaeger i fvc_deltarms=34.19 04:31:54 hal.hal 647 jaeger i fvc_perc_90=9.1 04:31:54 hal.hal 647 jaeger i fvc_percent_reached=58.7 04:34:05 Same-field overhead: 0:05:16 04:34:27 apogee.expose=apRaw-41550021, 43, A, Object 04:34:34 boss exposure 900.0, file=341959 04:42:08 apogee.expose=apRaw-41550022, 43, B, Object === Seeing 1.7", clear jaeger configuration load --no-clone --epoch-delay 2500 36004 04:59:21 Config Loaded: 20973-36004-5389 jaeger configuration slew Execute the design (can be done while slewing): jaeger configuration execute Halt the rotator: tcc axis stop rot Dither the robots: jaeger configuration dither 0.03 Corrective fvc loop: jaeger fvc loop --max-iterations 4 --target-90-percentile 10 04:59:48 CmdStarted: OBSERVER.kgrabow 148 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 04:59:48 OBSERVER.kgrabow 148 jaeger i text="FVC iteration 1" 05:00:08 OBSERVER.kgrabow 148 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0012.fits 05:00:15 OBSERVER.kgrabow 148 jaeger i fvc_rms=44.94 05:00:15 OBSERVER.kgrabow 148 jaeger i fvc_perc_90=62.1 05:00:15 OBSERVER.kgrabow 148 jaeger i fvc_percent_reached=3.3 05:00:31 OBSERVER.kgrabow 148 jaeger i text="FVC iteration 2" 05:00:51 OBSERVER.kgrabow 148 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0013.fits 05:00:58 OBSERVER.kgrabow 148 jaeger i fvc_rms=8.63 05:00:58 OBSERVER.kgrabow 148 jaeger i fvc_deltarms=36.309999999999995 05:00:58 OBSERVER.kgrabow 148 jaeger i fvc_perc_90=9.1 05:00:58 OBSERVER.kgrabow 148 jaeger i fvc_percent_reached=62.4 05:01:14 CmdDone: OBSERVER.kgrabow 148 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 cherno offset ( no arguments, which is equivalent to 0 0 0, just to make sure that offsets are cleared) 05:01:21 CmdStarted: OBSERVER.kgrabow 149 cherno offset DO hartmanns and boss cals for BOSS dither fields 05:01:55 boss exposure 4.0, file=341960 05:02:36 boss exposure 4.0, file=341961 05:03:18 sp1.motor.move= -1270, -1269, -1270 05:03:18 Hartmann collimate output sp1: offset: r= -1319 (Out of focus); b= 3.8 (In Focus) sp1: pred. move: spAverageMove= -1270 sp1: pred. resid: r= -49, b= -0.2, txt= OK, spTemp = 9.1 05:03:37 boss exposure 4.0, file=341962 05:05:09 boss exposure 25.0, file=341963 Once guiding stabilizes, expose BOSS for 300s 05:08:29 boss exposure 300.0, file=341964 Now do the 12x telescope dithers cherno offset dra ddec 0 ( where dra ddec are from chernoDither command) 05:14:33 CmdStarted: OBSERVER.kgrabow 151 cherno offset 0.11 -1.41 0 05:15:32 boss exposure 300.0, file=341965 05:21:36 CmdStarted: OBSERVER.kgrabow 153 cherno offset 0.56 0.14 0 05:22:34 boss exposure 300.0, file=341966 05:28:38 CmdStarted: OBSERVER.kgrabow 155 cherno offset -0.04 0.65 0 05:29:37 boss exposure 300.0, file=341967 05:35:40 CmdStarted: OBSERVER.kgrabow 157 cherno offset -0.55 -0.17 0 05:36:39 boss exposure 300.0, file=341968 05:42:43 CmdStarted: OBSERVER.kgrabow 159 cherno offset 1.36 -0.26 0 05:43:41 boss exposure 300.0, file=341969 05:49:45 CmdStarted: OBSERVER.kgrabow 161 cherno offset -0.36 -0.43 0 05:50:44 boss exposure 300.0, file=341970 05:56:48 CmdStarted: OBSERVER.kgrabow 163 cherno offset -0.72 -0.88 0 05:57:47 boss exposure 300.0, file=341971 06:03:51 CmdStarted: OBSERVER.kgrabow 165 cherno offset -1.35 0.42 0 06:04:50 boss exposure 300.0, file=341972 06:10:53 CmdStarted: OBSERVER.kgrabow 167 cherno offset 0.48 -1.20 0 06:11:52 boss exposure 300.0, file=341973 06:17:56 CmdStarted: OBSERVER.kgrabow 169 cherno offset 0.82 1.05 0 06:18:55 boss exposure 300.0, file=341974 06:25:02 CmdStarted: OBSERVER.kgrabow 171 cherno offset -0.29 -0.28 0 06:26:08 boss exposure 300.0, file=341975 06:32:12 CmdStarted: OBSERVER.kgrabow 173 cherno offset -0.70 -0.72 0 06:33:11 boss exposure 300.0, file=341976 cherno offset ( no arguments, which is equivalent to 0 0 0) jaeger configuration reverse jaeger configuration reverse === 06:43:05 CmdStarted: OBSERVER.kgrabow 181 jaeger configuration load --no-clone --epoch-delay 2500 111265 06:46:49 Config Loaded: 21478-111265-5391 jaeger configuration slew Execute the design (can be done while slewing): jaeger configuration execute Halt the rotator: tcc axis stop rot Dither the robots: jaeger configuration dither 0.03 Corrective fvc loop: jaeger fvc loop --max-iterations 4 --target-90-percentile 10 06:48:03 CmdStarted: OBSERVER.kgrabow 188 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 06:48:03 OBSERVER.kgrabow 188 jaeger i text="FVC iteration 1" 06:48:23 OBSERVER.kgrabow 188 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0014.fits 06:48:30 OBSERVER.kgrabow 188 jaeger i fvc_rms=39.04 06:48:30 OBSERVER.kgrabow 188 jaeger i fvc_perc_90=55.4 06:48:30 OBSERVER.kgrabow 188 jaeger i fvc_percent_reached=2.0 06:48:46 OBSERVER.kgrabow 188 jaeger i text="FVC iteration 2" 06:49:06 OBSERVER.kgrabow 188 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0015.fits 06:49:12 OBSERVER.kgrabow 188 jaeger i fvc_rms=6.33 06:49:12 OBSERVER.kgrabow 188 jaeger i fvc_deltarms=32.71 06:49:12 OBSERVER.kgrabow 188 jaeger i fvc_perc_90=9.2 06:49:12 OBSERVER.kgrabow 188 jaeger i fvc_percent_reached=55.3 06:49:28 CmdDone: OBSERVER.kgrabow 188 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 06:50:41 boss exposure 4.0, file=341977 06:51:22 boss exposure 4.0, file=341978 06:52:03 sp1.motor.move= -462, -463, -466 06:52:03 Hartmann collimate output sp1: offset: r= -989 (In Focus); b= -0.2 (In Focus) sp1: pred. move: spAverageMove= -462 sp1: pred. resid: r= -526, b= -1.7, txt= OK, spTemp = 8.9 06:52:22 boss exposure 4.0, file=341979 06:53:54 boss exposure 25.0, file=341980 06:56:54 CmdStarted: OBSERVER.kgrabow 190 cherno offset Once guiding stabilizes, expose BOSS for 300s 06:57:13 boss exposure 300.0, file=341981 Now do the 12x telescope dithers cherno offset dra ddec 0 ( where dra ddec are from chernoDither command) 07:03:17 CmdStarted: OBSERVER.kgrabow 192 cherno offset 0.25 0.13 0 07:04:16 boss exposure 300.0, file=341982 07:10:20 CmdStarted: OBSERVER.kgrabow 194 cherno offset 0.81 -0.33 0 07:11:21 boss exposure 300.0, file=341983 07:17:25 CmdStarted: OBSERVER.kgrabow 196 cherno offset 0.38 0.70 0 07:18:24 boss exposure 300.0, file=341984 07:24:28 CmdStarted: OBSERVER.kgrabow 198 cherno offset 0.03 -0.06 0 07:25:27 boss exposure 300.0, file=341985 07:31:31 CmdStarted: OBSERVER.kgrabow 200 cherno offset 0.57 0.02 0 07:32:30 boss exposure 300.0, file=341986 07:38:34 CmdStarted: OBSERVER.kgrabow 202 cherno offset 0.05 0.74 0 07:39:33 boss exposure 300.0, file=341987 07:45:36 CmdStarted: OBSERVER.kgrabow 204 cherno offset 0.45 -0.23 0 07:46:35 boss exposure 300.0, file=341988 07:52:39 CmdStarted: OBSERVER.kgrabow 206 cherno offset -1.34 -0.36 0 07:53:38 boss exposure 300.0, file=341989 07:59:42 CmdStarted: OBSERVER.kgrabow 208 cherno offset 0.64 0.55 0 08:00:40 boss exposure 300.0, file=341990 08:06:44 CmdStarted: OBSERVER.kgrabow 210 cherno offset 0.20 -0.55 0 08:07:43 boss exposure 300.0, file=341991 08:13:47 CmdStarted: OBSERVER.kgrabow 212 cherno offset 1.02 -1.03 0 08:14:46 boss exposure 300.0, file=341992 08:20:49 CmdStarted: OBSERVER.kgrabow 214 cherno offset 0.27 -1.41 0 08:21:48 boss exposure 300.0, file=341993 08:27:52 CmdStarted: OBSERVER.kgrabow 216 cherno offset jaeger configuration reverse jaeger configuration reverse === 08:31:51 CmdDone: OBSERVER.kgrabow 219 jaeger configuration load --no-clone --epoch-delay 2500 111269 08:34:59 Config Loaded: 21482-111269-5419 jaeger configuration slew Execute the design (can be done while slewing): jaeger configuration execute Halt the rotator: tcc axis stop rot Dither the robots: jaeger configuration dither 0.03 Corrective fvc loop: jaeger fvc loop --max-iterations 4 --target-90-percentile 10 08:35:14 CmdStarted: OBSERVER.kgrabow 225 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 08:35:14 OBSERVER.kgrabow 225 jaeger i text="FVC iteration 1" 08:35:34 OBSERVER.kgrabow 225 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0016.fits 08:35:41 OBSERVER.kgrabow 225 jaeger i fvc_rms=40.910000000000004 08:35:41 OBSERVER.kgrabow 225 jaeger i fvc_perc_90=56.7 08:35:41 OBSERVER.kgrabow 225 jaeger i fvc_percent_reached=1.5 08:35:57 OBSERVER.kgrabow 225 jaeger i text="FVC iteration 2" 08:36:17 OBSERVER.kgrabow 225 jaeger d fvc_filename=/data/fcam/59717/fimg-fvc1n-0017.fits 08:36:23 OBSERVER.kgrabow 225 jaeger i fvc_rms=11.26 08:36:23 OBSERVER.kgrabow 225 jaeger i fvc_deltarms=29.650000000000006 08:36:23 OBSERVER.kgrabow 225 jaeger i fvc_perc_90=8.7 08:36:23 OBSERVER.kgrabow 225 jaeger i fvc_percent_reached=62.8 08:36:39 CmdDone: OBSERVER.kgrabow 225 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 08:37:35 boss exposure 4.0, file=341994 08:38:15 boss exposure 4.0, file=341995 08:38:56 sp1.motor.move= -458, -463, -460 08:38:56 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= 0.8 (In Focus) sp1: pred. move: spAverageMove= -458 sp1: pred. resid: r= -201, b= -0.6, txt= OK, spTemp = 8.6 08:39:15 boss exposure 4.0, file=341996 08:40:47 boss exposure 25.0, file=341997 cherno offset 08:52:10 boss exposure 300.0, file=341998 Guiding was extremely poor. All the sudden, we got a major smoke spike. We finished the current exposure, took APOGEE dome flats, and then closed. 08:58:00 apogee.expose=apRaw-41550023, 5, B, DomeFlat 08:59:33 apogee.expose=apRaw-41550024, 5, B, DomeFlat 09:01:26 apogee.expose=apRaw-41550025, 5, B, DomeFlat 08:55Z - Closed enclosure and stopped ventilating. Started the HVAC positive pressure differential of 0.5 to try to keep the smoke out of the enclosure. There is not enough time left in the night to continue observing, even if the smoke went away. We started the morning cals and turned off the FPS. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0100 0.0040 Axial B: 0.0080 0.0030 Axial C: -0.1230 -0.1150 Trans D: -0.0329 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 19.83 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6560 -9.6570 Axial B: -9.6670 -9.6710 Axial C: -9.7000 -9.6970 Trans D: 0.1130 0.1140 GALILS Commanded: 4879550 4872150 4901100 0 -3400 Actual: 4859249 4859117 4859079 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3856.95 0.03 -0.05 -0.04 41.62 ---- Telescope Status ---- 01:30Z Started ventilation 02:00Z encl25m : open 09:10Z encl25m : closed No interlocks bypassed Status at: 09:34Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 680/710 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 136 lbs, 22 psi ---- Software Used ---- -- STUI software: STUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.15.2-alpha.0 kaiju : 1.2.4-alpha.0 coordio : 1.4.0-alpha.0 fps_calibrati : APO.2022.04.21+c71bfb1 cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : FAILED STUIAdditions : 3.1.13 --------------Other Versions-------------- sdss-obstools : 3.7.14 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V34 Fiducials : v1_148 idlspec2d : v6_0_7 Kronos : 1.3.1a roboscheduler : 1.2.2a /dev/sdb1 2.0T 174G 1.9T 9% /home 10.25.1.230:/data 21T 18T 2.8T 87% /data ---- APOGEE Data Summary ---- APOGEE data list, mjd=59717, all raw_data: /data/apogee/utr_cdr/59717/apRaw-*.fits archive: /data/apogee/archive/59717/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59717/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 59717 1 23:55 41550001 Dark 3 A 13.0 ---------- a-b-c - - 59717 2 00:07 41550002 Dark 60 A 13.0 ---------- a-b-c - - 59717 3 00:09 41550003 QuarFlat 10 A 13.0 ---------- a-b-c - - 59717 4 00:11 41550004 Arc-Thar 12 B 13.5 ---------- a-b-c 0.94 - 59717 5 00:19 41550005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59717 6 00:21 41550006 Arc-Thar 12 A 13.0 ---------- a-b-c 0.52 - 59717 7 00:28 41550007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59717 8 00:39 41550008 Dark 60 A 13.0 ---------- a-b-c - - 59717 9 00:45 41550009 Arc---- 30 A 13.0 ---------- a-b-c - 96 FPI 59717 10 02:16 41550010 DomeFlat 5 A 13.0 -999-5377 a-b-c - 139 59717 11 02:21 41550011 DomeFlat 5 A 13.0 -999-5377 a-b-c - 138 59717 12 02:23 41550012 DomeFlat 5 A 13.0 -999-5377 a-b-c - 142 59717 13 02:54 41550013 Object 43 A 13.0 42965-5378 a-b-c 0.42 1,1 59717 14 03:02 41550014 Object 43 B 13.5 42965-5378 a-b-c 0.92 1,1 59717 15 03:30 41550015 Object 43 B 13.5 42868-5381 a-b-c 0.93 1,1 59717 16 03:38 41550016 Object 43 A 13.0 42869-5382 a-b-c 0.42 1,1 59717 17 03:57 41550017 Object 43 A 13.0 42869-5382 a-b-c 0.42 1,1 59717 18 04:04 41550018 Object 43 B 13.5 42869-5382 a-b-c 0.93 1,1 59717 19 04:19 41550019 Object 43 B 13.5 42870-5383 a-b-c 0.93 1,1 59717 20 04:27 41550020 Object 43 A 13.0 42870-5383 a-b-c 0.43 1,1 59717 21 04:41 41550021 Object 43 A 13.0 42871-5384 a-b-c 0.43 1,1 59717 22 04:49 41550022 Object 43 B 13.5 42871-5384 a-b-c 0.94 1,1 59717 23 08:58 41550023 DomeFlat 5 B 13.5 111269-5419 a-b-c - 136 59717 24 09:00 41550024 DomeFlat 5 B 13.5 111269-5419 a-b-c - 136 59717 25 09:01 41550025 DomeFlat 5 B 13.5 111269-5419 a-b-c - 135 ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59717 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:57 b1-00341937 ----------- ---- bia Clo 0.0 4347 4487 3112 2 23:57 r1-00341937 ----------- ---- bia Clo 0.0 4347 4487 3112 3 23:59 b1-00341938 ----------- ---- dar Clo 20.0 4347 4487 3112 4 23:59 r1-00341938 ----------- ---- dar Clo 20.0 4347 4487 3112 5 00:01 b1-00341939 39253-100538 5376 arc Lef 4.1 4347 4487 3112 HART 6 00:01 r1-00341939 39253-100538 5376 arc Lef 4.1 4347 4487 3112 HART 7 00:02 b1-00341940 39253-100538 5376 arc Rig 4.1 4347 4487 3112 HART 8 00:02 r1-00341940 39253-100538 5376 arc Rig 4.1 4347 4487 3112 HART 9 00:03 r1-00341941 39253-100538 5376 arc Out 4.1 4041 4181 2807 10 00:03 b1-00341941 39253-100538 5376 arc Out 4.1 4041 4181 2807 11 00:04 b1-00341942 39253-100538 5376 fla Out 25.1 4041 4181 2807 12 00:04 r1-00341942 39253-100538 5376 fla Out 25.1 4041 4181 2807 13 02:29 b1-00341943 42965-101164 5378 arc Lef 4.1 4041 4181 2807 HART 14 02:29 r1-00341943 42965-101164 5378 arc Lef 4.1 4041 4181 2807 HART 15 02:29 r1-00341943 42965-101164 5378 arc Lef 4.1 4041 4181 2807 HART 16 02:37 r1-00341946 ----------- ---- bia Clo 0.0 4041 4181 2807 17 02:37 b1-00341946 ----------- ---- bia Clo 0.0 4041 4181 2807 18 02:39 r1-00341947 42965-101164 5378 arc Lef 4.1 4041 4181 2807 HART 19 02:39 b1-00341947 42965-101164 5378 arc Lef 4.1 4041 4181 2807 HART 20 02:40 r1-00341948 42965-101164 5378 arc Rig 4.1 4041 4181 2807 HART 21 02:40 b1-00341948 42965-101164 5378 arc Rig 4.1 4041 4181 2807 HART 22 02:41 r1-00341949 42965-101164 5378 arc Out 4.1 4880 5023 3648 23 02:41 b1-00341949 42965-101164 5378 arc Out 4.1 4880 5023 3648 24 02:42 b1-00341950 42965-101164 5378 fla Out 25.1 4880 5023 3648 25 02:42 r1-00341950 42965-101164 5378 fla Out 25.1 4880 5023 3648 26 02:47 b1-00341951 42965-101164 5378 sci Out 900.1 4880 5023 3648 27 02:47 r1-00341951 42965-101164 5378 sci Out 900.1 4880 5023 3648 28 03:18 b1-00341952 42868-101160 5381 arc Out 4.1 4880 5023 3648 29 03:18 r1-00341952 42868-101160 5381 arc Out 4.1 4880 5023 3648 30 03:20 r1-00341953 42868-101160 5381 fla Out 25.1 4880 5023 3648 31 03:20 b1-00341953 42868-101160 5381 fla Out 25.1 4880 5023 3648 32 03:23 b1-00341954 42868-101160 5381 sci Out 900.1 4880 5023 3648 33 03:23 r1-00341954 42868-101160 5381 sci Out 900.1 4880 5023 3648 34 03:42 r1-00341955 42869-101160 5382 arc Out 4.1 4880 5023 3648 35 03:42 b1-00341955 42869-101160 5382 arc Out 4.1 4880 5023 3648 36 03:43 b1-00341956 42869-101160 5382 fla Out 25.1 4880 5023 3648 37 03:43 r1-00341956 42869-101160 5382 fla Out 25.1 4880 5023 3648 38 03:49 b1-00341957 42869-101160 5382 sci Out 900.1 4880 5023 3648 39 03:49 r1-00341957 42869-101160 5382 sci Out 900.1 4880 5023 3648 40 04:12 b1-00341958 42870-101160 5383 sci Out 900.1 4880 5023 3648 41 04:12 r1-00341958 42870-101160 5383 sci Out 900.1 4880 5023 3648 42 04:34 r1-00341959 42871-101160 5384 sci Out 900.1 4880 5023 3648 43 04:34 b1-00341959 42871-101160 5384 sci Out 900.1 4880 5023 3648 44 05:01 b1-00341960 36004-20973 5389 arc Lef 4.1 4880 5023 3648 HART 45 05:01 r1-00341960 36004-20973 5389 arc Lef 4.1 4880 5023 3648 HART 46 05:02 b1-00341961 36004-20973 5389 arc Rig 4.1 4880 5023 3648 HART 47 05:02 r1-00341961 36004-20973 5389 arc Rig 4.1 4880 5023 3648 HART 48 05:03 r1-00341962 36004-20973 5389 arc Out 4.1 3610 3754 2378 49 05:03 b1-00341962 36004-20973 5389 arc Out 4.1 3610 3754 2378 50 05:05 b1-00341963 36004-20973 5389 fla Out 25.1 3610 3754 2378 51 05:05 r1-00341963 36004-20973 5389 fla Out 25.1 3610 3754 2378 52 05:08 b1-00341964 36004-20973 5389 sci Out 300.1 3610 3754 2378 53 05:08 r1-00341964 36004-20973 5389 sci Out 300.1 3610 3754 2378 54 05:15 b1-00341965 36004-20973 5389 sci Out 300.1 3610 3754 2378 55 05:15 r1-00341965 36004-20973 5389 sci Out 300.1 3610 3754 2378 56 05:22 r1-00341966 36004-20973 5389 sci Out 300.1 3610 3754 2378 57 05:22 b1-00341966 36004-20973 5389 sci Out 300.1 3610 3754 2378 58 05:29 r1-00341967 36004-20973 5389 sci Out 300.1 3610 3754 2378 59 05:29 b1-00341967 36004-20973 5389 sci Out 300.1 3610 3754 2378 60 05:36 b1-00341968 36004-20973 5389 sci Out 300.1 3610 3754 2378 61 05:36 r1-00341968 36004-20973 5389 sci Out 300.1 3610 3754 2378 62 05:43 b1-00341969 36004-20973 5389 sci Out 300.1 3610 3754 2378 63 05:43 r1-00341969 36004-20973 5389 sci Out 300.1 3610 3754 2378 64 05:50 r1-00341970 36004-20973 5389 sci Out 300.1 3610 3754 2378 65 05:50 b1-00341970 36004-20973 5389 sci Out 300.1 3610 3754 2378 66 05:57 b1-00341971 36004-20973 5389 sci Out 300.1 3610 3754 2378 67 05:57 r1-00341971 36004-20973 5389 sci Out 300.1 3610 3754 2378 68 06:04 b1-00341972 36004-20973 5389 sci Out 300.1 3610 3754 2378 69 06:04 r1-00341972 36004-20973 5389 sci Out 300.1 3610 3754 2378 70 06:11 b1-00341973 36004-20973 5389 sci Out 300.1 3610 3754 2378 71 06:11 r1-00341973 36004-20973 5389 sci Out 300.1 3610 3754 2378 72 06:18 b1-00341974 36004-20973 5389 sci Out 300.1 3610 3754 2378 73 06:18 r1-00341974 36004-20973 5389 sci Out 300.1 3610 3754 2378 74 06:26 b1-00341975 36004-20973 5389 sci Out 300.1 3610 3754 2378 75 06:26 r1-00341975 36004-20973 5389 sci Out 300.1 3610 3754 2378 76 06:33 r1-00341976 36004-20973 5389 sci Out 300.1 3610 3754 2378 77 06:33 b1-00341976 36004-20973 5389 sci Out 300.1 3610 3754 2378 78 06:50 b1-00341977 111265-21478 5391 arc Lef 4.1 3610 3754 2378 HART 79 06:50 r1-00341977 111265-21478 5391 arc Lef 4.1 3610 3754 2378 HART 80 06:51 b1-00341978 111265-21478 5391 arc Rig 4.1 3610 3754 2378 HART 81 06:51 r1-00341978 111265-21478 5391 arc Rig 4.1 3610 3754 2378 HART 82 06:52 b1-00341979 111265-21478 5391 arc Out 4.1 3148 3291 1912 83 06:52 r1-00341979 111265-21478 5391 arc Out 4.1 3148 3291 1912 84 06:53 b1-00341980 111265-21478 5391 fla Out 25.1 3148 3291 1912 85 06:53 r1-00341980 111265-21478 5391 fla Out 25.1 3148 3291 1912 86 06:57 r1-00341981 111265-21478 5391 sci Out 300.1 3148 3291 1912 87 06:57 b1-00341981 111265-21478 5391 sci Out 300.1 3148 3291 1912 88 07:04 b1-00341982 111265-21478 5391 sci Out 300.1 3148 3291 1912 89 07:04 r1-00341982 111265-21478 5391 sci Out 300.1 3148 3291 1912 90 07:11 r1-00341983 111265-21478 5391 sci Out 300.1 3148 3291 1912 91 07:11 b1-00341983 111265-21478 5391 sci Out 300.1 3148 3291 1912 92 07:18 r1-00341984 111265-21478 5391 sci Out 300.1 3148 3291 1912 93 07:18 b1-00341984 111265-21478 5391 sci Out 300.1 3148 3291 1912 94 07:25 r1-00341985 111265-21478 5391 sci Out 300.1 3148 3291 1912 95 07:25 b1-00341985 111265-21478 5391 sci Out 300.1 3148 3291 1912 96 07:32 r1-00341986 111265-21478 5391 sci Out 300.1 3148 3291 1912 97 07:32 b1-00341986 111265-21478 5391 sci Out 300.1 3148 3291 1912 98 07:39 b1-00341987 111265-21478 5391 sci Out 300.1 3148 3291 1912 99 07:39 r1-00341987 111265-21478 5391 sci Out 300.1 3148 3291 1912 100 07:46 r1-00341988 111265-21478 5391 sci Out 300.1 3148 3291 1912 101 07:46 b1-00341988 111265-21478 5391 sci Out 300.1 3148 3291 1912 102 07:53 b1-00341989 111265-21478 5391 sci Out 300.1 3148 3291 1912 103 07:53 r1-00341989 111265-21478 5391 sci Out 300.1 3148 3291 1912 104 08:00 r1-00341990 111265-21478 5391 sci Out 300.1 3148 3291 1912 105 08:00 b1-00341990 111265-21478 5391 sci Out 300.1 3148 3291 1912 106 08:07 r1-00341991 111265-21478 5391 sci Out 300.1 3148 3291 1912 107 08:07 b1-00341991 111265-21478 5391 sci Out 300.1 3148 3291 1912 108 08:14 r1-00341992 111265-21478 5391 sci Out 300.1 3148 3291 1912 109 08:14 b1-00341992 111265-21478 5391 sci Out 300.1 3148 3291 1912 110 08:21 r1-00341993 111265-21478 5391 sci Out 300.1 3148 3291 1912 111 08:21 b1-00341993 111265-21478 5391 sci Out 300.1 3148 3291 1912 112 08:37 r1-00341994 111269-21482 5419 arc Lef 4.1 3148 3291 1912 HART 113 08:37 b1-00341994 111269-21482 5419 arc Lef 4.1 3148 3291 1912 HART 114 08:38 r1-00341995 111269-21482 5419 arc Rig 4.1 3148 3291 1912 HART 115 08:38 b1-00341995 111269-21482 5419 arc Rig 4.1 3148 3291 1912 HART 116 08:39 r1-00341996 111269-21482 5419 arc Out 4.1 2690 2828 1452 117 08:39 b1-00341996 111269-21482 5419 arc Out 4.1 2690 2828 1452 118 08:40 b1-00341997 111269-21482 5419 fla Out 25.1 2690 2828 1452 119 08:40 r1-00341997 111269-21482 5419 fla Out 25.1 2690 2828 1452 120 08:52 b1-00341998 111269-21482 5419 sci Out 300.1 2690 2828 1452 121 08:52 r1-00341998 111269-21482 5419 sci Out 300.1 2690 2828 1452 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 00:02:40 9.9 -1319 -2.2 -306 -3.2 02:40:50 9.0 329 -4.2 839 -1.6 05:03:10 8.6 -1319 3.8 -1270 -0.2 06:52:00 8.5 -989 -0.2 -462 -1.7 08:38:50 8.2 -659 0.8 -458 -0.6 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 59717 Fill night time in Hours below *=*=*= Total bright time : 2.6 *=*=*= Bright time, queued observations : 0.6 *=*=*= Bright time, commissioning/engineering: 4.2 *=*=*= Bright time lost to weather : 2.0 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 1.3 *=*=*= Dark time, queued observations : 1.3 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 0