Subject: 2.5m obslog 20220506 (SJD 59706) From: viktorm@apo.nmsu.edu Date: Sat, 7 May 2022 11:50:09 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday May 06, 2022 (SJD 59706) ---- Observing Team ---- Katie Grabowski Viktor Malanushenko ---- Observing Plan ---- Same basic observing plan as last two nights, with the same three BOSS dither designs, however, we are going to skip the robot dithers this time, which simplifies things further, with just one FVC loop per dither field. We would like to obtain BOSS dithers on three designs - 35988, 35994, and 36004 - starting around 10:30-11:00 local, if it is clear. Observe from the queue before that, and after the dithers if there is time. ---- Observing Summary ---- Light cloudy at the evening. Clear sky after 10:40Z. Seeing ~ 1.2" - 2.0" Observed: --------- Time field-dsgn-conf Design type BOSS/APOGEE exp complete? Comment =========================================================================== 02:15:12 101252-44125-5177 bright_2x1_v1 1x900/1xAB DONE 03:08:55 112360-108410-5184 dark_174x8_v1 2x900/2xAB DONE 03:57:06 112360-108411-5186 dark_174x8_v1 2x900/2xAB uncomplete 04:31:29 112360-108412-5187 dark_174x8_v1 2x900/1xAB - aborted due to run tests 04:53:14 20957-35988-5189 bright_1x1 13x900. DONE BOSS dither test 06:41:12 20963-35994-5190 bright_1x1 13x900. DONE BOSS dither test 08:29:44 20973-36004-5194 bright_1x1 13x900. DONE BOSS dither test 10:21:51 100535-39198-5195 dark_2x1 2x900/2xAB DONE 11:04:16 100553-39751-5196bright_single_79x1_v1 1x900/1xAB DONE Notes: ===== - We disable the robot 1340. In detail:'Log' and 'Problems in detail' sections - Dark time lost to technical issues : 0.4 - Integrated Dust Counts: ~6400 dust-hrs ---- Engineering Issues ---- - Weather page intermittently providing the correct information. - Wrong information's intermittently providing about open/close enclosure ---- Observing Log ---- Afternoon: ========= All systems alive and responsive. 00:02:36 apogee.expose=apRaw-41440001, 3, A, Dark 00:04:16 boss exposure 20.0, file=341300 00:07:57 boss exposure 4.0, file=341301 00:08:37 boss exposure 4.0, file=341302 00:09:19 sp1.motor.move= 345, 345, 346 00:09:19 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= -4.2 (Out of focus) sp1: pred. move: spAverageMove= 345 sp1: pred. resid: r= -1004, b= -3.1, txt= OK, spTemp = 8.5 00:11:55 boss exposure 4.0, file=341303 00:13:44 boss exposure 25.0, file=341304 Did not adjust blue ring. 00:09Z- Started APOGEE cals ---------- motorPosition sp1: 1269, 1406, 0; ---------- Median spectrographs temperatures: Tsp1= 8.5 Outside air temperature= 0.0; 19.5 ---------- 00:24:57 Config Loaded: -999--999-5176 00:26:06 OBSERVER.kgrabow 107 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0001.fits 0:26:13 OBSERVER.kgrabow 107 jaeger i fvc_rms=40.08 00:26:13 OBSERVER.kgrabow 107 jaeger i fvc_perc_90=62.1 00:26:13 OBSERVER.kgrabow 107 jaeger i fvc_percent_reached=1.4 00:39:04 boss exposure 4.0, file=341305 00:39:44 boss exposure 4.0, file=341306 00:40:25 sp1.motor.move= 184, 184, 183 00:40:25 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= -3.2 (In Focus) sp1: pred. move: spAverageMove= 184 sp1: pred. resid: r= -843, b= -2.6, txt= OK, spTemp = 8.5 --------- motorPosition sp1: 1453, 1590, 183; ---------- Median spectrographs temperatures: Tsp1= 8.5 Outside air temperature= 19.0; ---------- Weather page intermittently providing the correct information. 01:00Z- Started ventilation Night ===== 02:10:20 apogee.expose=apRaw-41440010, 5, A, DomeFlat 02:11:57 apogee.expose=apRaw-41440011, 5, A, DomeFlat 02:13:26 apogee.expose=apRaw-41440012, 5, A, DomeFlat 02:14:55 apogee.expose=apRaw-41440013, 5, A, DomeFlat 02:15:12 Config Loaded: 101252-44125-5177; bright_2x1_v1 02:16:05 Jaeger collision: 1340 02:16:11 OBSERVER.kg.jaeger 747 jaeger f error="Trajectory failed with error: Something went wrong during the trajectory: The FPS got locked during the trajectory. Trajectory failed 26.70 seconds after start" 02:16:11 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0001.pdf we try disable that robot 1340. That is not help, so we did restart jaeger actor at 02:30Z. Now is ok. Additional information in to 'Problems in Detail' section. 02:26:26 Config Loaded: 101252-44125-5179 02:31:16 Config Loaded: 101252-44125-5180 02:31:34 Config Loaded: 101252-44125-5181 02:31:55 Config Loaded: 101252-44125-5182 02:33:09 Config Loaded: 101252-44125-5183 02:34:40 boss exposure 4.0, file=341307 02:35:24 boss exposure 4.0, file=341308 02:36:07 sp1.motor.move= 1993, 1993, 1994 02:36:07 Hartmann collimate output sp1: offset: r= 2638 (Out of focus); b= -4.2 (Out of focus) sp1: pred. move: spAverageMove= 1993 sp1: pred. resid: r= 644, b= 2.0, txt= OK, spTemp = 8.6 02:36:26 boss exposure 4.0, file=341309 02:36:45 Jaeger collision: 444 02:37:34 Jaeger collision: 444 02:39:34 Jaeger collision: 444 02:45:06 boss exposure 4.0, file=341310 02:46:38 boss exposure 25.0, file=341311 Seeing approx 1.6" 02:52:00 apogee.expose=apRaw-41440014, 43, A, Object 02:52:07 boss exposure 900.0, file=341312 02:59:41 apogee.expose=apRaw-41440015, 43, B, Object 03:08:55 Config Loaded: 112360-108410-5184 03:10:30 Jaeger collision: 1340 -- we disabled that robot. See in 'Problems in Detail' 03:14:00 Config Loaded: 112360-108410-5185 03:16:42 Hartmann collimate output sp1: offset: r= 659 (In Focus); b= 2.8 (In Focus) sp1: pred. move: spAverageMove= -120 sp1: pred. resid: r= 779, b= 2.4, txt= OK, spTemp = 8.4 03:17:05 boss exposure 4.0, file=341315 03:18:38 boss exposure 25.0, file=341316 03:22:48 New-field overhead: 0:14:37 03:23:10 apogee.expose=apRaw-41440016, 46, B, Object 03:23:17 boss exposure 900.0, file=341317 03:31:28 apogee.expose=apRaw-41440017, 46, A, Object 03:39:37 apogee.expose=apRaw-41440018, 43, A, Object 03:39:40 boss exposure 900.0, file=341318 03:47:18 apogee.expose=apRaw-41440019, 43, B, Object 03:57:06 Config Loaded: 112360-108411-5186 03:57:18 Same-field overhead: 0:01:32 03:57:32 apogee.expose=apRaw-41440020, 46, B, Object 03:57:38 boss exposure 900.0, file=341319 04:05:49 apogee.expose=apRaw-41440021, 46, A, Object 04:13:59 apogee.expose=apRaw-41440022, 43, A, Object 04:14:02 boss exposure 900.0, file=341320 04:21:40 apogee.expose=apRaw-41440023, 43, B, Object 04:31:29 Config Loaded: 112360-108412-5187 04:31:39 Same-field overhead: 0:01:33 04:31:53 apogee.expose=apRaw-41440024, 43, B, Object 04:32:00 boss exposure 900.0, file=341321 04:39:39 apogee.expose=apRaw-41440025, 43, A, Object 04:44:01 encl25m : closed; --- !!! 04:49:33 apogee.expose=apRaw-41440026, 43, A, Object 04:49:40 boss exposure 900.0, file=341322 ==== three BOSS dither designs Tests ==== 04:53:14 Config Loaded: 20957-35988-5189 04:55:16 CmdStarted: OBSERVER.kgrabow 219 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 04:55:16 OBSERVER.kgrabow 219 jaeger i text="FVC iteration 1" 04:55:36 OBSERVER.kgrabow 219 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0007.fits 04:55:43 OBSERVER.kgrabow 219 jaeger i fvc_rms=40.33 04:55:43 OBSERVER.kgrabow 219 jaeger i fvc_perc_90=58.8 04:55:43 OBSERVER.kgrabow 219 jaeger i fvc_percent_reached=2.5 04:55:59 OBSERVER.kgrabow 219 jaeger i text="FVC iteration 2" 04:56:18 OBSERVER.kgrabow 219 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0008.fits 04:56:25 OBSERVER.kgrabow 219 jaeger i fvc_rms=5.94 04:56:25 OBSERVER.kgrabow 219 jaeger i fvc_deltarms=34.39 04:56:25 OBSERVER.kgrabow 219 jaeger i fvc_perc_90=9.0 04:56:25 OBSERVER.kgrabow 219 jaeger i fvc_percent_reached=62.4 04:56:41 CmdDone: OBSERVER.kgrabow 219 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 04:57:07 CmdStarted: OBSERVER.kgrabow 220 cherno offset 05:01:22 sp1.motor.move= -779, -782, -785 05:01:22 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= 2.8 (In Focus) sp1: pred. move: spAverageMove= -779 sp1: pred. resid: r= 120, b= 0.4, txt= OK, spTemp = 8.1 05:01:41 boss exposure 4.0, file=341325 05:03:16 boss exposure 25.0, file=341326 05:01:25 OBSERVER.kg.jaeger 869 jaeger i text="FVC iteration 1" 05:01:46 OBSERVER.kg.jaeger 869 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0009.fits 05:01:52 OBSERVER.kg.jaeger 869 jaeger i fvc_rms=39.129999999999995 05:01:52 OBSERVER.kg.jaeger 869 jaeger i fvc_perc_90=57.8 05:01:52 OBSERVER.kg.jaeger 869 jaeger i fvc_percent_reached=4.0 05:02:08 OBSERVER.kg.jaeger 869 jaeger i text="FVC iteration 2" 05:02:28 OBSERVER.kg.jaeger 869 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0010.fits 05:02:35 OBSERVER.kg.jaeger 869 jaeger i fvc_rms=6.58 05:02:35 OBSERVER.kg.jaeger 869 jaeger i fvc_deltarms=32.55 05:02:35 OBSERVER.kg.jaeger 869 jaeger i fvc_perc_90=10.0 05:02:35 OBSERVER.kg.jaeger 869 jaeger i fvc_percent_reached=58.8 05:08:26 CmdStarted: OBSERVER.kgrabow 229 boss exposure science itime=300 05:08:45 boss exposure 300.0, file=341327 — base exposure — 05:14:54 CmdStarted: OBSERVER.kgrabow 230 cherno offset 0.24 0.39 0 05:15:34 CmdStarted: OBSERVER.kgrabow 231 boss exposure science itime=300 05:15:57 boss exposure 300.0, file=341328 05:22:01 CmdStarted: OBSERVER.kgrabow 232 cherno offset 0.34 0.33 0 05:22:41 CmdStarted: OBSERVER.kgrabow 233 boss exposure science itime=300 05:23:00 boss exposure 300.0, file=341329 05:29:03 CmdStarted: OBSERVER.kgrabow 234 cherno offset 0.61 0.57 0 05:29:43 CmdStarted: OBSERVER.kgrabow 235 boss exposure science itime=300 05:30:02 boss exposure 300.0, file=341330 05:36:07 CmdStarted: OBSERVER.kgrabow 236 cherno offset -0.17 -0.19 0 05:36:47 CmdStarted: OBSERVER.kgrabow 237 boss exposure science itime=300 05:37:06 boss exposure 300.0, file=341331 05:43:10 CmdStarted: OBSERVER.kgrabow 238 cherno offset 0.25 -0.21 0 05:43:50 CmdStarted: OBSERVER.kgrabow 239 boss exposure science itime=300 05:44:11 boss exposure 300.0, file=341332 05:50:15 CmdStarted: OBSERVER.kgrabow 240 cherno offset -0.20 -0.45 0 05:50:55 CmdStarted: OBSERVER.kgrabow 241 boss exposure science itime=300 05:51:14 boss exposure 300.0, file=341333 05:57:18 CmdStarted: OBSERVER.kgrabow 242 cherno offset -0.20 -0.45 0 05:57:58 CmdStarted: OBSERVER.kgrabow 243 boss exposure science itime=300 05:58:17 boss exposure 300.0, file=341334 06:04:21 CmdStarted: OBSERVER.kgrabow 244 cherno offset -0.50 -0.53 0 06:05:01 CmdStarted: OBSERVER.kgrabow 245 boss exposure science itime=300 06:05:20 boss exposure 300.0, file=341335 06:11:24 CmdStarted: OBSERVER.kgrabow 246 cherno offset -0.16 0.25 0 06:12:04 CmdStarted: OBSERVER.kgrabow 247 boss exposure science itime=300 06:12:22 boss exposure 300.0, file=341336 06:18:26 CmdStarted: OBSERVER.kgrabow 248 cherno offset -0.05 -0.65 0 06:19:06 CmdStarted: OBSERVER.kgrabow 249 boss exposure science itime=300 06:19:25 boss exposure 300.0, file=341337 06:25:29 CmdStarted: OBSERVER.kgrabow 250 cherno offset 0.50 -0.62 0 06:26:09 CmdStarted: OBSERVER.kgrabow 251 boss exposure science itime=300 06:26:28 boss exposure 300.0, file=341338 06:32:31 CmdStarted: OBSERVER.kgrabow 252 cherno offset 0.63 0.57 0 06:33:11 CmdStarted: OBSERVER.kgrabow 253 boss exposure science itime=300 06:33:30 boss exposure 300.0, file=341339 06:38:45 CmdStarted: OBSERVER.kgrabow 254 cherno offset 06:38:47 CmdStarted: OBSERVER.kgrabow 255 jaeger configuration reverse 06:39:09 CmdStarted: OBSERVER.kgrabow 256 jaeger configuration reverse ======== 06:39:43 CmdStarted: OBSERVER.kgrabow 257 tcc track 121,70 mount /rota=190 /rotty=mount 06:39:56 CmdStarted: OBSERVER.kgrabow 258 jaeger configuration load --no-clone --epoch-delay 2500 35994 06:41:12 Config Loaded: 20963-35994-5190 06:39:43 CmdStarted: OBSERVER.kgrabow 257 tcc track 121,70 mount /rota=190 /rotty=mount 06:39:56 CmdStarted: OBSERVER.kgrabow 258 jaeger configuration load --no-clone --epoch-delay 2500 35994 06:41:16 CmdStarted: OBSERVER.kgrabow 260 tcc axis stop 06:41:28 CmdStarted: OBSERVER.kgrabow 261 jaeger configuration load --no-clone --epoch-delay 2500 35988 - mistake 06:42:23 CmdStarted: OBSERVER.kgrabow 262 jaeger configuration load --no-clone --epoch-delay 2500 35994 06:43:52 CmdStarted: OBSERVER.kgrabow 263 jaeger configuration execute 06:44:58 CmdStarted: OBSERVER.kgrabow 264 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 06:44:59 OBSERVER.kgrabow 264 jaeger i text="FVC iteration 1" 06:45:18 OBSERVER.kgrabow 264 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0011.fits 06:45:25 OBSERVER.kgrabow 264 jaeger i fvc_rms=40.480000000000004 06:45:25 OBSERVER.kgrabow 264 jaeger i fvc_perc_90=57.7 06:45:25 OBSERVER.kgrabow 264 jaeger i fvc_percent_reached=2.1 06:45:41 OBSERVER.kgrabow 264 jaeger i text="FVC iteration 2" 06:46:01 OBSERVER.kgrabow 264 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0012.fits 06:46:07 OBSERVER.kgrabow 264 jaeger i fvc_rms=5.71 06:46:07 OBSERVER.kgrabow 264 jaeger i fvc_deltarms=34.77 06:46:07 OBSERVER.kgrabow 264 jaeger i fvc_perc_90=9.2 06:46:07 OBSERVER.kgrabow 264 jaeger i fvc_percent_reached=62.8 06:46:37 CmdStarted: OBSERVER.kgrabow 265 tcc axis init 06:46:41 CmdStarted: OBSERVER.kgrabow 266 cherno offset 06:49:47 Hartmann collimate output sp1: offset: r= 659 (In Focus); b= -0.2 (In Focus) sp1: pred. move: spAverageMove= 361 sp1: pred. resid: r= 297, b= 0.9, txt= OK, spTemp = 8.3 06:50:05 boss exposure 4.0, file=341342 06:51:37 boss exposure 25.0, file=341343 06:54:44 CmdStarted: OBSERVER.kgrabow 267 boss exposure science itime=300 06:55:03 boss exposure 300.0, file=341344 - base exposure with 0,0 offsets 07:01:07 CmdStarted: OBSERVER.kgrabow 268 cherno offset -0.57 0.02 0 07:01:47 CmdStarted: OBSERVER.kgrabow 269 boss exposure science itime=300 07:02:06 boss exposure 300.0, file=341345 07:08:10 CmdStarted: OBSERVER.kgrabow 270 cherno offset 0.31 -0.79 0 07:08:50 CmdStarted: OBSERVER.kgrabow 271 boss exposure science itime=300 07:09:12 boss exposure 300.0, file=341346 07:15:15 CmdStarted: OBSERVER.kgrabow 272 cherno offset 0.69 0.10 0 07:15:55 CmdStarted: OBSERVER.kgrabow 273 boss exposure science itime=300 07:16:14 boss exposure 300.0, file=341347 07:22:18 CmdStarted: OBSERVER.kgrabow 274 cherno offset 0.46 0.83 0 07:22:58 CmdStarted: OBSERVER.kgrabow 275 boss exposure science itime=300 07:23:17 boss exposure 300.0, file=341348 07:29:21 CmdStarted: OBSERVER.kgrabow 276 cherno offset 0.25 0.23 0 07:30:01 CmdStarted: OBSERVER.kgrabow 277 boss exposure science itime=300 07:30:20 boss exposure 300.0, file=341349 07:36:24 CmdStarted: OBSERVER.kgrabow 278 cherno offset 0.21 0.29 0 07:37:04 CmdStarted: OBSERVER.kgrabow 279 boss exposure science itime=300 07:37:23 boss exposure 300.0, file=341350 07:43:27 CmdStarted: OBSERVER.kgrabow 280 cherno offset 0.61 -0.03 0 07:44:07 CmdStarted: OBSERVER.kgrabow 281 boss exposure science itime=300 07:44:26 boss exposure 300.0, file=341351 07:50:29 CmdStarted: OBSERVER.kgrabow 282 cherno offset 0.04 -0.79 0 07:51:09 CmdStarted: OBSERVER.kgrabow 283 boss exposure science itime=300 07:51:28 boss exposure 300.0, file=341352 07:57:32 CmdStarted: OBSERVER.kgrabow 284 cherno offset 0.06 0.22 0 07:58:12 CmdStarted: OBSERVER.kgrabow 285 boss exposure science itime=300 07:58:31 boss exposure 300.0, file=341353 08:04:35 CmdStarted: OBSERVER.kgrabow 286 cherno offset -0.20 -0.69 0 08:05:15 CmdStarted: OBSERVER.kgrabow 287 boss exposure science itime=300 08:05:33 boss exposure 300.0, file=341354 08:11:37 CmdStarted: OBSERVER.kgrabow 288 cherno offset 0.02 -0.88 0 08:12:17 CmdStarted: OBSERVER.kgrabow 289 boss exposure science itime=300 08:12:36 boss exposure 300.0, file=341355 08:25:09 CmdStarted: OBSERVER.kgrabow 292 cherno offset 08:25:12 CmdStarted: OBSERVER.kgrabow 293 jaeger configuration reverse ======== 08:25:18 CmdStarted: OBSERVER.kgrabow 294 jaeger configuration load --no-clone --epoch-delay 2500 36004 08:26:10 CmdStarted: OBSERVER.kgrabow 295 cherno stop 08:26:15 CmdStarted: OBSERVER.kgrabow 296 tcc track 121,70 mount /rota=190 /rotty=mount 08:28:03 CmdStarted: OBSERVER.kgrabow 297 jaeger configuration execute 08:28:48 CmdStarted: OBSERVER.kgrabow 298 jaeger configuration load --no-clone --epoch-delay 2500 36004 08:29:35 CmdStarted: OBSERVER.kgrabow 301 jaeger configuration reverse 08:29:54 CmdStarted: OBSERVER.kgrabow 302 jaeger configuration execute 08:29:44 Config Loaded: 20973-36004-5194 08:30:14 CmdStarted: OBSERVER.kgrabow 304 jaeger unwind 08:30:24 CmdStarted: OBSERVER.kgrabow 305 jaeger status 08:30:28 CmdStarted: OBSERVER.kgrabow 306 jaeger configuration execute 08:31:26 CmdStarted: OBSERVER.kgrabow 309 tcc axis stop 08:31:31 CmdStarted: OBSERVER.kgrabow 310 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 08:31:31 OBSERVER.kgrabow 310 jaeger i text="FVC iteration 1" 08:31:51 OBSERVER.kgrabow 310 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0013.fits 08:31:58 OBSERVER.kgrabow 310 jaeger i fvc_rms=43.15 08:31:58 OBSERVER.kgrabow 310 jaeger i fvc_perc_90=60.699999999999996 08:31:58 OBSERVER.kgrabow 310 jaeger i fvc_percent_reached=3.3 08:32:14 OBSERVER.kgrabow 310 jaeger i text="FVC iteration 2" 08:32:34 OBSERVER.kgrabow 310 jaeger d fvc_filename=/data/fcam/59706/fimg-fvc1n-0014.fits 08:32:40 OBSERVER.kgrabow 310 jaeger i fvc_rms=7.550000000000001 08:32:40 OBSERVER.kgrabow 310 jaeger i fvc_deltarms=35.599999999999994 08:32:40 OBSERVER.kgrabow 310 jaeger i fvc_perc_90=9.4 08:32:40 OBSERVER.kgrabow 310 jaeger i fvc_percent_reached=57.5 08:32:56 CmdDone: OBSERVER.kgrabow 310 jaeger fvc loop --max-iterations 4 --target-90-percentile 10 during BOSS collimate we had netBurner problems, detail in section 'Problems in Detail'. Lost time was 10 min==0.1 hour 08:45:38 Hartmann collimate output sp1: offset: r= -989 (In Focus); b= 2.8 (In Focus) sp1: pred. move: spAverageMove= -944 sp1: pred. resid: r= -45, b= -0.1, txt= OK, spTemp = 8.1 08:46:00 boss exposure 4.0, file=341364 08:47:32 boss exposure 25.0, file=341365 08:50:41 CmdStarted: OBSERVER.kgrabow 326 boss exposure science itime=300 08:51:00 boss exposure 300.0, file=341366 08:57:04 CmdStarted: OBSERVER.kgrabow 327 cherno offset -0.25 -0.85 0 08:57:44 CmdStarted: OBSERVER.kgrabow 328 boss exposure science itime=300 08:58:03 boss exposure 300.0, file=341367 09:04:06 CmdStarted: OBSERVER.kgrabow 329 cherno offset -0.69 -0.44 0 09:04:46 CmdStarted: OBSERVER.kgrabow 330 boss exposure science itime=300 09:05:06 boss exposure 300.0, file=341368 09:11:09 CmdStarted: OBSERVER.kgrabow 331 cherno offset 0.22 -0.77 0 09:11:49 CmdStarted: OBSERVER.kgrabow 332 boss exposure science itime=300 09:12:08 boss exposure 300.0, file=341369 09:18:12 CmdStarted: OBSERVER.kgrabow 333 cherno offset -0.47 0.48 0 09:18:52 CmdStarted: OBSERVER.kgrabow 334 boss exposure science itime=300 09:19:12 boss exposure 300.0, file=341370 09:25:16 CmdStarted: OBSERVER.kgrabow 335 cherno offset -0.25 -0.19 0 09:25:56 CmdStarted: OBSERVER.kgrabow 336 boss exposure science itime=300 09:26:21 boss exposure 300.0, file=341371 09:32:24 CmdStarted: OBSERVER.kgrabow 337 cherno offset -0.13 0.28 0 09:33:05 CmdStarted: OBSERVER.kgrabow 338 boss exposure science itime=300 09:33:23 boss exposure 300.0, file=341372 09:39:27 CmdStarted: OBSERVER.kgrabow 339 cherno offset -0.54 0.50 0 09:40:07 CmdStarted: OBSERVER.kgrabow 340 boss exposure science itime=300 09:40:26 boss exposure 300.0, file=341373 09:46:30 CmdStarted: OBSERVER.kgrabow 341 cherno offset 0.09 -0.09 0 09:47:10 CmdStarted: OBSERVER.kgrabow 342 boss exposure science itime=300 09:47:29 boss exposure 300.0, file=341374 09:53:32 CmdStarted: OBSERVER.kgrabow 343 cherno offset 0.06 0.55 0 09:54:12 CmdStarted: OBSERVER.kgrabow 344 boss exposure science itime=300 09:54:31 boss exposure 300.0, file=341375 10:00:35 CmdStarted: OBSERVER.kgrabow 345 cherno offset -0.02 0.87 0 10:01:15 CmdStarted: OBSERVER.kgrabow 346 boss exposure science itime=300 10:01:34 boss exposure 300.0, file=341376 10:07:38 CmdStarted: OBSERVER.kgrabow 347 cherno offset 0.08 0.84 0 10:08:18 CmdStarted: OBSERVER.kgrabow 348 boss exposure science itime=300 10:08:37 boss exposure 300.0, file=341377 10:14:40 CmdStarted: OBSERVER.kgrabow 349 cherno offset -0.33 -0.43 0 10:15:20 CmdStarted: OBSERVER.kgrabow 350 boss exposure science itime=300 10:15:39 boss exposure 300.0, file=341378 10:20:51 CmdStarted: OBSERVER.kgrabow 351 cherno offset 10:21:02 CmdStarted: OBSERVER.kgrabow 352 jaeger configuration reverse 10:22:18 CmdStarted: OBSERVER.kgrabow 353 cherno stop =============== end dithered tests ================= 10:21:51 Config Loaded: 100535-39198-5195 - dark_2x1 10:25:07 Hartmann collimate output sp1: offset: r= 989 (In Focus); b= -0.2 (In Focus) sp1: pred. move: spAverageMove= 526 sp1: pred. resid: r= 462, b= 1.4, txt= OK, spTemp = 8.0 10:25:26 boss exposure 4.0, file=341381 10:27:02 boss exposure 25.0, file=341382 10:31:19 New-field overhead: 5:40:32 10:31:42 apogee.expose=apRaw-41440027, 46, A, Object 10:31:48 boss exposure 900.0, file=341383 10:39:55 apogee.expose=apRaw-41440028, 46, B, Object 10:48:04 apogee.expose=apRaw-41440029, 43, B, Object 10:48:13 boss exposure 900.0, file=341384 10:55:50 apogee.expose=apRaw-41440030, 43, A, Object 11:04:16 Config Loaded: 100553-39751-5196 11:07:54 Hartmann collimate output sp1: offset: r= 659 (In Focus); b= 1.8 (In Focus) sp1: pred. move: spAverageMove= 40 sp1: pred. resid: r= 618, b= 1.9, txt= OK, spTemp = 7.9 11:08:13 boss exposure 4.0, file=341387 11:09:48 boss exposure 25.0, file=341388 11:14:50 New-field overhead: 0:10:33 11:15:12 apogee.expose=apRaw-41440031, 43, A, Object 11:15:19 boss exposure 900.0, file=341389 11:22:53 apogee.expose=apRaw-41440032, 43, B, Object 11:31:20 apogee.expose=apRaw-41440033, 5, B, DomeFlat 11:32:56 apogee.expose=apRaw-41440034, 5, B, DomeFlat 11:34:22 apogee.expose=apRaw-41440035, 5, B, DomeFlat 11:40:50 -- APOGEE morning cals started ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0060 0.0040 Axial B: 0.0050 0.0030 Axial C: -0.1190 -0.1150 Trans D: -0.0335 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5350 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 19.67 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: -9.6660 -9.6710 Axial C: -9.6990 -9.6970 Trans D: 0.1020 0.1140 GALILS Commanded: 4881950 4875700 4905900 0 -3400 Actual: 4859066 4859343 4859324 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.02 -0.02 0.09 0.06 41.66 ---- Telescope Status ---- 01:00Z Started ventilation 01:58:01 encl25m : open; 11:38Z ?? encl25m : closed No interlocks bypassed Status at: Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 lbs, psi FPS Status ========== CP10 Loop = 6.99 L/min GFA Loop = 1.95 L/min Supply pressure = 41.0 psi Return pressure = 27.5 psi Chiller Status ============== Set temperarature = 13.3 C Flow = 3.5 Gpm ---- Software Used ---- Get Versions, 05/07/22, 00:12:08 -- STUI software: STUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.15.2-alpha.0 kaiju : 1.2.4-alpha.0 coordio : 1.4.0-alpha.0 fps_calibrati : APO.2022.04.21+71d56e9 cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : FAILED STUIAdditions : 3.1.13 --------------Other Versions-------------- sdss-obstools : 3.7.14 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V34 Fiducials : v1_148 idlspec2d : v6_0_7 Kronos : 1.2.1 roboscheduler : 1.2.2a /dev/sdb1 2.0T 173G 1.9T 9% /home 10.25.1.230:/data 21T 18T 2.4T 89% /data ---- APOGEE Data Summary ---- APOGEE data list, mjd=59706, all raw_data: /data/apogee/utr_cdr/59706/apRaw-*.fits archive: /data/apogee/archive/59706/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59706/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59706 1 00:02 41440001 Dark 3 A 13.0 ---------- a-b-c - - 59706 2 00:19 41440002 Dark 60 A 13.0 ---------- a-b-c - - 59706 3 00:21 41440003 QuarFlat 10 A 13.0 ---------- a-b-c - - 59706 4 00:23 41440004 Arc-Thar 12 B 13.5 ---------- a-b-c 0.97 - 59706 5 00:31 41440005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59706 6 00:33 41440006 Arc-Thar 12 A 13.0 ---------- a-b-c 0.55 - 59706 7 00:40 41440007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59706 8 00:51 41440008 Dark 60 A 13.0 ---------- a-b-c - - 59706 9 00:57 41440009 Arc---- 30 A 13.0 ---------- a-b-c - 100 FPI 59706 10 02:10 41440010 DomeFlat 5 A 13.0 -999-5176 a-b-c - 137 59706 11 02:12 41440011 DomeFlat 5 A 13.0 -999-5176 a-b-c - 140 59706 12 02:13 41440012 DomeFlat 5 A 13.0 -999-5176 a-b-c - 138 59706 13 02:15 41440013 DomeFlat 5 A 13.0 44125-5177 a-b-c - 134 59706 14 02:59 41440014 Object 43 A 13.0 44125-5183 a-b-c 0.43 - 59706 15 03:06 41440015 Object 43 B 13.5 44125-5183 a-b-c 0.94 - 59706 16 03:30 41440016 Object 46 B 13.5 108410-5185 a-b-c 0.93 - 59706 17 03:39 41440017 Object 46 A 13.0 108410-5185 a-b-c 0.42 - 59706 18 03:46 41440018 Object 43 A 13.0 108410-5185 a-b-c 0.43 - 59706 19 03:54 41440019 Object 43 B 13.5 108410-5185 a-b-c 0.94 - 59706 20 04:05 41440020 Object 46 B 13.5 108411-5186 a-b-c 0.94 - 59706 21 04:13 41440021 Object 46 A 13.0 108411-5186 a-b-c 0.42 - 59706 22 04:21 41440022 Object 43 A 13.0 108411-5186 a-b-c 0.43 - 59706 23 04:28 41440023 Object 43 B 13.5 108411-5186 a-b-c 0.94 - 59706 24 04:39 41440024 Object 43 B 13.5 108412-5187 a-b-c 0.94 - 59706 25 04:46 41440025 Object 43 A 13.0 108412-5187 a-b-c 0.43 - 59706 26 04:50 41440026 Object 10 A 13.0 108412-5187 a-b-c 0.42 - 59706 27 10:39 41440027 Object 46 A 13.0 39198-5195 a-b-c 0.42 - 59706 28 10:47 41440028 Object 46 B 13.5 39198-5195 a-b-c 0.93 - 59706 29 10:55 41440029 Object 43 B 13.5 39198-5195 a-b-c 0.93 - 59706 30 11:03 41440030 Object 43 A 13.0 39198-5195 a-b-c 0.42 - 59706 31 11:22 41440031 Object 43 A 13.0 39751-5196 a-b-c 0.44 - 59706 32 11:30 41440032 Object 43 B 13.5 39751-5196 a-b-c 0.94 - 59706 33 11:31 41440033 DomeFlat 5 B 13.5 39751-5196 a-b-c - 137 59706 34 11:33 41440034 DomeFlat 5 B 13.5 39751-5196 a-b-c - 139 59706 35 11:34 41440035 DomeFlat 5 B 13.5 39751-5196 a-b-c - 140 cannot read file : /data/apogee/utr_cdr/59706/apRaw-41440036.fits ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59706 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 00:02 b1-00341299 ----------- ---- bia Clo 0.0 924 1061 -346 2 00:02 r1-00341299 ----------- ---- bia Clo 0.0 924 1061 -346 3 00:04 b1-00341300 ----------- ---- dar Clo 20.0 924 1061 -346 4 00:04 r1-00341300 ----------- ---- dar Clo 20.0 924 1061 -346 5 00:07 b1-00341301 44127-101253 5174 arc Lef 4.1 924 1061 -346 HART 6 00:07 r1-00341301 44127-101253 5174 arc Lef 4.1 924 1061 -346 HART 7 00:08 b1-00341302 44127-101253 5174 arc Rig 4.1 924 1061 -346 HART 8 00:08 r1-00341302 44127-101253 5174 arc Rig 4.1 924 1061 -346 HART 9 00:11 r1-00341303 44127-101253 5174 arc Out 4.1 1269 1406 0 10 00:11 b1-00341303 44127-101253 5174 arc Out 4.1 1269 1406 0 11 00:13 r1-00341304 44127-101253 5174 fla Out 25.1 1269 1406 0 12 00:13 b1-00341304 44127-101253 5174 fla Out 25.1 1269 1406 0 13 00:39 b1-00341305 -999--999 5176 arc Lef 4.1 1269 1406 0 HART 14 00:39 r1-00341305 -999--999 5176 arc Lef 4.1 1269 1406 0 HART 15 00:39 r1-00341306 -999--999 5176 arc Rig 4.1 1269 1406 0 HART 16 00:39 b1-00341306 -999--999 5176 arc Rig 4.1 1269 1406 0 HART 17 02:34 r1-00341307 44125-101252 5183 arc Lef 4.1 1453 1590 183 HART 18 02:34 b1-00341307 44125-101252 5183 arc Lef 4.1 1453 1590 183 HART 19 02:35 r1-00341308 44125-101252 5183 arc Rig 4.1 1453 1590 183 HART 20 02:35 b1-00341308 44125-101252 5183 arc Rig 4.1 1453 1590 183 HART 21 02:36 b1-00341309 44125-101252 5183 arc Out 4.1 3446 3583 2177 22 02:36 r1-00341309 44125-101252 5183 arc Out 4.1 3446 3583 2177 23 02:45 b1-00341310 44125-101252 5183 arc Out 4.1 3446 3583 2177 24 02:45 r1-00341310 44125-101252 5183 arc Out 4.1 3446 3583 2177 25 02:46 b1-00341311 44125-101252 5183 fla Out 25.1 3446 3583 2177 26 02:46 r1-00341311 44125-101252 5183 fla Out 25.1 3446 3583 2177 27 02:52 r1-00341312 44125-101252 5183 sci Out 900.1 3446 3583 2177 28 02:52 b1-00341312 44125-101252 5183 sci Out 900.1 3446 3583 2177 29 03:15 b1-00341313 108410-112360 5185 arc Lef 4.1 3446 3583 2177 HART 30 03:15 r1-00341313 108410-112360 5185 arc Lef 4.1 3446 3583 2177 HART 31 03:16 r1-00341314 108410-112360 5185 arc Rig 4.1 3446 3583 2177 HART 32 03:16 b1-00341314 108410-112360 5185 arc Rig 4.1 3446 3583 2177 HART 33 03:17 b1-00341315 108410-112360 5185 arc Out 4.1 3326 3463 2057 34 03:17 r1-00341315 108410-112360 5185 arc Out 4.1 3326 3463 2057 35 03:18 b1-00341316 108410-112360 5185 fla Out 25.1 3326 3463 2057 36 03:18 r1-00341316 108410-112360 5185 fla Out 25.1 3326 3463 2057 37 03:23 b1-00341317 108410-112360 5185 sci Out 900.1 3326 3463 2057 38 03:23 r1-00341317 108410-112360 5185 sci Out 900.1 3326 3463 2057 39 03:39 b1-00341318 108410-112360 5185 sci Out 900.0 3326 3463 2057 40 03:39 r1-00341318 108410-112360 5185 sci Out 900.0 3326 3463 2057 41 03:57 r1-00341319 108411-112360 5186 sci Out 900.1 3326 3463 2057 42 03:57 b1-00341319 108411-112360 5186 sci Out 900.1 3326 3463 2057 43 04:14 b1-00341320 108411-112360 5186 sci Out 900.1 3326 3463 2057 44 04:14 r1-00341320 108411-112360 5186 sci Out 900.1 3326 3463 2057 45 04:32 r1-00341321 108412-112360 5187 sci Out 900.1 3326 3463 2057 46 04:32 b1-00341321 108412-112360 5187 sci Out 900.1 3326 3463 2057 47 04:49 r1-00341322 108412-112360 5187 sci Out 73.5 3326 3463 2057 48 04:49 b1-00341322 108412-112360 5187 sci Out 73.5 3326 3463 2057 49 05:00 b1-00341323 35988-20957 5189 arc Lef 4.1 3326 3463 2057 HART 50 05:00 r1-00341323 35988-20957 5189 arc Lef 4.1 3326 3463 2057 HART 51 05:00 b1-00341324 35988-20957 5189 arc Rig 4.1 3326 3463 2057 HART 52 05:00 r1-00341324 35988-20957 5189 arc Rig 4.1 3326 3463 2057 HART 53 05:01 b1-00341325 35988-20957 5189 arc Out 4.1 2547 2681 1272 54 05:01 r1-00341325 35988-20957 5189 arc Out 4.1 2547 2681 1272 55 05:03 b1-00341326 35988-20957 5189 fla Out 25.1 2547 2681 1272 56 05:03 r1-00341326 35988-20957 5189 fla Out 25.1 2547 2681 1272 57 05:08 b1-00341327 35988-20957 5189 sci Out 300.1 2547 2681 1272 58 05:08 r1-00341327 35988-20957 5189 sci Out 300.1 2547 2681 1272 59 05:15 b1-00341328 35988-20957 5189 sci Out 300.1 2547 2681 1272 60 05:15 r1-00341328 35988-20957 5189 sci Out 300.1 2547 2681 1272 61 05:23 r1-00341329 35988-20957 5189 sci Out 300.1 2547 2681 1272 62 05:23 b1-00341329 35988-20957 5189 sci Out 300.1 2547 2681 1272 63 05:30 r1-00341330 35988-20957 5189 sci Out 300.1 2547 2681 1272 64 05:30 b1-00341330 35988-20957 5189 sci Out 300.1 2547 2681 1272 65 05:37 r1-00341331 35988-20957 5189 sci Out 300.1 2547 2681 1272 66 05:37 b1-00341331 35988-20957 5189 sci Out 300.1 2547 2681 1272 67 05:44 r1-00341332 35988-20957 5189 sci Out 300.1 2547 2681 1272 68 05:44 b1-00341332 35988-20957 5189 sci Out 300.1 2547 2681 1272 69 05:51 r1-00341333 35988-20957 5189 sci Out 300.1 2547 2681 1272 70 05:51 b1-00341333 35988-20957 5189 sci Out 300.1 2547 2681 1272 71 05:58 r1-00341334 35988-20957 5189 sci Out 300.1 2547 2681 1272 72 05:58 b1-00341334 35988-20957 5189 sci Out 300.1 2547 2681 1272 73 06:05 b1-00341335 35988-20957 5189 sci Out 300.1 2547 2681 1272 74 06:05 r1-00341335 35988-20957 5189 sci Out 300.1 2547 2681 1272 75 06:12 b1-00341336 35988-20957 5189 sci Out 300.1 2547 2681 1272 76 06:12 r1-00341336 35988-20957 5189 sci Out 300.1 2547 2681 1272 77 06:19 b1-00341337 35988-20957 5189 sci Out 300.1 2547 2681 1272 78 06:19 r1-00341337 35988-20957 5189 sci Out 300.1 2547 2681 1272 79 06:26 b1-00341338 35988-20957 5189 sci Out 300.1 2547 2681 1272 80 06:26 r1-00341338 35988-20957 5189 sci Out 300.1 2547 2681 1272 81 06:33 b1-00341339 35988-20957 5189 sci Out 300.1 2547 2681 1272 82 06:33 r1-00341339 35988-20957 5189 sci Out 300.1 2547 2681 1272 83 06:48 b1-00341340 35994-20963 5192 arc Lef 4.1 2547 2681 1272 HART 84 06:48 r1-00341340 35994-20963 5192 arc Lef 4.1 2547 2681 1272 HART 85 06:49 b1-00341341 35994-20963 5192 arc Rig 4.1 2547 2681 1272 HART 86 06:49 r1-00341341 35994-20963 5192 arc Rig 4.1 2547 2681 1272 HART 87 06:50 b1-00341342 35994-20963 5192 arc Out 4.1 2908 3045 1639 88 06:50 r1-00341342 35994-20963 5192 arc Out 4.1 2908 3045 1639 89 06:51 b1-00341343 35994-20963 5192 fla Out 25.1 2908 3045 1639 90 06:51 r1-00341343 35994-20963 5192 fla Out 25.1 2908 3045 1639 91 06:55 r1-00341344 35994-20963 5192 sci Out 300.1 2908 3045 1639 92 06:55 b1-00341344 35994-20963 5192 sci Out 300.1 2908 3045 1639 93 07:02 b1-00341345 35994-20963 5192 sci Out 300.1 2908 3045 1639 94 07:02 r1-00341345 35994-20963 5192 sci Out 300.1 2908 3045 1639 95 07:09 r1-00341346 35994-20963 5192 sci Out 300.1 2908 3045 1639 96 07:09 b1-00341346 35994-20963 5192 sci Out 300.1 2908 3045 1639 97 07:16 r1-00341347 35994-20963 5192 sci Out 300.1 2908 3045 1639 98 07:16 b1-00341347 35994-20963 5192 sci Out 300.1 2908 3045 1639 99 07:23 b1-00341348 35994-20963 5192 sci Out 300.1 2908 3045 1639 100 07:23 r1-00341348 35994-20963 5192 sci Out 300.1 2908 3045 1639 101 07:30 b1-00341349 35994-20963 5192 sci Out 300.1 2908 3045 1639 102 07:30 r1-00341349 35994-20963 5192 sci Out 300.1 2908 3045 1639 103 07:37 r1-00341350 35994-20963 5192 sci Out 300.1 2908 3045 1639 104 07:37 b1-00341350 35994-20963 5192 sci Out 300.1 2908 3045 1639 105 07:44 r1-00341351 35994-20963 5192 sci Out 300.1 2908 3045 1639 106 07:44 b1-00341351 35994-20963 5192 sci Out 300.1 2908 3045 1639 107 07:51 b1-00341352 35994-20963 5192 sci Out 300.1 2908 3045 1639 108 07:51 r1-00341352 35994-20963 5192 sci Out 300.1 2908 3045 1639 109 07:58 r1-00341353 35994-20963 5192 sci Out 300.1 2908 3045 1639 110 07:58 b1-00341353 35994-20963 5192 sci Out 300.1 2908 3045 1639 111 08:05 r1-00341354 35994-20963 5192 sci Out 300.1 2908 3045 1639 112 08:05 b1-00341354 35994-20963 5192 sci Out 300.1 2908 3045 1639 113 08:12 b1-00341355 35994-20963 5192 sci Out 300.1 2908 3045 1639 114 08:12 r1-00341355 35994-20963 5192 sci Out 300.1 2908 3045 1639 115 08:19 b1-00341356 35994-20963 5192 sci Out 300.1 2908 3045 1639 116 08:19 r1-00341356 35994-20963 5192 sci Out 300.1 2908 3045 1639 117 08:42 b1-00341361 ----------- ---- bia Clo 0.0 2908 3045 1639 118 08:42 r1-00341361 ----------- ---- bia Clo 0.0 2908 3045 1639 119 08:44 r1-00341362 36004-20973 5194 arc Lef 4.1 2908 3045 1639 HART 120 08:44 b1-00341362 36004-20973 5194 arc Lef 4.1 2908 3045 1639 HART 121 08:44 b1-00341363 36004-20973 5194 arc Rig 4.1 2908 3045 1639 HART 122 08:44 r1-00341363 36004-20973 5194 arc Rig 4.1 2908 3045 1639 HART 123 08:46 b1-00341364 36004-20973 5194 arc Out 4.1 1964 2100 691 124 08:46 r1-00341364 36004-20973 5194 arc Out 4.1 1964 2100 691 125 08:47 b1-00341365 36004-20973 5194 fla Out 25.1 1964 2100 691 126 08:47 r1-00341365 36004-20973 5194 fla Out 25.1 1964 2100 691 127 08:51 r1-00341366 36004-20973 5194 sci Out 300.1 1964 2100 691 128 08:51 b1-00341366 36004-20973 5194 sci Out 300.1 1964 2100 691 129 08:58 r1-00341367 36004-20973 5194 sci Out 300.1 1964 2100 691 130 08:58 b1-00341367 36004-20973 5194 sci Out 300.1 1964 2100 691 131 09:05 r1-00341368 36004-20973 5194 sci Out 300.1 1964 2100 691 132 09:05 b1-00341368 36004-20973 5194 sci Out 300.1 1964 2100 691 133 09:12 b1-00341369 36004-20973 5194 sci Out 300.1 1964 2100 691 134 09:12 r1-00341369 36004-20973 5194 sci Out 300.1 1964 2100 691 135 09:19 b1-00341370 36004-20973 5194 sci Out 300.1 1964 2100 691 136 09:19 r1-00341370 36004-20973 5194 sci Out 300.1 1964 2100 691 137 09:26 b1-00341371 36004-20973 5194 sci Out 300.1 1964 2100 691 138 09:26 r1-00341371 36004-20973 5194 sci Out 300.1 1964 2100 691 139 09:33 r1-00341372 36004-20973 5194 sci Out 300.1 1964 2100 691 140 09:33 b1-00341372 36004-20973 5194 sci Out 300.1 1964 2100 691 141 09:40 r1-00341373 36004-20973 5194 sci Out 300.1 1964 2100 691 142 09:40 b1-00341373 36004-20973 5194 sci Out 300.1 1964 2100 691 143 09:47 r1-00341374 36004-20973 5194 sci Out 300.1 1964 2100 691 144 09:47 b1-00341374 36004-20973 5194 sci Out 300.1 1964 2100 691 145 09:54 r1-00341375 36004-20973 5194 sci Out 300.1 1964 2100 691 146 09:54 b1-00341375 36004-20973 5194 sci Out 300.1 1964 2100 691 147 10:01 b1-00341376 36004-20973 5194 sci Out 300.1 1964 2100 691 148 10:01 r1-00341376 36004-20973 5194 sci Out 300.1 1964 2100 691 149 10:08 b1-00341377 36004-20973 5194 sci Out 300.1 1964 2100 691 150 10:08 r1-00341377 36004-20973 5194 sci Out 300.1 1964 2100 691 151 10:15 b1-00341378 36004-20973 5194 sci Out 300.1 1964 2100 691 152 10:15 r1-00341378 36004-20973 5194 sci Out 300.1 1964 2100 691 153 10:23 r1-00341379 39198-100535 5195 arc Lef 4.1 1964 2100 691 HART 154 10:23 b1-00341379 39198-100535 5195 arc Lef 4.1 1964 2100 691 HART 155 10:24 b1-00341380 39198-100535 5195 arc Rig 4.1 1964 2100 691 HART 156 10:24 r1-00341380 39198-100535 5195 arc Rig 4.1 1964 2100 691 HART 157 10:25 r1-00341381 39198-100535 5195 arc Out 4.1 2489 2627 1221 158 10:25 b1-00341381 39198-100535 5195 arc Out 4.1 2489 2627 1221 159 10:27 r1-00341382 39198-100535 5195 fla Out 25.1 2489 2627 1221 160 10:27 b1-00341382 39198-100535 5195 fla Out 25.1 2489 2627 1221 161 10:31 r1-00341383 39198-100535 5195 sci Out 900.1 2489 2627 1221 162 10:31 b1-00341383 39198-100535 5195 sci Out 900.1 2489 2627 1221 163 10:48 r1-00341384 39198-100535 5195 sci Out 900.1 2489 2627 1221 164 10:48 b1-00341384 39198-100535 5195 sci Out 900.1 2489 2627 1221 165 11:06 b1-00341385 39751-100553 5196 arc Lef 4.1 2489 2627 1221 HART 166 11:06 r1-00341385 39751-100553 5196 arc Lef 4.1 2489 2627 1221 HART 167 11:07 b1-00341386 39751-100553 5196 arc Rig 4.1 2489 2627 1221 HART 168 11:07 r1-00341386 39751-100553 5196 arc Rig 4.1 2489 2627 1221 HART 169 11:08 b1-00341387 39751-100553 5196 arc Out 4.1 2529 2663 1259 170 11:08 r1-00341387 39751-100553 5196 arc Out 4.1 2529 2663 1259 171 11:09 b1-00341388 39751-100553 5196 fla Out 25.1 2529 2663 1259 172 11:09 r1-00341388 39751-100553 5196 fla Out 25.1 2529 2663 1259 173 11:15 b1-00341389 39751-100553 5196 sci Out 900.1 2529 2663 1259 174 11:15 r1-00341389 39751-100553 5196 sci Out 900.1 2529 2663 1259 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 00:09:10 8.1 -659 -4.2 345 -3.1 00:40:20 8.1 -659 -3.2 184 -2.6 02:36:00 8.4 2638 -4.2 1993 2.0 03:16:30 8.4 659 2.8 -120 2.4 05:01:10 8.1 -659 2.8 -779 0.4 06:49:40 7.9 659 -0.2 361 0.9 08:45:30 7.9 -989 2.8 -944 -0.1 10:25:00 7.7 989 -0.2 526 1.4 11:07:50 7.7 659 1.8 40 1.9 ---- Weather Log ---- Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma 18:00 17.0 -15.7 9.8 256.8 2419 18:15 16.1 -13.0 12.4 232.7 2180 18:30 16.1 -12.9 10.5 243.5 2143 18:45 14.3 -12.6 8.3 248.6 2088 19:00 18.0 -12.2 14.0 261.0 2103 19:15 17.8 -13.1 19.2 267.9 2099 19:30 18.6 -12.7 11.4 238.3 1953 19:45 19.6 -13.2 18.8 241.7 1875 20:00 17.9 -13.7 14.8 234.3 1937 20:15 17.4 -14.7 12.0 240.6 1792 20:30 16.5 -14.9 9.4 279.9 2461 20:45 16.0 -15.2 11.4 266.1 1792 21:00 17.0 -13.8 7.0 244.9 1738 21:15 17.3 -14.6 17.2 264.5 1905 21:30 16.7 -15.6 10.8 258.1 1682 21:45 17.8 -16.3 14.7 247.6 1799 22:00 17.1 -17.9 8.6 269.7 1642 22:15 18.7 -16.7 9.0 265.0 1732 22:30 18.6 -16.0 16.1 260.0 1772 22:45 20.4 -14.6 15.8 255.3 1670 23:00 18.8 -16.0 13.6 273.3 1645 23:15 19.0 -16.3 4.1 243.0 1641 23:30 19.0 -16.4 11.0 246.9 1679 23:45 18.1 -16.3 12.7 265.1 1776 00:00 18.9 -16.7 10.6 271.2 1762 00:15 19.3 -16.7 14.0 258.5 1866 00:30 18.7 -16.6 16.0 266.1 1941 00:45 18.4 -18.0 12.8 247.0 1944 01:00 18.1 -17.3 14.6 251.6 1992 01:15 18.1 -17.3 11.4 242.6 1993 01:30 16.6 -18.0 8.4 257.0 1965 01:45 15.7 -17.8 12.4 244.1 2118 02:00 15.4 -17.9 14.4 237.2 2370 02:15 15.6 -18.2 11.7 237.6 2328 191 7.27 02:30 15.5 -18.4 18.7 245.7 2354 152 3.44 02:45 15.3 -18.3 17.0 251.7 2223 161 5.56 03:00 15.1 -18.1 16.5 235.9 2349 88 8.56 03:15 15.2 -17.9 15.1 248.3 2325 137 5.90 03:30 15.1 -17.8 20.5 236.0 2368 88 14.51 03:45 15.0 -18.0 15.8 238.9 2419 137 1.90 04:00 14.8 -18.1 15.9 235.6 2295 88 14.89 04:15 14.6 -18.1 13.8 239.2 2258 88 10.63 04:30 14.6 -18.2 15.3 236.5 2261 107 6.20 04:45 14.6 -18.3 13.9 239.4 2340 88 8.48 05:00 14.4 -18.3 13.8 238.7 2364 152 1.39 05:15 14.6 -18.2 12.8 258.0 2382 88 11.24 05:30 14.5 -17.8 15.4 266.2 2449 147 1.52 05:45 14.3 -17.5 12.4 263.1 2333 107 4.72 06:00 13.8 -17.5 7.8 250.1 2359 88 12.95 06:15 13.9 -17.4 10.0 264.8 2370 152 2.34 06:30 13.6 -17.2 9.0 261.3 2279 156 4.54 06:45 14.8 -16.8 7.6 262.7 2309 88 12.03 07:00 14.6 -16.9 12.0 274.0 2403 230 13.15 07:15 14.4 -16.9 10.1 265.4 2414 171 2.25 07:30 14.4 -17.0 10.5 263.7 2342 176 8.00 07:45 14.3 -17.0 12.0 268.6 2392 230 14.71 08:00 14.4 -17.0 9.2 261.8 2319 117 8.14 08:15 14.3 -17.1 6.9 263.4 2318 137 3.12 08:30 14.3 -16.8 7.1 261.3 2411 152 2.69 08:45 14.3 -16.9 7.3 260.4 2289 97 6.73 09:00 14.1 -16.8 4.9 257.6 2289 112 3.68 09:15 14.1 -17.1 8.6 272.5 2378 191 5.84 09:30 14.2 -16.4 12.2 294.1 2354 313 28.05 09:45 13.9 -16.7 9.2 283.7 2285 88 7.94 10:00 13.6 -16.9 8.3 276.6 2229 259 21.94 10:15 13.9 -16.6 9.9 283.9 2232 176 8.08 10:30 13.9 -16.4 9.9 270.8 2178 132 2.09 10:45 13.7 -16.5 10.4 291.0 2249 156 4.43 11:00 13.8 -16.7 9.7 288.8 2330 249 19.50 11:15 13.5 -16.8 11.2 291.3 2345 88 6.29 11:30 13.7 -17.3 11.1 302.4 2464 117 2.21 11:45 13.8 -17.2 13.0 290.5 2519 114 40.51 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 59706 Fill night time in Hours below *=*=*= Total bright time : 0 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 0 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 8.4 *=*=*= Dark time, queued observations : 2.9 *=*=*= Dark time, commissioning/engineering : 5.5 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 0.4 ---- Problems in Detail ---- 02:16:05 Jaeger collision: 1340 02:16:11 OBSERVER.kg.jaeger 747 jaeger f error="Trajectory failed with error: Something went wrong during the trajectory: The FPS got locked during the trajectory. Trajectory failed 26.70 seconds after start" 02:16:11 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0001.pdf 02:18:33 Jaeger collision: 1340 02:18:46 CmdStarted: OBSERVER.kgrabow 139 jaeger unlock 02:18:49 CmdStarted: OBSERVER.kgrabow 140 jaeger unwind 02:19:39 CmdStarted: OBSERVER.kgrabow 141 jaeger configuration load 44125 02:19:48 CmdStarted: OBSERVER.kgrabow 142 jaeger configuration execute 02:20:48 OBSERVER.kgrabow 143 jaeger f error="Command 'status positioner' failed." 02:20:48 CmdDone: OBSERVER.kgrabow 143 jaeger status positioner 02:21:06 CmdStarted: OBSERVER.kgrabow 144 jaeger status 1340 02:21:06 OBSERVER.kgrabow 144 jaeger > 02:21:07 OBSERVER.kgrabow 144 jaeger i positioner_status=1340,10.0179,170.0243,0x8db06fe1,T,F,F,F,04.01.21,6,1,5 02:21:07 OBSERVER.kgrabow 144 jaeger : 02:21:07 CmdDone: OBSERVER.kgrabow 144 jaeger status 1340 ..... 02:24:13 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0007.pdf 02:24:13 OBSERVER.kgrabow 151 jaeger f error="Trajectory failed with error: Something went wrong during the trajectory: The FPS got locked during the trajectory. Trajectory failed 6.16 seconds after start" 02:24:13 CmdDone: OBSERVER.kgrabow 151 jaeger explode 3 02:24:55 CmdStarted: OBSERVER.kgrabow 152 jaeger unlock 02:24:58 CmdStarted: OBSERVER.kgrabow 153 jaeger unwind 02:25:51 CmdStarted: OBSERVER.kgrabow 154 jaeger disable 1340 02:26:44 .jaeger 0 jaeger w text="Mismatch between number of positioners and trajectory. (JaegerUserWarning)" 02:26:44 OBSERVER.kgrabow 156 jaeger f error="Trajectory validation failed." 02:26:44 CmdDone: OBSERVER.kgrabow 156 jaeger configuration execute 02:30Z restart jaeger actor 02:31:53 CmdStarted: OBSERVER.kgrabow 161 jaeger configuration load 44125 02:32:14 CmdStarted: OBSERVER.kgrabow 162 jaeger configuration load 44125 --no-clone 02:32:14 CmdStarted: OBSERVER.kgrabow.cherno 11 cherno get-scale --max-age 7200 02:33:18 CmdStarted: OBSERVER.kgrabow 163 jaeger configuration execute ----- 02:37:34 .jaeger 0 jaeger f text="A collision was detected in positioner 444. Sending SEND_TRAJECTORY_ABORT and locking the FPS." 02:37:34 .jaeger 0 jaeger w text="Locking the FPS. (JaegerUserWarning)" 02:37:35 .jaeger 0 jaeger e locked=T; locked_by=444 02:37:35 .jaeger 0 jaeger i fps_status=0x14 02:37:37 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0011.pdf 02:37:37 OBSERVER.kgrabow 165 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59706/trajectory-59706-0011.json 02:37:37 OBSERVER.kgrabow 165 jaeger f error="Trajectory failed with error: Something went wrong during the trajectory: The FPS got locked during the trajectory. Trajectory failed 4.21 seconds after start" 02:37:37 CmdDone: OBSERVER.kgrabow 165 jaeger explode 3 02:37:39 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0011.pdf 02:37:39 .jaeger 0 jaeger w text="Snapshot for locked FPS: /data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0011.pdf (JaegerUserWarning)" 02:37:42 CmdStarted: OBSERVER.kgrabow 166 jaeger unlock 02:37:42 OBSERVER.kgrabow 166 jaeger > 02:37:42 OBSERVER.kgrabow 166 jaeger i locked=F 02:37:42 OBSERVER.kgrabow 166 jaeger : text="FPS unlocked" 02:37:42 CmdDone: OBSERVER.kgrabow 166 jaeger unlock 02:37:42 .jaeger 0 jaeger i fps_status=0x11 02:38:02 CmdStarted: OBSERVER.kgrabow 167 jaeger status 444 02:38:02 OBSERVER.kgrabow 167 jaeger > 02:38:03 OBSERVER.kgrabow 167 jaeger i positioner_status=444,358.6309,41.2141,0x8db067e1,T,F,F,F,04.01.21,4,3,11 02:38:03 OBSERVER.kgrabow 167 jaeger : 02:38:03 CmdDone: OBSERVER.kgrabow 167 jaeger status 444 03:10:30 .jaeger 0 jaeger f text="A collision was detected in positioner 1340. Sending SEND_TRAJECTORY_ABORT and locking the FPS." 03:10:35 .jaeger 0 jaeger i snapshot=/data/logs/jaeger/snapshots/59706/fps_snapshot_59706_0017.pdf 03:10:35 OBSERVER.kg.jaeger 800 jaeger f error="Trajectory failed with error: Something went wrong during the trajectory: The FPS got locked during the trajectory. Trajectory failed 33.91 seconds after start" 03:10:35 CmdDone: OBSERVER.kg.jaeger 800 jaeger configuration execute 03:10:59 .jaeger 40 jaeger i text="Command 'unwind' failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collided, cannot generate paths'. See traceback in the log for more information." 03:13:00 OBSERVER.kgrabow 190 jaeger f error="Command 'unwind' failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collided, cannot generate paths'. See traceback in the log for more information." 03:13:00 CmdDone: OBSERVER.kgrabow 190 jaeger unwind 03:13:09 CmdStarted: OBSERVER.kgrabow 191 jaeger explode 5 03:13:25 CmdStarted: OBSERVER.kgrabow 192 jaeger unwind ... 03:11:47 CmdStarted: OBSERVER.kgrabow 188 jaeger disable 1340 03:12:44 CmdStarted: OBSERVER.kgrabow 189 jaeger configuration load 108410 --no-clone ========== during BOSS collimate we had netBurner problems: 08:35:07 boss exposure 4.0, file=341357 08:36:49 Hartmann collimate output Hartmann failed sp1: offset: r= ? (?); b= ? (?) sp1: pred. move: spAverageMove= ? sp1: pred. resid: r= ?, b= ?, txt= ?, spTemp = 8.1 08:38:17 boss exposure 4.0, file=341357 08:41:25 sp1.motor.move= None, None, None 08:41:42 Hartmann collimate output Hartmann failed sp1: offset: r= ? (?); b= ? (?) sp1: pred. move: spAverageMove= ? sp1: pred. resid: r= ?, b= ?, txt= ?, spTemp = 999.9 08:42:38 sp1.motor.move= None, None, None 08:37:23 CmdStarted: OBSERVER.kgrabow 312 boss ping 08:37:34 CmdStarted: OBSERVER.kgrabow 313 boss clear exposure 08:37:39 CmdStarted: OBSERVER.kgrabow 314 boss clearExposure 08:39:42 CmdStarted: OBSERVER.kgrabow 315 boss clearExposure 08:39:46 CmdStarted: OBSERVER.kgrabow 316 boss reloadControllers 08:39:53 CmdStarted: OBSERVER.kgrabow 317 boss ping 08:42:20 CmdStarted: OBSERVER.kgrabow 324 alerts acknowledge id=boss.specMechProtocol severity=critical Lost time : 8:45-8:36=6 min==0.2 hour