From: Stefanie Wachter Date: Fri, 27 May 2022 13:20:47 -0700 Subject: Re: [sloan-25mlog 6092] Re: 2.5m obslog 20220526 (SJD 59726) --00000000000064af2c05e0040b01 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Kaike, if you are starting a new list, please also link it to this wiki so we know which robot to check during summer shutdown https://wiki.sdss.org/display/SE/Summer+Shutdown+2022 cheers Stefanie On Fri, May 27, 2022 at 1:09 PM Jos=C3=A9 S=C3=A1nchez-Gallego wrote: > There is a list of disabled robots here > > https://wiki.sdss.org/pages/viewpage.action?pageId=3D109873620 > > but the most reliable place is always the keyword disabled_positioners in > this file > > https://github.com/sdss/jaeger/blob/main/python/jaeger/etc/jaeger.yml > > Jos=C3=A9 > > > On May 27, 2022 at 12:47:17, Kaike wrote: > >> Hi Jose, >> >> Karen and I discussed whether we should start a tracking list of >> problematic robots so that we know which robots needs to be replaced dur= ing >> the coming shutdown. I started the list at the bottom on the observing p= lan >> page https://wiki.sdss.org/display/APO/SDSS-N+March+Observing+Plan (see >> below). >> >> Jose: do you have a list for disabled robots? >> >> Observers: Please keep the list in a numeric order. If a troublesome >> robot is already in the list, please DO NOT start a new line, just add t= he >> number of designs you had troubles with it and the date for the robot. >> >> Thanks, >> >> -Kaike >> A tracking list of problematic robots >> Disabled robots: >> >> 612 (2 designs on 5/27) >> >> 902 (1 design on 5/27) >> >> >> >> >> >> >> On May 27, 2022, at 11:58 AM, Jos=C3=A9 S=C3=A1nchez-Gallego >> wrote: >> >> It seems collisions have been increasing lately. >> >> Do you have a list or a sense of what robots are repeat offenders? I >> think 1340 and 612 are in that list and we should disable them permanent= ly >> for now; are there others? >> >> Jos=C3=A9 >> >> On May 27, 2022 at 03:12:02, kinemuchi@apo.nmsu.edu wrote: >> >>> >>> APACHE POINT OBSERVATORY SDSS 2.5M >>> >>> OBSERVING LOG >>> Thursday May 26, 2022 >>> >>> (SJD 59726) >>> >>> ---- Observing Team ---- >>> >>> Kaike Pan >>> Karen Kinemuchi >>> >>> >>> ---- Observing Plan ---- >>> >>> Please observe from the queue until about 10:30. After that, if clear, >>> do >>> BOSS dithers on designs 35994, 36002, 36018, using the following >>> sequence >>> (note the --centroid-method keyword on the jaeger fvc loop command!). >>> If not clear, observe from queue. >>> >>> ---- Observing Summary ---- >>> >>> Lost 1.0 hour due to rising dust counts. >>> >>> Observed: >>> --------- >>> Time field-dsgn-conf Design type BOSS/APOGEE exp complete? >>> Comment >>> >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D >>> 02:40:56 101175-43160-5562 bright_8x2_v1 1x900s+1xAB DONE >>> 03:09:13 101175-43161-5563 bright_8x2_v1 1x900s+1xAB DONE >>> 03:31:13 104639-57937-5564 dark_10x4_4yr_v1 2x900s+2xAB DONE >>> 04:12:20 104639-57938-5565 dark_10x4_4yr_v1 3x900s+3xAB DONE >>> 05:07:14 104639-57939-5566 dark_10x4_4yr_v1 3x900s+3xAB DONE (epoch >>> not done) >>> 06:07:02 112359-107018-5568 dark_174x8_v1 2x900s+2xAB DONE >>> 06:46:29 112359-107019-5569 dark_174x8_v1 3x900s+3xAB DONE cloned >>> 07:35:59 112359-107020-5570 dark_174x8_v1 5x900s+5xAB not done cloned >>> >>> >>> ---- Engineering Issues ---- >>> >>> * 02:36Z Disabled position 612 due to reported collision. See log for >>> details. >>> >>> * Simulations were running on boson guider. To turn off, issue command= : >>> "fliswarm simulate --stop" >>> >>> * Had trouble with the following designs (see log for details): >>> 02:21:33 Field-Design-Configuration: 101175-43160-5560 (robot #612) >>> 06:01:55 Field-Design-Configuration: 104639-57940-5567 (#612) >>> 09:01:13 Field-Design-Configuration: 104541-56893-5571 (#612, 902) >>> 09:16:38 Field-Design-Configuration: 104541-56893-5572 (#612, 902) >>> 09:25:19 Field-Design-Configuration: 104541-56893-5573 (#902) >>> >>> * 08:34Z Discovered a weird bug in Kronos while refreshing the queue. >>> JohnD >>> has been notified. See log for details. >>> >>> * Dust counts ~12000 >>> >>> ---- Observing Log ---- >>> >>> Afternoon: >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>> BOSS collimation is checked, no adjustment made. >>> 0:10:52 Hartmann collimate output >>> sp1: offset: r=3D -659 (In Focus); b=3D -3.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D 184 >>> sp1: pred. resid: r=3D -843, b=3D -2.6, txt=3D OK, spTemp =3D 9.3 >>> motorPosition >>> sp1: 2236, 2383, 1000; >>> ---------- >>> Median spectrographs temperatures: >>> Tsp1=3D 9.3 >>> Outside air temperature=3D 20.3; >>> BOSS cals: >>> 00:12:35 boss exposure 25.0, file=3D342512 >>> 00:16:33 boss exposure 4.0, file=3D342513 >>> >>> 0:28:17 Config Loaded: -999--999-5559 >>> 00:29:40 OBSERVER.kpan 71 jaeger i fvc_rms=3D40.919999999999995 >>> 00:29:40 OBSERVER.kpan 71 jaeger i fvc_perc_90=3D64.69999999999999 >>> 00:29:40 OBSERVER.kpan 71 jaeger i fvc_percent_reached=3D1.4 >>> >>> 00:40Z: started ventilation. >>> Night: >>> =3D=3D=3D=3D=3D=3D >>> 02:03:37 encl25m : open; >>> >>> APOGEE dark: >>> 02:09:18 apogee.expose=3DapRaw-41640010, 5, A, Dark >>> >>> 02:21:33 Field-Design-Configuration: 101175-43160-5560 >>> >>> APOGEE dome flats: >>> 02:23:59 apogee.expose=3DapRaw-41640011, 5, A, DomeFlat >>> 02:25:26 apogee.expose=3DapRaw-41640012, 5, A, DomeFlat >>> 02:26:53 apogee.expose=3DapRaw-41640013, 5, A, DomeFlat >>> >>> 02:28:26 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> >>> Trying to unlock and unwind. >>> >>> 02:31:30 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 02:31:30 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 02:31:30 .jaeger 0 jaeger i fps_status=3D0x14 >>> 02:31:32 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 02:31:36 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0003.pd= f >>> 02:31:36 .jaeger 158 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0003.json >>> 02:31:36 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0003.pd= f >>> 02:31:36 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0003.pdf >>> (JaegerUserWarning)" >>> 02:31:36 .jaeger 158 jaeger i text=3D"Command 'unwind' failed because o= f >>> an uncaught error 'RuntimeError: unwind: cannot modify a done command w= ith >>> status .'. See traceback in the log for more >>> information." >>> >>> Applying jaeger explode 5. Positioner 612 does not appear to be close = to >>> anything, but is reporting collision. >>> >>> 02:32:44 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 02:32:44 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 02:32:45 .jaeger 0 jaeger i fps_status=3D0x14 >>> 02:32:46 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 02:32:50 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0005.pd= f >>> 02:32:50 OBSERVER.kpan 85 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0005.json >>> 02:32:50 OBSERVER.kpan 85 jaeger f error=3D"Trajectory failed with erro= r: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.49 seconds after start" >>> 02:32:50 CmdDone: OBSERVER.kpan 85 jaeger explode 10 >>> >>> 02:33:53 CmdStarted: OBSERVER.kpan 87 jaeger status 612 >>> positioner_status=3D612,154.4269,121.9903,0x8db067e1,T,F,F,F,04.01.21,1= ,1,5 >>> >>> 02:34:47 CmdStarted: OBSERVER.kpan 88 jaeger goto 612 155.4 120 >>> >>> 02:35:04 CmdStarted: OBSERVER.kpan 89 jaeger goto 612 156.4 120 >>> >>> jaeger unwind worked this time. >>> >>> 02:36:46 CmdStarted: OBSERVER.kpan 91 jaeger disable 612 >>> >>> Time stamps of collisions: >>> 02:28:26 Jaeger collision: 612 >>> 02:31:01 Jaeger collision: 612 >>> 02:31:30 Jaeger collision: 612 >>> 02:32:15 Jaeger collision: 612 >>> 02:32:44 Jaeger collision: 612 >>> >>> >>> 02:38:11 CmdStarted: OBSERVER.kpan 93 jaeger configuration load >>> --no-clone >>> >>> 02:39:52 Field-Design-Configuration: 101175-43161-5561 >>> >>> 02:40:00 CmdStarted: OBSERVER.kpan 94 jaeger configuration load >>> --no-clone 43160 >>> >>> 02:40:56 Field-Design-Configuration: 101175-43160-5562 >>> >>> HARTMANN: >>> 02:42:08 boss exposure 4.0, file=3D342514 >>> 02:42:49 boss exposure 4.0, file=3D342515 >>> 02:43:32 sp1.motor.move=3D 1330, 1330, 1330 >>> 02:43:32 Hartmann collimate output >>> sp1: offset: r=3D 989 (In Focus); b=3D -5.2 (Out of focus) >>> sp1: pred. move: spAverageMove=3D 1330 >>> sp1: pred. resid: r=3D -341, b=3D -1.1, txt=3D OK, spTemp =3D 9.6 >>> >>> BOSS cals: >>> 02:43:50 boss exposure 4.0, file=3D342516 >>> 02:45:29 boss exposure 25.0, file=3D342517 >>> >>> FVC Loop: >>> 02:43:35 hal.hal 3212 jaeger i text=3D"FVC iteration 1" >>> 02:43:55 hal.hal 3212 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0002.fits >>> 02:44:02 hal.hal 3212 jaeger i fvc_rms=3D42.34 >>> 02:44:02 hal.hal 3212 jaeger i fvc_perc_90=3D63.9 >>> 02:44:02 hal.hal 3212 jaeger i fvc_percent_reached=3D1.6 >>> 02:44:18 hal.hal 3212 jaeger i text=3D"FVC iteration 2" >>> 02:44:38 hal.hal 3212 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0003.fits >>> 02:44:45 hal.hal 3212 jaeger i fvc_rms=3D17.11 >>> 02:44:45 hal.hal 3212 jaeger i fvc_deltarms=3D25.230000000000004 >>> 02:44:45 hal.hal 3212 jaeger i fvc_perc_90=3D9.2 >>> 02:44:45 hal.hal 3212 jaeger i fvc_percent_reached=3D54.2 >>> >>> 02:49Z The boson:guider gui was not showing the current exposures. We >>> found a simulation going on, so we issued a "fliswarm simulate --stop". >>> >>> Seeing is 2.0", cloud/dust approaching site. >>> >>> DATA: >>> 02:52:31 apogee.expose=3DapRaw-41640014, 43, A, Object >>> 02:52:38 boss exposure 900.0, file=3D342518 >>> 03:00:13 apogee.expose=3DapRaw-41640015, 43, B, Object >>> >>> 03:09:13 Field-Design-Configuration: 101175-43161-5563 >>> >>> FVC Loop: >>> 03:11:17 hal.hal 3246 jaeger i text=3D"FVC iteration 1" >>> 03:11:37 hal.hal 3246 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0004.fits >>> 03:11:44 hal.hal 3246 jaeger i fvc_rms=3D38.129999999999995 >>> 03:11:44 hal.hal 3246 jaeger i fvc_perc_90=3D55.4 >>> 03:11:44 hal.hal 3246 jaeger i fvc_percent_reached=3D4.1 >>> 03:12:00 hal.hal 3246 jaeger i text=3D"FVC iteration 2" >>> 03:12:20 hal.hal 3246 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0005.fits >>> 03:12:26 hal.hal 3246 jaeger i fvc_rms=3D6.819999999999999 >>> 03:12:26 hal.hal 3246 jaeger i fvc_deltarms=3D31.309999999999995 >>> 03:12:26 hal.hal 3246 jaeger i fvc_perc_90=3D9.2 >>> 03:12:26 hal.hal 3246 jaeger i fvc_percent_reached=3D59.9 >>> >>> Seeing is 2.0" >>> >>> DATA: >>> 03:16:00 apogee.expose=3DapRaw-41640016, 43, B, Object >>> 03:16:06 boss exposure 900.0, file=3D342519 >>> 03:23:45 apogee.expose=3DapRaw-41640017, 43, A, Object >>> >>> >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D >>> >>> 03:29:04 CmdStarted: OBSERVER.kpan 101 jaeger enable 612 >>> >>> 03:31:13 Field-Design-Configuration: 104639-57937-5564 >>> >>> Configuration successful >>> >>> HARTMANN: >>> 03:33:15 boss exposure 4.0, file=3D342520 >>> 03:33:58 boss exposure 4.0, file=3D342521 >>> 03:34:39 sp1.motor.move=3D 673, 675, 674 >>> 03:34:39 Hartmann collimate output >>> sp1: offset: r=3D 0 (In Focus); b=3D -4.2 (Out of focus) >>> sp1: pred. move: spAverageMove=3D 674 >>> sp1: pred. resid: r=3D -674, b=3D -2.1, txt=3D OK, spTemp =3D 9.6 >>> >>> BOSS Cals >>> 03:34:58 boss exposure 4.0, file=3D342522 >>> 03:36:34 boss exposure 25.0, file=3D342523 >>> >>> FVC Loop: >>> 03:34:42 hal.hal 3272 jaeger i text=3D"FVC iteration 1" >>> 03:35:02 hal.hal 3272 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0006.fits >>> 03:35:09 hal.hal 3272 jaeger i fvc_rms=3D41.529999999999994 >>> 03:35:09 hal.hal 3272 jaeger i fvc_perc_90=3D61.400000000000006 >>> 03:35:09 hal.hal 3272 jaeger i fvc_percent_reached=3D2.4 >>> 03:35:25 hal.hal 3272 jaeger i text=3D"FVC iteration 2" >>> 03:35:46 hal.hal 3272 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0007.fits >>> 03:35:53 hal.hal 3272 jaeger i fvc_rms=3D20.95 >>> 03:35:53 hal.hal 3272 jaeger i fvc_deltarms=3D20.579999999999995 >>> 03:35:53 hal.hal 3272 jaeger i fvc_perc_90=3D9.799999999999999 >>> 03:35:53 hal.hal 3272 jaeger i fvc_percent_reached=3D57.8 >>> >>> Seeing is 1.6" >>> >>> DATA: >>> 03:40:43 apogee.expose=3DapRaw-41640018, 46, A, Object >>> 03:40:50 boss exposure 900.0, file=3D342524 >>> 03:48:56 apogee.expose=3DapRaw-41640019, 46, B, Object >>> 03:57:06 apogee.expose=3DapRaw-41640020, 43, B, Object >>> 03:57:13 boss exposure 900.0, file=3D342525 >>> 04:04:51 apogee.expose=3DapRaw-41640021, 43, A, Object >>> >>> 04:11Z Seeing is worsening. Now at 2.6" >>> >>> >>> 04:12:20 Field-Design-Configuration: 104639-57938-5565 >>> >>> FVC Loop: >>> 04:14:21 hal.hal 3310 jaeger i text=3D"FVC iteration 1" >>> 04:14:41 hal.hal 3310 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0008.fits >>> 04:14:48 hal.hal 3310 jaeger i fvc_rms=3D41.17 >>> 04:14:48 hal.hal 3310 jaeger i fvc_perc_90=3D59.4 >>> 04:14:48 hal.hal 3310 jaeger i fvc_percent_reached=3D2.7 >>> 04:15:05 hal.hal 3310 jaeger i text=3D"FVC iteration 2" >>> 04:15:25 hal.hal 3310 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0009.fits >>> 04:15:32 hal.hal 3310 jaeger i fvc_rms=3D9.08 >>> 04:15:33 hal.hal 3310 jaeger i fvc_deltarms=3D32.09 >>> 04:15:33 hal.hal 3310 jaeger i fvc_perc_90=3D8.8 >>> 04:15:33 hal.hal 3310 jaeger i fvc_percent_reached=3D61.6 >>> >>> Seeing is 2.0" >>> >>> DATA: >>> 04:19:00 apogee.expose=3DapRaw-41640022, 46, A, Object >>> 04:19:07 boss exposure 900.0, file=3D342526 >>> 04:27:13 apogee.expose=3DapRaw-41640023, 46, B, Object >>> >>> Postponing the telescope dither test because the seeing is unstable. >>> The >>> RMS values are also rather poor with 1.6-2.5 values. Seeing is between >>> 1.8 >>> and 2.5". >>> >>> 04:35:22 apogee.expose=3DapRaw-41640024, 43, B, Object >>> 04:35:31 boss exposure 900.0, file=3D342527 >>> 04:43:08 apogee.expose=3DapRaw-41640025, 43, A, Object >>> 04:52:00 apogee.expose=3DapRaw-41640026, 43, A, Object >>> 04:52:07 boss exposure 900.0, file=3D342528 >>> 04:59:41 apogee.expose=3DapRaw-41640027, 43, B, Object >>> >>> 05:07:14 Field-Design-Configuration: 104639-57939-5566 >>> >>> FVC Loop: >>> 05:09:01 hal.hal 3345 jaeger i text=3D"FVC iteration 1" >>> 05:09:21 hal.hal 3345 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0010.fits >>> 05:09:28 hal.hal 3345 jaeger i fvc_rms=3D38.39 >>> 05:09:28 hal.hal 3345 jaeger i fvc_perc_90=3D54.5 >>> 05:09:28 hal.hal 3345 jaeger i fvc_percent_reached=3D3.9 >>> 05:09:49 hal.hal 3345 jaeger i text=3D"FVC iteration 2" >>> 05:10:10 hal.hal 3345 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0011.fits >>> 05:10:17 hal.hal 3345 jaeger i fvc_rms=3D11.66 >>> 05:10:17 hal.hal 3345 jaeger i fvc_deltarms=3D26.73 >>> 05:10:17 hal.hal 3345 jaeger i fvc_perc_90=3D8.7 >>> 05:10:17 hal.hal 3345 jaeger i fvc_percent_reached=3D62.0 >>> >>> Seeing is 1.9" >>> >>> DATA: >>> 05:13:14 apogee.expose=3DapRaw-41640028, 46, B, Object >>> 05:13:20 boss exposure 900.0, file=3D342529 >>> 05:21:31 apogee.expose=3DapRaw-41640029, 46, A, Object >>> 05:29:41 apogee.expose=3DapRaw-41640030, 43, A, Object >>> 05:29:46 boss exposure 900.0, file=3D342530 >>> 05:37:21 apogee.expose=3DapRaw-41640031, 43, B, Object >>> 05:46:40 apogee.expose=3DapRaw-41640032, 43, B, Object >>> 05:46:47 boss exposure 900.0, file=3D342531 >>> 05:54:26 apogee.expose=3DapRaw-41640033, 43, A, Object >>> >>> 06:01:55 Field-Design-Configuration: 104639-57940-5567 >>> >>> 06:03:34 Jaeger collision: 612 >>> >>> 06:03:34 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 06:03:36 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 06:03:40 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0024.pd= f >>> 06:03:40 hal.hal 3378 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0024.json >>> 06:03:40 hal.hal 3378 jaeger f error=3D"Trajectory failed with error: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 39.12 seconds after start" >>> 06:03:40 CmdDone: hal.hal 3378 jaeger configuration execute >>> 06:03:40 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0024.pd= f >>> 06:03:40 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0024.pdf >>> (JaegerUserWarning)" >>> >>> Skipping this last design since we are running out of time to complete >>> this >>> epoch. >>> >>> >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D >>> 06:07:02 Field-Design-Configuration: 112359-107018-5568 >>> >>> HARTMANN: >>> 06:08:17 boss exposure 4.0, file=3D342532 >>> 06:08:57 boss exposure 4.0, file=3D342533 >>> 06:09:38 sp1.motor.move=3D -461, -464, -463 >>> 06:09:38 Hartmann collimate output >>> sp1: offset: r=3D -989 (In Focus); b=3D -0.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D -462 >>> sp1: pred. resid: r=3D -526, b=3D -1.7, txt=3D OK, spTemp =3D 8.9 >>> >>> BOSS cals: >>> 06:09:57 boss exposure 4.0, file=3D342534 >>> 06:11:35 boss exposure 25.0, file=3D342535 >>> >>> FVC Loop: >>> 06:09:42 hal.hal 3393 jaeger i text=3D"FVC iteration 1" >>> 06:10:02 hal.hal 3393 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0012.fits >>> 06:10:09 hal.hal 3393 jaeger i fvc_rms=3D40.0 >>> 06:10:09 hal.hal 3393 jaeger i fvc_perc_90=3D58.9 >>> 06:10:09 hal.hal 3393 jaeger i fvc_percent_reached=3D2.7 >>> 06:10:26 hal.hal 3393 jaeger i text=3D"FVC iteration 2" >>> 06:10:46 hal.hal 3393 jaeger d >>> fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0013.fits >>> 06:10:53 hal.hal 3393 jaeger i fvc_rms=3D6.57 >>> 06:10:53 hal.hal 3393 jaeger i fvc_deltarms=3D33.43 >>> 06:10:53 hal.hal 3393 jaeger i fvc_perc_90=3D8.4 >>> 06:10:53 hal.hal 3393 jaeger i fvc_percent_reached=3D63.1 >>> >>> Seeing is 2.0" >>> >>> DATA: >>> 06:14:49 apogee.expose=3DapRaw-41640034, 46, A, Object >>> 06:14:55 boss exposure 900.0, file=3D342536 >>> 06:23:02 apogee.expose=3DapRaw-41640035, 46, B, Object >>> 06:31:11 apogee.expose=3DapRaw-41640036, 43, B, Object >>> 06:31:18 boss exposure 900.0, file=3D342537 >>> 06:38:57 apogee.expose=3DapRaw-41640037, 43, A, Object >>> >>> 06:46:29 Field-Design-Configuration: 112359-107019-5569 >>> >>> Seeing is 2.6" Seeing has been variable for the past hour >>> >>> DATA: >>> 06:47:53 apogee.expose=3DapRaw-41640038, 46, A, Object >>> 06:48:00 boss exposure 900.0, file=3D342538 >>> 06:56:06 apogee.expose=3DapRaw-41640039, 46, B, Object >>> 07:04:16 apogee.expose=3DapRaw-41640040, 43, B, Object >>> 07:04:23 boss exposure 900.0, file=3D342539 >>> 07:12:01 apogee.expose=3DapRaw-41640041, 43, A, Object >>> 07:20:48 apogee.expose=3DapRaw-41640042, 43, A, Object >>> 07:20:54 boss exposure 900.0, file=3D342540 >>> 07:28:29 apogee.expose=3DapRaw-41640043, 43, B, Object >>> >>> >>> 07:35:59 Field-Design-Configuration: 112359-107020-5570 >>> >>> Seeing is 2.3" >>> >>> DATA: >>> 07:37:14 apogee.expose=3DapRaw-41640044, 46, B, Object >>> 07:37:20 boss exposure 900.0, file=3D342541 >>> 07:45:31 apogee.expose=3DapRaw-41640045, 46, A, Object >>> 07:53:41 apogee.expose=3DapRaw-41640046, 43, A, Object >>> 07:53:44 boss exposure 900.0, file=3D342542 >>> 08:01:22 apogee.expose=3DapRaw-41640047, 43, B, Object >>> >>> Some clouds are coming in. >>> >>> 08:11:50 apogee.expose=3DapRaw-41640048, 46, B, Object >>> 08:11:57 boss exposure 900.0, file=3D342543 >>> 08:20:08 apogee.expose=3DapRaw-41640049, 46, A, Object >>> 08:28:18 apogee.expose=3DapRaw-41640050, 43, A, Object >>> 08:28:21 boss exposure 900.0, file=3D342544 >>> 08:35:59 apogee.expose=3DapRaw-41640051, 43, B, Object >>> >>> 08:29Z Seeing is 3.6" >>> >>> 08:32Z Refreshed the Kronos queue and we only see the RM field is >>> available. >>> We are approaching airmass of 1.4. We cannot observe this field for th= e >>> rest of the night. The observability windows are different and not >>> correct. >>> >>> 08:45:29 apogee.expose=3DapRaw-41640052, 43, B, Object >>> 08:45:35 boss exposure 900.0, file=3D342545 >>> 08:53:14 apogee.expose=3DapRaw-41640053, 43, A, Object >>> >>> 08:48Z Refreshed the Kronos queue again, and now we have sensible field= s. >>> Seeing bloomed up to 5.5". Not getting useful signal at all. >>> >>> 09:01Z Giving up on this field since we have passed airmass 1.4. >>> >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D >>> 09:01:13 Field-Design-Configuration: 104541-56893-5571 >>> >>> 09:02:52 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:02:52 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:02:53 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 09:02:57 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0029.pd= f >>> 09:02:57 hal.hal 3470 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0029.json >>> 09:02:57 hal.hal 3470 jaeger f error=3D"Trajectory failed with error: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 28.68 seconds after start" >>> 09:02:57 CmdDone: hal.hal 3470 jaeger configuration execute >>> 09:02:57 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0029.pd= f >>> 09:02:57 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0029.pdf >>> (JaegerUserWarning)" >>> >>> 09:04:07 jaeger unlock >>> >>> Trying to unwind: >>> >>> 09:04:14 OBSERVER.kpan 118 jaeger d text=3D"Calculating unwind trajecto= ry." >>> 09:04:14 OBSERVER.kpan 118 jaeger f error=3D"Command 'unwind' failed >>> because of an uncaught error 'RuntimeError: Grid is Kaiju-collided, can= not >>> generate paths'. See traceback in the log for more information." >>> 09:04:14 CmdDone: OBSERVER.kpan 118 jaeger unwind >>> >>> 09:05:12 CmdStarted: OBSERVER.kpan 120 jaeger explode 612 >>> Oops - took a while for the command to fail. >>> >>> 09:07:08 CmdStarted: OBSERVER.kpan 122 jaeger explode 5 >>> >>> 09:07:08 CmdStarted: OBSERVER.kpan 122 jaeger explode 5 >>> 09:07:08 OBSERVER.kpan 122 jaeger > >>> 09:07:08 OBSERVER.kpan 122 jaeger d text=3D"Calculating explode >>> trajectory." >>> 09:07:09 OBSERVER.kpan 122 jaeger i text=3D"Executing explode trajector= y." >>> 09:07:09 OBSERVER.kpan 122 jaeger d text=3D"Sending trajectory data." >>> 09:07:13 OBSERVER.kpan 122 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0031.json >>> 09:07:13 OBSERVER.kpan 122 jaeger d text=3D"Trajectory sent in 2.2 >>> seconds." >>> 09:07:13 OBSERVER.kpan 122 jaeger i move_time=3D1.62 >>> 09:07:13 OBSERVER.kpan 122 jaeger i text=3D"Starting trajectory ..." >>> 09:07:14 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:07:14 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:07:14 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:07:16 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 09:07:20 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0031.pd= f >>> 09:07:20 OBSERVER.kpan 122 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0031.json >>> 09:07:20 OBSERVER.kpan 122 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 6.90 seconds after start" >>> 09:07:20 CmdDone: OBSERVER.kpan 122 jaeger explode 5 >>> 09:07:20 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0031.pd= f >>> >>> 09:08:13 CmdStarted: OBSERVER.kpan 126 jaeger unlock >>> 09:08:48 CmdStarted: OBSERVER.kpan 127 jaeger goto 612 11 171 >>> >>> 09:08:59 OBSERVER.kpan 127 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0032.json >>> 09:08:59 OBSERVER.kpan 127 jaeger f error=3D"Goto command failed: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.67 seconds after start" >>> 09:08:59 CmdDone: OBSERVER.kpan 127 jaeger goto 612 11 171 >>> 09:08:59 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0032.pd= f >>> >>> Position 612 appears to be at home, but is still causing all the unlock= s >>> to >>> happen. >>> >>> 09:09:41 CmdStarted: OBSERVER.kpan 129 jaeger unwind --force >>> 09:10:00 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:10:00 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:10:01 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:10:02 .jaeger 0 jaeger e locked=3DT; locked_by=3D902 >>> 09:10:07 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0033.pd= f >>> 09:10:07 OBSERVER.kpan 129 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0033.json >>> 09:10:07 OBSERVER.kpan 129 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.99 seconds after start" >>> 09:10:07 CmdDone: OBSERVER.kpan 129 jaeger unwind --force >>> 09:10:07 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0033.pd= f >>> >>> 09:10:29 CmdDone: OBSERVER.kpan 130 jaeger unlock >>> 09:10:51 CmdStarted: OBSERVER.kpan 131 jaeger explode 5 >>> >>> 09:10:57 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:10:57 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:10:57 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:10:58 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 09:11:03 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0034.pd= f >>> 09:11:03 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0034.pdf >>> (JaegerUserWarning)" >>> 09:11:03 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0034.pd= f >>> 09:11:03 OBSERVER.kpan 131 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0034.json >>> 09:11:03 OBSERVER.kpan 131 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.35 seconds after start" >>> 09:11:03 CmdDone: OBSERVER.kpan 131 jaeger explode 5 >>> >>> Still complaining about position 612, which is close to home position >>> and not >>> collided against anything. >>> >>> Doing a combination of jaeger unlock and jaeger explode 5 commands. >>> >>> 09:12:19 CmdStarted: OBSERVER.kpan 135 jaeger status 612 >>> 09:12:19 OBSERVER.kpan 135 jaeger > >>> 09:12:20 OBSERVER.kpan 135 jaeger i >>> positioner_status=3D612,8.9623,169.986,0x8db067e1,T,F,F,F,04.01.21,1,1,= 35 >>> 09:12:20 OBSERVER.kpan 135 jaeger : >>> 09:12:20 CmdDone: OBSERVER.kpan 135 jaeger status 612 >>> >>> 09:12:42 jaeger goto 612 10 170 >>> >>> 09:13:03 jaeger unwind >> >>> Reloading design >>> >>> 09:16:38 Field-Design-Configuration: 104541-56893-5572 >>> 09:17:36 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:17:36 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:17:37 .jaeger 0 jaeger e locked=3DT; locked_by=3D612 >>> 09:17:37 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:17:42 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0038.pd= f >>> 09:17:42 OBSERVER.kpan 139 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0038.json >>> 09:17:42 OBSERVER.kpan 139 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 28.80 seconds after start" >>> 09:17:42 CmdDone: OBSERVER.kpan 139 jaeger configuration execute >>> 09:17:42 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0038.pd= f >>> 09:17:42 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0038.pdf >>> (JaegerUserWarning)" >>> >>> 09:18:06 CmdStarted: OBSERVER.kpan 141 jaeger status 612 >>> 09:18:06 OBSERVER.kpan 141 jaeger > >>> 09:18:07 OBSERVER.kpan 141 jaeger i >>> positioner_status=3D612,10.0653,169.986,0x8db067e1,T,F,F,F,04.01.21,1,1= ,38 >>> >>> Disabling position 612 since it is consistently causing trouble. >>> >>> 09:18:18 CmdStarted: OBSERVER.kpan 142 jaeger goto 612 10 170 >>> 09:18:18 OBSERVER.kpan 142 jaeger > >>> 09:18:19 OBSERVER.kpan 142 jaeger f error=3D"Command 'goto 612 10 170' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:18:19 CmdDone: OBSERVER.kpan 142 jaeger goto 612 10 170 >>> >>> 09:18:53 CmdStarted: OBSERVER.kpan 146 jaeger goto 612 10 171 >>> 09:18:53 OBSERVER.kpan 146 jaeger > >>> 09:18:53 OBSERVER.kpan 146 jaeger f error=3D"Command 'goto 612 10 171' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:18:53 CmdDone: OBSERVER.kpan 146 jaeger goto 612 10 171 >>> >>> 09:19:09 CmdStarted: OBSERVER.kpan 148 jaeger status 612 >>> 09:19:09 OBSERVER.kpan 148 jaeger > >>> 09:19:10 OBSERVER.kpan 148 jaeger i >>> positioner_status=3D612,10.0653,169.9859,0x8db067e1,T,F,F,F,04.01.21,1,= 1,38 >>> >>> 09:19:34 CmdStarted: OBSERVER.kpan 149 jaeger disable 612 >>> >>> 09:19:42 CmdStarted: OBSERVER.kpan 150 jaeger unwind >>> 09:19:42 OBSERVER.kpan 150 jaeger > >>> 09:19:43 OBSERVER.kpan 150 jaeger i folded=3DF >>> 09:19:43 OBSERVER.kpan 150 jaeger d text=3D"Calculating unwind trajecto= ry." >>> 09:19:43 OBSERVER.kpan 150 jaeger f error=3D"Command 'unwind' failed >>> because of an uncaught error 'RuntimeError: Grid is Kaiju-collided, can= not >>> generate paths'. See traceback in the log for more information." >>> 09:19:43 CmdDone: OBSERVER.kpan 150 jaeger unwind >>> >>> 09:20:19 CmdStarted: OBSERVER.kpan 152 jaeger explode 5 >>> >>> 09:20:24 OBSERVER.kpan 152 jaeger i text=3D"Starting trajectory ..." >>> 09:20:26 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:20:26 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:20:26 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:20:28 .jaeger 0 jaeger e locked=3DT; locked_by=3D902 >>> 09:20:29 .jaeger 0 jaeger f text=3D"Failed setting chiller temperature.= " >>> 09:20:32 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0039.pd= f >>> 09:20:32 OBSERVER.kpan 152 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0039.json >>> 09:20:32 OBSERVER.kpan 152 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.68 seconds after start" >>> 09:20:32 CmdDone: OBSERVER.kpan 152 jaeger explode 5 >>> >>> Trying to unwind/explode, and like before, positioner 902 is causing >>> trouble. >>> >>> Trying again >>> 09:20:52 jaeger unwind >> >>> 09:21:50 CmdStarted: OBSERVER.kpan 155 jaeger status 612 >>> 09:21:50 OBSERVER.kpan 155 jaeger > >>> 09:21:51 OBSERVER.kpan 155 jaeger i >>> positioner_status=3D612,10.0608,169.9861,0x8db067e1,T,T,F,F,04.01.21,1,= 1,40 >>> >>> 09:22:07 CmdStarted: OBSERVER.kpan 156 jaeger status 902 >>> 09:22:07 OBSERVER.kpan 156 jaeger > >>> 09:22:08 OBSERVER.kpan 156 jaeger i >>> positioner_status=3D902,9.9954,170.0,0x8db067e1,T,F,F,F,04.01.21,3,1,40 >>> >>> Time stamps of the collisions: >>> 09:02:52 Jaeger collision: 612 >>> 09:06:40 Jaeger collision: 612 >>> 09:07:14 Jaeger collision: 612 >>> 09:08:53 Jaeger collision: 612 >>> 09:10:00 Jaeger collision: 902 >>> 09:10:57 Jaeger collision: 612 >>> 09:11:32 Jaeger collision: 612 >>> 09:17:36 Jaeger collision: 612 >>> 09:20:26 Jaeger collision: 902 >>> >>> Reloading the design again: >>> 09:25:19 Field-Design-Configuration: 104541-56893-5573 >>> >>> 09:26:05 Jaeger collision: 902 >>> >>> 09:26:05 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:26:05 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:26:06 .jaeger 0 jaeger e locked=3DT; locked_by=3D902 >>> 09:26:06 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:26:10 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0042.pd= f >>> 09:26:10 hal.hal 3481 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0042.json >>> 09:26:10 hal.hal 3481 jaeger f error=3D"Trajectory failed with error: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 33.52 seconds after start" >>> 09:26:10 CmdDone: hal.hal 3481 jaeger configuration execute >>> 09:26:10 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0042.pd= f >>> 09:26:10 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0042.pdf >>> (JaegerUserWarning)" >>> >>> 09:27:06 CmdStarted: OBSERVER.kpan 163 jaeger status 902 >>> 09:27:06 OBSERVER.kpan 163 jaeger > >>> 09:27:07 OBSERVER.kpan 163 jaeger i >>> positioner_status=3D902,10.0022,169.8934,0x8db067e1,T,F,F,F,04.01.21,3,= 1,42 >>> >>> This positioner is mostly at home. Unlocking and issuing jaeger >>> configuration >>> reverse: >>> >>> 09:27:56 CmdStarted: OBSERVER.kpan 166 jaeger configuration reverse >>> 09:27:56 OBSERVER.kpan 166 jaeger > >>> 09:27:56 OBSERVER.kpan 166 jaeger f error=3D"The configuration was not >>> executed. Try unwinding." >>> 09:27:56 CmdDone: OBSERVER.kpan 166 jaeger configuration reverse >>> >>> Doing an explode 5 >>> >>> 09:28:23 OBSERVER.kpan 168 jaeger i text=3D"Starting trajectory ..." >>> 09:28:24 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:28:24 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:28:25 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:28:26 .jaeger 0 jaeger e locked=3DT; locked_by=3D902 >>> 09:28:30 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0043.pd= f >>> 09:28:30 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0043.pdf >>> (JaegerUserWarning)" >>> 09:28:30 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0043.pd= f >>> 09:28:30 OBSERVER.kpan 168 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0043.json >>> 09:28:30 OBSERVER.kpan 168 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.38 seconds after start" >>> >>> 09:28:52 jaeger unlock >>> >>> 09:29:24 CmdStarted: OBSERVER.kpan 171 jaeger goto 902 10 171 >>> >>> 09:28:24 Jaeger collision: 902 >>> 09:30:11 Jaeger collision: 902 >>> >>> Trying to unwind, it is unsuccessful >>> >>> 09:30:11 .jaeger 0 jaeger f text=3D"A collision was detected in positio= ner >>> 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 09:30:11 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning= )" >>> 09:30:11 .jaeger 0 jaeger i fps_status=3D0x14 >>> 09:30:12 .jaeger 0 jaeger e locked=3DT; locked_by=3D902 >>> 09:30:17 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0045.pd= f >>> 09:30:17 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: >>> /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0045.pdf >>> (JaegerUserWarning)" >>> 09:30:17 .jaeger 0 jaeger i >>> snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0045.pd= f >>> 09:30:17 OBSERVER.kpan 172 jaeger d >>> trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0045.json >>> 09:30:17 OBSERVER.kpan 172 jaeger f error=3D"Trajectory failed with err= or: >>> Something went wrong during the trajectory: The FPS got locked during t= he >>> trajectory. Trajectory failed 7.15 seconds after start" >>> 09:30:17 CmdDone: OBSERVER.kpan 172 jaeger unwind >>> >>> 09:30:41 CmdStarted: OBSERVER.kpan 174 jaeger status 902 >>> 09:30:41 OBSERVER.kpan 174 jaeger > >>> 09:30:42 OBSERVER.kpan 174 jaeger i >>> positioner_status=3D902,10.0176,170.9487,0x8db067e1,T,F,F,F,04.01.21,3,= 1,45 >>> 09:30:42 OBSERVER.kpan 174 jaeger : >>> 09:30:42 CmdDone: OBSERVER.kpan 174 jaeger status 902 >>> 09:30:42 .jaeger 0 jaeger d alive_at=3D1653643842.422802 >>> 09:30:50 CmdStarted: OBSERVER.kpan 175 jaeger goto 902 10 171 >>> 09:30:50 OBSERVER.kpan 175 jaeger > >>> 09:30:50 OBSERVER.kpan 175 jaeger f error=3D"Command 'goto 902 10 171' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:30:50 CmdDone: OBSERVER.kpan 175 jaeger goto 902 10 171 >>> >>> 09:31:21 CmdStarted: OBSERVER.kpan 177 jaeger goto 902 10 170 >>> 09:31:21 OBSERVER.kpan 177 jaeger > >>> 09:31:22 OBSERVER.kpan 177 jaeger f error=3D"Command 'goto 902 10 170' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:31:22 CmdDone: OBSERVER.kpan 177 jaeger goto 902 10 170 >>> >>> 09:31:56 CmdStarted: OBSERVER.kpan 180 jaeger unwind --force >>> 09:31:56 OBSERVER.kpan 180 jaeger > >>> 09:31:57 OBSERVER.kpan 180 jaeger i folded=3DF >>> 09:31:57 OBSERVER.kpan 180 jaeger d text=3D"Calculating unwind trajecto= ry." >>> 09:31:57 OBSERVER.kpan 180 jaeger f error=3D"Command 'unwind --force' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:31:57 CmdDone: OBSERVER.kpan 180 jaeger unwind --force >>> >>> 09:32:28 CmdStarted: OBSERVER.kpan 183 jaeger goto 902 10 169 >>> 09:32:28 OBSERVER.kpan 183 jaeger > >>> 09:32:29 OBSERVER.kpan 183 jaeger f error=3D"Command 'goto 902 10 169' >>> failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, >>> cannot generate paths'. See traceback in the log for more information." >>> 09:32:29 CmdDone: OBSERVER.kpan 183 jaeger goto 902 10 169 >>> >>> 09:34:27 CmdStarted: OBSERVER.karen 3 jaeger explode 10 >>> 09:34:46 CmdStarted: OBSERVER.karen 4 jaeger unwind --force >>> >>> This worked. >>> >>> Dust counts have risen. Seeing is poor (> 2.5"). We can smell some >>> smoke in places >>> on site, and there appears to be some smoggy air (can see headlight bea= m) >>> as we walk down to the enclosure. >>> >>> To be preventative going into the holiday weekend, we are going to clos= e >>> now. >>> >>> APOGEE dome flat: >>> 09:42:09 apogee.expose=3DapRaw-41640054, 5, A, DomeFlat >>> 09:43:37 apogee.expose=3DapRaw-41640055, 5, A, DomeFlat >>> 09:45:07 apogee.expose=3DapRaw-41640056, 5, A, DomeFlat >>> >>> 09:52:37 encl25m : closed; >>> >>> >>> 09:56Z Started morning cals. FPS powered off. >>> >>> ---- Mirror Numbers ---- >>> >>> >>> PRIMARY: >>> -------- >>> Scale: 1.000000 >>> >>> MIGS TONIGHT NOMINAL >>> Axial A: 0.0150 0.0140 >>> Axial B: 0.0060 0.0050 >>> Axial C: -0.0190 -0.0200 >>> Trans D: 0.0020 0.0010 >>> Lateral E: 0.3315 0.3315 >>> Lateral F: 0.5345 0.5345 >>> >>> GALILS >>> Commanded: 12500 -1600 5300 47050 -8800 -8400 >>> Actual: 12500 -1600 5300 47050 -8800 -8400 >>> >>> SETMIR VALUES >>> PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 >>> PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 >>> >>> SECONDARY: >>> ---------- >>> >>> Focus: 0.0000 >>> Air temp: 20.61 >>> Altitude: 30.0 >>> >>> MIGS TONIGHT NOMINAL >>> Axial A: -9.6540 -9.6550 >>> Axial B: -0.0470 -0.0470 >>> Axial C: -9.7020 -9.7010 >>> Trans D: 0.1020 0.1030 >>> >>> GALILS >>> Commanded: 4877900 4874550 4895750 -50 -3450 >>> Actual: 4859192 4859186 4859280 -50 -3450 >>> >>> SETMIR VALUES >>> SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 >>> SecOrient: 3857.0 -0.03 -0.0 -0.0 42.89 >>> >>> >>> >>> ---- Telescope Status ---- >>> >>> 00:40Z Started ventilation >>> 02:03Z encl25m : open >>> 09:52Z encl25m : closed >>> >>> No interlocks bypassed >>> >>> Status at: 10:01Z >>> Telescope stowed at: 121.0, 30.0, 0.0 mount >>> Instrument mounted: FPS >>> Counterweights at: 683 685 703 702 >>> LN2 autofill systems: Connected and turned on >>> 180L LN2 dewar scales: SP1 106 lbs, 22.1 psi >>> >>> >>> >>> >>> ---- Software Used ---- >>> >>> -- STUI software: >>> STUI : 1.7.17b1 >>> alerts : 2.2.1 >>> boss : 6.0.1 >>> -boss.specMec : 3.0.4 >>> apo : 3.0.1 >>> fliswarm : 0.2.1-alpha.0 >>> jaeger : 0.15.2-alpha.0 >>> kaiju : 1.2.4-alpha.0 >>> coordio : 1.4.0-alpha.0 >>> fps_calibrati : APO.2022.04.21+55c1d22 >>> cherno : 0.1.1-alpha.0 >>> hal : 0.1.1-alpha.0 >>> hartmann : 2.0.2 >>> hub : 5.0.1a0 >>> mcp : 2.1 >>> -mcp.plc : 34 >>> -mcp.azFiduci : v1_148 >>> -mcp.altFiduc : v1_148 >>> -mcp.rotFiduc : v1_148 >>> tcc : 1.4.0 >>> apogee : not availble >>> apogeecal : not availble >>> apogeeql : v1_7_0dev >>> STUIAdditions : 3.1.13 >>> >>> >>> ---- APOGEE Data Summary ---- >>> >>> >>> list_ap >>> APOGEE data list, mjd=3D59726, all >>> raw_data: /data/apogee/utr_cdr/59726/apRaw-*.fits >>> archive: /data/apogee/archive/59726/apR-[a,b,c]-*.apz >>> quickred: /data/apogee/quickred/59726/apq-*.fits >>> -----------------------------------------------------------------------= ------- >>> >>> mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset >>> %Flux/FPI Comm >>> >>> -----------------------------------------------------------------------= ------- >>> 59726 1 23:48 41640001 Dark 3 A 13.0 ---------- a-b-c - >>> - >>> 59726 2 00:02 41640002 Dark 60 A 13.0 ---------- a-b-c - >>> - >>> 59726 3 00:04 41640003 QuarFlat 10 A 13.0 ---------- a-b-c - >>> - >>> 59726 4 00:06 41640004 Arc-Thar 12 B 13.5 ---------- a-b-c 0.9= 4 >>> - >>> 59726 5 00:13 41640005 Arc-Une 40 B 13.5 ---------- a-b-c - >>> - >>> 59726 6 00:16 41640006 Arc-Thar 12 A 13.0 ---------- a-b-c 0.5= 2 >>> - >>> 59726 7 00:23 41640007 Arc-Une 40 A 13.0 ---------- a-b-c - >>> - >>> 59726 8 00:34 41640008 Dark 60 A 13.0 ---------- a-b-c - >>> - >>> 59726 9 00:40 41640009 Arc---- 30 A 13.0 ---------- a-b-c - >>> 98 FPI >>> 59726 10 02:09 41640010 Dark 5 A 13.0 ---------- a-b-c - >>> - >>> -----------------------------------------------------------------------= ------- >>> >>> APOGEE data list, mjd=3D59726, all >>> raw_data: /data/apogee/utr_cdr/59726/apRaw-*.fits >>> archive: /data/apogee/archive/59726/apR-[a,b,c]-*.apz >>> quickred: /data/apogee/quickred/59726/apq-*.fits >>> -----------------------------------------------------------------------= ------- >>> >>> mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset >>> %Flux/FPI Comm >>> >>> -----------------------------------------------------------------------= ------- >>> 59726 1 23:48 41640001 Dark 3 A 13.0 ---------- a-b-c - >>> - >>> 59726 2 00:02 41640002 Dark 60 A 13.0 ---------- a-b-c - >>> - >>> 59726 3 00:04 41640003 QuarFlat 10 A 13.0 ---------- a-b-c - >>> - >>> 59726 4 00:06 41640004 Arc-Thar 12 B 13.5 ---------- a-b-c 0.9= 4 >>> - >>> 59726 5 00:13 41640005 Arc-Une 40 B 13.5 ---------- a-b-c - >>> - >>> 59726 6 00:16 41640006 Arc-Thar 12 A 13.0 ---------- a-b-c 0.5= 2 >>> - >>> 59726 7 00:23 41640007 Arc-Une 40 A 13.0 ---------- a-b-c - >>> - >>> 59726 8 00:34 41640008 Dark 60 A 13.0 ---------- a-b-c - >>> - >>> 59726 9 00:40 41640009 Arc---- 30 A 13.0 ---------- a-b-c - >>> 98 FPI >>> 59726 10 02:09 41640010 Dark 5 A 13.0 ---------- a-b-c - >>> - >>> 59726 11 02:24 41640011 DomeFlat 5 A 13.0 43160-5560 a-b-c - >>> 145 >>> 59726 12 02:25 41640012 DomeFlat 5 A 13.0 43160-5560 a-b-c - >>> 148 >>> 59726 13 02:27 41640013 DomeFlat 5 A 13.0 43160-5560 a-b-c - >>> 153 >>> 59726 14 02:59 41640014 Object 43 A 13.0 43160-5562 a-b-c 0.4= 1 >>> 1,1 >>> 59726 15 03:07 41640015 Object 43 B 13.5 43160-5562 a-b-c 0.9= 3 >>> 1,1 >>> 59726 16 03:23 41640016 Object 43 B 13.5 43161-5563 a-b-c 0.9= 3 >>> 1,1 >>> 59726 17 03:30 41640017 Object 43 A 13.0 43161-5563 a-b-c 0.4= 2 >>> 1,1 >>> 59726 18 03:48 41640018 Object 46 A 13.0 57937-5564 a-b-c 0.4= 3 >>> 1,1 >>> 59726 19 03:56 41640019 Object 46 B 13.5 57937-5564 a-b-c 0.9= 3 >>> 1,1 >>> 59726 20 04:04 41640020 Object 43 B 13.5 57937-5564 a-b-c 0.9= 3 >>> 1,1 >>> 59726 21 04:12 41640021 Object 43 A 13.0 57937-5564 a-b-c 0.4= 2 >>> 1,1 >>> 59726 22 04:26 41640022 Object 46 A 13.0 57938-5565 a-b-c 0.4= 2 >>> 1,1 >>> 59726 23 04:34 41640023 Object 46 B 13.5 57938-5565 a-b-c 0.9= 3 >>> 1,1 >>> 59726 24 04:42 41640024 Object 43 B 13.5 57938-5565 a-b-c 0.9= 3 >>> 1,1 >>> 59726 25 04:50 41640025 Object 43 A 13.0 57938-5565 a-b-c 0.4= 2 >>> 1,1 >>> 59726 26 04:59 41640026 Object 43 A 13.0 57938-5565 a-b-c 0.4= 2 >>> 1,1 >>> 59726 27 05:06 41640027 Object 43 B 13.5 57938-5565 a-b-c 0.9= 2 >>> 1,1 >>> 59726 28 05:20 41640028 Object 46 B 13.5 57939-5566 a-b-c 0.9= 3 >>> 1,1 >>> 59726 29 05:29 41640029 Object 46 A 13.0 57939-5566 a-b-c 0.4= 2 >>> 1,1 >>> 59726 30 05:36 41640030 Object 43 A 13.0 57939-5566 a-b-c 0.4= 2 >>> 1,1 >>> 59726 31 05:44 41640031 Object 43 B 13.5 57939-5566 a-b-c 0.9= 2 >>> 1,1 >>> 59726 32 05:53 41640032 Object 43 B 13.5 57939-5566 a-b-c 0.9= 3 >>> 1,1 >>> 59726 33 06:01 41640033 Object 43 A 13.0 57939-5566 a-b-c 0.4= 3 >>> 1,1 >>> 59726 34 06:22 41640034 Object 46 A 13.0 107018-5568 a-b-c >>> 0.42 1,1 >>> 59726 35 06:30 41640035 Object 46 B 13.5 107018-5568 a-b-c >>> 0.93 1,1 >>> 59726 36 06:38 41640036 Object 43 B 13.5 107018-5568 a-b-c >>> 0.93 1,1 >>> 59726 37 06:46 41640037 Object 43 A 13.0 107018-5568 a-b-c >>> 0.42 1,1 >>> 59726 38 06:55 41640038 Object 46 A 13.0 107019-5569 a-b-c >>> 0.42 1,1 >>> 59726 39 07:03 41640039 Object 46 B 13.5 107019-5569 a-b-c >>> 0.93 1,1 >>> 59726 40 07:11 41640040 Object 43 B 13.5 107019-5569 a-b-c >>> 0.93 1,1 >>> 59726 41 07:19 41640041 Object 43 A 13.0 107019-5569 a-b-c >>> 0.42 1,1 >>> 59726 42 07:28 41640042 Object 43 A 13.0 107019-5569 a-b-c >>> 0.42 1,1 >>> 59726 43 07:35 41640043 Object 43 B 13.5 107019-5569 a-b-c >>> 0.93 1,1 >>> 59726 44 07:44 41640044 Object 46 B 13.5 107020-5570 a-b-c >>> 0.93 1,1 >>> 59726 45 07:53 41640045 Object 46 A 13.0 107020-5570 a-b-c >>> 0.42 1,1 >>> 59726 46 08:00 41640046 Object 43 A 13.0 107020-5570 a-b-c >>> 0.42 1,1 >>> 59726 47 08:08 41640047 Object 43 B 13.5 107020-5570 a-b-c >>> 0.93 1,1 >>> 59726 48 08:19 41640048 Object 46 B 13.5 107020-5570 a-b-c >>> 0.94 1,1 >>> 59726 49 08:27 41640049 Object 46 A 13.0 107020-5570 a-b-c >>> 0.42 1,1 >>> 59726 50 08:35 41640050 Object 43 A 13.0 107020-5570 a-b-c >>> 0.42 1,1 >>> 59726 51 08:43 41640051 Object 43 B 13.5 107020-5570 a-b-c >>> 0.93 1,1 >>> 59726 52 08:52 41640052 Object 43 B 13.5 107020-5570 a-b-c >>> 0.94 1,1 >>> 59726 53 09:00 41640053 Object 43 A 13.0 107020-5570 a-b-c >>> 0.42 1,1 >>> 59726 54 09:42 41640054 DomeFlat 5 A 13.0 56893-5573 a-b-c - >>> 146 >>> 59726 55 09:44 41640055 DomeFlat 5 A 13.0 56893-5573 a-b-c - >>> 147 >>> 59726 56 09:45 41640056 DomeFlat 5 A 13.0 56893-5573 a-b-c - >>> 148 >>> cannot read file : /data/apogee/utr_cdr/59726/apRaw-41640057.fits >>> -----------------------------------------------------------------------= ------- >>> >>> >>> >>> >>> ---- eBOSS Data Summary ---- >>> >>> Reading FITS from /data/spectro//59726 >>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >>> - - - >>> n Time Filename design-field cfg flav shu Exp colA colB >>> colC Hrt >>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >>> - - - >>> 1 00:02 b1-00342506 ----------- ---- bia Clo 0.0 2033 2180 >>> 798 >>> 2 00:02 r1-00342506 ----------- ---- bia Clo 0.0 2033 2180 >>> 798 >>> 3 00:04 b1-00342507 ----------- ---- dar Clo 20.0 2033 2180 >>> 798 >>> 4 00:04 r1-00342507 ----------- ---- dar Clo 20.0 2033 2180 >>> 798 >>> 5 00:07 b1-00342508 38525-100498 5558 arc Lef 4.1 2033 2180 >>> 798 HART >>> 6 00:07 r1-00342508 38525-100498 5558 arc Lef 4.1 2033 2180 >>> 798 HART >>> 7 00:08 b1-00342509 38525-100498 5558 arc Rig 4.1 2033 2180 >>> 798 HART >>> 8 00:08 r1-00342509 38525-100498 5558 arc Rig 4.1 2033 2180 >>> 798 HART >>> 9 00:09 b1-00342510 38525-100498 5558 arc Lef 4.1 2053 2199 >>> 816 HART >>> 10 00:09 r1-00342510 38525-100498 5558 arc Lef 4.1 2053 2199 >>> 816 HART >>> 11 00:10 b1-00342511 38525-100498 5558 arc Rig 4.1 2053 2199 >>> 816 HART >>> 12 00:10 r1-00342511 38525-100498 5558 arc Rig 4.1 2053 2199 >>> 816 HART >>> 13 00:12 r1-00342512 38525-100498 5558 fla Out 25.1 2236 2383 >>> 1000 >>> 14 00:12 b1-00342512 38525-100498 5558 fla Out 25.1 2236 2383 >>> 1000 >>> 15 00:16 b1-00342513 38525-100498 5558 arc Out 4.1 2236 2383 >>> 1000 >>> 16 00:16 r1-00342513 38525-100498 5558 arc Out 4.1 2236 2383 >>> 1000 >>> 17 02:42 b1-00342514 43160-101175 5562 arc Lef 4.1 2236 2383 >>> 1000 HART >>> 18 02:42 r1-00342514 43160-101175 5562 arc Lef 4.1 2236 2383 >>> 1000 HART >>> 19 02:42 b1-00342515 43160-101175 5562 arc Rig 4.1 2236 2383 >>> 1000 HART >>> 20 02:42 r1-00342515 43160-101175 5562 arc Rig 4.1 2236 2383 >>> 1000 HART >>> 21 02:43 r1-00342516 43160-101175 5562 arc Out 4.1 3566 3713 >>> 2330 >>> 22 02:43 b1-00342516 43160-101175 5562 arc Out 4.1 3566 3713 >>> 2330 >>> 23 02:45 r1-00342517 43160-101175 5562 fla Out 25.1 3566 3713 >>> 2330 >>> 24 02:45 b1-00342517 43160-101175 5562 fla Out 25.1 3566 3713 >>> 2330 >>> 25 02:52 b1-00342518 43160-101175 5562 sci Out 900.1 3566 3713 >>> 2330 >>> 26 02:52 r1-00342518 43160-101175 5562 sci Out 900.1 3566 3713 >>> 2330 >>> 27 03:16 b1-00342519 43161-101175 5563 sci Out 900.1 3566 3713 >>> 2330 >>> 28 03:16 r1-00342519 43161-101175 5563 sci Out 900.1 3566 3713 >>> 2330 >>> 29 03:33 b1-00342520 57937-104639 5564 arc Lef 4.1 3566 3713 >>> 2330 HART >>> 30 03:33 r1-00342520 57937-104639 5564 arc Lef 4.1 3566 3713 >>> 2330 HART >>> 31 03:33 r1-00342521 57937-104639 5564 arc Rig 4.1 3566 3713 >>> 2330 HART >>> 32 03:33 b1-00342521 57937-104639 5564 arc Rig 4.1 3566 3713 >>> 2330 HART >>> 33 03:34 r1-00342522 57937-104639 5564 arc Out 4.0 4239 4388 >>> 3004 >>> 34 03:34 b1-00342522 57937-104639 5564 arc Out 4.0 4239 4388 >>> 3004 >>> 35 03:36 b1-00342523 57937-104639 5564 fla Out 25.1 4239 4388 >>> 3004 >>> 36 03:36 r1-00342523 57937-104639 5564 fla Out 25.1 4239 4388 >>> 3004 >>> 37 03:40 r1-00342524 57937-104639 5564 sci Out 900.1 4239 4388 >>> 3004 >>> 38 03:40 b1-00342524 57937-104639 5564 sci Out 900.1 4239 4388 >>> 3004 >>> 39 03:57 r1-00342525 57937-104639 5564 sci Out 900.0 4239 4388 >>> 3004 >>> 40 03:57 b1-00342525 57937-104639 5564 sci Out 900.0 4239 4388 >>> 3004 >>> 41 04:19 r1-00342526 57938-104639 5565 sci Out 900.1 4239 4388 >>> 3004 >>> 42 04:19 b1-00342526 57938-104639 5565 sci Out 900.1 4239 4388 >>> 3004 >>> 43 04:35 r1-00342527 57938-104639 5565 sci Out 900.1 4239 4388 >>> 3004 >>> 44 04:35 b1-00342527 57938-104639 5565 sci Out 900.1 4239 4388 >>> 3004 >>> 45 04:52 b1-00342528 57938-104639 5565 sci Out 900.0 4239 4388 >>> 3004 >>> 46 04:52 r1-00342528 57938-104639 5565 sci Out 900.0 4239 4388 >>> 3004 >>> 47 05:13 r1-00342529 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 48 05:13 b1-00342529 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 49 05:29 b1-00342530 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 50 05:29 r1-00342530 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 51 05:46 b1-00342531 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 52 05:46 r1-00342531 57939-104639 5566 sci Out 900.1 4239 4388 >>> 3004 >>> 53 06:08 b1-00342532 107018-112359 5568 arc Lef 4.1 4239 4388 >>> 3004 HART >>> 54 06:08 r1-00342532 107018-112359 5568 arc Lef 4.1 4239 4388 >>> 3004 HART >>> 55 06:08 b1-00342533 107018-112359 5568 arc Rig 4.1 4239 4388 >>> 3004 HART >>> 56 06:08 r1-00342533 107018-112359 5568 arc Rig 4.1 4239 4388 >>> 3004 HART >>> 57 06:09 b1-00342534 107018-112359 5568 arc Out 4.0 3778 3924 >>> 2541 >>> 58 06:09 r1-00342534 107018-112359 5568 arc Out 4.0 3778 3924 >>> 2541 >>> 59 06:11 b1-00342535 107018-112359 5568 fla Out 25.1 3778 3924 >>> 2541 >>> 60 06:11 r1-00342535 107018-112359 5568 fla Out 25.1 3778 3924 >>> 2541 >>> 61 06:14 r1-00342536 107018-112359 5568 sci Out 900.1 3778 3924 >>> 2541 >>> 62 06:14 b1-00342536 107018-112359 5568 sci Out 900.1 3778 3924 >>> 2541 >>> 63 06:31 r1-00342537 107018-112359 5568 sci Out 900.0 3778 3924 >>> 2541 >>> 64 06:31 b1-00342537 107018-112359 5568 sci Out 900.0 3778 3924 >>> 2541 >>> 65 06:48 b1-00342538 107019-112359 5569 sci Out 900.0 3778 3924 >>> 2541 >>> 66 06:48 r1-00342538 107019-112359 5569 sci Out 900.0 3778 3924 >>> 2541 >>> 67 07:04 b1-00342539 107019-112359 5569 sci Out 900.1 3778 3924 >>> 2541 >>> 68 07:04 r1-00342539 107019-112359 5569 sci Out 900.1 3778 3924 >>> 2541 >>> 69 07:20 b1-00342540 107019-112359 5569 sci Out 900.1 3778 3924 >>> 2541 >>> 70 07:20 r1-00342540 107019-112359 5569 sci Out 900.1 3778 3924 >>> 2541 >>> 71 07:37 r1-00342541 107020-112359 5570 sci Out 900.0 3778 3924 >>> 2541 >>> 72 07:37 b1-00342541 107020-112359 5570 sci Out 900.0 3778 3924 >>> 2541 >>> 73 07:53 r1-00342542 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> 74 07:53 b1-00342542 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> 75 08:11 r1-00342543 107020-112359 5570 sci Out 900.0 3778 3924 >>> 2541 >>> 76 08:11 b1-00342543 107020-112359 5570 sci Out 900.0 3778 3924 >>> 2541 >>> 77 08:28 b1-00342544 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> 78 08:28 r1-00342544 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> 79 08:45 r1-00342545 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> 80 08:45 b1-00342545 107020-112359 5570 sci Out 900.1 3778 3924 >>> 2541 >>> >>> >>> ---- BOSS Spectrographs Collimation ---- >>> >>> Time TSP1 R1 B1 Move1 B1Resid >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>> 00:08:40 8.8 -989 -3.2 19 -3.2 >>> 00:10:40 8.8 -659 -3.2 184 -2.6 >>> 02:43:20 9.2 989 -5.2 1330 -1.1 >>> 03:34:30 9.0 0 -4.2 674 -2.1 >>> 06:09:30 8.6 -989 -0.2 -462 -1.7 >>> >>> >>> ---- Time Tracking ---- >>> >>> *=3D*=3D*=3D Observatory: APO >>> *=3D*=3D*=3D MJD: 59726 >>> Fill night time in Hours below >>> *=3D*=3D*=3D Total bright time : 0 >>> *=3D*=3D*=3D Bright time, queued observations : 0 >>> *=3D*=3D*=3D Bright time, commissioning/engineering: 0 >>> *=3D*=3D*=3D Bright time lost to weather : 0 >>> *=3D*=3D*=3D Bright time lost to technical issues : 0 >>> >>> *=3D*=3D*=3D Total dark time : 8.0 >>> *=3D*=3D*=3D Dark time, queued observations : 7.0 >>> *=3D*=3D*=3D Dark time, commissioning/engineering : 0 >>> *=3D*=3D*=3D Dark time lost to weather : 1.0 >>> *=3D*=3D*=3D Dark time lost to technical issues : 0 >>> >>> >>> >>> >>> ____________________________________________________________ >>> Logs of Nightly APO Activities >>> https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.ht= ml >>> >> ____________________________________________________________ >> Logs of Nightly APO Activities >> https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.htm= l >> >> >> ____________________________________________________________ > Logs of Nightly APO Activities > https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html > --=20 Please note that while this e-mail might reach you on the weekend or other unusual times, please know that this is a matter of my personal work-life balance, and that I do not expect to receive an answer outside your usual business hours. Stefanie Wachter, PhD SDSS-V Lead Systems Engineer Carnegie Observatories --00000000000064af2c05e0040b01 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Kaike,=C2=A0if you are starting a n= ew list, please also link it to this wiki so we know which robot to check d= uring summer shutdownhttps://wiki.sdss.org/display/SE/Summ= er+Shutdown+2022cheersStefanieOn Fri, May 27, 2022 at 1:09 PM Jos=C3=A9 S=C3=A1nchez= -Gallego wro= te: There is a list of disabled robots herehttps://wiki.sdss.org/pages/viewpage.ac= tion?pageId=3D109873620but the most reliable place is always the keyword=C2=A0disabled_positione= rs in this filehttps://github.com/sdss/jaeger/blob/main/python/jaeger/etc/j= aeger.ymlJos=C3=A9= On May 27, 2022 at 12:47:17, Kaik= e wrote: Hi Jose,=C2=A0Karen and I discussed whether we should start a tr= acking list of problematic robots so that we know which robots needs to be = replaced during the coming shutdown. I started the list at the bottom on th= e observing plan page=C2=A0https://wiki.sdss.org/display/A= PO/SDSS-N+March+Observing+Plan=C2=A0(see below).Jose: do you have a list for disabled robots?O= bservers: Please keep the list in a numeric order. If a troublesome robot i= s already in the list, please DO NOT start a new line, just add the number = of designs you had troubles with it and the date for the robot.Thanks,-KaikeA tracking list of prob= lematic robots=C2=A0Disabled robots:=C2=A0612 (2 designs on 5/27)902 (1 design on 5/27)On May 27, 2022, at 11:58 AM, Jos=C3=A9 S=C3=A1nchez-Gallego = wrote:It seems collisions have been i= ncreasing lately.Do you h= ave a list or a sense of what robots are repeat offenders? I think=C2=A0134= 0 and 612 are in that list and we should disable them permanently for now; = are there others?Jos=C3= =A9 On May 27, 2022 at 03:12:02, kinemuchi@apo.nmsu.= edu wrote: =20 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0APACHE PO= INT OBSERVATORY SDSS 2.5M =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0OBSERVING LOG =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0Thursday May 26, 2022 =C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0(SJD 59726)---- =C2=A0Observing Team ----Kaike PanKaren Kinemuchi---- Observing Plan ----Please observe from the queue until about 10:30. After that, if clear, d= o BOSS dithers on designs =C2=A035994, 36002, 36018, using the followin= g sequence (note the --centroid-method keyword on the jaeger fvc loop c= ommand!). If not clear, observe from queue.---- Observing Summa= ry ----Lost 1.0 hour due to rising dust counts.Observed:---------Time =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0field-dsgn-conf =C2=A0=C2= =A0Design type =C2=A0BOSS/APOGEE exp =C2=A0complete? Comment=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D02:40= :56 =C2=A0101175-43160-5562 bright_8x2_v1 1x900s+1xAB =C2=A0DONE03:09:1= 3 =C2=A0101175-43161-5563 bright_8x2_v1 1x900s+1xAB =C2=A0DONE03:31:13 = =C2=A0104639-57937-5564 dark_10x4_4yr_v1 =C2=A02x900s+2xAB DONE04:12:20= =C2=A0104639-57938-5565 dark_10x4_4yr_v1 =C2=A03x900s+3xAB DONE05:07:1= 4 =C2=A0104639-57939-5566 dark_10x4_4yr_v1 =C2=A03x900s+3xAB DONE (epoch no= t done)06:07:02 =C2=A0112359-107018-5568 dark_174x8_v1 =C2=A02x900s+2xA= B DONE06:46:29 =C2=A0112359-107019-5569 dark_174x8_v1 3x900s+3xAB DONE = cloned07:35:59 =C2=A0112359-107020-5570 dark_174x8_v1 5x900s+5xAB not d= one =C2=A0cloned---- Engineering Issues ----* 02:36Z = =C2=A0Disabled position 612 due to reported collision.=C2=A0 See log for de= tails.* Simulations were running on boson guider.=C2=A0 To turn off= , issue command: "fliswarm simulate --stop"* Had trou= ble with the following designs (see log for details):02:21:33 =C2=A0Fie= ld-Design-Configuration: 101175-43160-5560 (robot #612)06:01:55 =C2=A0F= ield-Design-Configuration: 104639-57940-5567 (#612)09:01:13 =C2=A0Field= -Design-Configuration: 104541-56893-5571 (#612, 902)09:16:38 =C2=A0Fiel= d-Design-Configuration: 104541-56893-5572 (#612, 902)09:25:19 =C2=A0Fie= ld-Design-Configuration: 104541-56893-5573 (#902)* 08:34Z =C2=A0Dis= covered a weird bug in Kronos while refreshing the queue. JohnDhas been= notified.=C2=A0 See log for details.* Dust counts ~12000--= -- Observing Log ----Afternoon:=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DBOSS collimation is checked, no adjustment made.0:10:52 =C2=A0Hartman= n collimate output =C2=A0=C2=A0sp1: offset: r=3D -659 (In Focus); =C2= =A0b=3D -3.2 (In Focus) =C2=A0=C2=A0sp1: pred. move: spAverageMove=3D = 184 =C2=A0=C2=A0sp1: pred. resid: r=3D -843, b=3D -2.6, txt=3D OK, spTe= mp =3D 9.3motorPosition =C2=A0=C2=A0=C2=A0=C2=A0sp1: =C2=A0=C2=A0= =C2=A02236, =C2=A0=C2=A0=C2=A02383, =C2=A0=C2=A0=C2=A01000; =C2=A0-----= -----Median spectrographs temperatures: =C2=A0=C2=A0=C2=A0=C2=A0Tsp= 1=3D 9.3 =C2=A0=C2=A0=C2=A0=C2=A0Outside air temperature=3D 20.3; =C2= =A0BOSS cals:00:12:35 =C2=A0boss exposure =C2=A0=C2=A025.0, file=3D= 342512 00:16:33 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file=3D34251= 3 0:28:17 =C2=A0Config Loaded: -999--999-555900:29:40 OBSERVER.= kpan 71 jaeger i fvc_rms=3D40.91999999999999500:29:40 OBSERVER.kpan 71 = jaeger i fvc_perc_90=3D64.6999999999999900:29:40 OBSERVER.kpan 71 jaege= r i fvc_percent_reached=3D1.400:40Z: started ventilation.Night:= =3D=3D=3D=3D=3D=3D02:03:37 =C2=A0encl25m : open; =C2=A0APOG= EE dark:02:09:18 =C2=A0apogee.expose=3DapRaw-41640010, 5, A, Dark02:21:33 =C2=A0Field-Design-Configuration: 101175-43160-5560APOGE= E dome flats:02:23:59 =C2=A0apogee.expose=3DapRaw-41640011, 5, A, DomeF= lat02:25:26 =C2=A0apogee.expose=3DapRaw-41640012, 5, A, DomeFlat02:= 26:53 =C2=A0apogee.expose=3DapRaw-41640013, 5, A, DomeFlat02:28:26 = .jaeger 0 jaeger f text=3D"A collision was detected in positioner 612.= Sending SEND_TRAJECTORY_ABORT and locking the FPS."Trying to = unlock and unwind.02:31:30 .jaeger 0 jaeger f text=3D"A collis= ion was detected in positioner 612. Sending SEND_TRAJECTORY_ABORT and locki= ng the FPS."02:31:30 .jaeger 0 jaeger w text=3D"Locking the F= PS. (JaegerUserWarning)"02:31:30 .jaeger 0 jaeger i fps_status=3D0= x1402:31:32 .jaeger 0 jaeger e locked=3DT; locked_by=3D61202:31:36 = .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapsho= t_59726_0003.pdf02:31:36 .jaeger 158 jaeger d trajectory_dump_file=3D/d= ata/logs/jaeger/trajectories/59726/trajectory-59726-0003.json02:31:36 .= jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot= _59726_0003.pdf02:31:36 .jaeger 0 jaeger w text=3D"Snapshot for lo= cked FPS: /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0003.pdf (Ja= egerUserWarning)"02:31:36 .jaeger 158 jaeger i text=3D"Comman= d 'unwind' failed because of an uncaught error 'RuntimeError: u= nwind: cannot modify a done command with status .'. See traceback in the log for more information."App= lying jaeger explode 5.=C2=A0 Positioner 612 does not appear to be close to= anything, but is reporting collision.02:32:44 .jaeger 0 jaeger = f text=3D"A collision was detected in positioner 612. Sending SEND_TRA= JECTORY_ABORT and locking the FPS."02:32:44 .jaeger 0 jaeger w tex= t=3D"Locking the FPS. (JaegerUserWarning)"02:32:45 .jaeger 0 = jaeger i fps_status=3D0x1402:32:46 .jaeger 0 jaeger e locked=3DT; locke= d_by=3D61202:32:50 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snap= shots/59726/fps_snapshot_59726_0005.pdf02:32:50 OBSERVER.kpan 85 jaeger= d trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-5= 9726-0005.json02:32:50 OBSERVER.kpan 85 jaeger f error=3D"Trajecto= ry failed with error: Something went wrong during the trajectory: The FPS g= ot locked during the trajectory. Trajectory failed 7.49 seconds after start= "02:32:50 CmdDone: OBSERVER.kpan 85 jaeger explode 1002:33= :53 CmdStarted: OBSERVER.kpan 87 jaeger status 612positioner_status=3D6= 12,154.4269,121.9903,0x8db067e1,T,F,F,F,04.01.21,1,1,502:34:47 CmdS= tarted: OBSERVER.kpan 88 jaeger goto 612 155.4 12002:35:04 CmdStart= ed: OBSERVER.kpan 89 jaeger goto 612 156.4 120jaeger unwind worked = this time.02:36:46 CmdStarted: OBSERVER.kpan 91 jaeger disable 612Time stamps of collisions:02:28:26 =C2=A0Jaeger collision: =C2= =A061202:31:01 =C2=A0Jaeger collision: =C2=A061202:31:30 =C2=A0Jaeg= er collision: =C2=A061202:32:15 =C2=A0Jaeger collision: =C2=A061202= :32:44 =C2=A0Jaeger collision: =C2=A061202:38:11 CmdStarted: OB= SERVER.kpan 93 jaeger configuration load --no-clone02:39:52 =C2=A0F= ield-Design-Configuration: 101175-43161-556102:40:00 CmdStarted: OB= SERVER.kpan 94 jaeger configuration load --no-clone 4316002:40:56 = =C2=A0Field-Design-Configuration: 101175-43160-5562HARTMANN:02:= 42:08 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file=3D342514 02:42:49= =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file=3D342515 02:43:32 =C2= =A0sp1.motor.move=3D 1330, 1330, 133002:43:32 =C2=A0Hartmann collimate = output =C2=A0=C2=A0sp1: offset: r=3D 989 (In Focus); =C2=A0b=3D -5.2 (O= ut of focus) =C2=A0=C2=A0sp1: pred. move: spAverageMove=3D 1330 = =C2=A0=C2=A0sp1: pred. resid: r=3D -341, b=3D -1.1, txt=3D OK, spTemp =3D 9= .6BOSS cals:02:43:50 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0,= file=3D342516 02:45:29 =C2=A0boss exposure =C2=A0=C2=A025.0, file=3D34= 2517FVC Loop:02:43:35 hal.hal 3212 jaeger i text=3D"FVC it= eration 1"02:43:55 hal.hal 3212 jaeger d fvc_filename=3D/data/fcam= /59726/fimg-fvc1n-0002.fits02:44:02 hal.hal 3212 jaeger i fvc_rms=3D42.= 3402:44:02 hal.hal 3212 jaeger i fvc_perc_90=3D63.902:44:02 hal.hal= 3212 jaeger i fvc_percent_reached=3D1.602:44:18 hal.hal 3212 jaeger i = text=3D"FVC iteration 2"02:44:38 hal.hal 3212 jaeger d fvc_fi= lename=3D/data/fcam/59726/fimg-fvc1n-0003.fits02:44:45 hal.hal 3212 jae= ger i fvc_rms=3D17.1102:44:45 hal.hal 3212 jaeger i fvc_deltarms=3D25.2= 3000000000000402:44:45 hal.hal 3212 jaeger i fvc_perc_90=3D9.202:44= :45 hal.hal 3212 jaeger i fvc_percent_reached=3D54.202:49Z =C2=A0Th= e boson:guider gui was not showing the current exposures.=C2=A0 We foun= d a simulation going on, so we issued a "fliswarm simulate --stop"= ;. =C2=A0Seeing is 2.0", cloud/dust approaching site.D= ATA:02:52:31 =C2=A0apogee.expose=3DapRaw-41640014, 43, A, Object02:= 52:38 =C2=A0boss exposure =C2=A0900.0, file=3D342518 03:00:13 =C2=A0apo= gee.expose=3DapRaw-41640015, 43, B, Object03:09:13 =C2=A0Field-Desi= gn-Configuration: 101175-43161-5563FVC Loop:03:11:17 hal.hal 32= 46 jaeger i text=3D"FVC iteration 1"03:11:37 hal.hal 3246 jae= ger d fvc_filename=3D/data/fcam/59726/fimg-fvc1n-0004.fits03:11:44 hal.= hal 3246 jaeger i fvc_rms=3D38.12999999999999503:11:44 hal.hal 3246 jae= ger i fvc_perc_90=3D55.403:11:44 hal.hal 3246 jaeger i fvc_percent_reac= hed=3D4.103:12:00 hal.hal 3246 jaeger i text=3D"FVC iteration 2&qu= ot;03:12:20 hal.hal 3246 jaeger d fvc_filename=3D/data/fcam/59726/fimg-= fvc1n-0005.fits03:12:26 hal.hal 3246 jaeger i fvc_rms=3D6.8199999999999= 9903:12:26 hal.hal 3246 jaeger i fvc_deltarms=3D31.3099999999999950= 3:12:26 hal.hal 3246 jaeger i fvc_perc_90=3D9.203:12:26 hal.hal 3246 ja= eger i fvc_percent_reached=3D59.9Seeing is 2.0"DATA:03:16:00 =C2=A0apogee.expose=3DapRaw-41640016, 43, B, Object03:16:06 = =C2=A0boss exposure =C2=A0900.0, file=3D342519 03:23:45 =C2=A0apogee.ex= pose=3DapRaw-41640017, 43, A, Object=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D03:2= 9:04 CmdStarted: OBSERVER.kpan 101 jaeger enable 61203:31:13 =C2=A0= Field-Design-Configuration: 104639-57937-5564Configuration successf= ulHARTMANN:03:33:15 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, = file=3D342520 03:33:58 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file= =3D342521 03:34:39 =C2=A0sp1.motor.move=3D 673, 675, 67403:34:39 = =C2=A0Hartmann collimate output =C2=A0=C2=A0sp1: offset: r=3D 0 (In Foc= us); =C2=A0b=3D -4.2 (Out of focus) =C2=A0=C2=A0sp1: pred. move: spAve= rageMove=3D 674 =C2=A0=C2=A0sp1: pred. resid: r=3D -674, b=3D -2.1, txt= =3D OK, spTemp =3D 9.6BOSS Cals03:34:58 =C2=A0boss exposure =C2= =A0=C2=A0=C2=A04.0, file=3D342522 03:36:34 =C2=A0boss exposure =C2=A0= =C2=A025.0, file=3D342523 FVC Loop:03:34:42 hal.hal 3272 jaeger= i text=3D"FVC iteration 1"03:35:02 hal.hal 3272 jaeger d fvc= _filename=3D/data/fcam/59726/fimg-fvc1n-0006.fits03:35:09 hal.hal 3272 = jaeger i fvc_rms=3D41.52999999999999403:35:09 hal.hal 3272 jaeger i fvc= _perc_90=3D61.40000000000000603:35:09 hal.hal 3272 jaeger i fvc_percent= _reached=3D2.403:35:25 hal.hal 3272 jaeger i text=3D"FVC iteration= 2"03:35:46 hal.hal 3272 jaeger d fvc_filename=3D/data/fcam/59726/= fimg-fvc1n-0007.fits03:35:53 hal.hal 3272 jaeger i fvc_rms=3D20.950= 3:35:53 hal.hal 3272 jaeger i fvc_deltarms=3D20.57999999999999503:35:53= hal.hal 3272 jaeger i fvc_perc_90=3D9.79999999999999903:35:53 hal.hal = 3272 jaeger i fvc_percent_reached=3D57.8Seeing is 1.6"= DATA:03:40:43 =C2=A0apogee.expose=3DapRaw-41640018, 46, A, Object03= :40:50 =C2=A0boss exposure =C2=A0900.0, file=3D342524 03:48:56 =C2=A0ap= ogee.expose=3DapRaw-41640019, 46, B, Object03:57:06 =C2=A0apogee.expose= =3DapRaw-41640020, 43, B, Object03:57:13 =C2=A0boss exposure =C2=A0900.= 0, file=3D342525 04:04:51 =C2=A0apogee.expose=3DapRaw-41640021, 43, A, = Object04:11Z =C2=A0Seeing is worsening.=C2=A0 Now at 2.6"04:12:20 =C2=A0Field-Design-Configuration: 104639-57938-5565= FVC Loop:04:14:21 hal.hal 3310 jaeger i text=3D"FVC iteration 1&qu= ot;04:14:41 hal.hal 3310 jaeger d fvc_filename=3D/data/fcam/59726/fimg-= fvc1n-0008.fits04:14:48 hal.hal 3310 jaeger i fvc_rms=3D41.1704:14:= 48 hal.hal 3310 jaeger i fvc_perc_90=3D59.404:14:48 hal.hal 3310 jaeger= i fvc_percent_reached=3D2.704:15:05 hal.hal 3310 jaeger i text=3D"= ;FVC iteration 2"04:15:25 hal.hal 3310 jaeger d fvc_filename=3D/da= ta/fcam/59726/fimg-fvc1n-0009.fits04:15:32 hal.hal 3310 jaeger i fvc_rm= s=3D9.0804:15:33 hal.hal 3310 jaeger i fvc_deltarms=3D32.0904:15:33= hal.hal 3310 jaeger i fvc_perc_90=3D8.804:15:33 hal.hal 3310 jaeger i = fvc_percent_reached=3D61.6Seeing is =C2=A02.0"DATA:04:19:00 =C2=A0apogee.expose=3DapRaw-41640022, 46, A, Object04:19:07 = =C2=A0boss exposure =C2=A0900.0, file=3D342526 04:27:13 =C2=A0apogee.ex= pose=3DapRaw-41640023, 46, B, ObjectPostponing the telescope dither= test because the seeing is unstable.=C2=A0 The RMS values are also rat= her poor with 1.6-2.5 values.=C2=A0 Seeing is between 1.8and 2.5".= 04:35:22 =C2=A0apogee.expose=3DapRaw-41640024, 43, B, Object04:= 35:31 =C2=A0boss exposure =C2=A0900.0, file=3D342527 04:43:08 =C2=A0apo= gee.expose=3DapRaw-41640025, 43, A, Object04:52:00 =C2=A0apogee.expose= =3DapRaw-41640026, 43, A, Object04:52:07 =C2=A0boss exposure =C2=A0900.= 0, file=3D342528 04:59:41 =C2=A0apogee.expose=3DapRaw-41640027, 43, B, = Object05:07:14 =C2=A0Field-Design-Configuration: 104639-57939-5566FVC Loop:05:09:01 hal.hal 3345 jaeger i text=3D"FVC iterati= on 1"05:09:21 hal.hal 3345 jaeger d fvc_filename=3D/data/fcam/5972= 6/fimg-fvc1n-0010.fits05:09:28 hal.hal 3345 jaeger i fvc_rms=3D38.3905:09:28 hal.hal 3345 jaeger i fvc_perc_90=3D54.505:09:28 hal.hal 3345= jaeger i fvc_percent_reached=3D3.905:09:49 hal.hal 3345 jaeger i text= =3D"FVC iteration 2"05:10:10 hal.hal 3345 jaeger d fvc_filena= me=3D/data/fcam/59726/fimg-fvc1n-0011.fits05:10:17 hal.hal 3345 jaeger = i fvc_rms=3D11.6605:10:17 hal.hal 3345 jaeger i fvc_deltarms=3D26.7305:10:17 hal.hal 3345 jaeger i fvc_perc_90=3D8.705:10:17 hal.hal 3345 = jaeger i fvc_percent_reached=3D62.0Seeing is 1.9"DATA:= 05:13:14 =C2=A0apogee.expose=3DapRaw-41640028, 46, B, Object05:13:2= 0 =C2=A0boss exposure =C2=A0900.0, file=3D342529 05:21:31 =C2=A0apogee.= expose=3DapRaw-41640029, 46, A, Object05:29:41 =C2=A0apogee.expose=3Dap= Raw-41640030, 43, A, Object05:29:46 =C2=A0boss exposure =C2=A0900.0, fi= le=3D342530 05:37:21 =C2=A0apogee.expose=3DapRaw-41640031, 43, B, Objec= t05:46:40 =C2=A0apogee.expose=3DapRaw-41640032, 43, B, Object05:46:= 47 =C2=A0boss exposure =C2=A0900.0, file=3D342531 05:54:26 =C2=A0apogee= .expose=3DapRaw-41640033, 43, A, Object06:01:55 =C2=A0Field-Design-= Configuration: 104639-57940-556706:03:34 =C2=A0Jaeger collision: = =C2=A061206:03:34 .jaeger 0 jaeger f text=3D"A collision was d= etected in positioner 612. Sending SEND_TRAJECTORY_ABORT and locking the FP= S."06:03:36 .jaeger 0 jaeger e locked=3DT; locked_by=3D61206:0= 3:40 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_sn= apshot_59726_0024.pdf06:03:40 hal.hal 3378 jaeger d trajectory_dump_fil= e=3D/data/logs/jaeger/trajectories/59726/trajectory-59726-0024.json06:0= 3:40 hal.hal 3378 jaeger f error=3D"Trajectory failed with error: Some= thing went wrong during the trajectory: The FPS got locked during the traje= ctory. Trajectory failed 39.12 seconds after start"06:03:40 CmdDon= e: hal.hal 3378 jaeger configuration execute06:03:40 .jaeger 0 jaeger i= snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0024.pdf06:03:40 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: /data/l= ogs/jaeger/snapshots/59726/fps_snapshot_59726_0024.pdf (JaegerUserWarning)&= quot;Skipping this last design since we are running out of time to = complete thisepoch. =C2=A0=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D06:07:02 =C2= =A0Field-Design-Configuration: 112359-107018-5568HARTMANN:06:08= :17 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file=3D342532 06:08:57 = =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, file=3D342533 06:09:38 =C2= =A0sp1.motor.move=3D -461, -464, -46306:09:38 =C2=A0Hartmann collimate = output =C2=A0=C2=A0sp1: offset: r=3D -989 (In Focus); =C2=A0b=3D -0.2 (= In Focus) =C2=A0=C2=A0sp1: pred. move: spAverageMove=3D -462 =C2= =A0=C2=A0sp1: pred. resid: r=3D -526, b=3D -1.7, txt=3D OK, spTemp =3D 8.9BOSS cals:06:09:57 =C2=A0boss exposure =C2=A0=C2=A0=C2=A04.0, fi= le=3D342534 06:11:35 =C2=A0boss exposure =C2=A0=C2=A025.0, file=3D34253= 5 FVC Loop:06:09:42 hal.hal 3393 jaeger i text=3D"FVC iter= ation 1"06:10:02 hal.hal 3393 jaeger d fvc_filename=3D/data/fcam/5= 9726/fimg-fvc1n-0012.fits06:10:09 hal.hal 3393 jaeger i fvc_rms=3D40.006:10:09 hal.hal 3393 jaeger i fvc_perc_90=3D58.906:10:09 hal.hal 33= 93 jaeger i fvc_percent_reached=3D2.706:10:26 hal.hal 3393 jaeger i tex= t=3D"FVC iteration 2"06:10:46 hal.hal 3393 jaeger d fvc_filen= ame=3D/data/fcam/59726/fimg-fvc1n-0013.fits06:10:53 hal.hal 3393 jaeger= i fvc_rms=3D6.5706:10:53 hal.hal 3393 jaeger i fvc_deltarms=3D33.4306:10:53 hal.hal 3393 jaeger i fvc_perc_90=3D8.406:10:53 hal.hal 3393 = jaeger i fvc_percent_reached=3D63.1Seeing is 2.0"DATA:= 06:14:49 =C2=A0apogee.expose=3DapRaw-41640034, 46, A, Object06:14:5= 5 =C2=A0boss exposure =C2=A0900.0, file=3D342536 06:23:02 =C2=A0apogee.= expose=3DapRaw-41640035, 46, B, Object06:31:11 =C2=A0apogee.expose=3Dap= Raw-41640036, 43, B, Object06:31:18 =C2=A0boss exposure =C2=A0900.0, fi= le=3D342537 06:38:57 =C2=A0apogee.expose=3DapRaw-41640037, 43, A, Objec= t06:46:29 =C2=A0Field-Design-Configuration: 112359-107019-5569Seeing is 2.6" =C2=A0Seeing has been variable for the past hour= DATA:06:47:53 =C2=A0apogee.expose=3DapRaw-41640038, 46, A, Object06:48:00 =C2=A0boss exposure =C2=A0900.0, file=3D342538 06:56:06 =C2= =A0apogee.expose=3DapRaw-41640039, 46, B, Object07:04:16 =C2=A0apogee.e= xpose=3DapRaw-41640040, 43, B, Object07:04:23 =C2=A0boss exposure =C2= =A0900.0, file=3D342539 07:12:01 =C2=A0apogee.expose=3DapRaw-41640041, = 43, A, Object07:20:48 =C2=A0apogee.expose=3DapRaw-41640042, 43, A, Obje= ct07:20:54 =C2=A0boss exposure =C2=A0900.0, file=3D342540 07:28:29 = =C2=A0apogee.expose=3DapRaw-41640043, 43, B, Object07:35:59 =C2= =A0Field-Design-Configuration: 112359-107020-5570Seeing is 2.3"= ;DATA:07:37:14 =C2=A0apogee.expose=3DapRaw-41640044, 46, B, Obj= ect07:37:20 =C2=A0boss exposure =C2=A0900.0, file=3D342541 07:45:31= =C2=A0apogee.expose=3DapRaw-41640045, 46, A, Object07:53:41 =C2=A0apog= ee.expose=3DapRaw-41640046, 43, A, Object07:53:44 =C2=A0boss exposure = =C2=A0900.0, file=3D342542 08:01:22 =C2=A0apogee.expose=3DapRaw-4164004= 7, 43, B, ObjectSome clouds are coming in.08:11:50 =C2=A0ap= ogee.expose=3DapRaw-41640048, 46, B, Object08:11:57 =C2=A0boss exposure= =C2=A0900.0, file=3D342543 08:20:08 =C2=A0apogee.expose=3DapRaw-416400= 49, 46, A, Object08:28:18 =C2=A0apogee.expose=3DapRaw-41640050, 43, A, = Object08:28:21 =C2=A0boss exposure =C2=A0900.0, file=3D342544 08:35= :59 =C2=A0apogee.expose=3DapRaw-41640051, 43, B, Object08:29Z Seein= g is 3.6"08:32Z Refreshed the Kronos queue and we only see the= RM field is available.We are approaching airmass of 1.4.=C2=A0 We cann= ot observe this field for therest of the night.=C2=A0 The observability= windows are different and not correct.08:45:29 =C2=A0apogee.expose= =3DapRaw-41640052, 43, B, Object08:45:35 =C2=A0boss exposure =C2=A0900.= 0, file=3D342545 08:53:14 =C2=A0apogee.expose=3DapRaw-41640053, 43, A, = Object08:48Z Refreshed the Kronos queue again, and now we have sens= ible fields.Seeing bloomed up to 5.5".=C2=A0 Not getting useful si= gnal at all.09:01Z Giving up on this field since we have passed air= mass 1.4.=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D09:01:13 =C2=A0Field-Design-Configurat= ion: 104541-56893-557109:02:52 .jaeger 0 jaeger f text=3D"A co= llision was detected in positioner 612. Sending SEND_TRAJECTORY_ABORT and l= ocking the FPS."09:02:52 .jaeger 0 jaeger w text=3D"Locking t= he FPS. (JaegerUserWarning)"09:02:53 .jaeger 0 jaeger e locked=3DT= ; locked_by=3D61209:02:57 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeg= er/snapshots/59726/fps_snapshot_59726_0029.pdf09:02:57 hal.hal 3470 jae= ger d trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajector= y-59726-0029.json09:02:57 hal.hal 3470 jaeger f error=3D"Trajector= y failed with error: Something went wrong during the trajectory: The FPS go= t locked during the trajectory. Trajectory failed 28.68 seconds after start= "09:02:57 CmdDone: hal.hal 3470 jaeger configuration execute09= :02:57 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_= snapshot_59726_0029.pdf09:02:57 .jaeger 0 jaeger w text=3D"Snapsho= t for locked FPS: /data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0029= .pdf (JaegerUserWarning)"09:04:07 jaeger unlockTrying = to unwind:09:04:14 OBSERVER.kpan 118 jaeger d text=3D"Calculat= ing unwind trajectory."09:04:14 OBSERVER.kpan 118 jaeger f error= =3D"Command 'unwind' failed because of an uncaught error '= RuntimeError: Grid is Kaiju-collided, cannot generate paths'. See trace= back in the log for more information."09:04:14 CmdDone: OBSERVER.k= pan 118 jaeger unwind09:05:12 CmdStarted: OBSERVER.kpan 120 jaeger = explode 612Oops - took a while for the command to fail.09:07:08= CmdStarted: OBSERVER.kpan 122 jaeger explode 509:07:08 CmdStarted:= OBSERVER.kpan 122 jaeger explode 509:07:08 OBSERVER.kpan 122 jaeger &g= t; 09:07:08 OBSERVER.kpan 122 jaeger d text=3D"Calculating explode= trajectory."09:07:09 OBSERVER.kpan 122 jaeger i text=3D"Exec= uting explode trajectory."09:07:09 OBSERVER.kpan 122 jaeger d text= =3D"Sending trajectory data."09:07:13 OBSERVER.kpan 122 jaege= r d trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-= 59726-0031.json09:07:13 OBSERVER.kpan 122 jaeger d text=3D"Traject= ory sent in 2.2 seconds."09:07:13 OBSERVER.kpan 122 jaeger i move_= time=3D1.6209:07:13 OBSERVER.kpan 122 jaeger i text=3D"Starting tr= ajectory ..."09:07:14 .jaeger 0 jaeger f text=3D"A collision = was detected in positioner 612. Sending SEND_TRAJECTORY_ABORT and locking t= he FPS."09:07:14 .jaeger 0 jaeger w text=3D"Locking the FPS. = (JaegerUserWarning)"09:07:14 .jaeger 0 jaeger i fps_status=3D0x1409:07:16 .jaeger 0 jaeger e locked=3DT; locked_by=3D61209:07:20 .jae= ger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59= 726_0031.pdf09:07:20 OBSERVER.kpan 122 jaeger d trajectory_dump_file=3D= /data/logs/jaeger/trajectories/59726/trajectory-59726-0031.json09:07:20= OBSERVER.kpan 122 jaeger f error=3D"Trajectory failed with error: Som= ething went wrong during the trajectory: The FPS got locked during the traj= ectory. Trajectory failed 6.90 seconds after start"09:07:20 CmdDon= e: OBSERVER.kpan 122 jaeger explode 509:07:20 .jaeger 0 jaeger i snapsh= ot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0031.pdf0= 9:08:13 CmdStarted: OBSERVER.kpan 126 jaeger unlock09:08:48 CmdStarted:= OBSERVER.kpan 127 jaeger goto 612 11 17109:08:59 OBSERVER.kpan 127= jaeger d trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/traje= ctory-59726-0032.json09:08:59 OBSERVER.kpan 127 jaeger f error=3D"= Goto command failed: Something went wrong during the trajectory: The FPS go= t locked during the trajectory. Trajectory failed 7.67 seconds after start&= quot;09:08:59 CmdDone: OBSERVER.kpan 127 jaeger goto 612 11 17109:0= 8:59 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_sn= apshot_59726_0032.pdfPosition 612 appears to be at home, but is sti= ll causing all the unlocks to happen.09:09:41 CmdStarted: OBSER= VER.kpan 129 jaeger unwind --force09:10:00 .jaeger 0 jaeger f text=3D&q= uot;A collision was detected in positioner 902. Sending SEND_TRAJECTORY_ABO= RT and locking the FPS."09:10:00 .jaeger 0 jaeger w text=3D"L= ocking the FPS. (JaegerUserWarning)"09:10:01 .jaeger 0 jaeger i fp= s_status=3D0x1409:10:02 .jaeger 0 jaeger e locked=3DT; locked_by=3D90209:10:07 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726= /fps_snapshot_59726_0033.pdf09:10:07 OBSERVER.kpan 129 jaeger d traject= ory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-59726-0033.= json09:10:07 OBSERVER.kpan 129 jaeger f error=3D"Trajectory failed= with error: Something went wrong during the trajectory: The FPS got locked= during the trajectory. Trajectory failed 7.99 seconds after start"09:10:07 CmdDone: OBSERVER.kpan 129 jaeger unwind --force09:10:07 .jae= ger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59= 726_0033.pdf09:10:29 CmdDone: OBSERVER.kpan 130 jaeger unlock09= :10:51 CmdStarted: OBSERVER.kpan 131 jaeger explode 509:10:57 .jaeg= er 0 jaeger f text=3D"A collision was detected in positioner 612. Send= ing SEND_TRAJECTORY_ABORT and locking the FPS."09:10:57 .jaeger 0 = jaeger w text=3D"Locking the FPS. (JaegerUserWarning)"09:10:5= 7 .jaeger 0 jaeger i fps_status=3D0x1409:10:58 .jaeger 0 jaeger e locke= d=3DT; locked_by=3D61209:11:03 .jaeger 0 jaeger i snapshot=3D/data/logs= /jaeger/snapshots/59726/fps_snapshot_59726_0034.pdf09:11:03 .jaeger 0 j= aeger w text=3D"Snapshot for locked FPS: /data/logs/jaeger/snapshots/5= 9726/fps_snapshot_59726_0034.pdf (JaegerUserWarning)"09:11:03 .jae= ger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59= 726_0034.pdf09:11:03 OBSERVER.kpan 131 jaeger d trajectory_dump_file=3D= /data/logs/jaeger/trajectories/59726/trajectory-59726-0034.json09:11:03= OBSERVER.kpan 131 jaeger f error=3D"Trajectory failed with error: Som= ething went wrong during the trajectory: The FPS got locked during the traj= ectory. Trajectory failed 7.35 seconds after start"09:11:03 CmdDon= e: OBSERVER.kpan 131 jaeger explode 5Still complaining about positi= on 612, which is close to home position and notcollided against anythin= g.Doing a combination of jaeger unlock and jaeger explode 5 command= s.09:12:19 CmdStarted: OBSERVER.kpan 135 jaeger status 61209:12= :19 OBSERVER.kpan 135 jaeger > 09:12:20 OBSERVER.kpan 135 jaeger i p= ositioner_status=3D612,8.9623,169.986,0x8db067e1,T,F,F,F,04.01.21,1,1,3509:12:20 OBSERVER.kpan 135 jaeger : 09:12:20 CmdDone: OBSERVER.kpan 13= 5 jaeger status 61209:12:42 =C2=A0jaeger goto 612 10 17009:= 13:03 =C2=A0jaeger unwind =C2=A0<-- successfulReloading design09:16:38 =C2=A0Field-Design-Configuration: 104541-56893-557209:17= :36 .jaeger 0 jaeger f text=3D"A collision was detected in positioner = 612. Sending SEND_TRAJECTORY_ABORT and locking the FPS."09:17:36 .= jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning)"09:17:37 .jaeger 0 jaeger e locked=3DT; locked_by=3D61209:17:37 .jaeg= er 0 jaeger i fps_status=3D0x1409:17:42 .jaeger 0 jaeger i snapshot=3D/= data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0038.pdf09:17:42 OB= SERVER.kpan 139 jaeger d trajectory_dump_file=3D/data/logs/jaeger/trajector= ies/59726/trajectory-59726-0038.json09:17:42 OBSERVER.kpan 139 jaeger f= error=3D"Trajectory failed with error: Something went wrong during th= e trajectory: The FPS got locked during the trajectory. Trajectory failed 2= 8.80 seconds after start"09:17:42 CmdDone: OBSERVER.kpan 139 jaege= r configuration execute09:17:42 .jaeger 0 jaeger i snapshot=3D/data/log= s/jaeger/snapshots/59726/fps_snapshot_59726_0038.pdf09:17:42 .jaeger 0 = jaeger w text=3D"Snapshot for locked FPS: /data/logs/jaeger/snapshots/= 59726/fps_snapshot_59726_0038.pdf (JaegerUserWarning)"09:18:06= CmdStarted: OBSERVER.kpan 141 jaeger status 61209:18:06 OBSERVER.kpan = 141 jaeger > 09:18:07 OBSERVER.kpan 141 jaeger i positioner_status= =3D612,10.0653,169.986,0x8db067e1,T,F,F,F,04.01.21,1,1,38Disabling = position 612 since it is consistently causing trouble.09:18:18 CmdS= tarted: OBSERVER.kpan 142 jaeger goto 612 10 17009:18:18 OBSERVER.kpan = 142 jaeger > 09:18:19 OBSERVER.kpan 142 jaeger f error=3D"Comma= nd 'goto 612 10 170' failed because of an uncaught error 'Runti= meError: Grid is Kaiju-collided, cannot generate paths'. See traceback = in the log for more information."09:18:19 CmdDone: OBSERVER.kpan 1= 42 jaeger goto 612 10 17009:18:53 CmdStarted: OBSERVER.kpan 146 jae= ger goto 612 10 17109:18:53 OBSERVER.kpan 146 jaeger > 09:18:53 = OBSERVER.kpan 146 jaeger f error=3D"Command 'goto 612 10 171' = failed because of an uncaught error 'RuntimeError: Grid is Kaiju-collid= ed, cannot generate paths'. See traceback in the log for more informati= on."09:18:53 CmdDone: OBSERVER.kpan 146 jaeger goto 612 10 171= 09:19:09 CmdStarted: OBSERVER.kpan 148 jaeger status 61209:19:09 OB= SERVER.kpan 148 jaeger > 09:19:10 OBSERVER.kpan 148 jaeger i positio= ner_status=3D612,10.0653,169.9859,0x8db067e1,T,F,F,F,04.01.21,1,1,3809:19:34 CmdStarted: OBSERVER.kpan 149 jaeger disable 61209:19:42 = CmdStarted: OBSERVER.kpan 150 jaeger unwind09:19:42 OBSERVER.kpan 150 j= aeger > 09:19:43 OBSERVER.kpan 150 jaeger i folded=3DF09:19:43 O= BSERVER.kpan 150 jaeger d text=3D"Calculating unwind trajectory."= 09:19:43 OBSERVER.kpan 150 jaeger f error=3D"Command 'unwind&#= 39; failed because of an uncaught error 'RuntimeError: Grid is Kaiju-co= llided, cannot generate paths'. See traceback in the log for more infor= mation."09:19:43 CmdDone: OBSERVER.kpan 150 jaeger unwind0= 9:20:19 CmdStarted: OBSERVER.kpan 152 jaeger explode 509:20:24 OBSE= RVER.kpan 152 jaeger i text=3D"Starting trajectory ..."09:20:= 26 .jaeger 0 jaeger f text=3D"A collision was detected in positioner 9= 02. Sending SEND_TRAJECTORY_ABORT and locking the FPS."09:20:26 .j= aeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning)"09:20:26 .jaeger 0 jaeger i fps_status=3D0x1409:20:28 .jaeger 0 jaeger= e locked=3DT; locked_by=3D90209:20:29 .jaeger 0 jaeger f text=3D"= Failed setting chiller temperature."09:20:32 .jaeger 0 jaeger i sn= apshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0039.pdf0= 9:20:32 OBSERVER.kpan 152 jaeger d trajectory_dump_file=3D/data/logs/jaeger= /trajectories/59726/trajectory-59726-0039.json09:20:32 OBSERVER.kpan 15= 2 jaeger f error=3D"Trajectory failed with error: Something went wrong= during the trajectory: The FPS got locked during the trajectory. Trajector= y failed 7.68 seconds after start"09:20:32 CmdDone: OBSERVER.kpan = 152 jaeger explode 5Trying to unwind/explode, and like before, posi= tioner 902 is causing trouble.Trying again09:20:52 =C2=A0jaeger= unwind <-- successful09:21:50 CmdStarted: OBSERVER.kpan 155 jae= ger status 61209:21:50 OBSERVER.kpan 155 jaeger > 09:21:51 OBSER= VER.kpan 155 jaeger i positioner_status=3D612,10.0608,169.9861,0x8db067e1,T= ,T,F,F,04.01.21,1,1,4009:22:07 CmdStarted: OBSERVER.kpan 156 jaeger= status 90209:22:07 OBSERVER.kpan 156 jaeger > 09:22:08 OBSERVER= .kpan 156 jaeger i positioner_status=3D902,9.9954,170.0,0x8db067e1,T,F,F,F,= 04.01.21,3,1,40Time stamps of the collisions:09:02:52 =C2=A0Jae= ger collision: =C2=A061209:06:40 =C2=A0Jaeger collision: =C2=A06120= 9:07:14 =C2=A0Jaeger collision: =C2=A061209:08:53 =C2=A0Jaeger collisio= n: =C2=A061209:10:00 =C2=A0Jaeger collision: =C2=A090209:10:57 =C2= =A0Jaeger collision: =C2=A061209:11:32 =C2=A0Jaeger collision: =C2=A061= 209:17:36 =C2=A0Jaeger collision: =C2=A061209:20:26 =C2=A0Jaeger co= llision: =C2=A0902Reloading the design again:09:25:19 =C2=A0Fie= ld-Design-Configuration: 104541-56893-557309:26:05 =C2=A0Jaeger col= lision: =C2=A090209:26:05 .jaeger 0 jaeger f text=3D"A collisi= on was detected in positioner 902. Sending SEND_TRAJECTORY_ABORT and lockin= g the FPS."09:26:05 .jaeger 0 jaeger w text=3D"Locking the FP= S. (JaegerUserWarning)"09:26:06 .jaeger 0 jaeger e locked=3DT; loc= ked_by=3D90209:26:06 .jaeger 0 jaeger i fps_status=3D0x1409:26:10 .= jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot= _59726_0042.pdf09:26:10 hal.hal 3481 jaeger d trajectory_dump_file=3D/d= ata/logs/jaeger/trajectories/59726/trajectory-59726-0042.json09:26:10 h= al.hal 3481 jaeger f error=3D"Trajectory failed with error: Something = went wrong during the trajectory: The FPS got locked during the trajectory.= Trajectory failed 33.52 seconds after start"09:26:10 CmdDone: hal= .hal 3481 jaeger configuration execute09:26:10 .jaeger 0 jaeger i snaps= hot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0042.pdf09:2= 6:10 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: /data/logs/ja= eger/snapshots/59726/fps_snapshot_59726_0042.pdf (JaegerUserWarning)"09:27:06 CmdStarted: OBSERVER.kpan 163 jaeger status 90209:27:06= OBSERVER.kpan 163 jaeger > 09:27:07 OBSERVER.kpan 163 jaeger i posi= tioner_status=3D902,10.0022,169.8934,0x8db067e1,T,F,F,F,04.01.21,3,1,42= This positioner is mostly at home.=C2=A0 Unlocking and issuing jaeger c= onfigurationreverse:09:27:56 CmdStarted: OBSERVER.kpan 166 jaeg= er configuration reverse09:27:56 OBSERVER.kpan 166 jaeger > 09:2= 7:56 OBSERVER.kpan 166 jaeger f error=3D"The configuration was not exe= cuted. Try unwinding."09:27:56 CmdDone: OBSERVER.kpan 166 jaeger c= onfiguration reverseDoing an explode 509:28:23 OBSERVER.kpa= n 168 jaeger i text=3D"Starting trajectory ..."09:28:24 .jaeg= er 0 jaeger f text=3D"A collision was detected in positioner 902. Send= ing SEND_TRAJECTORY_ABORT and locking the FPS."09:28:24 .jaeger 0 = jaeger w text=3D"Locking the FPS. (JaegerUserWarning)"09:28:2= 5 .jaeger 0 jaeger i fps_status=3D0x1409:28:26 .jaeger 0 jaeger e locke= d=3DT; locked_by=3D90209:28:30 .jaeger 0 jaeger i snapshot=3D/data/logs= /jaeger/snapshots/59726/fps_snapshot_59726_0043.pdf09:28:30 .jaeger 0 j= aeger w text=3D"Snapshot for locked FPS: /data/logs/jaeger/snapshots/5= 9726/fps_snapshot_59726_0043.pdf (JaegerUserWarning)"09:28:30 .jae= ger 0 jaeger i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59= 726_0043.pdf09:28:30 OBSERVER.kpan 168 jaeger d trajectory_dump_file=3D= /data/logs/jaeger/trajectories/59726/trajectory-59726-0043.json09:28:30= OBSERVER.kpan 168 jaeger f error=3D"Trajectory failed with error: Som= ething went wrong during the trajectory: The FPS got locked during the traj= ectory. Trajectory failed 7.38 seconds after start"09:28:52 = =C2=A0jaeger unlock09:29:24 CmdStarted: OBSERVER.kpan 171 jaeger go= to 902 10 17109:28:24 =C2=A0Jaeger collision: =C2=A090209:30:11= =C2=A0Jaeger collision: =C2=A0902Trying to unwind, it is unsuccess= ful09:30:11 .jaeger 0 jaeger f text=3D"A collision was detecte= d in positioner 902. Sending SEND_TRAJECTORY_ABORT and locking the FPS.&quo= t;09:30:11 .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUser= Warning)"09:30:11 .jaeger 0 jaeger i fps_status=3D0x1409:30:12= .jaeger 0 jaeger e locked=3DT; locked_by=3D90209:30:17 .jaeger 0 jaege= r i snapshot=3D/data/logs/jaeger/snapshots/59726/fps_snapshot_59726_0045.pd= f09:30:17 .jaeger 0 jaeger w text=3D"Snapshot for locked FPS: /dat= a/logs/jaeger/snapshots/59726/fps_snapshot_59726_0045.pdf (JaegerUserWarnin= g)"09:30:17 .jaeger 0 jaeger i snapshot=3D/data/logs/jaeger/snapsh= ots/59726/fps_snapshot_59726_0045.pdf09:30:17 OBSERVER.kpan 172 jaeger = d trajectory_dump_file=3D/data/logs/jaeger/trajectories/59726/trajectory-59= 726-0045.json09:30:17 OBSERVER.kpan 172 jaeger f error=3D"Trajecto= ry failed with error: Something went wrong during the trajectory: The FPS g= ot locked during the trajectory. Trajectory failed 7.15 seconds after start= "09:30:17 CmdDone: OBSERVER.kpan 172 jaeger unwind09:30:41= CmdStarted: OBSERVER.kpan 174 jaeger status 90209:30:41 OBSERVER.kpan = 174 jaeger > 09:30:42 OBSERVER.kpan 174 jaeger i positioner_status= =3D902,10.0176,170.9487,0x8db067e1,T,F,F,F,04.01.21,3,1,4509:30:42 OBSE= RVER.kpan 174 jaeger : 09:30:42 CmdDone: OBSERVER.kpan 174 jaeger statu= s 90209:30:42 .jaeger 0 jaeger d alive_at=3D1653643842.42280209:30:= 50 CmdStarted: OBSERVER.kpan 175 jaeger goto 902 10 17109:30:50 OBSERVE= R.kpan 175 jaeger > 09:30:50 OBSERVER.kpan 175 jaeger f error=3D&quo= t;Command 'goto 902 10 171' failed because of an uncaught error = 9;RuntimeError: Grid is Kaiju-collided, cannot generate paths'. See tra= ceback in the log for more information."09:30:50 CmdDone: OBSERVER= .kpan 175 jaeger goto 902 10 17109:31:21 CmdStarted: OBSERVER.kpan = 177 jaeger goto 902 10 17009:31:21 OBSERVER.kpan 177 jaeger > 09= :31:22 OBSERVER.kpan 177 jaeger f error=3D"Command 'goto 902 10 17= 0' failed because of an uncaught error 'RuntimeError: Grid is Kaiju= -collided, cannot generate paths'. See traceback in the log for more in= formation."09:31:22 CmdDone: OBSERVER.kpan 177 jaeger goto 902 10 = 17009:31:56 CmdStarted: OBSERVER.kpan 180 jaeger unwind --force= 09:31:56 OBSERVER.kpan 180 jaeger > 09:31:57 OBSERVER.kpan 180 jaege= r i folded=3DF09:31:57 OBSERVER.kpan 180 jaeger d text=3D"Calculat= ing unwind trajectory."09:31:57 OBSERVER.kpan 180 jaeger f error= =3D"Command 'unwind --force' failed because of an uncaught err= or 'RuntimeError: Grid is Kaiju-collided, cannot generate paths'. S= ee traceback in the log for more information."09:31:57 CmdDone: OB= SERVER.kpan 180 jaeger unwind --force09:32:28 CmdStarted: OBSERVER.= kpan 183 jaeger goto 902 10 16909:32:28 OBSERVER.kpan 183 jaeger > 09:32:29 OBSERVER.kpan 183 jaeger f error=3D"Command 'goto 902 = 10 169' failed because of an uncaught error 'RuntimeError: Grid is = Kaiju-collided, cannot generate paths'. See traceback in the log for mo= re information."09:32:29 CmdDone: OBSERVER.kpan 183 jaeger goto 90= 2 10 16909:34:27 CmdStarted: OBSERVER.karen 3 jaeger explode 10= 09:34:46 CmdStarted: OBSERVER.karen 4 jaeger unwind --forceThis wor= ked.Dust counts have risen.=C2=A0 Seeing is poor (> 2.5").= =C2=A0 We can smell some smoke in placeson site, and there appears to b= e some smoggy air (can see headlight beam)as we walk down to the enclos= ure.To be preventative going into the holiday weekend, we are going= to close now.APOGEE dome flat:09:42:09 =C2=A0apogee.expose=3Da= pRaw-41640054, 5, A, DomeFlat09:43:37 =C2=A0apogee.expose=3DapRaw-41640= 055, 5, A, DomeFlat09:45:07 =C2=A0apogee.expose=3DapRaw-41640056, 5, A,= DomeFlat09:52:37 =C2=A0encl25m : closed; =C2=A009:56Z = Started morning cals.=C2=A0 FPS powered off.---- Mirror Numbers ---= -PRIMARY:--------Scale: 1.000000MIGS TONIGHT N= OMINALAxial A: 0.0150 0.0140Axial B: 0.0060 0.0050Axial C: = -0.0190 -0.0200Trans D: 0.0020 0.0010Lateral E: 0.3315 0.3315Lateral F: 0.5345 0.5345GALILSCommanded: =C2=A012500 -1600 = 5300 47050 -8800 -8400Actual: =C2=A0=C2=A0=C2=A0=C2=A012500 -1600 5300 = 47050 -8800 -8400SETMIR VALUESPrimDesOrient: 0.0 -59.5 -9.15 -5= 12.0 1906.3PrimOrient: =C2=A0=C2=A0=C2=A01.07 -59.51 -9.21 -512.13 1906= .31SECONDARY:----------Focus: =C2=A0=C2=A0=C2=A0=C2=A0= =C2=A00.0000Air temp: =C2=A0=C2=A0=C2=A020.61Altitude: =C2=A0=C2=A0= 30.0MIGS TONIGHT NOMINALAxial A: -9.6540 -9.6550Axial B: -= 0.0470 -0.0470Axial C: -9.7020 -9.7010Trans D: 0.1020 0.1030GALILSCommanded: 4877900 4874550 4895750 -50 -3450Actual: =C2=A0= =C2=A0=C2=A04859192 4859186 4859280 -50 -3450SETMIR VALUESSecDe= sOrient: 3857.0 0.0 0.0 0.0 42.22SecOrient: =C2=A0=C2=A0=C2=A03857.0 -0= .03 -0.0 -0.0 42.89---- Telescope Status ----00:40Z= =C2=A0=C2=A0=C2=A0=C2=A0Started ventilation02:03Z =C2=A0=C2=A0=C2=A0= =C2=A0encl25m : open09:52Z =C2=A0=C2=A0=C2=A0=C2=A0encl25m : closed= No interlocks bypassedStatus at: =C2=A010:01ZTelescope stow= ed at: =C2=A0=C2=A0=C2=A0121.0, 30.0, =C2=A0=C2=A00.0 =C2=A0mountInstru= ment mounted: =C2=A0=C2=A0=C2=A0=C2=A0FPS =C2=A0=C2=A0=C2=A0=C2=A0Count= erweights at: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0683 685 703 702 =C2=A0=C2=A0=C2= =A0LN2 autofill systems: =C2=A0=C2=A0Connected and turned on180L LN= 2 dewar scales: =C2=A0SP1 =C2=A0106 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0lbs, =C2= =A022.1 =C2=A0=C2=A0psi---- Software Used ---- = -- STUI software: STUI =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: 1.7.17b1alerts =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 2.2.= 1boss =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 6.0.1= -boss.specMec : 3.0.4apo =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0: 3.0.1fliswarm =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.2.1-al= pha.0jaeger =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.15.2-alpha.0kaiju =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.2.4-alpha.0coordio =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.4.0-alpha.0fps_calibra= ti : APO.2022.04.21+55c1d22cherno =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: 0.1.1-alpha.0hal =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0: 0.1.1-alpha.0hartmann =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: = 2.0.2hub =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: = 5.0.1a0mcp =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= : 2.1-mcp.plc =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 34-mcp.azFiduci : v1_= 148-mcp.altFiduc : v1_148-mcp.rotFiduc : v1_148tcc =C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.4.0apogee =C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: not availbleapogeecal =C2=A0=C2=A0= =C2=A0=C2=A0: not availbleapogeeql =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: v1_7= _0devSTUIAdditions : 3.1.13---- APOGEE Data Summary ----list_apAPOGEE data list, =C2=A0=C2=A0mjd=3D59726, =C2=A0allraw_data: =C2=A0/data/apogee/utr_cdr/59726/apRaw-*.fitsarchive: =C2=A0= /data/apogee/archive/59726/apR-[a,b,c]-*.apzquickred: =C2=A0/data/apoge= e/quickred/59726/apq-*.fits--------------------------------------------= ---------------------------------- mjd =C2=A0=C2=A0i =C2=A0=C2=A0UT = =C2=A0=C2=A0File/Exp =C2=A0Imtype Nread A/B Dth =C2=A0Design-Cfg =C2=A0Arch= Offset %Flux/FPI Comm -----------------------------------------------= -------------------------------59726 =C2=A0=C2=A01 23:48 =C2=A041640001= =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A0=C2=A03 =C2=A0A =C2=A013.0 =C2=A0------= ---- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0= =C2=A02 00:02 =C2=A041640002 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A060 =C2=A0A = =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- = =C2=A059726 =C2=A0=C2=A03 00:04 =C2=A041640003 =C2=A0QuarFlat 10 =C2=A0= A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0-= =C2=A059726 =C2=A0=C2=A04 00:06 =C2=A041640004 =C2=A0Arc-Thar 12 =C2= =A0B =C2=A013.5 =C2=A0---------- =C2=A0a-b-c =C2=A00.94 =C2=A0- =C2=A05= 9726 =C2=A0=C2=A05 00:13 =C2=A041640005 =C2=A0Arc-Une =C2=A040 =C2=A0B =C2= =A013.5 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2= =A059726 =C2=A0=C2=A06 00:16 =C2=A041640006 =C2=A0Arc-Thar 12 =C2=A0A = =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A00.52 =C2=A0- =C2=A059726 = =C2=A0=C2=A07 00:23 =C2=A041640007 =C2=A0Arc-Une =C2=A040 =C2=A0A =C2=A013.= 0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A0= 59726 =C2=A0=C2=A08 00:34 =C2=A041640008 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2= =A060 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- = =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A09 00:40 =C2=A041640009 =C2=A0Arc-= --- =C2=A030 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0= =C2=A0- =C2=A0=C2=A098 =C2=A0FPI59726 =C2=A010 02:09 =C2=A041640010 =C2= =A0=C2=A0=C2=A0Dark =C2=A0=C2=A0=C2=A05 =C2=A0A =C2=A013.0 =C2=A0----------= =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A0------------------= ------------------------------------------------------------ APOGEE dat= a list, =C2=A0=C2=A0mjd=3D59726, =C2=A0allraw_data: =C2=A0/data/apogee/= utr_cdr/59726/apRaw-*.fitsarchive: =C2=A0/data/apogee/archive/59726/apR= -[a,b,c]-*.apzquickred: =C2=A0/data/apogee/quickred/59726/apq-*.fits--------------------------------------------------------------------------= ---- mjd =C2=A0=C2=A0i =C2=A0=C2=A0UT =C2=A0=C2=A0File/Exp =C2=A0Imtyp= e Nread A/B Dth =C2=A0Design-Cfg =C2=A0Arch Offset %Flux/FPI Comm ----= --------------------------------------------------------------------------59726 =C2=A0=C2=A01 23:48 =C2=A041640001 =C2=A0=C2=A0=C2=A0Dark =C2=A0= =C2=A0=C2=A03 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0= =C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A02 00:02 =C2=A041640002 = =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A060 =C2=A0A =C2=A013.0 =C2=A0---------- = =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A03= 00:04 =C2=A041640003 =C2=A0QuarFlat 10 =C2=A0A =C2=A013.0 =C2=A0----------= =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A0= 4 00:06 =C2=A041640004 =C2=A0Arc-Thar 12 =C2=A0B =C2=A013.5 =C2=A0---------= - =C2=A0a-b-c =C2=A00.94 =C2=A0- =C2=A059726 =C2=A0=C2=A05 00:13 =C2=A0= 41640005 =C2=A0Arc-Une =C2=A040 =C2=A0B =C2=A013.5 =C2=A0---------- =C2=A0a= -b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A06 00:16 = =C2=A041640006 =C2=A0Arc-Thar 12 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0= a-b-c =C2=A00.52 =C2=A0- =C2=A059726 =C2=A0=C2=A07 00:23 =C2=A041640007= =C2=A0Arc-Une =C2=A040 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2= =A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0=C2=A08 00:34 =C2=A041= 640008 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A060 =C2=A0A =C2=A013.0 =C2=A0-----= ----- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A059726 =C2=A0= =C2=A09 00:40 =C2=A041640009 =C2=A0Arc---- =C2=A030 =C2=A0A =C2=A013.0 =C2= =A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A098 =C2=A0FPI5= 9726 =C2=A010 02:09 =C2=A041640010 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A0=C2= =A05 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- = =C2=A0=C2=A0- =C2=A059726 =C2=A011 02:24 =C2=A041640011 =C2=A0DomeFlat = =C2=A05 =C2=A0A =C2=A013.0 =C2=A043160-5560 =C2=A0a-b-c =C2=A0=C2=A0=C2=A0-= =C2=A0145 59726 =C2=A012 02:25 =C2=A041640012 =C2=A0DomeFlat =C2=A05 = =C2=A0A =C2=A013.0 =C2=A043160-5560 =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A01= 48 59726 =C2=A013 02:27 =C2=A041640013 =C2=A0DomeFlat =C2=A05 =C2=A0A = =C2=A013.0 =C2=A043160-5560 =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0153 5= 9726 =C2=A014 02:59 =C2=A041640014 =C2=A0=C2=A0Object =C2=A043 =C2=A0A =C2= =A013.0 =C2=A043160-5562 =C2=A0a-b-c =C2=A00.41 1,1 59726 =C2=A015 03:0= 7 =C2=A041640015 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A043160= -5562 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A016 03:23 =C2=A041640016 = =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A043161-5563 =C2=A0a-b-c= =C2=A00.93 1,1 59726 =C2=A017 03:30 =C2=A041640017 =C2=A0=C2=A0Object = =C2=A043 =C2=A0A =C2=A013.0 =C2=A043161-5563 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A018 03:48 =C2=A041640018 =C2=A0=C2=A0Object =C2=A046 =C2=A0A = =C2=A013.0 =C2=A057937-5564 =C2=A0a-b-c =C2=A00.43 1,1 59726 =C2=A019 0= 3:56 =C2=A041640019 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A057= 937-5564 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A020 04:04 =C2=A041640020= =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A057937-5564 =C2=A0a-b-= c =C2=A00.93 1,1 59726 =C2=A021 04:12 =C2=A041640021 =C2=A0=C2=A0Object= =C2=A043 =C2=A0A =C2=A013.0 =C2=A057937-5564 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A022 04:26 =C2=A041640022 =C2=A0=C2=A0Object =C2=A046 =C2=A0A = =C2=A013.0 =C2=A057938-5565 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A023 0= 4:34 =C2=A041640023 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A057= 938-5565 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A024 04:42 =C2=A041640024= =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A057938-5565 =C2=A0a-b-= c =C2=A00.93 1,1 59726 =C2=A025 04:50 =C2=A041640025 =C2=A0=C2=A0Object= =C2=A043 =C2=A0A =C2=A013.0 =C2=A057938-5565 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A026 04:59 =C2=A041640026 =C2=A0=C2=A0Object =C2=A043 =C2=A0A = =C2=A013.0 =C2=A057938-5565 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A027 0= 5:06 =C2=A041640027 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A057= 938-5565 =C2=A0a-b-c =C2=A00.92 1,1 59726 =C2=A028 05:20 =C2=A041640028= =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A057939-5566 =C2=A0a-b-= c =C2=A00.93 1,1 59726 =C2=A029 05:29 =C2=A041640029 =C2=A0=C2=A0Object= =C2=A046 =C2=A0A =C2=A013.0 =C2=A057939-5566 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A030 05:36 =C2=A041640030 =C2=A0=C2=A0Object =C2=A043 =C2=A0A = =C2=A013.0 =C2=A057939-5566 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A031 0= 5:44 =C2=A041640031 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A057= 939-5566 =C2=A0a-b-c =C2=A00.92 1,1 59726 =C2=A032 05:53 =C2=A041640032= =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A057939-5566 =C2=A0a-b-= c =C2=A00.93 1,1 59726 =C2=A033 06:01 =C2=A041640033 =C2=A0=C2=A0Object= =C2=A043 =C2=A0A =C2=A013.0 =C2=A057939-5566 =C2=A0a-b-c =C2=A00.43 1,1 59726 =C2=A034 06:22 =C2=A041640034 =C2=A0=C2=A0Object =C2=A046 =C2=A0A = =C2=A013.0 =C2=A0107018-5568 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A035 = 06:30 =C2=A041640035 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A01= 07018-5568 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A036 06:38 =C2=A0416400= 36 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A0107018-5568 =C2=A0a= -b-c =C2=A00.93 1,1 59726 =C2=A037 06:46 =C2=A041640037 =C2=A0=C2=A0Obj= ect =C2=A043 =C2=A0A =C2=A013.0 =C2=A0107018-5568 =C2=A0a-b-c =C2=A00.42 1,= 1 59726 =C2=A038 06:55 =C2=A041640038 =C2=A0=C2=A0Object =C2=A046 =C2= =A0A =C2=A013.0 =C2=A0107019-5569 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2= =A039 07:03 =C2=A041640039 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 = =C2=A0107019-5569 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A040 07:11 =C2= =A041640040 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 =C2=A0107019-556= 9 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A041 07:19 =C2=A041640041 =C2=A0= =C2=A0Object =C2=A043 =C2=A0A =C2=A013.0 =C2=A0107019-5569 =C2=A0a-b-c =C2= =A00.42 1,1 59726 =C2=A042 07:28 =C2=A041640042 =C2=A0=C2=A0Object =C2= =A043 =C2=A0A =C2=A013.0 =C2=A0107019-5569 =C2=A0a-b-c =C2=A00.42 1,1 5= 9726 =C2=A043 07:35 =C2=A041640043 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2= =A013.5 =C2=A0107019-5569 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A044 07:= 44 =C2=A041640044 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A01070= 20-5570 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A045 07:53 =C2=A041640045 = =C2=A0=C2=A0Object =C2=A046 =C2=A0A =C2=A013.0 =C2=A0107020-5570 =C2=A0a-b-= c =C2=A00.42 1,1 59726 =C2=A046 08:00 =C2=A041640046 =C2=A0=C2=A0Object= =C2=A043 =C2=A0A =C2=A013.0 =C2=A0107020-5570 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A047 08:08 =C2=A041640047 =C2=A0=C2=A0Object =C2=A043 =C2=A0B = =C2=A013.5 =C2=A0107020-5570 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2=A048 = 08:19 =C2=A041640048 =C2=A0=C2=A0Object =C2=A046 =C2=A0B =C2=A013.5 =C2=A01= 07020-5570 =C2=A0a-b-c =C2=A00.94 1,1 59726 =C2=A049 08:27 =C2=A0416400= 49 =C2=A0=C2=A0Object =C2=A046 =C2=A0A =C2=A013.0 =C2=A0107020-5570 =C2=A0a= -b-c =C2=A00.42 1,1 59726 =C2=A050 08:35 =C2=A041640050 =C2=A0=C2=A0Obj= ect =C2=A043 =C2=A0A =C2=A013.0 =C2=A0107020-5570 =C2=A0a-b-c =C2=A00.42 1,= 1 59726 =C2=A051 08:43 =C2=A041640051 =C2=A0=C2=A0Object =C2=A043 =C2= =A0B =C2=A013.5 =C2=A0107020-5570 =C2=A0a-b-c =C2=A00.93 1,1 59726 =C2= =A052 08:52 =C2=A041640052 =C2=A0=C2=A0Object =C2=A043 =C2=A0B =C2=A013.5 = =C2=A0107020-5570 =C2=A0a-b-c =C2=A00.94 1,1 59726 =C2=A053 09:00 =C2= =A041640053 =C2=A0=C2=A0Object =C2=A043 =C2=A0A =C2=A013.0 =C2=A0107020-557= 0 =C2=A0a-b-c =C2=A00.42 1,1 59726 =C2=A054 09:42 =C2=A041640054 =C2=A0= DomeFlat =C2=A05 =C2=A0A =C2=A013.0 =C2=A056893-5573 =C2=A0a-b-c =C2=A0=C2= =A0=C2=A0- =C2=A0146 59726 =C2=A055 09:44 =C2=A041640055 =C2=A0DomeFlat= =C2=A05 =C2=A0A =C2=A013.0 =C2=A056893-5573 =C2=A0a-b-c =C2=A0=C2=A0=C2=A0= - =C2=A0147 59726 =C2=A056 09:45 =C2=A041640056 =C2=A0DomeFlat =C2=A05 = =C2=A0A =C2=A013.0 =C2=A056893-5573 =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A01= 48 =C2=A0=C2=A0=C2=A0cannot read file : /data/apogee/utr_cdr/59726/apR= aw-41640057.fits-------------------------------------------------------= ----------------------- ---- eBOSS Data Summary ----Reading FITS from /data/spectro//59726- - - - - - - - - - - - - - - - = - - - - - - - - - - - - - - - - - - - - - - - =C2=A0n =C2=A0Time =C2= =A0Filename =C2=A0=C2=A0=C2=A0design-field cfg =C2=A0flav =C2=A0shu =C2=A0= =C2=A0Exp =C2=A0=C2=A0=C2=A0=C2=A0colA =C2=A0=C2=A0colB =C2=A0=C2=A0colC Hr= t- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - = - - - - =C2=A01 00:02 b1-00342506 ----------- ---- bia Clo =C2=A0=C2= =A0=C2=A00.0 =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 = =C2=A02 00:02 r1-00342506 ----------- ---- bia Clo =C2=A0=C2=A0=C2=A00.0 = =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 =C2=A03 00:04 = b1-00342507 ----------- ---- dar Clo =C2=A0=C2=A020.0 =C2=A0=C2=A02033 =C2= =A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 =C2=A04 00:04 r1-00342507 --------= --- ---- dar Clo =C2=A0=C2=A020.0 =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0= =C2=A0=C2=A0798 =C2=A05 00:07 b1-00342508 38525-100498 5558 arc Lef = =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A07= 98 HART =C2=A06 00:07 r1-00342508 38525-100498 5558 arc Lef =C2=A0=C2= =A0=C2=A04.1 =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 HART =C2=A07 00:08 b1-00342509 38525-100498 5558 arc Rig =C2=A0=C2=A0=C2=A04.= 1 =C2=A0=C2=A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 HART =C2=A08 = 00:08 r1-00342509 38525-100498 5558 arc Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2= =A02033 =C2=A0=C2=A02180 =C2=A0=C2=A0=C2=A0798 HART =C2=A09 00:09 b1-00= 342510 38525-100498 5558 arc Lef =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02053 =C2= =A0=C2=A02199 =C2=A0=C2=A0=C2=A0816 HART 10 00:09 r1-00342510 38525-100= 498 5558 arc Lef =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02053 =C2=A0=C2=A02199 = =C2=A0=C2=A0=C2=A0816 HART 11 00:10 b1-00342511 38525-100498 5558 arc R= ig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02053 =C2=A0=C2=A02199 =C2=A0=C2=A0=C2= =A0816 HART 12 00:10 r1-00342511 38525-100498 5558 arc Rig =C2=A0=C2=A0= =C2=A04.1 =C2=A0=C2=A02053 =C2=A0=C2=A02199 =C2=A0=C2=A0=C2=A0816 HART = 13 00:12 r1-00342512 38525-100498 5558 fla Out =C2=A0=C2=A025.1 =C2=A0=C2= =A02236 =C2=A0=C2=A02383 =C2=A0=C2=A01000 14 00:12 b1-00342512 38525-1= 00498 5558 fla Out =C2=A0=C2=A025.1 =C2=A0=C2=A02236 =C2=A0=C2=A02383 =C2= =A0=C2=A01000 15 00:16 b1-00342513 38525-100498 5558 arc Out =C2=A0=C2= =A0=C2=A04.1 =C2=A0=C2=A02236 =C2=A0=C2=A02383 =C2=A0=C2=A01000 16 00:= 16 r1-00342513 38525-100498 5558 arc Out =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A0= 2236 =C2=A0=C2=A02383 =C2=A0=C2=A01000 17 02:42 b1-00342514 43160-1011= 75 5562 arc Lef =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02236 =C2=A0=C2=A02383 =C2= =A0=C2=A01000 HART 18 02:42 r1-00342514 43160-101175 5562 arc Lef =C2= =A0=C2=A0=C2=A04.1 =C2=A0=C2=A02236 =C2=A0=C2=A02383 =C2=A0=C2=A01000 HART 19 02:42 b1-00342515 43160-101175 5562 arc Rig =C2=A0=C2=A0=C2=A04.1 = =C2=A0=C2=A02236 =C2=A0=C2=A02383 =C2=A0=C2=A01000 HART 20 02:42 r1-003= 42515 43160-101175 5562 arc Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A02236 =C2= =A0=C2=A02383 =C2=A0=C2=A01000 HART 21 02:43 r1-00342516 43160-101175 5= 562 arc Out =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0= =C2=A02330 22 02:43 b1-00342516 43160-101175 5562 arc Out =C2=A0=C2=A0= =C2=A04.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330 23 02:45 = r1-00342517 43160-101175 5562 fla Out =C2=A0=C2=A025.1 =C2=A0=C2=A03566 =C2= =A0=C2=A03713 =C2=A0=C2=A02330 24 02:45 b1-00342517 43160-101175 5562 = fla Out =C2=A0=C2=A025.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330= 25 02:52 b1-00342518 43160-101175 5562 sci Out =C2=A0900.1 =C2=A0=C2= =A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330 26 02:52 r1-00342518 43160-1= 01175 5562 sci Out =C2=A0900.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2= =A02330 27 03:16 b1-00342519 43161-101175 5563 sci Out =C2=A0900.1 =C2= =A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330 28 03:16 r1-00342519 4= 3161-101175 5563 sci Out =C2=A0900.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2= =A0=C2=A02330 29 03:33 b1-00342520 57937-104639 5564 arc Lef =C2=A0=C2= =A0=C2=A04.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330 HART 30= 03:33 r1-00342520 57937-104639 5564 arc Lef =C2=A0=C2=A0=C2=A04.1 =C2=A0= =C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02330 HART 31 03:33 r1-00342521 = 57937-104639 5564 arc Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A03566 =C2=A0=C2= =A03713 =C2=A0=C2=A02330 HART 32 03:33 b1-00342521 57937-104639 5564 ar= c Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A03566 =C2=A0=C2=A03713 =C2=A0=C2=A02= 330 HART 33 03:34 r1-00342522 57937-104639 5564 arc Out =C2=A0=C2=A0=C2= =A04.0 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 34 03:34 b1-= 00342522 57937-104639 5564 arc Out =C2=A0=C2=A0=C2=A04.0 =C2=A0=C2=A04239 = =C2=A0=C2=A04388 =C2=A0=C2=A03004 35 03:36 b1-00342523 57937-104639 55= 64 fla Out =C2=A0=C2=A025.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03= 004 36 03:36 r1-00342523 57937-104639 5564 fla Out =C2=A0=C2=A025.1 = =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 37 03:40 r1-0034252= 4 57937-104639 5564 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 = =C2=A0=C2=A03004 38 03:40 b1-00342524 57937-104639 5564 sci Out =C2=A0= 900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 39 03:57 r1-0= 0342525 57937-104639 5564 sci Out =C2=A0900.0 =C2=A0=C2=A04239 =C2=A0=C2=A0= 4388 =C2=A0=C2=A03004 40 03:57 b1-00342525 57937-104639 5564 sci Out = =C2=A0900.0 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 41 04:1= 9 r1-00342526 57938-104639 5565 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0= =C2=A04388 =C2=A0=C2=A03004 42 04:19 b1-00342526 57938-104639 5565 sci= Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 43= 04:35 r1-00342527 57938-104639 5565 sci Out =C2=A0900.1 =C2=A0=C2=A04239 = =C2=A0=C2=A04388 =C2=A0=C2=A03004 44 04:35 b1-00342527 57938-104639 55= 65 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 45 04:52 b1-00342528 57938-104639 5565 sci Out =C2=A0900.0 =C2=A0=C2=A0= 4239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 46 04:52 r1-00342528 57938-1046= 39 5565 sci Out =C2=A0900.0 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03= 004 47 05:13 r1-00342529 57939-104639 5566 sci Out =C2=A0900.1 =C2=A0= =C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 48 05:13 b1-00342529 5793= 9-104639 5566 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0= =C2=A03004 49 05:29 b1-00342530 57939-104639 5566 sci Out =C2=A0900.1 = =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 50 05:29 r1-0034253= 0 57939-104639 5566 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 = =C2=A0=C2=A03004 51 05:46 b1-00342531 57939-104639 5566 sci Out =C2=A0= 900.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 52 05:46 r1-0= 0342531 57939-104639 5566 sci Out =C2=A0900.1 =C2=A0=C2=A04239 =C2=A0=C2=A0= 4388 =C2=A0=C2=A03004 53 06:08 b1-00342532 107018-112359 5568 arc Lef = =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 HA= RT 54 06:08 r1-00342532 107018-112359 5568 arc Lef =C2=A0=C2=A0=C2=A04.= 1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2=A0=C2=A03004 HART 55 06:08 b1-0= 0342533 107018-112359 5568 arc Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A04239 = =C2=A0=C2=A04388 =C2=A0=C2=A03004 HART 56 06:08 r1-00342533 107018-1123= 59 5568 arc Rig =C2=A0=C2=A0=C2=A04.1 =C2=A0=C2=A04239 =C2=A0=C2=A04388 =C2= =A0=C2=A03004 HART 57 06:09 b1-00342534 107018-112359 5568 arc Out =C2= =A0=C2=A0=C2=A04.0 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 = 58 06:09 r1-00342534 107018-112359 5568 arc Out =C2=A0=C2=A0=C2=A04.0 =C2= =A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 59 06:11 b1-00342535 1= 07018-112359 5568 fla Out =C2=A0=C2=A025.1 =C2=A0=C2=A03778 =C2=A0=C2=A0392= 4 =C2=A0=C2=A02541 60 06:11 r1-00342535 107018-112359 5568 fla Out =C2= =A0=C2=A025.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 61 06= :14 r1-00342536 107018-112359 5568 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2= =A0=C2=A03924 =C2=A0=C2=A02541 62 06:14 b1-00342536 107018-112359 5568= sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 63 06:31 r1-00342537 107018-112359 5568 sci Out =C2=A0900.0 =C2=A0=C2=A03= 778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 64 06:31 b1-00342537 107018-1123= 59 5568 sci Out =C2=A0900.0 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02= 541 65 06:48 b1-00342538 107019-112359 5569 sci Out =C2=A0900.0 =C2=A0= =C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 66 06:48 r1-00342538 1070= 19-112359 5569 sci Out =C2=A0900.0 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0= =C2=A02541 67 07:04 b1-00342539 107019-112359 5569 sci Out =C2=A0900.1= =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 68 07:04 r1-003425= 39 107019-112359 5569 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924= =C2=A0=C2=A02541 69 07:20 b1-00342540 107019-112359 5569 sci Out =C2= =A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 70 07:20 r= 1-00342540 107019-112359 5569 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0= =C2=A03924 =C2=A0=C2=A02541 71 07:37 r1-00342541 107020-112359 5570 sc= i Out =C2=A0900.0 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 7= 2 07:37 b1-00342541 107020-112359 5570 sci Out =C2=A0900.0 =C2=A0=C2=A03778= =C2=A0=C2=A03924 =C2=A0=C2=A02541 73 07:53 r1-00342542 107020-112359 = 5570 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541= 74 07:53 b1-00342542 107020-112359 5570 sci Out =C2=A0900.1 =C2=A0=C2= =A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 75 08:11 r1-00342543 107020-= 112359 5570 sci Out =C2=A0900.0 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2= =A02541 76 08:11 b1-00342543 107020-112359 5570 sci Out =C2=A0900.0 = =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 77 08:28 b1-0034254= 4 107020-112359 5570 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 = =C2=A0=C2=A02541 78 08:28 r1-00342544 107020-112359 5570 sci Out =C2= =A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 79 08:45 r= 1-00342545 107020-112359 5570 sci Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0= =C2=A03924 =C2=A0=C2=A02541 80 08:45 b1-00342545 107020-112359 5570 sc= i Out =C2=A0900.1 =C2=A0=C2=A03778 =C2=A0=C2=A03924 =C2=A0=C2=A02541 ---- BOSS Spectrographs Collimation ----Time =C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0TSP1 =C2=A0=C2=A0R1 =C2=A0=C2=A0=C2=A0B1 =C2=A0= =C2=A0Move1 =C2=A0=C2=A0B1Resid=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D00:08:40 =C2=A0=C2=A0=C2=A08.8 =C2=A0=C2=A0-989 = =C2=A0-3.2 =C2=A0=C2=A0=C2=A0=C2=A019 =C2=A0-3.200:10:40 =C2=A0=C2=A0= =C2=A08.8 =C2=A0=C2=A0-659 =C2=A0-3.2 =C2=A0=C2=A0=C2=A0184 =C2=A0-2.60= 2:43:20 =C2=A0=C2=A0=C2=A09.2 =C2=A0=C2=A0=C2=A0989 =C2=A0-5.2 =C2=A0=C2=A0= 1330 =C2=A0-1.103:34:30 =C2=A0=C2=A0=C2=A09.0 =C2=A0=C2=A0=C2=A0=C2=A0= =C2=A00 =C2=A0-4.2 =C2=A0=C2=A0=C2=A0674 =C2=A0-2.106:09:30 =C2=A0=C2= =A0=C2=A08.6 =C2=A0=C2=A0-989 =C2=A0-0.2 =C2=A0=C2=A0-462 =C2=A0-1.7---- Time Tracking ----*=3D*=3D*=3D Observatory: APO*=3D*= =3D*=3D MJD: 59726 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Fill night time = in Hours below*=3D*=3D*=3D Total bright time =C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0: 0*=3D*=3D*=3D Bright time, queued observations = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0*=3D*=3D*=3D Bright time, commissionin= g/engineering: 0*=3D*=3D*=3D Bright time lost to weather =C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0*=3D*=3D*=3D Bright = time lost to technical issues =C2=A0: 0*=3D*=3D*=3D Total dark time= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 8.0*=3D*= =3D*=3D Dark time, queued observations =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: 7.0*=3D*=3D*=3D Dark time, commissioning/engineering =C2=A0: 0*=3D*=3D*=3D Dark time lost to weather =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.0*=3D*=3D*=3D Dark time lost= to technical issues =C2=A0=C2=A0=C2=A0: 0_____________= _______________________________________________Logs of Nightly APO Acti= vities https://trac.sdss.= org/tracmailman/browser/private/sloan-25mlog/index.html ____________________________________________________________Logs of Nig= htly APO Activities https= ://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html ____________________________________________________________ Logs of Nightly APO Activities https://trac.sdss.org/tracm= ailman/browser/private/sloan-25mlog/index.html -- Please note that while this e-mail might reach you on the= weekend or other unusual times, please know that this is a matter of my pe= rsonal work-life balance, and that I do not expect to receive an answer out= side your usual business hours.Stefan= ie Wachter, PhDSDSS-V Lead Systems EngineerCarnegie Observa= tories --00000000000064af2c05e0040b01--