Subject: Re: [sloan-25mlog 5903] Re: 2.5m obslog 20220225 (SJD 59636) From: Karen Kinemuchi Date: Sat, 26 Feb 2022 15:53:46 -0700 --Apple-Mail=_51FD160B-7F3F-4423-9903-4D0B2DB4D0AC Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Feb 26, 2022, at 12:38 PM, Audrey Oravetz = wrote: >=20 > Hi Jose and Karen, >=20 >> Hi Karen, Audrey, >>=20 >> NOTES TO DAY STAFF AND DEVELOPERS: >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>> * For the commissioning designs with 4 cloned visits, the last = config id >>> initiated new trajectories to be calculated and was not identified = as a >>> "cloned" >>> field like the previous two design reloads. Occurred for design set = of >>> 16716. >>>=20 >> This is expected. jaeger will not clone more than one hour/4 designs. >> After >> that period, you'll get a new, non-cloned configuration even if it = could >> be >> cloned. The idea with this is that after one hour you normally want = to >> reconfigure the array to update the atmospheric refraction estimates, = and >> to update the scale, and also to take new cals. If the designs = appears as >> normal (not cloned) you want to do the full goto field macro. >=20 > Good to know. Thank you for clarifying. Thanks for this info. =20 >> * 02:48Z Had an instance where an APOGEE exposure aborted for no = reason. >> See >>> log and Problems in detail of the problem. Unknown cause; please = check >>> data. >>>=20 >>=20 >> This seems to be the same issue we had las week. The error message is = the >> same. Were Matt instructions on restarting the controller followed? = If >> they >> were, this problem seems to be becoming more frequent. >=20 > Luckily, we did not need to do anything other than restart the = exposure > sequence last night. Not sure if that was just a fluke though. >=20 Outside of the conversation on infrastructure with JohnW, is there = anything the night staff can do if this happens in the middle of the = night. If all it takes is checking the instrument gui and restarting = the exposure sequence, then we can do that. >> Right now if APOGEE fails BOSS will stop. We decided to change that = and I >> modified HAL but we never restarted it. If you restart hal it should = now >> not fail the other science exposure if one fails. >=20 > Good idea. Karen/Dmitry are on shift tonight and will restart hal. Hal was just restarted now. >=20 >>=20 >> I'm not sure about the guider, though. It seems something in the = APOGEE >> error cascaded into something that affected the guider but I'm not >> immediate sure what it is. I think last week that didn't happen. = Since I >> may not be able to look into that for a bit, can you open a Jira = ticket >> with that issue so that it doesn't get forgotten? >=20 > Yes, I will issue a ticket. Thanks Audrey! >=20 >>=20 >> * 12:45Z BOSS sp1cam is DEAD. Critical alert sounded but does not = appear >>> in the >>> alerts window. Morning biases and darks appear ok. See log for more >>> details. >>>=20 >>=20 >> Sounds like a temporary controller error that almost immediately = cleared >> itself ... >=20 > Thanks for taking care of this, Karen. >=20 >>=20 >>=20 >> ---- Observing Log ---- >>>=20 >>> Afternoon: >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>=20 >>> /dev/sdb1 2.0T 161G 1.9T 8% /home >>> tmpfs 3.2G 0 3.2G 0% /run/user/2005 >>> 10.25.1.230:/data 21T 18T 2.4T 89% /data >>> overlay 228G 48G 180G 22% = /var/lib/docker/overlay2 >>> tmpfs 3.2G 4.0K 3.2G 1% /run/user/3021 >>> 10.25.1.230:/archive 20T 725G 19T 4% /archive >>> tmpfs 3.2G 0 3.2G 0% /run/user/1002 >>>=20 >>> 22:14:41 boss exposure 0.0, file=3D338009 >>> 22:16:06 boss exposure 20.0, file=3D338010 >>> 22:17:50 boss exposure 4.0, file=3D338011 >>> 22:18:31 boss exposure 4.0, file=3D338012 >>> 22:19:15 sp1.motor.move=3D 1495, 1496, 1495 >>> 22:19:15 Hartmann collimate output >>> sp1: offset: r=3D 1319 (Out of focus); b=3D -5.2 (Out of focus) >>> sp1: pred. move: spAverageMove=3D 1495 >>> sp1: pred. resid: r=3D -176, b=3D -0.6, txt=3D OK, spTemp =3D 3.5 >>> 22:19:54 boss exposure 4.0, file=3D338013 >>> 22:25:00 boss exposure 30.0, file=3D338014 >>>=20 >>> 23:22Z - Started ventilating. Cloudy at the moment, but it may clear = out >>> later. Telescope checkout went ok. >>>=20 >>> FPS is powered on, connected, cooled. >>>=20 >>> Night: >>> =3D=3D=3D=3D=3D=3D >>>=20 >>> 00:59:46 encl25m : open; >>>=20 >>> #1: Observe design (16716,16716,16716,16716) >>>=20 >>> 01:17Z Preloaded the first field of the night. We have our first = robot >>> collision >>> of the night, Robot #184. >>>=20 >>> 01:19:25 Config Loaded: 16716-3727 >>>=20 >>> Issued hal go-to-field command, but failed because we disabled one >>> robot. >>> Try >>> again. Accidentally loaded the wrong design, will manually load the >>> correct one. >>>=20 >>> 01:26:29 CmdStarted: APO.aoravetz 91 jaeger configuration load 16716 >>> --no-clone >>>=20 >>> 01:27:43 Config Loaded: 16716-3729 >>>=20 >>> 01:28:17 CmdStarted: APO.apo_2 26 hal goto-field --guider-time 15 >>>=20 >>> HARTMANN: >>> 01:29:22 boss exposure 4.0, file=3D338015 >>> 01:30:03 boss exposure 4.0, file=3D338016 >>> 01:30:49 sp1.motor.move=3D 2467, 2466, 2467 >>> 01:30:49 Hartmann collimate output >>> sp1: offset: r=3D 1979 (Out of focus); b=3D -9.3 (Out of focus) >>> sp1: pred. move: spAverageMove=3D 2467 >>> sp1: pred. resid: r=3D -488, b=3D -1.5, txt=3D OK, spTemp =3D 2.4 >>>=20 >>> Boss cals: >>> 01:31:09 boss exposure 4.0, file=3D338017 >>> 01:34:22 boss exposure 25.0, file=3D338018 >>>=20 >>> FVC Loop: >>> 01:31:34 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS full fit = 51.890 >>> um." >>> 01:32:19 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS full fit = 16.020 >>> um." >>> 01:33:01 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS full fit = 11.600 >>> um." >>> 01:33:42 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS full fit = 10.870 >>> um." >>>=20 >>> 01:31:30 APO.apo_2.jaeger 2332 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0001.fits >>> 01:32:14 APO.apo_2.jaeger 2332 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0002.fits >>> 01:32:57 APO.apo_2.jaeger 2332 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0003.fits >>> 01:33:38 APO.apo_2.jaeger 2332 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0004.fits >>>=20 >>> 01:33:42 FVC Loop - RMS: 10.87 Delta RMS: 0.73 Image #: 0004 >>>=20 >>> Cherno error: >>> 01:36:34 APO.apo_2 27 cherno f error=3D"Command 'acquire -c -t 5' = failed >>> because >>> of an uncaught error 'ExposerError: The guider is already = exposing.'. >>> See >>> traceback in the log for more information." >>> 01:36:34 CmdDone: APO.apo_2 27 cherno acquire -c -t 5 >>>=20 >>> We set the focus initially at 350 and the autofocus feature appears = to >>> be >>> working. Best focus is at 419 and auto adjusting with Boson. >>>=20 >>> 01:36:02 tcc set focus=3D350.0 >>> 01:37:44 APO.apo_2 28 cherno i guide_rms=3D2,0.431,0.741,0.857 >>> 01:38:12 APO.apo_2 28 cherno i guide_rms=3D3,0.138,0.21,0.251 >>> 01:38:38 APO.apo_2 28 cherno i guide_rms=3D4,0.057,0.072,0.092 >>> 01:39:06 APO.apo_2 28 cherno i guide_rms=3D5,0.051,0.037,0.063 >>>=20 >>> Guider autofocus set up took about 3 minutes. >>>=20 >>> We are waiting for the sky to be dark enough to take data. >>>=20 >>> 01:48:26 hal goto-field -s fvc,acquire,guide --guider-time 15 >>>=20 >>> Running a new FVC loop for the first field of the night (2min): >>> 01:50:20 FVC Loop - RMS: 15.11 Delta RMS: 0.21 Image #: 0007 >>>=20 >>> 01:48:57 APO.apo_2.jaeger 2350 jaeger i text=3D"[FVC]: RMS full fit = 21.970 >>> um." >>> 01:49:39 APO.apo_2.jaeger 2350 jaeger i text=3D"[FVC]: RMS full fit = 15.320 >>> um." >>> 01:50:20 APO.apo_2.jaeger 2350 jaeger i text=3D"[FVC]: RMS full fit = 15.110 >>> um." >>>=20 >>> 01:48:52 APO.apo_2.jaeger 2350 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0005.fits >>> 01:49:34 APO.apo_2.jaeger 2350 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0006.fits >>> 01:50:16 APO.apo_2.jaeger 2350 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0007.fits >>>=20 >>> DATA: >>> 01:53:53 apogee.expose=3DapRaw-40740009, 43, A, Object >>> 01:53:59 boss exposure 900.0, file=3D338019 >>> 02:01:34 apogee.expose=3DapRaw-40740010, 43, B, Object >>>=20 >>> 02:09:26 Config Loaded: 16716-3730 >>> Seeing is about 1.7" >>> 02:10:34 boss exposure 900.0, file=3D338020 >>> 02:10:36 apogee.expose=3DapRaw-40740011, 43, A, Object >>> 02:18:17 apogee.expose=3DapRaw-40740012, 43, B, Object >>>=20 >>> 02:26:02 Config Loaded: 16716-3731 >>> 02:27:33 boss exposure 900.0, file=3D338021 >>> 02:27:34 apogee.expose=3DapRaw-40740013, 43, A, Object >>> 02:35:15 apogee.expose=3DapRaw-40740014, 43, B, Object >>>=20 >>> Manually reloading the design and a new trajectory was calculated = (2min) >>> 02:43:59 Config Loaded: 16716-3732 >>>=20 >>> Command to take data was aborted. See Problems in Detail for log = output >>> and >>> time stamps. >>>=20 >>> Problem appears to stem from APOGEE, but it is unclear what happened = to >>> the apogee controller. The exposure completed up to 28 reads. >>> The guider also stopped when this happened. >>>=20 >>> 02:44:06 boss exposure 900.0, file=3D338022 >> 02:44:07 apogee.expose=3DapRaw-40740015, 43, A, Object >>=20 >>> To recover from this unforced abort was to restart the guider and >>> restarted >>> the data exposure sequence in hal. >>>=20 >>> 02:51:19 boss exposure 900.0, file=3D338022 >>> 02:51:20 apogee.expose=3DapRaw-40740016, 43, A, Object >>> 02:59:01 apogee.expose=3DapRaw-40740017, 43, B, Object >>>=20 >>> BOSS exposure number did not increment up in the reissue of the = exposure >>> sequence. >>>=20 >>> APOGEE dome flat: >>> 03:07:07 apogee.expose=3DapRaw-40740018, 5, B, DomeFlat >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>> #2. observe design 4791 (just once) >>>=20 >>> 03:09:38 Config Loaded: 4791-3733 >>>=20 >>> 03:10:02 APO.apo_2.jaeger 2408 jaeger f error=3D"The configuration = was not >>> executed. Try unwinding." >>> 03:10:02 CmdDone: APO.apo_2.jaeger 2408 jaeger configuration reverse >>>=20 >>> We noticed that the configuration reverse command seems to be = failing >>> with >>> each new design from last night to tonight. Issuing an unwind and >>> resuming >>> hal go-to-field. >>>=20 >>> HARTMANN: >>> 03:12:35 boss exposure 4.0, file=3D338024 >>> 03:13:18 boss exposure 4.0, file=3D338025 >>> 03:14:02 sp1.motor.move=3D -1916, -1917, -1918 >>> 03:14:02 Hartmann collimate output >>> sp1: offset: r=3D -1649 (Out of focus); b=3D 6.8 (Out of focus) >>> sp1: pred. move: spAverageMove=3D -1917 >>> sp1: pred. resid: r=3D 268, b=3D 0.8, txt=3D OK, spTemp =3D 2.0 >>>=20 >>> BOSS cals: >>> 03:14:21 boss exposure 4.0, file=3D338026 >>> 03:17:20 boss exposure 25.0, file=3D338027 >>>=20 >>> FVC Loop: >>> 03:15:17 APO.apo_2.jaeger 2421 jaeger i text=3D"[FVC]: RMS full fit = 15.690 >>> um." >>> 03:15:58 APO.apo_2.jaeger 2421 jaeger i text=3D"[FVC]: RMS full fit = 12.690 >>> um." >>> 03:16:39 APO.apo_2.jaeger 2421 jaeger i text=3D"[FVC]: RMS full fit = 14.650 >>> um." >>>=20 >>> 03:15:13 APO.apo_2.jaeger 2421 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0009.fits >>> 03:15:54 APO.apo_2.jaeger 2421 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0010.fits >>> 03:16:35 APO.apo_2.jaeger 2421 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0011.fits >>>=20 >>> 03:14:33 APO.apo_2.jaeger 2421 jaeger i fvc_perc_95=3D80.89 >>> 03:15:17 APO.apo_2.jaeger 2421 jaeger i fvc_perc_95=3D27.15 >>> 03:15:58 APO.apo_2.jaeger 2421 jaeger i fvc_perc_95=3D23.08 >>> 03:16:39 APO.apo_2.jaeger 2421 jaeger i fvc_perc_95=3D28.56 >>>=20 >>> 03:16:39 FVC Loop - RMS: 14.65 Delta RMS: -1.96 Image #: 0011 >>>=20 >>> We've been setting the cherno pid values to 1.0 to help converge the >>> guide_rms >>> value faster. We reset it back to 0.7 when we are starting science. >>>=20 >>> DATA: >>> 03:20:41 boss exposure 900.0, file=3D338028 >>> 03:20:42 apogee.expose=3DapRaw-40740019, 43, A, Object >>> 03:28:23 apogee.expose=3DapRaw-40740020, 43, B, Object >>> 03:36:11 apogee.expose=3DapRaw-40740021, 5, B, DomeFlat >>>=20 >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>>=20 >>> #3. observe 36183 for 2 hours, i.e. 8 times (36183, 36183, 36183, = 36183, >>> 36183, 36183, 36183, 36183) >>>=20 >>> 03:37:12 Config Loaded: 36183-3734 >>>=20 >>> 03:37:19 hal goto-field --guider-time 15 >>>=20 >>> HARTMANN: >>> 03:40:12 boss exposure 4.0, file=3D338029 >>> 03:40:53 boss exposure 4.0, file=3D338030 >>> 03:41:36 sp1.motor.move=3D 531, 532, 533 >>> 03:41:36 Hartmann collimate output >>> sp1: offset: r=3D 1319 (Out of focus); b=3D 0.8 (In Focus) >>> sp1: pred. move: spAverageMove=3D 531 >>> sp1: pred. resid: r=3D 788, b=3D 2.5, txt=3D OK, spTemp =3D 2.0 >>>=20 >>> BOSS cals: >>> 03:41:56 boss exposure 4.0, file=3D338031 >>> 03:44:54 boss exposure 25.0, file=3D338032 >>>=20 >>> FVC Loop: >>> 03:42:07 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS full fit = 45.440 >>> um." >>> 03:42:52 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS full fit = 14.140 >>> um." >>> 03:43:32 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS full fit = 11.850 >>> um." >>> 03:44:13 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS full fit = 9.210 >>> um." >>>=20 >>> 03:42:03 APO.apo_2.jaeger 2461 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0012.fits >>> 03:42:47 APO.apo_2.jaeger 2461 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0013.fits >>> 03:43:28 APO.apo_2.jaeger 2461 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0014.fits >>> 03:44:09 APO.apo_2.jaeger 2461 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0015.fits >>>=20 >>> 03:42:07 APO.apo_2.jaeger 2461 jaeger i fvc_perc_95=3D76.16 >>> 03:42:52 APO.apo_2.jaeger 2461 jaeger i fvc_perc_95=3D27.62 >>> 03:43:32 APO.apo_2.jaeger 2461 jaeger i fvc_perc_95=3D23.2 >>> 03:44:13 APO.apo_2.jaeger 2461 jaeger i fvc_perc_95=3D17.68 >>>=20 >>> 03:44:13 FVC Loop - RMS: 9.21 Delta RMS: 2.64 Image #: 0015 >>>=20 >>> 03:46Z Boson on obs2 has crashed. >>>=20 >>> DATA: >>> 03:49:03 boss exposure 900.0, file=3D338033 >>> 03:49:05 apogee.expose=3DapRaw-40740022, 43, A, Object >>> 03:56:45 apogee.expose=3DapRaw-40740023, 43, B, Object >>>=20 >>> 04:04:59 Config Loaded: 36183-3735 >>> 04:05:31 boss exposure 900.0, file=3D338034 >>> 04:05:31 apogee.expose=3DapRaw-40740024, 43, A, Object >>> 04:13:12 apogee.expose=3DapRaw-40740025, 43, B, Object >>>=20 >>> 04:20:48 Config Loaded: 36183-3736 >>> 04:23:49 boss exposure 900.0, file=3D338035 >>> 04:23:50 apogee.expose=3DapRaw-40740026, 43, A, Object >>> 04:31:31 apogee.expose=3DapRaw-40740027, 43, B, Object >>>=20 >>> 04:38:58 jaeger configuration load 36183 >>> This command has started a recalculation of the trajectories, but = this >>> is >>> the >>> same design and should be "cloned". >>>=20 >>> 04:39:55 Config Loaded: 36183-3737 >>> 04:40:24 boss exposure 900.0, file=3D338036 >>> 04:40:26 apogee.expose=3DapRaw-40740028, 43, A, Object >>> 04:48:06 apogee.expose=3DapRaw-40740029, 43, B, Object >>>=20 >>> 04:56:04 Config Loaded: 36183-3739 >>> 04:57:37 boss exposure 900.0, file=3D338037 >>> 04:57:39 apogee.expose=3DapRaw-40740030, 43, A, Object >>> 05:05:19 apogee.expose=3DapRaw-40740031, 43, B, Object >>>=20 >>> 05:12:50 Config Loaded: 36183-3740 >>> 05:14:13 boss exposure 900.0, file=3D338038 >>> 05:14:15 apogee.expose=3DapRaw-40740032, 43, A, Object >>> 05:21:56 apogee.expose=3DapRaw-40740033, 43, B, Object >>>=20 >>> 05:30Z Boson crashed on obs1 >>>=20 >>> 05:29:43 Config Loaded: 36183-3741 >>> 05:32:02 boss exposure 900.0, file=3D338039 >>> 05:32:04 apogee.expose=3DapRaw-40740034, 43, A, Object >>> 05:39:44 apogee.expose=3DapRaw-40740035, 43, B, Object >>>=20 >>> 05:37Z thick clouds on site. >>>=20 >>> 05:44Z Guider failed due to clouds. We had less than 2 minutes to = go >>> with >>> the exposure, so these last two exposures may be low S/N. >>>=20 >>> 05:47Z pausing observations until these clouds pass. >>>=20 >>> 05:48:12 Config Loaded: 36183-3742 >>> 06:15Z Too cloudy to complete Design 36183. >>> 06:15:55 apogee.expose=3DapRaw-40740036, 5, B, DomeFlat >>>=20 >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>> #4. observe 28911, 28912, 28913, 28914 >>>=20 >>> 06:20:43 Config Loaded: 28911-3743 >>>=20 >>> HARTMANN: >>> 06:23:28 boss exposure 4.0, file=3D338040 >>> 06:24:08 boss exposure 4.0, file=3D338041 >>> 06:24:50 sp1.motor.move=3D -763, -764, -766 >>> 06:24:51 Hartmann collimate output >>> sp1: offset: r=3D 659 (In Focus); b=3D 6.8 (Out of focus) >>> sp1: pred. move: spAverageMove=3D -763 >>> sp1: pred. resid: r=3D 1422, b=3D 4.5, txt=3D Move blue ring 8.9 = degrees., >>> spTemp =3D 2.1 >>>=20 >>> Moving blue ring by +3 degrees. >>>=20 >>> Doing Hartmanns again: >>>=20 >>> 06:32:50 boss exposure 4.0, file=3D338042 >>> 06:33:30 boss exposure 4.0, file=3D338043 >>> 06:34:12 sp1.motor.move=3D 852, 853, 855 >>> 06:34:12 Hartmann collimate output >>> sp1: offset: r=3D 1319 (Out of focus); b=3D -1.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D 852 >>> sp1: pred. resid: r=3D 467, b=3D 1.5, txt=3D OK, spTemp =3D 2.1 >>>=20 >>> Ok, in spec. Moving on with the hal go-to field command. >>>=20 >>> FVC Loop: >>> 06:34:43 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS full fit = 47.240 >>> um." >>> 06:35:27 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS full fit = 15.970 >>> um." >>> 06:36:09 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS full fit = 10.190 >>> um." >>> 06:36:50 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS full fit = 10.220 >>> um." >>>=20 >>> 06:34:39 APO.apo_2.jaeger 2556 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0016.fits >>> 06:35:23 APO.apo_2.jaeger 2556 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0017.fits >>> 06:36:04 APO.apo_2.jaeger 2556 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0018.fits >>> 06:36:45 APO.apo_2.jaeger 2556 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0019.fits >>>=20 >>> 06:34:43 APO.apo_2.jaeger 2556 jaeger i fvc_perc_95=3D82.34 >>> 06:35:27 APO.apo_2.jaeger 2556 jaeger i fvc_perc_95=3D28.58 >>> 06:36:09 APO.apo_2.jaeger 2556 jaeger i fvc_perc_95=3D21.57 >>> 06:36:50 APO.apo_2.jaeger 2556 jaeger i fvc_perc_95=3D18.94 >>>=20 >>> 06:36:50 FVC Loop - RMS: 10.22 Delta RMS: -0.03 Image #: 0019 >>>=20 >>> BOSS cals: >>> 06:34:46 boss exposure 4.0, file=3D338044 >>> 06:37:32 boss exposure 25.0, file=3D338045 >>>=20 >>> 06:39Z Still very cloudy and guider does not see many stars. = Guider >>> exptime >>> is 45s. We will pause for the clouds to pass through. >>>=20 >>> 06:47Z Small break in the clouds, but still rather cloudy. We'll = try >>> to >>> get some data. Seeing is about 2" >>>=20 >>> DATA: >>> 06:47:33 boss exposure 900.0, file=3D338046 >>> 06:47:34 apogee.expose=3DapRaw-40740037, 43, A, Object >>> 06:55:15 apogee.expose=3DapRaw-40740038, 43, B, Object >>>=20 >>> At the end of these exposures, the clouds return and the guider = stopped. >>> We will wait for another break in the clouds. >>>=20 >>> 07:04:02 Config Loaded: 28912-3744 >>>=20 >>> 08:10Z Some clearing in the sky. >>>=20 >>> 08:10Z Boson on obs2 has crashed. >>>=20 >>> Restarting data collection: >>>=20 >>> 08:13:32 boss exposure 900.0, file=3D338047 >>> 08:13:32 apogee.expose=3DapRaw-40740039, 43, A, Object >>> 08:21:13 apogee.expose=3DapRaw-40740040, 43, B, Object >>>=20 >>> 08:32:55 Config Loaded: 28913-3745 >>> 08:33:24 boss exposure 900.0, file=3D338048 >>> 08:33:26 apogee.expose=3DapRaw-40740041, 43, A, Object >>> 08:41:07 apogee.expose=3DapRaw-40740042, 43, B, Object >>>=20 >>> 08:48:35 Config Loaded: 28914-3746 >>> 08:50:46 boss exposure 900.0, file=3D338049 >>> 08:50:47 apogee.expose=3DapRaw-40740043, 43, A, Object >>> 08:58:28 apogee.expose=3DapRaw-40740044, 43, B, Object >>>=20 >>> Bonus exposure since the first one in this set was clouded out. >>> 09:06:34 Config Loaded: 28911-3747 >>> 09:07:18 apogee.expose=3DapRaw-40740045, 43, A, Object >>> 09:07:18 boss exposure 900.0, file=3D338050 >>> 09:14:58 apogee.expose=3DapRaw-40740046, 43, B, Object >>> 09:22:52 apogee.expose=3DapRaw-40740047, 5, B, DomeFlat >>>=20 >>> jaeger configuration reverse did not work this time. Issuing = unwind. >>>=20 >>> 09:24:10 jaeger unwind >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>> #6. observe 34479, 34480, 34481,34482 if in observability window, >>> otherwise do after >>>=20 >>> 09:23:35 Config Loaded: 34479-3748 >>>=20 >>> HARTMANN: >>> 09:27:05 boss exposure 4.0, file=3D338051 >>> 09:27:46 boss exposure 4.0, file=3D338052 >>> 09:28:28 sp1.motor.move=3D -132, -133, -132 >>> 09:28:28 Hartmann collimate output >>> sp1: offset: r=3D -329 (In Focus); b=3D -0.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D -132 >>> sp1: pred. resid: r=3D -196, b=3D -0.6, txt=3D OK, spTemp =3D 1.6 >>>=20 >>> BOSS cals: >>> 09:28:48 boss exposure 4.0, file=3D338053 >>> 09:32:28 boss exposure 25.0, file=3D338054 >>>=20 >>> FVC Loop: >>> 09:28:59 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit = 48.510 >>> um." >>> 09:29:43 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit = 21.660 >>> um." >>> 09:30:24 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit = 19.350 >>> um." >>> 09:31:05 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit = 16.390 >>> um." >>> 09:31:46 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit = 15.910 >>> um." >>>=20 >>> 09:28:54 APO.apo_2.jaeger 2632 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0020.fits >>> 09:29:39 APO.apo_2.jaeger 2632 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0021.fits >>> 09:30:20 APO.apo_2.jaeger 2632 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0022.fits >>> 09:31:01 APO.apo_2.jaeger 2632 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0023.fits >>> 09:31:42 APO.apo_2.jaeger 2632 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0024.fits >>>=20 >>> 09:28:59 APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D86.53 >>> 09:29:43 APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D28.94 >>> 09:30:24 APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D28.84 >>> 09:31:05 APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D21.18 >>> 09:31:46 APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D20.09 >>>=20 >>> 09:31:46 FVC Loop - RMS: 15.91 Delta RMS: 0.48 Image #: 0024 >>>=20 >>> DATA: >>> 09:35:49 boss exposure 900.0, file=3D338055 >>> 09:35:51 apogee.expose=3DapRaw-40740048, 43, A, Object >>> 09:43:31 apogee.expose=3DapRaw-40740049, 43, B, Object >>>=20 >>> 09:51:00 Config Loaded: 34480-3749 >>> 09:55:03 boss exposure 900.0, file=3D338056 >>> 09:55:05 apogee.expose=3DapRaw-40740050, 43, A, Object >>> 10:02:45 apogee.expose=3DapRaw-40740051, 43, B, Object >>>=20 >>> 10:10:12 Config Loaded: 34481-3750 >>> 10:11:32 boss exposure 900.0, file=3D338057 >>> 10:11:34 apogee.expose=3DapRaw-40740052, 43, A, Object >>> 10:19:15 apogee.expose=3DapRaw-40740053, 43, B, Object >>>=20 >>> 10:27:19 Config Loaded: 34482-3751 >>> 10:28:05 boss exposure 900.0, file=3D338058 >>> 10:28:07 apogee.expose=3DapRaw-40740054, 43, A, Object >>> 10:35:48 apogee.expose=3DapRaw-40740055, 43, B, Object >>>=20 >>> 10:43:35 apogee.expose=3DapRaw-40740056, 5, B, DomeFlat >>>=20 >>> 10:44:51 jaeger unwind >>> because jaeger configuration reverse failed. >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>> #7. refresh the Kronos queue and observe the rest of the night from = the >>> queue >>> (ran out of time to do commissioning task #6.) >>>=20 >>> 10:45Z Refreshed Kronos and loaded into hal the next available = design: >>>=20 >>> 10:44:21 Config Loaded: 14688-3752 (Field 19484) >>>=20 >>> 10:46:25 hal goto-field --guider-time 15 >>>=20 >>> HARTMANN: >>> 0:47:29 boss exposure 4.0, file=3D338059 >>> 10:48:11 boss exposure 4.0, file=3D338060 >>> 10:48:52 sp1.motor.move=3D 30, 30, 28 >>> 10:48:52 Hartmann collimate output >>> sp1: offset: r=3D -329 (In Focus); b=3D -1.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D 28 >>> sp1: pred. resid: r=3D -357, b=3D -1.1, txt=3D OK, spTemp =3D 1.7 >>>=20 >>> FVC Loop: >>> Encountered a collision during the fvc loop: >>> 10:50:12 Jaeger collision: 238 >>>=20 >>> 10:50:12 .jaeger 0 jaeger w text=3D"Positioner 322 replied to >>> START_TRAJECTORY UID=3D4307 with 'INVALID_TRAJECTORY'. >>> (JaegerUserWarning)" >>> 10:50:12 APO.apo_2.jaeger 2701 jaeger d >>> = trajectory_dump_file=3D/data/logs/jaeger/trajectories/59636/trajectory-596= 36-0034.json >>> 10:50:12 APO.apo_2.jaeger 2701 jaeger f error=3D"Failed processing = image: >>> Failed executing the correction trajectory: Something went wrong = during >>> the >>> trajectory: START_TRAJECTORY failed" >>> 10:50:12 CmdDone: APO.apo_2.jaeger 2701 jaeger fvc loop >>>=20 >>> 10:50:12 .jaeger 0 jaeger f text=3D"A collision was detected in = positioner >>> 238. Sending SEND_TRAJECTORY_ABORT and locking the FPS." >>> 10:50:12 .jaeger 0 jaeger w text=3D"Locking the FPS. = (JaegerUserWarning)" >>>=20 >>> See snapshot: fps_snapshot_59636_0034.pdf >>>=20 >>> Issued a jaeger configuration reverse, and that seemed to work. >>> 10:52:29 Config Loaded: 14688-3753 (clone of config id 3752) >>> 10:53:31 Config Loaded: 14688-3754 (trying to get a new trajectory = to >>> avoid >>> collision) >>>=20 >>> 10:49:23 APO.apo_2.jaeger 2701 jaeger i text=3D"[FVC]: RMS full fit = 48.610 >>> um." >>> 10:50:08 APO.apo_2.jaeger 2701 jaeger i text=3D"[FVC]: RMS full fit = 14.260 >>> um." >>> 10:55:23 APO.apo_2.jaeger 2711 jaeger i text=3D"[FVC]: RMS full fit = 49.250 >>> um." >>> 10:56:14 APO.apo_2.jaeger 2711 jaeger i text=3D"[FVC]: RMS full fit = 15.290 >>> um." >>> 10:56:56 APO.apo_2.jaeger 2711 jaeger i text=3D"[FVC]: RMS full fit = 9.920 >>> um." >>>=20 >>> 10:49:19 APO.apo_2.jaeger 2701 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0025.fits >>> 10:50:03 APO.apo_2.jaeger 2701 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0026.fits >>> 10:55:19 APO.apo_2.jaeger 2711 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0027.fits >>> 10:56:10 APO.apo_2.jaeger 2711 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0028.fits >>> 10:56:52 APO.apo_2.jaeger 2711 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0029.fits >>>=20 >>> 10:49:23 APO.apo_2.jaeger 2701 jaeger i fvc_perc_95=3D89.43 >>> 10:50:08 APO.apo_2.jaeger 2701 jaeger i fvc_perc_95=3D26.78 >>> 10:55:23 APO.apo_2.jaeger 2711 jaeger i fvc_perc_95=3D89.53 >>> 10:56:14 APO.apo_2.jaeger 2711 jaeger i fvc_perc_95=3D30.11 >>> 10:56:56 APO.apo_2.jaeger 2711 jaeger i fvc_perc_95=3D18.19 >>>=20 >>> 10:56:56 FVC Loop - RMS: 9.92 Delta RMS: 5.37 Image #: 0029 >>>=20 >>> BOSS cals: >>> 10:49:12 boss exposure 4.0, file=3D338061 >>> 10:57:33 boss exposure 25.0, file=3D338062 >>>=20 >>> DATA: >>> 11:01:34 boss exposure 900.0, file=3D338063 >>> 11:01:34 apogee.expose=3DapRaw-40740057, 43, A, Object >>> 11:09:15 apogee.expose=3DapRaw-40740058, 43, B, Object >>>=20 >>> 11:18:06 apogee.expose=3DapRaw-40740059, 5, B, DomeFlat >>>=20 >>>=20 >>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>> Next design from Kronos: >>> 11:18:49 Config Loaded: 10857-3755 >>>=20 >>> HARTMANN: >>> 11:20:53 boss exposure 4.0, file=3D338064 >>> 11:21:34 boss exposure 4.0, file=3D338065 >>> 11:22:16 sp1.motor.move=3D 689, 693, 692 >>> 11:22:16 Hartmann collimate output >>> sp1: offset: r=3D 1319 (Out of focus); b=3D -0.2 (In Focus) >>> sp1: pred. move: spAverageMove=3D 691 >>> sp1: pred. resid: r=3D 627, b=3D 2.0, txt=3D OK, spTemp =3D 1.4 >>>=20 >>> FVC Loop: >>> 11:22:46 APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS full fit = 46.380 >>> um." >>> 11:23:30 APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS full fit = 14.290 >>> um." >>> 11:24:11 APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS full fit = 11.490 >>> um." >>> 11:24:52 APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS full fit = 9.800 >>> um." >>>=20 >>> 11:22:42 APO.apo_2.jaeger 2747 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0030.fits >>> 11:23:26 APO.apo_2.jaeger 2747 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0031.fits >>> 11:24:07 APO.apo_2.jaeger 2747 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0032.fits >>> 11:24:48 APO.apo_2.jaeger 2747 jaeger d >>> fvc_filename=3D/data/fcam/59636/fimg-fvc1n-0033.fits >>>=20 >>> 11:22:46 APO.apo_2.jaeger 2747 jaeger i fvc_perc_95=3D82.79 >>> 11:23:31 APO.apo_2.jaeger 2747 jaeger i fvc_perc_95=3D27.38 >>> 11:24:11 APO.apo_2.jaeger 2747 jaeger i fvc_perc_95=3D21.97 >>> 11:24:52 APO.apo_2.jaeger 2747 jaeger i fvc_perc_95=3D20.58 >>>=20 >>> 11:24:52 FVC Loop - RMS: 9.80 Delta RMS: 1.69 Image #: 0033 >>>=20 >>> BOSS cals: >>> 11:22:35 boss exposure 4.0, file=3D338066 >>> 11:25:33 boss exposure 25.0, file=3D338067 >>>=20 >>> DATA: >>> 11:29:33 apogee.expose=3DapRaw-40740060, 43, A, Object >>> 11:29:34 boss exposure 900.0, file=3D338068 >>> 11:37:14 apogee.expose=3DapRaw-40740061, 43, B, Object >>>=20 >>> 11:44:53 Config Loaded: 10858-3756 >>> 11:46:08 boss exposure 900.0, file=3D338069 >>> 11:46:10 apogee.expose=3DapRaw-40740062, 43, A, Object >>> 11:53:51 apogee.expose=3DapRaw-40740063, 43, B, Object >>> 12:01:40 apogee.expose=3DapRaw-40740064, 5, B, DomeFlat >>>=20 >>> Kronos shows the B1 S/N is too low. Going to stay on this design and >>> take >>> more data. However, we have already loaded the next design: >>> 12:01:33 Config Loaded: 9196-3757 >>>=20 >>> 12:05:02 boss exposure 900.0, file=3D338070 >> 12:05:03 apogee.expose=3DapRaw-40740065, 43, A, Object >>=20 >>> We've aborted these exposures because the headers are being = populated >>> with >>> the >>> design information of a design we don't want to start. >>>=20 >>> Reloaded the previous design: >>> 12:05:58 Config Loaded: 10858-3758 >>>=20 >>> Now taking data again in this design to get more S/N for b1. >>>=20 >>> 12:06:54 apogee.expose=3DapRaw-40740066, 43, A, Object >>> 12:07:00 boss exposure 900.0, file=3D338070 >>> 12:14:35 apogee.expose=3DapRaw-40740067, 43, B, Object >>>=20 >>> 12:11Z Boson is slowing down on obs2 again. Will restart to avoid a >>> crash. >>> See problems in details for additional error message that popped up. >>>=20 >>>=20 >>>=20 >>>=20 >>> 12:23Z Unwind and powered down FPS >>>=20 >>> 12:28:47 encl25m : closed; >>>=20 >>> 12:34Z Started morning cals. >>> 12:45Z Received a critical alert on BOSS. boss ping shows sp1cam = is >>> dead. >>> Tried to reload controllers, and boss ping shows everything is ok. >>> Since >>> we are running morning boss cals, the biases keep going. another = boss >>> ping >>> shows that sp1daq is dead. Tried to reload controllers and is ok. = But >>> sp1cam now shows it is dead. >>>=20 >>> boss exposure stop does not stop the morning cal script from the = control >>> room. >>>=20 >>> The alerts window does not show any critical alerts, so it must have >>> cleared >>> itself? >>>=20 >>> morning boss biases appear to be still going and the bias levels in = the >>> images >>> are around 2100 counts. They look normal. >>>=20 >>> Not entirely sure if we are having a netburner issue or just a >>> communications >>> hiccup?? >>>=20 >>> Data appears to be written to disk. >>>=20 >>> 13:18:03 CmdStarted: OBSERVER.karen 18 boss ping >>> 13:18:03 OBSERVER.karen 18 boss i text=3D"sp1daq: OK" >>> 13:18:04 OBSERVER.karen 18 boss i text=3D"sp1cam: OK" >>> 13:18:04 OBSERVER.karen 18 boss i text=3D"Response parsed." >>> 13:18:04 OBSERVER.karen 18 boss i text=3D"sp1mech: OK" >>> 13:18:04 OBSERVER.karen 18 boss : >>>=20 >>> Everything looks like it is connected and communicating. >>>=20 >>> Maybe a communications hiccup? Can someone please look into this? = This >>> problem >>> may be increasing in frequency? >>>=20 >>> ---- Mirror Numbers ---- >>>=20 >>>=20 >>> PRIMARY: >>> -------- >>> Scale: 1.000000 >>>=20 >>> MIGS TONIGHT NOMINAL >>> Axial A: 0.0020 0.0040 >>> Axial B: -0.0010 0.0030 >>> Axial C: -0.1110 -0.1150 >>> Trans D: -0.0342 -0.0338 >>> Lateral E: 0.3315 0.3315 >>> Lateral F: 0.5350 0.5350 >>>=20 >>> GALILS >>> Commanded: 12500 -1600 5300 47050 -8800 -8400 >>> Actual: 12500 -1600 5300 47050 -8800 -8400 >>>=20 >>> SETMIR VALUES >>> PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 >>> PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 >>>=20 >>> SECONDARY: >>> ---------- >>>=20 >>> Focus: 0.0000 >>> Air temp: 4.50 >>> Altitude: 30.0 >>>=20 >>> MIGS TONIGHT NOMINAL >>> Axial A: -9.6550 -9.6570 >>> Axial B: -9.6680 -9.6710 >>> Axial C: -9.6950 -9.6970 >>> Trans D: 0.1120 0.1140 >>>=20 >>> GALILS >>> Commanded: 4893800 4893300 4914250 -50 -3450 >>> Actual: 4859199 4859280 4859230 -50 -3450 >>>=20 >>> SETMIR VALUES >>> SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 >>> SecOrient: 3857.01 0.01 0.02 0.01 42.86 >>>=20 >>>=20 >>>=20 >>> ---- Telescope Status ---- >>>=20 >>> 23:22Z Started ventilation >>> 00:59Z encl25m : open >>> 12:28Z encl25m : closed >>>=20 >>> No interlocks bypassed >>>=20 >>> Status at:12:35Z >>> Telescope stowed at: 121.0, 30.0, 0.0 mount >>> Instrument mounted: fps >>> Counterweights at: 685 687 704 704 >>> LN2 autofill systems: Connected and turned on >>> 180L LN2 dewar scales: SP1 221 lbs, 22.7 psi >>>=20 >>>=20 >>>=20 >>>=20 >>> ---- Software Used ---- >>>=20 >>> Get Versions, 02/25/22, 22:12:37 >>> -- STUI software: >>> STUI : 1.7.17b1 >>> alerts : 2.2.0 >>> boss : 6.0.1 >>> -boss.specMec : 3.0.4 >>> guider : FAILED >>> ecamera : FAILED >>> apo : 3.0.1 >>> fliswarm : 0.2.1-alpha.0 >>> jaeger : 0.14.1-alpha.0 >>> kaiju : 1.2.2-alpha.1 >>> coordio : 1.2.2-alpha.1 >>> fps_calibrati : APO.2021.12.25+960cb05 >>> cherno : 0.1.1-alpha.0 >>> hal : 0.1.1-alpha.0 >>> hartmann : 2.0.2 >>> hub : 5.0.1a0 >>> mcp : 2.1 >>> -mcp.plc : 34 >>> -mcp.azFiduci : v1_148 >>> -mcp.altFiduc : v1_148 >>> -mcp.rotFiduc : v1_148 >>> tcc : 1.4.0 >>> apogee : not availble >>> apogeecal : not availble >>> apogeeql : FAILED >>> STUIAdditions : 3.1.12 >>> -- done -- >>>=20 >>>=20 >>>=20 >>> ---- APOGEE Data Summary ---- >>>=20 >>> APOGEE data list, mjd=3D59636, all >>> raw_data: /data/apogee/utr_cdr/59636/apRaw-*.fits >>> archive: /data/apogee/archive/59636/apR-[a,b,c]-*.apz >>> quickred: /data/apogee/quickred/59636/apq-*.fits >>> = --------------------------------------------------------------------------= ---- >>>=20 >>> mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch = Offset >>> %Flux Comm >>>=20 >>> = --------------------------------------------------------------------------= ---- >>> 59636 1 22:25 40740001 Dark 60 A 13.0 ---------- a-b-c = - >>> - >>> 59636 2 22:27 40740002 QuarFlat 10 A 13.0 ---------- a-b-c = - >>> 98 >>> 59636 3 22:29 40740003 Arc-Thar 12 B 13.5 ---------- a-b-c = 1.54 >>> - >>> 59636 4 22:36 40740004 Arc-Une 40 B 13.5 ---------- a-b-c = - >>> - >>> 59636 5 22:39 40740005 Arc-Thar 12 A 13.0 ---------- a-b-c = 0.96 >>> - >>> 59636 6 22:46 40740006 Arc-Une 40 A 13.0 ---------- a-b-c = - >>> - >>> 59636 7 22:57 40740007 Dark 60 A 13.0 ---------- a-b-c = - >>> - >>> 59636 8 23:02 40740008 Arc---- 30 A 13.0 ---------- a-b-c = - >>> - FPI >>> 59636 9 02:01 40740009 Object 43 A 13.0 16716-3729 a-b-c = 0.93 >>> - >>> 59636 10 02:08 40740010 Object 43 B 13.5 16716-3729 a-b-c = 1.43 >>> - >>> 59636 11 02:17 40740011 Object 43 A 13.0 16716-3730 a-b-c = 0.93 >>> - >>> 59636 12 02:25 40740012 Object 43 B 13.5 16716-3730 a-b-c = 1.42 >>> - >>> 59636 13 02:34 40740013 Object 43 A 13.0 16716-3731 a-b-c = 0.94 >>> - >>> 59636 14 02:42 40740014 Object 43 B 13.5 16716-3731 a-b-c = 1.43 >>> - >>> 59636 15 02:48 40740015 Object 28 A 13.0 16716-3732 a-b-c = 0.99 >>> - >>> 59636 16 02:58 40740016 Object 43 A 13.0 16716-3732 a-b-c = 0.94 >>> - >>> 59636 17 03:06 40740017 Object 43 B 13.5 16716-3732 a-b-c = 1.43 >>> - >>> 59636 18 03:07 40740018 DomeFlat 5 B 13.5 16716-3732 a-b-c = - >>> 142 >>> 59636 19 03:27 40740019 Object 43 A 13.0 4791-3733 a-b-c = 0.93 >>> - >>>=20 >>> 59636 20 03:35 40740020 Object 43 B 13.5 4791-3733 a-b-c = 1.43 >>> - >>>=20 >>> 59636 21 03:36 40740021 DomeFlat 5 B 13.5 4791-3733 a-b-c = - >>> 145 >>> 59636 22 03:56 40740022 Object 43 A 13.0 36183-3734 a-b-c = 0.93 >>> - >>> 59636 23 04:03 40740023 Object 43 B 13.5 36183-3734 a-b-c = 1.43 >>> - >>> 59636 24 04:12 40740024 Object 43 A 13.0 36183-3735 a-b-c = 0.93 >>> - >>> 59636 25 04:20 40740025 Object 43 B 13.5 36183-3735 a-b-c = 1.43 >>> - >>> 59636 26 04:31 40740026 Object 43 A 13.0 36183-3736 a-b-c = 0.93 >>> - >>> 59636 27 04:38 40740027 Object 43 B 13.5 36183-3736 a-b-c = 1.43 >>> - >>> 59636 28 04:47 40740028 Object 43 A 13.0 36183-3737 a-b-c = 0.94 >>> - >>> 59636 29 04:55 40740029 Object 43 B 13.5 36183-3737 a-b-c = 1.43 >>> - >>> 59636 30 05:04 40740030 Object 43 A 13.0 36183-3739 a-b-c = 0.94 >>> - >>> 59636 31 05:12 40740031 Object 43 B 13.5 36183-3739 a-b-c = 1.42 >>> - >>> 59636 32 05:21 40740032 Object 43 A 13.0 36183-3740 a-b-c = 0.93 >>> - >>> 59636 33 05:29 40740033 Object 43 B 13.5 36183-3740 a-b-c = 1.43 >>> - >>> 59636 34 05:39 40740034 Object 43 A 13.0 36183-3741 a-b-c = 0.93 >>> - >>> 59636 35 05:46 40740035 Object 43 B 13.5 36183-3741 a-b-c = 1.44 >>> - >>> 59636 36 06:16 40740036 DomeFlat 5 B 13.5 36183-3742 a-b-c = - >>> 144 >>> 59636 37 06:54 40740037 Object 43 A 13.0 28911-3743 a-b-c = 0.94 >>> - >>> 59636 38 07:02 40740038 Object 43 B 13.5 28911-3743 a-b-c = 1.43 >>> - >>> 59636 39 08:20 40740039 Object 43 A 13.0 28912-3744 a-b-c = 0.94 >>> - >>> 59636 40 08:28 40740040 Object 43 B 13.5 28912-3744 a-b-c = 1.43 >>> - >>> 59636 41 08:40 40740041 Object 43 A 13.0 28913-3745 a-b-c = 0.94 >>> - >>> 59636 42 08:48 40740042 Object 43 B 13.5 28913-3745 a-b-c = 1.43 >>> - >>> 59636 43 08:58 40740043 Object 43 A 13.0 28914-3746 a-b-c = 0.94 >>> - >>> 59636 44 09:05 40740044 Object 43 B 13.5 28914-3746 a-b-c = 1.43 >>> - >>> 59636 45 09:14 40740045 Object 43 A 13.0 28911-3747 a-b-c = 0.94 >>> - >>> 59636 46 09:22 40740046 Object 43 B 13.5 28911-3747 a-b-c = 1.43 >>> - >>> 59636 47 09:23 40740047 DomeFlat 5 B 13.5 34479-3748 a-b-c = - >>> 150 >>> 59636 48 09:43 40740048 Object 43 A 13.0 34479-3748 a-b-c = 0.94 >>> - >>> 59636 49 09:50 40740049 Object 43 B 13.5 34479-3748 a-b-c = 1.43 >>> - >>> 59636 50 10:02 40740050 Object 43 A 13.0 34480-3749 a-b-c = 0.94 >>> - >>> 59636 51 10:09 40740051 Object 43 B 13.5 34480-3749 a-b-c = 1.43 >>> - >>> 59636 52 10:18 40740052 Object 43 A 13.0 34481-3750 a-b-c = 0.94 >>> - >>> 59636 53 10:26 40740053 Object 43 B 13.5 34481-3750 a-b-c = 1.43 >>> - >>> 59636 54 10:35 40740054 Object 43 A 13.0 34482-3751 a-b-c = 0.93 >>> - >>> 59636 55 10:43 40740055 Object 43 B 13.5 34482-3751 a-b-c = 1.42 >>> - >>> 59636 56 10:44 40740056 DomeFlat 5 B 13.5 34482-3751 a-b-c = - >>> 146 >>> 59636 57 11:08 40740057 Object 43 A 13.0 14688-3754 a-b-c = 0.93 >>> - >>> 59636 58 11:16 40740058 Object 43 B 13.5 14688-3754 a-b-c = 1.42 >>> - >>> 59636 59 11:18 40740059 DomeFlat 5 B 13.5 14688-3754 a-b-c = - >>> 147 >>> 59636 60 11:36 40740060 Object 43 A 13.0 10857-3755 a-b-c = 0.93 >>> - >>> 59636 61 11:44 40740061 Object 43 B 13.5 10857-3755 a-b-c = 1.43 >>> - >>> 59636 62 11:53 40740062 Object 43 A 13.0 10858-3756 a-b-c = 0.94 >>> - >>> 59636 63 12:01 40740063 Object 43 B 13.5 10858-3756 a-b-c = 1.42 >>> - >>> 59636 64 12:02 40740064 DomeFlat 5 B 13.5 9196-3757 a-b-c = - >>> 148 >>> 59636 65 12:06 40740065 Object 10 A 13.0 10858-3758 a-b-c = 0.94 >>> - >>> 59636 66 12:14 40740066 Object 43 A 13.0 10858-3758 a-b-c = 0.94 >>> - >>> 59636 67 12:21 40740067 Object 43 B 13.5 10858-3758 a-b-c = 1.43 >>> - >>> cannot read file : /data/apogee/utr_cdr/59636/apRaw-40740068.fits >>> = --------------------------------------------------------------------------= ---- >>>=20 >>>=20 >>>=20 >>>=20 >>> ---- eBOSS Data Summary ---- >>>=20 >>> Reading FITS from /data/spectro//59636 >>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - = - - >>> - >>> - - >>> n Time Filename design-field cfg flav shu Exp colA = colB >>> colC Hrt >>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - = - - >>> - >>> - - >>> 1 22:14 b1-00338009 ----------- ---- bia Clo 0.0 -6689 -6539 >>> -7920 >>> 2 22:14 r1-00338009 ----------- ---- bia Clo 0.0 -6689 -6539 >>> -7920 >>> 3 22:16 b1-00338010 ----------- ---- dar Clo 20.0 -6689 -6539 >>> -7920 >>> 4 22:16 r1-00338010 ----------- ---- dar Clo 20.0 -6689 -6539 >>> -7920 >>> 5 22:17 r1-00338011 34479-16169 3726 arc Lef 4.1 -6689 -6539 >>> -7920 >>> HART >>> 6 22:17 b1-00338011 34479-16169 3726 arc Lef 4.1 -6689 -6539 >>> -7920 >>> HART >>> 7 22:18 r1-00338012 34479-16169 3726 arc Rig 4.1 -6689 -6539 >>> -7920 >>> HART >>> 8 22:18 b1-00338012 34479-16169 3726 arc Rig 4.1 -6689 -6539 >>> -7920 >>> HART >>> 9 22:19 b1-00338013 34479-16169 3726 arc Out 4.1 -5194 -5043 >>> -6425 >>> 10 22:19 r1-00338013 34479-16169 3726 arc Out 4.1 -5194 -5043 >>> -6425 >>> 11 22:25 b1-00338014 34479-16169 3726 fla Out 30.1 -5194 -5043 >>> -6425 >>> 12 22:25 r1-00338014 34479-16169 3726 fla Out 30.1 -5194 -5043 >>> -6425 >>> 13 01:29 b1-00338015 16716-19942 3729 arc Lef 4.1 -5194 -5043 >>> -6425 >>> HART >>> 14 01:29 r1-00338015 16716-19942 3729 arc Lef 4.1 -5194 -5043 >>> -6425 >>> HART >>> 15 01:30 b1-00338016 16716-19942 3729 arc Rig 4.1 -5194 -5043 >>> -6425 >>> HART >>> 16 01:30 r1-00338016 16716-19942 3729 arc Rig 4.1 -5194 -5043 >>> -6425 >>> HART >>> 17 01:31 r1-00338017 16716-19942 3729 arc Out 4.1 -2727 -2577 >>> -3958 >>> 18 01:31 b1-00338017 16716-19942 3729 arc Out 4.1 -2727 -2577 >>> -3958 >>> 19 01:34 b1-00338018 16716-19942 3729 fla Out 25.1 -2727 -2577 >>> -3958 >>> 20 01:34 r1-00338018 16716-19942 3729 fla Out 25.1 -2727 -2577 >>> -3958 >>> 21 01:53 b1-00338019 16716-19942 3729 sci Out 900.1 -2727 -2577 >>> -3958 >>> 22 01:53 r1-00338019 16716-19942 3729 sci Out 900.1 -2727 -2577 >>> -3958 >>> 23 02:10 b1-00338020 16716-19942 3730 sci Out 900.1 -2727 -2577 >>> -3958 >>> 24 02:10 r1-00338020 16716-19942 3730 sci Out 900.1 -2727 -2577 >>> -3958 >>> 25 02:27 r1-00338021 16716-19942 3731 sci Out 900.0 -2727 -2577 >>> -3958 >>> 26 02:27 b1-00338021 16716-19942 3731 sci Out 900.0 -2727 -2577 >>> -3958 >>> 27 02:51 r1-00338023 16716-19942 3732 sci Out 900.1 -2727 -2577 >>> -3958 >>> 28 02:51 b1-00338023 16716-19942 3732 sci Out 900.1 -2727 -2577 >>> -3958 >>> 29 03:12 r1-00338024 4791-17049 3733 arc Lef 4.1 -2727 -2577 = -3958 >>> HART >>> 30 03:12 b1-00338024 4791-17049 3733 arc Lef 4.1 -2727 -2577 = -3958 >>> HART >>> 31 03:13 r1-00338025 4791-17049 3733 arc Rig 4.1 -2727 -2577 = -3958 >>> HART >>> 32 03:13 b1-00338025 4791-17049 3733 arc Rig 4.1 -2727 -2577 = -3958 >>> HART >>> 33 03:14 r1-00338026 4791-17049 3733 arc Out 4.1 -4643 -4494 = -5876 >>> 34 03:14 b1-00338026 4791-17049 3733 arc Out 4.1 -4643 -4494 = -5876 >>> 35 03:17 b1-00338027 4791-17049 3733 fla Out 25.1 -4643 -4494 = -5876 >>> 36 03:17 r1-00338027 4791-17049 3733 fla Out 25.1 -4643 -4494 = -5876 >>> 37 03:20 b1-00338028 4791-17049 3733 sci Out 900.1 -4643 -4494 = -5876 >>> 38 03:20 r1-00338028 4791-17049 3733 sci Out 900.1 -4643 -4494 = -5876 >>> 39 03:40 r1-00338029 36183-21152 3734 arc Lef 4.1 -4643 -4494 >>> -5876 >>> HART >>> 40 03:40 b1-00338029 36183-21152 3734 arc Lef 4.1 -4643 -4494 >>> -5876 >>> HART >>> 41 03:40 r1-00338030 36183-21152 3734 arc Rig 4.1 -4643 -4494 >>> -5876 >>> HART >>> 42 03:40 b1-00338030 36183-21152 3734 arc Rig 4.1 -4643 -4494 >>> -5876 >>> HART >>> 43 03:41 b1-00338031 36183-21152 3734 arc Out 4.1 -4112 -3962 >>> -5343 >>> 44 03:41 r1-00338031 36183-21152 3734 arc Out 4.1 -4112 -3962 >>> -5343 >>> 45 03:44 r1-00338032 36183-21152 3734 fla Out 25.1 -4112 -3962 >>> -5343 >>> 46 03:44 b1-00338032 36183-21152 3734 fla Out 25.1 -4112 -3962 >>> -5343 >>> 47 03:49 r1-00338033 36183-21152 3734 sci Out 900.1 -4112 -3962 >>> -5343 >>> 48 03:49 b1-00338033 36183-21152 3734 sci Out 900.1 -4112 -3962 >>> -5343 >>> 49 04:05 r1-00338034 36183-21152 3735 sci Out 900.1 -4112 -3962 >>> -5343 >>> 50 04:05 b1-00338034 36183-21152 3735 sci Out 900.1 -4112 -3962 >>> -5343 >>> 51 04:23 b1-00338035 36183-21152 3736 sci Out 900.1 -4112 -3962 >>> -5343 >>> 52 04:23 r1-00338035 36183-21152 3736 sci Out 900.1 -4112 -3962 >>> -5343 >>> 53 04:40 r1-00338036 36183-21152 3737 sci Out 900.1 -4112 -3962 >>> -5343 >>> 54 04:40 b1-00338036 36183-21152 3737 sci Out 900.1 -4112 -3962 >>> -5343 >>> 55 04:57 r1-00338037 36183-21152 3739 sci Out 900.1 -4112 -3962 >>> -5343 >>> 56 04:57 b1-00338037 36183-21152 3739 sci Out 900.1 -4112 -3962 >>> -5343 >>> 57 05:14 r1-00338038 36183-21152 3740 sci Out 900.1 -4112 -3962 >>> -5343 >>> 58 05:14 b1-00338038 36183-21152 3740 sci Out 900.1 -4112 -3962 >>> -5343 >>> 59 05:32 b1-00338039 36183-21152 3741 sci Out 900.1 -4112 -3962 >>> -5343 >>> 60 05:32 r1-00338039 36183-21152 3741 sci Out 900.1 -4112 -3962 >>> -5343 >>> 61 06:23 r1-00338040 28911-16165 3743 arc Lef 4.1 -4112 -3962 >>> -5343 >>> HART >>> 62 06:23 b1-00338040 28911-16165 3743 arc Lef 4.1 -4112 -3962 >>> -5343 >>> HART >>> 63 06:24 b1-00338041 28911-16165 3743 arc Rig 4.1 -4112 -3962 >>> -5343 >>> HART >>> 64 06:24 r1-00338041 28911-16165 3743 arc Rig 4.1 -4112 -3962 >>> -5343 >>> HART >>> 65 06:32 r1-00338042 28911-16165 3743 arc Lef 4.1 -4875 -4726 >>> -6109 >>> HART >>> 66 06:32 b1-00338042 28911-16165 3743 arc Lef 4.1 -4875 -4726 >>> -6109 >>> HART >>> 67 06:33 r1-00338043 28911-16165 3743 arc Rig 4.1 -4875 -4726 >>> -6109 >>> HART >>> 68 06:33 b1-00338043 28911-16165 3743 arc Rig 4.1 -4875 -4726 >>> -6109 >>> HART >>> 69 06:34 r1-00338044 28911-16165 3743 arc Out 4.1 -4023 -3873 >>> -5254 >>> 70 06:34 b1-00338044 28911-16165 3743 arc Out 4.1 -4023 -3873 >>> -5254 >>> 71 06:37 r1-00338045 28911-16165 3743 fla Out 25.1 -4023 -3873 >>> -5254 >>> 72 06:37 b1-00338045 28911-16165 3743 fla Out 25.1 -4023 -3873 >>> -5254 >>> 73 06:47 b1-00338046 28911-16165 3743 sci Out 900.1 -4023 -3873 >>> -5254 >>> 74 06:47 r1-00338046 28911-16165 3743 sci Out 900.1 -4023 -3873 >>> -5254 >>> 75 08:13 b1-00338047 28912-16165 3744 sci Out 900.1 -4023 -3873 >>> -5254 >>> 76 08:13 r1-00338047 28912-16165 3744 sci Out 900.1 -4023 -3873 >>> -5254 >>> 77 08:33 r1-00338048 28913-16165 3745 sci Out 900.1 -4023 -3873 >>> -5254 >>> 78 08:33 b1-00338048 28913-16165 3745 sci Out 900.1 -4023 -3873 >>> -5254 >>> 79 08:50 b1-00338049 28914-16165 3746 sci Out 900.1 -4023 -3873 >>> -5254 >>> 80 08:50 r1-00338049 28914-16165 3746 sci Out 900.1 -4023 -3873 >>> -5254 >>> 81 09:07 r1-00338050 28911-16165 3747 sci Out 900.1 -4023 -3873 >>> -5254 >>> 82 09:07 b1-00338050 28911-16165 3747 sci Out 900.1 -4023 -3873 >>> -5254 >>> 83 09:27 b1-00338051 34479-16169 3748 arc Lef 4.1 -4023 -3873 >>> -5254 >>> HART >>> 84 09:27 r1-00338051 34479-16169 3748 arc Lef 4.1 -4023 -3873 >>> -5254 >>> HART >>> 85 09:27 r1-00338052 34479-16169 3748 arc Rig 4.1 -4023 -3873 >>> -5254 >>> HART >>> 86 09:27 b1-00338052 34479-16169 3748 arc Rig 4.1 -4023 -3873 >>> -5254 >>> HART >>> 87 09:28 b1-00338053 34479-16169 3748 arc Out 4.1 -4155 -4006 >>> -5386 >>> 88 09:28 r1-00338053 34479-16169 3748 arc Out 4.1 -4155 -4006 >>> -5386 >>> 89 09:32 r1-00338054 34479-16169 3748 fla Out 25.1 -4155 -4006 >>> -5386 >>> 90 09:32 b1-00338054 34479-16169 3748 fla Out 25.1 -4155 -4006 >>> -5386 >>> 91 09:35 r1-00338055 34479-16169 3748 sci Out 900.1 -4155 -4006 >>> -5386 >>> 92 09:35 b1-00338055 34479-16169 3748 sci Out 900.1 -4155 -4006 >>> -5386 >>> 93 09:55 b1-00338056 34480-16169 3749 sci Out 900.1 -4155 -4006 >>> -5386 >>> 94 09:55 r1-00338056 34480-16169 3749 sci Out 900.1 -4155 -4006 >>> -5386 >>> 95 10:11 r1-00338057 34481-16169 3750 sci Out 900.1 -4155 -4006 >>> -5386 >>> 96 10:11 b1-00338057 34481-16169 3750 sci Out 900.1 -4155 -4006 >>> -5386 >>> 97 10:28 b1-00338058 34482-16169 3751 sci Out 900.1 -4155 -4006 >>> -5386 >>> 98 10:28 r1-00338058 34482-16169 3751 sci Out 900.1 -4155 -4006 >>> -5386 >>> 99 10:47 b1-00338059 14688-19484 3752 arc Lef 4.1 -4155 -4006 >>> -5386 >>> HART >>> 100 10:47 r1-00338059 14688-19484 3752 arc Lef 4.1 -4155 -4006 >>> -5386 >>> HART >>> 101 10:48 b1-00338060 14688-19484 3752 arc Rig 4.1 -4155 -4006 >>> -5386 >>> HART >>> 102 10:48 r1-00338060 14688-19484 3752 arc Rig 4.1 -4155 -4006 >>> -5386 >>> HART >>> 103 10:49 b1-00338061 14688-19484 3752 arc Out 4.1 -4125 -3976 >>> -5358 >>> 104 10:49 r1-00338061 14688-19484 3752 arc Out 4.1 -4125 -3976 >>> -5358 >>> 105 10:57 b1-00338062 14688-19484 3754 fla Out 25.1 -4125 -3976 >>> -5358 >>> 106 10:57 r1-00338062 14688-19484 3754 fla Out 25.1 -4125 -3976 >>> -5358 >>> 107 11:01 r1-00338063 14688-19484 3754 sci Out 900.1 -4125 -3976 >>> -5358 >>> 108 11:01 b1-00338063 14688-19484 3754 sci Out 900.1 -4125 -3976 >>> -5358 >>> 109 11:20 r1-00338064 10857-18559 3755 arc Lef 4.1 -4125 -3976 >>> -5358 >>> HART >>> 110 11:20 b1-00338064 10857-18559 3755 arc Lef 4.1 -4125 -3976 >>> -5358 >>> HART >>> 111 11:21 r1-00338065 10857-18559 3755 arc Rig 4.1 -4125 -3976 >>> -5358 >>> HART >>> 112 11:21 b1-00338065 10857-18559 3755 arc Rig 4.1 -4125 -3976 >>> -5358 >>> HART >>> 113 11:22 b1-00338066 10857-18559 3755 arc Out 4.1 -3436 -3283 >>> -4666 >>> 114 11:22 r1-00338066 10857-18559 3755 arc Out 4.1 -3436 -3283 >>> -4666 >>> 115 11:25 r1-00338067 10857-18559 3755 fla Out 25.1 -3436 -3283 >>> -4666 >>> 116 11:25 b1-00338067 10857-18559 3755 fla Out 25.1 -3436 -3283 >>> -4666 >>> 117 11:29 r1-00338068 10857-18559 3755 sci Out 900.1 -3436 -3283 >>> -4666 >>> 118 11:29 b1-00338068 10857-18559 3755 sci Out 900.1 -3436 -3283 >>> -4666 >>> 119 11:46 r1-00338069 10858-18559 3756 sci Out 900.1 -3436 -3283 >>> -4666 >>> 120 11:46 b1-00338069 10858-18559 3756 sci Out 900.1 -3436 -3283 >>> -4666 >>> 121 12:07 r1-00338071 10858-18559 3758 sci Out 900.1 -3436 -3283 >>> -4666 >>> 122 12:07 b1-00338071 10858-18559 3758 sci Out 900.1 -3436 -3283 >>> -4666 >>> 123 12:32 r1-00338072 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>> 124 12:32 b1-00338072 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>> 125 12:33 r1-00338073 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>> 126 12:33 b1-00338073 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>> 127 12:34 b1-00338074 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>> 128 12:34 r1-00338074 ----------- ---- bia Clo 0.0 -3436 -3283 >>> -4666 >>>=20 >>>=20 >>> ---- BOSS Spectrographs Collimation ---- >>>=20 >>> Time TSP1 R1 B1 Move1 B1Resid >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>> 22:19:00 2.8 1319 -5.2 1495 -0.6 >>> 01:30:40 2.0 1979 -9.3 2467 -1.5 >>> 03:13:50 1.4 -1649 6.8 -1917 0.8 >>> 03:41:30 1.5 1319 0.8 531 2.5 >>> 06:24:40 2.0 659 6.8 -763 4.5 >>> 06:34:00 2.0 1319 -1.2 852 1.5 >>> 09:28:20 1.6 -329 -0.2 -132 -0.6 >>> 10:48:40 1.2 -329 -1.2 28 -1.1 >>> 11:22:10 1.2 1319 -0.2 691 2.0 >>>=20 >>>=20 >>> ---- Miscellaneous ---- >>>=20 >>>=20 >>> [observer@sdss5-hub: sdss5]$ list_ap -m 59635 >>> APOGEE data list, mjd=3D59635, all >>> raw_data: /data/apogee/utr_cdr/59635/apRaw-*.fits >>> archive: /data/apogee/archive/59635/apR-[a,b,c]-*.apz >>> quickred: /data/apogee/quickred/59635/apq-*.fits >>>=20 >>> = --------------------------------------------------------------------------= ---- >>>=20 >>> mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch = Offset >>> %Flux Comm >>>=20 >>> = --------------------------------------------------------------------------= ---- >>> 59635 53 11:52 40730053 Dark 60 B 13.5 ---------- a-b-c = - >>> - >>> 59635 54 12:02 40730054 Dark 60 B 13.5 ---------- a-b-c = - >>> - >>> 59635 55 12:13 40730055 Dark 60 B 13.5 ---------- a-b-c = - >>> - >>> 59635 56 12:15 40730056 QuarFlat 10 B 13.5 ---------- a-b-c = - >>> 98 >>> 59635 57 12:17 40730057 QuarFlat 10 B 13.5 ---------- a-b-c = - >>> 98 >>> 59635 58 12:18 40730058 QuarFlat 10 B 13.5 ---------- a-b-c = - >>> 99 >>> 59635 59 12:21 40730059 Arc-Thar 12 B 13.5 ---------- a-b-c = 1.58 >>> - >>> 59635 60 12:28 40730060 Arc-Une 40 B 13.5 ---------- a-b-c = - >>> - >>> 59635 61 12:30 40730061 Arc-Thar 12 A 13.0 ---------- a-b-c = 0.99 >>> - >>> 59635 62 12:37 40730062 Arc-Une 40 A 13.0 ---------- a-b-c = - >>> - >>> 59635 63 12:43 40730063 Dark 30 A 13.0 ---------- a-b-c = - >>> - >>> 59635 64 12:48 40730064 InteFlat 30 A 13.0 ---------- a-b-c = - >>> 279 >>> 59635 65 12:53 40730065 InteFlat 30 A 13.0 ---------- a-b-c = - >>> 279 >>> 59635 66 12:59 40730066 InteFlat 30 A 13.0 ---------- a-b-c = - >>> 279 >>> 59635 67 13:04 40730067 Dark 30 A 13.0 ---------- a-b-c = - >>> - >>> 59635 68 13:10 40730068 Arc---- 30 A 13.0 ---------- a-b-c = - >>> - FPI >>> = --------------------------------------------------------------------------= ---- >>>=20 >>>=20 >>> ---- Problems in Detail ---- >>>=20 >>> This problem was seen previously on Feb 9th. The APOGEE exposure >>> aborted >>> after >>> 26 reads. We used the same protocol to restart the exposure. No = other >>> information or resolution of this problem since the 9th. >>>=20 >>>=20 >>> 02:48:17 APO.apo_2.apogee 2385 apogee f errorMessage=3D"cannot = execute >>> command: Controller is busy..." >>> 02:48:17 CmdDone: APO.apo_2.apogee 2385 apogee expose time=3D459.0 >>> object=3Dobject >>> 02:48:17 APO.apo_2 34 hal e error=3D"Command 'apogee expose = time=3D459.0 >>> object=3Dobject' failed." >>> 02:48:17 APO.apo_2.cherno 2355 cherno f error=3D"Command 'acquire -c = -t >>> 15.0' failed because of an uncaught error 'ExposerError: Expose = command >>> failed.'. See traceback in the log for more information. >>> 02:48:17 APO.apo_2 34 hal w text=3D"Running cleanup tasks." >>> 02:48:22 APO.apo_2 34 hal w text=3D"Cancelling current APOGEE = exposure." >>> 02:48:22 APO.apo_2 34 hal w text=3D"Cancelling current BOSS = exposure." >>> 02:48:22 APO.apo_2.boss 2381 boss f text=3D"exposure aborted" >>> 02:48:22 CmdDone: APO.apo_2.boss 2381 boss exposure science = itime=3D900.0 >>> 02:48:22 .boss 466 boss w text=3D"this command has already been >>> finished!!!! >>> (client.v1451 466): exposure science itime=3D900.0" >>> 02:48:22 .boss 466 boss w text=3D"this command has already been >>> finished!!!! >>> (client.v1451 466): exposure science itime=3D900.0" >>>=20 >>> 12:13Z Boson on obs2 error message when restarting it. Message = appeared >>> in a >>> popup window indicating a Java Script error in the main process: >>>=20 >>> Uncaught Exception: >>> Error: The 'screen' module can't be used before the app 'ready' = event >>> at createScreenIfNeeded (node:electron/js2c/browser_init:125:261) >>> at Object.get (node:electron/js2c/browser_init:125:303) >>> at createWindow >>> = (/Applications/boson.app/Contents/Resources/app.asar/build/src/main/main.j= s:99:40) >>> at App. >>> = (/Applications/boson.app/Contents/Resources/app.asar/build/src/main/main.j= s:198:9) >>> at App.emit (node:events:390:28) >>>=20 >>> Clicking ok on the window brought the Boson windows up. Not sure = what >>> happened. >>>=20 >>> ____________________________________________________________ >>> Logs of Nightly APO Activities >>> = https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html >>>=20 >> ____________________________________________________________ >> Logs of Nightly APO Activities > >> = https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html = --Apple-Mail=_51FD160B-7F3F-4423-9903-4D0B2DB4D0AC Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii On Feb 26, 2022, at 12:38 PM, Audrey Oravetz wrote:Hi Jose and Karen,Hi = Karen, Audrey,NOTES TO DAY STAFF AND = DEVELOPERS:=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D* For the = commissioning designs with 4 cloned visits, the last config idinitiated new trajectories to be calculated and was not = identified as a"cloned"field like the = previous two design reloads. Occurred for design set of16716.This is = expected. jaeger will not clone more than one hour/4 designs.Afterthat period, you'll get a new, non-cloned = configuration even if it couldbecloned. = The idea with this is that after one hour you normally want toreconfigure the array to update the atmospheric refraction = estimates, andto update the scale, and also to take new = cals. If the designs appears asnormal (not cloned) you = want to do the full goto field macro.Good to know. Thank you for = clarifying.Thanks= for this info. * = 02:48Z Had an instance where an APOGEE exposure aborted for no = reason.Seelog and Problems in detail of the problem. Unknown = cause; please checkdata.This seems to be the same issue = we had las week. The error message is thesame. Were Matt = instructions on restarting the controller followed? Iftheywere, this problem seems to be becoming = more frequent.Luckily, we did not need to do anything other than restart = the exposuresequence last = night. Not sure if that was just a fluke though.Outside of = the conversation on infrastructure with JohnW, is there anything the = night staff can do if this happens in the middle of the night. If = all it takes is checking the instrument gui and restarting the exposure = sequence, then we can do that.Right now if APOGEE fails BOSS will = stop. We decided to change that and Imodified HAL but we = never restarted it. If you restart hal it should nownot = fail the other science exposure if one fails.Good idea. Karen/Dmitry are on shift tonight and will restart = hal.Hal = was just restarted now.I'm not sure about the = guider, though. It seems something in the APOGEEerror = cascaded into something that affected the guider but I'm notimmediate sure what it is. I think last week that didn't = happen. Since Imay not be able to look into that for a = bit, can you open a Jira ticketwith that issue so that it = doesn't get forgotten?Yes, I will issue a = ticket.Thanks= Audrey!* 12:45Z BOSS sp1cam is DEAD. Critical alert sounded = but does not appearin = thealerts window. Morning biases and darks appear ok. See = log for moredetails.Sounds like a temporary = controller error that almost immediately cleareditself = ...Thanks for taking care of this, Karen.---- Observing Log ----Afternoon:=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D/dev/sdb1 = &n= bsp; 2.0T 161G 1.9T 8% /hometmpfs = &n= bsp; 3.2G 0 = 3.2G 0% /run/user/200510.25.1.230:/data = 21T 18T = 2.4T 89% /dataoverlay = &n= bsp; 228G 48G 180G 22% = /var/lib/docker/overlay2tmpfs = &n= bsp; 3.2G 4.0K 3.2G = 1% /run/user/302110.25.1.230:/archive = 20T 725G 19T = 4% /archivetmpfs = &n= bsp; 3.2G 0 = 3.2G 0% /run/user/100222:14:41 boss exposure 0.0, = file=3D33800922:16:06 boss exposure = 20.0, file=3D33801022:17:50 boss = exposure 4.0, file=3D33801122:18:31 = boss exposure 4.0, file=3D33801222:19:15 sp1.motor.move=3D 1495, 1496, 149522:19:15 Hartmann collimate output sp1: offset: r=3D 1319 (Out of focus); b=3D -5.2 = (Out of focus) sp1: pred. move: spAverageMove=3D = 1495 sp1: pred. resid: r=3D -176, b=3D -0.6, txt=3D = OK, spTemp =3D 3.522:19:54 boss exposure = 4.0, file=3D33801322:25:00 boss = exposure 30.0, file=3D33801423:22Z - Started ventilating. Cloudy at the moment, but it = may clear outlater. Telescope checkout went ok.FPS is powered on, connected, cooled.Night:=3D=3D=3D=3D=3D=3D00:59:46 encl25m : open;#1: Observe design (16716,16716,16716,16716)01:17Z Preloaded the first field of the night. We have = our first robotcollisionof the night, = Robot #184.01:19:25 Config Loaded: = 16716-3727Issued hal go-to-field command, = but failed because we disabled onerobot.Tryagain. Accidentally loaded the wrong = design, will manually load thecorrect one.01:26:29 CmdStarted: APO.aoravetz 91 jaeger = configuration load 16716--no-clone01:27:43 Config Loaded: 16716-372901:28:17 CmdStarted: APO.apo_2 26 hal goto-field = --guider-time 15HARTMANN:01:29:22 boss exposure 4.0, = file=3D33801501:30:03 boss exposure = 4.0, file=3D33801601:30:49 = sp1.motor.move=3D 2467, 2466, 246701:30:49 = Hartmann collimate output sp1: offset: r=3D = 1979 (Out of focus); b=3D -9.3 (Out of focus) sp1: pred. move: spAverageMove=3D 2467 sp1: pred. resid: r=3D -488, b=3D -1.5, txt=3D OK, = spTemp =3D 2.4Boss cals:01:31:09 boss exposure 4.0, = file=3D33801701:34:22 boss exposure = 25.0, file=3D338018FVC = Loop:01:31:34 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]:= RMS full fit 51.890um."01:32:19 = APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS full fit 16.020um."01:33:01 APO.apo_2.jaeger 2332 jaeger i = text=3D"[FVC]: RMS full fit 11.600um."01:33:42 APO.apo_2.jaeger 2332 jaeger i text=3D"[FVC]: RMS = full fit 10.870um."01:31:30 = APO.apo_2.jaeger 2332 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0001.fits01:32:14 APO.apo_2.jaeger 2332 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0002.fits01:32:57 APO.apo_2.jaeger 2332 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0003.fits01:33:38 APO.apo_2.jaeger 2332 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0004.fits01:33:42 FVC Loop - RMS: 10.87 Delta = RMS: 0.73 Image #: 0004Cherno = error:01:36:34 APO.apo_2 27 cherno f error=3D"Command = 'acquire -c -t 5' failedbecauseof an = uncaught error 'ExposerError: The guider is already exposing.'.Seetraceback in the log for more = information."01:36:34 CmdDone: APO.apo_2 27 cherno = acquire -c -t 5We set the focus initially = at 350 and the autofocus feature appears tobeworking. Best focus is at 419 and auto adjusting with = Boson.01:36:02 tcc set focus=3D350.001:37:44 APO.apo_2 28 cherno i = guide_rms=3D2,0.431,0.741,0.85701:38:12 APO.apo_2 28 = cherno i guide_rms=3D3,0.138,0.21,0.25101:38:38 APO.apo_2 = 28 cherno i guide_rms=3D4,0.057,0.072,0.09201:39:06 = APO.apo_2 28 cherno i guide_rms=3D5,0.051,0.037,0.063Guider autofocus set up took about 3 minutes.We are waiting for the sky to be dark enough to take = data.01:48:26 hal goto-field -s = fvc,acquire,guide --guider-time 15Running = a new FVC loop for the first field of the night (2min):01:50:20 FVC Loop - RMS: 15.11 Delta RMS: = 0.21 Image #: 000701:48:57 = APO.apo_2.jaeger 2350 jaeger i text=3D"[FVC]: RMS full fit 21.970um."01:49:39 APO.apo_2.jaeger 2350 jaeger i = text=3D"[FVC]: RMS full fit 15.320um."01:50:20 APO.apo_2.jaeger 2350 jaeger i text=3D"[FVC]: RMS = full fit 15.110um."01:48:52 = APO.apo_2.jaeger 2350 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0005.fits01:49:34 APO.apo_2.jaeger 2350 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0006.fits01:50:16 APO.apo_2.jaeger 2350 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0007.fitsDATA:01:53:53 = apogee.expose=3DapRaw-40740009, 43, A, Object01:53:59= boss exposure 900.0, file=3D33801902:01:34 = apogee.expose=3DapRaw-40740010, 43, B, Object02:09:26 Config Loaded: 16716-3730Seeing = is about 1.7"02:10:34 boss exposure 900.0, = file=3D33802002:10:36 apogee.expose=3DapRaw-40740011,= 43, A, Object02:18:17 = apogee.expose=3DapRaw-40740012, 43, B, Object02:26:02 Config Loaded: 16716-373102:27:33= boss exposure 900.0, file=3D33802102:27:34 = apogee.expose=3DapRaw-40740013, 43, A, Object02:35:15= apogee.expose=3DapRaw-40740014, 43, B, ObjectManually reloading the design and a new trajectory was = calculated (2min)02:43:59 Config Loaded: = 16716-3732Command to take data was = aborted. See Problems in Detail for log outputandtime stamps.Problem appears to = stem from APOGEE, but it is unclear what happened tothe = apogee controller. The exposure completed up to 28 reads.The guider also stopped when this happened.02:44:06 boss exposure 900.0, file=3D338022 = <--aborted02:44:07 apogee.expose=3DapRaw-40740015,= 43, A, Object <--abortedTo recover = from this unforced abort was to restart the guider andrestartedthe data exposure sequence in hal.02:51:19 boss exposure 900.0, = file=3D33802202:51:20 apogee.expose=3DapRaw-40740016,= 43, A, Object02:59:01 = apogee.expose=3DapRaw-40740017, 43, B, ObjectBOSS exposure number did not increment up in the reissue of = the exposuresequence.APOGEE = dome flat:03:07:07 apogee.expose=3DapRaw-40740018, = 5, B, DomeFlat=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D#2. observe design 4791 (just = once)03:09:38 Config Loaded: = 4791-373303:10:02 APO.apo_2.jaeger 2408 = jaeger f error=3D"The configuration was notexecuted. Try = unwinding."03:10:02 CmdDone: APO.apo_2.jaeger 2408 jaeger = configuration reverseWe noticed that the = configuration reverse command seems to be failingwitheach new design from last night to tonight. Issuing an = unwind andresuminghal go-to-field.HARTMANN:03:12:35 boss = exposure 4.0, file=3D33802403:13:18 = boss exposure 4.0, file=3D33802503:14:02 sp1.motor.move=3D -1916, -1917, -191803:14:02 Hartmann collimate output sp1: offset: r=3D -1649 (Out of focus); b=3D 6.8 = (Out of focus) sp1: pred. move: spAverageMove=3D = -1917 sp1: pred. resid: r=3D 268, b=3D 0.8, txt=3D = OK, spTemp =3D 2.0BOSS cals:03:14:21 boss exposure 4.0, = file=3D33802603:17:20 boss exposure = 25.0, file=3D338027FVC = Loop:03:15:17 APO.apo_2.jaeger 2421 jaeger i text=3D"[FVC]:= RMS full fit 15.690um."03:15:58 = APO.apo_2.jaeger 2421 jaeger i text=3D"[FVC]: RMS full fit 12.690um."03:16:39 APO.apo_2.jaeger 2421 jaeger i = text=3D"[FVC]: RMS full fit 14.650um."03:15:13 APO.apo_2.jaeger 2421 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0009.fits03:15:54 APO.apo_2.jaeger 2421 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0010.fits03:16:35 APO.apo_2.jaeger 2421 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0011.fits03:14:33 APO.apo_2.jaeger 2421 jaeger i = fvc_perc_95=3D80.8903:15:17 APO.apo_2.jaeger 2421 jaeger = i fvc_perc_95=3D27.1503:15:58 APO.apo_2.jaeger 2421 = jaeger i fvc_perc_95=3D23.0803:16:39 APO.apo_2.jaeger = 2421 jaeger i fvc_perc_95=3D28.5603:16:39 = FVC Loop - RMS: 14.65 Delta RMS: -1.96 Image #: 0011We've been setting the cherno pid values to = 1.0 to help converge theguide_rmsvalue = faster. We reset it back to 0.7 when we are starting science.DATA:03:20:41 boss = exposure 900.0, file=3D33802803:20:42 = apogee.expose=3DapRaw-40740019, 43, A, Object03:28:23= apogee.expose=3DapRaw-40740020, 43, B, Object03:36:11 apogee.expose=3DapRaw-40740021, 5, B, = DomeFlat=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D#3. observe 36183 for = 2 hours, i.e. 8 times (36183, 36183, 36183, 36183,36183, = 36183, 36183, 36183)03:37:12 Config = Loaded: 36183-373403:37:19 hal = goto-field --guider-time 15HARTMANN:03:40:12 boss exposure 4.0, = file=3D33802903:40:53 boss exposure = 4.0, file=3D33803003:41:36 = sp1.motor.move=3D 531, 532, 53303:41:36 = Hartmann collimate output sp1: offset: r=3D = 1319 (Out of focus); b=3D 0.8 (In Focus) sp1: = pred. move: spAverageMove=3D 531 sp1: pred. resid: = r=3D 788, b=3D 2.5, txt=3D OK, spTemp =3D 2.0BOSS cals:03:41:56 boss exposure = 4.0, file=3D33803103:44:54 boss = exposure 25.0, file=3D338032FVC = Loop:03:42:07 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]:= RMS full fit 45.440um."03:42:52 = APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS full fit 14.140um."03:43:32 APO.apo_2.jaeger 2461 jaeger i = text=3D"[FVC]: RMS full fit 11.850um."03:44:13 APO.apo_2.jaeger 2461 jaeger i text=3D"[FVC]: RMS = full fit 9.210um."03:42:03 = APO.apo_2.jaeger 2461 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0012.fits03:42:47 APO.apo_2.jaeger 2461 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0013.fits03:43:28 APO.apo_2.jaeger 2461 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0014.fits03:44:09 APO.apo_2.jaeger 2461 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0015.fits03:42:07 APO.apo_2.jaeger 2461 jaeger i = fvc_perc_95=3D76.1603:42:52 APO.apo_2.jaeger 2461 jaeger = i fvc_perc_95=3D27.6203:43:32 APO.apo_2.jaeger 2461 = jaeger i fvc_perc_95=3D23.203:44:13 APO.apo_2.jaeger 2461 = jaeger i fvc_perc_95=3D17.6803:44:13 = FVC Loop - RMS: 9.21 Delta RMS: 2.64 Image #: = 001503:46Z Boson on obs2 has crashed.DATA:03:49:03 boss = exposure 900.0, file=3D33803303:49:05 = apogee.expose=3DapRaw-40740022, 43, A, Object03:56:45= apogee.expose=3DapRaw-40740023, 43, B, Object04:04:59 Config Loaded: 36183-373504:05:31= boss exposure 900.0, file=3D33803404:05:31 = apogee.expose=3DapRaw-40740024, 43, A, Object04:13:12= apogee.expose=3DapRaw-40740025, 43, B, Object04:20:48 Config Loaded: 36183-373604:23:49= boss exposure 900.0, file=3D33803504:23:50 = apogee.expose=3DapRaw-40740026, 43, A, Object04:31:31= apogee.expose=3DapRaw-40740027, 43, B, Object04:38:58 jaeger configuration load 36183This command has started a recalculation of the trajectories, = but thisisthesame design = and should be "cloned".04:39:55 = Config Loaded: 36183-373704:40:24 boss = exposure 900.0, file=3D33803604:40:26 = apogee.expose=3DapRaw-40740028, 43, A, Object04:48:06= apogee.expose=3DapRaw-40740029, 43, B, Object04:56:04 Config Loaded: 36183-373904:57:37= boss exposure 900.0, file=3D33803704:57:39 = apogee.expose=3DapRaw-40740030, 43, A, Object05:05:19= apogee.expose=3DapRaw-40740031, 43, B, Object05:12:50 Config Loaded: 36183-374005:14:13= boss exposure 900.0, file=3D33803805:14:15 = apogee.expose=3DapRaw-40740032, 43, A, Object05:21:56= apogee.expose=3DapRaw-40740033, 43, B, Object05:30Z Boson crashed on obs105:29:43 Config Loaded: 36183-374105:32:02= boss exposure 900.0, file=3D33803905:32:04 = apogee.expose=3DapRaw-40740034, 43, A, Object05:39:44= apogee.expose=3DapRaw-40740035, 43, B, Object05:37Z thick clouds on site.05:44Z Guider failed due to clouds. We had less than 2 = minutes to gowiththe exposure, so these = last two exposures may be low S/N.05:47Z = pausing observations until these clouds pass.05:48:12 Config Loaded: 36183-374206:15Z = Too cloudy to complete Design 36183.06:15:55 = apogee.expose=3DapRaw-40740036, 5, B, DomeFlat=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D#4. observe 28911, 28912, 28913, = 2891406:20:43 Config Loaded: = 28911-3743HARTMANN:06:23:28 = boss exposure 4.0, file=3D33804006:24:08 boss exposure 4.0, = file=3D33804106:24:50 sp1.motor.move=3D -763, -764, = -76606:24:51 Hartmann collimate output sp1: offset: r=3D 659 (In Focus); b=3D 6.8 (Out = of focus) sp1: pred. move: spAverageMove=3D -763 sp1: pred. resid: r=3D 1422, b=3D 4.5, txt=3D Move blue = ring 8.9 degrees.,spTemp =3D 2.1Moving blue ring by +3 degrees.Doing Hartmanns again:06:32:50 = boss exposure 4.0, file=3D33804206:33:30 boss exposure 4.0, = file=3D33804306:34:12 sp1.motor.move=3D 852, 853, = 85506:34:12 Hartmann collimate output sp1: offset: r=3D 1319 (Out of focus); b=3D -1.2 = (In Focus) sp1: pred. move: spAverageMove=3D 852 sp1: pred. resid: r=3D 467, b=3D 1.5, txt=3D OK, spTemp = =3D 2.1Ok, in spec. Moving on with = the hal go-to field command.FVC Loop:06:34:43 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS = full fit 47.240um."06:35:27 = APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS full fit 15.970um."06:36:09 APO.apo_2.jaeger 2556 jaeger i = text=3D"[FVC]: RMS full fit 10.190um."06:36:50 APO.apo_2.jaeger 2556 jaeger i text=3D"[FVC]: RMS = full fit 10.220um."06:34:39 = APO.apo_2.jaeger 2556 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0016.fits06:35:23 APO.apo_2.jaeger 2556 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0017.fits06:36:04 APO.apo_2.jaeger 2556 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0018.fits06:36:45 APO.apo_2.jaeger 2556 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0019.fits06:34:43 APO.apo_2.jaeger 2556 jaeger i = fvc_perc_95=3D82.3406:35:27 APO.apo_2.jaeger 2556 jaeger = i fvc_perc_95=3D28.5806:36:09 APO.apo_2.jaeger 2556 = jaeger i fvc_perc_95=3D21.5706:36:50 APO.apo_2.jaeger = 2556 jaeger i fvc_perc_95=3D18.9406:36:50 = FVC Loop - RMS: 10.22 Delta RMS: -0.03 Image #: 0019BOSS cals:06:34:46 boss = exposure 4.0, file=3D33804406:37:32 = boss exposure 25.0, file=3D33804506:39Z Still very cloudy and guider does not see many = stars. Guiderexptimeis 45s. We = will pause for the clouds to pass through.06:47Z Small break in the clouds, but still rather = cloudy. We'll trytoget some data. = Seeing is about 2"DATA:06:47:33 boss exposure 900.0, file=3D33804606:47:34 apogee.expose=3DapRaw-40740037, 43, A, = Object06:55:15 apogee.expose=3DapRaw-40740038, 43, = B, ObjectAt the end of these exposures, = the clouds return and the guider stopped.We will wait for = another break in the clouds.07:04:02 = Config Loaded: 28912-374408:10Z = Some clearing in the sky.08:10Z = Boson on obs2 has crashed.Restarting = data collection:08:13:32 boss = exposure 900.0, file=3D33804708:13:32 = apogee.expose=3DapRaw-40740039, 43, A, Object08:21:13= apogee.expose=3DapRaw-40740040, 43, B, Object08:32:55 Config Loaded: 28913-374508:33:24= boss exposure 900.0, file=3D33804808:33:26 = apogee.expose=3DapRaw-40740041, 43, A, Object08:41:07= apogee.expose=3DapRaw-40740042, 43, B, Object08:48:35 Config Loaded: 28914-374608:50:46= boss exposure 900.0, file=3D33804908:50:47 = apogee.expose=3DapRaw-40740043, 43, A, Object08:58:28= apogee.expose=3DapRaw-40740044, 43, B, ObjectBonus exposure since the first one in this set was clouded = out.09:06:34 Config Loaded: 28911-374709:07:18 apogee.expose=3DapRaw-40740045, 43, A, = Object09:07:18 boss exposure 900.0, = file=3D33805009:14:58 apogee.expose=3DapRaw-40740046,= 43, B, Object09:22:52 = apogee.expose=3DapRaw-40740047, 5, B, DomeFlatjaeger configuration reverse did not work this time. = Issuing unwind.09:24:10 jaeger = unwind=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D#6. observe 34479, 34480, = 34481,34482 if in observability window,otherwise do = after09:23:35 Config Loaded: = 34479-3748HARTMANN:09:27:05 = boss exposure 4.0, file=3D33805109:27:46 boss exposure 4.0, = file=3D33805209:28:28 sp1.motor.move=3D -132, -133, = -13209:28:28 Hartmann collimate output sp1: offset: r=3D -329 (In Focus); b=3D -0.2 (In = Focus) sp1: pred. move: spAverageMove=3D -132 sp1: pred. resid: r=3D -196, b=3D -0.6, txt=3D OK, = spTemp =3D 1.6BOSS cals:09:28:48 boss exposure 4.0, = file=3D33805309:32:28 boss exposure = 25.0, file=3D338054FVC = Loop:09:28:59 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]:= RMS full fit 48.510um."09:29:43 = APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit 21.660um."09:30:24 APO.apo_2.jaeger 2632 jaeger i = text=3D"[FVC]: RMS full fit 19.350um."09:31:05 APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS = full fit 16.390um."09:31:46 = APO.apo_2.jaeger 2632 jaeger i text=3D"[FVC]: RMS full fit 15.910um."09:28:54 APO.apo_2.jaeger = 2632 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0020.fits09:29:39 APO.apo_2.jaeger 2632 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0021.fits09:30:20 APO.apo_2.jaeger 2632 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0022.fits09:31:01 APO.apo_2.jaeger 2632 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0023.fits09:31:42 APO.apo_2.jaeger 2632 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0024.fits09:28:59 APO.apo_2.jaeger 2632 jaeger i = fvc_perc_95=3D86.5309:29:43 APO.apo_2.jaeger 2632 jaeger = i fvc_perc_95=3D28.9409:30:24 APO.apo_2.jaeger 2632 = jaeger i fvc_perc_95=3D28.8409:31:05 APO.apo_2.jaeger = 2632 jaeger i fvc_perc_95=3D21.1809:31:46 = APO.apo_2.jaeger 2632 jaeger i fvc_perc_95=3D20.0909:31:46 FVC Loop - RMS: 15.91 Delta RMS: = 0.48 Image #: 0024DATA:09:35:49 boss exposure 900.0, file=3D33805509:35:51 apogee.expose=3DapRaw-40740048, 43, A, = Object09:43:31 apogee.expose=3DapRaw-40740049, 43, = B, Object09:51:00 Config Loaded: = 34480-374909:55:03 boss exposure 900.0, = file=3D33805609:55:05 apogee.expose=3DapRaw-40740050,= 43, A, Object10:02:45 = apogee.expose=3DapRaw-40740051, 43, B, Object10:10:12 Config Loaded: 34481-375010:11:32= boss exposure 900.0, file=3D33805710:11:34 = apogee.expose=3DapRaw-40740052, 43, A, Object10:19:15= apogee.expose=3DapRaw-40740053, 43, B, Object10:27:19 Config Loaded: 34482-375110:28:05= boss exposure 900.0, file=3D33805810:28:07 = apogee.expose=3DapRaw-40740054, 43, A, Object10:35:48= apogee.expose=3DapRaw-40740055, 43, B, Object10:43:35 apogee.expose=3DapRaw-40740056, 5, B, = DomeFlat10:44:51 jaeger unwindbecause jaeger configuration reverse failed.=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D#7. refresh the Kronos queue and = observe the rest of the night from thequeue(ran out of time to do commissioning task #6.)10:45Z Refreshed Kronos and loaded into hal = the next available design:10:44:21 = Config Loaded: 14688-3752 (Field 19484)10:46:25 hal goto-field --guider-time 15HARTMANN:0:47:29 boss = exposure 4.0, file=3D33805910:48:11 = boss exposure 4.0, file=3D33806010:48:52 sp1.motor.move=3D 30, 30, 2810:48:52 Hartmann collimate output sp1: offset: r=3D -329 (In Focus); b=3D -1.2 (In = Focus) sp1: pred. move: spAverageMove=3D 28 sp1: pred. resid: r=3D -357, b=3D -1.1, txt=3D OK, = spTemp =3D 1.7FVC Loop:Encountered a collision during the fvc loop:10:50:12 Jaeger collision: 23810:50:12 .jaeger 0 jaeger w text=3D"Positioner 322 replied = toSTART_TRAJECTORY UID=3D4307 with = 'INVALID_TRAJECTORY'.(JaegerUserWarning)"10:50:12 APO.apo_2.jaeger 2701 jaeger dtrajectory_dump_file=3D/data/logs/jaeger/trajectories/59636/tra= jectory-59636-0034.json10:50:12 APO.apo_2.jaeger 2701 = jaeger f error=3D"Failed processing image:Failed = executing the correction trajectory: Something went wrong duringthetrajectory: START_TRAJECTORY failed"10:50:12 CmdDone: APO.apo_2.jaeger 2701 jaeger fvc loop10:50:12 .jaeger 0 jaeger f text=3D"A = collision was detected in positioner238. Sending = SEND_TRAJECTORY_ABORT and locking the FPS."10:50:12 = .jaeger 0 jaeger w text=3D"Locking the FPS. (JaegerUserWarning)"See snapshot: fps_snapshot_59636_0034.pdfIssued a jaeger configuration reverse, and = that seemed to work.10:52:29 Config Loaded: = 14688-3753 (clone of config id 3752)10:53:31 Config = Loaded: 14688-3754 (trying to get a new trajectory toavoidcollision)10:49:23 APO.apo_2.jaeger 2701 jaeger i text=3D"[FVC]: RMS = full fit 48.610um."10:50:08 = APO.apo_2.jaeger 2701 jaeger i text=3D"[FVC]: RMS full fit 14.260um."10:55:23 APO.apo_2.jaeger 2711 jaeger i = text=3D"[FVC]: RMS full fit 49.250um."10:56:14 APO.apo_2.jaeger 2711 jaeger i text=3D"[FVC]: RMS = full fit 15.290um."10:56:56 = APO.apo_2.jaeger 2711 jaeger i text=3D"[FVC]: RMS full fit 9.920um."10:49:19 APO.apo_2.jaeger = 2701 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0025.fits10:50:03 APO.apo_2.jaeger 2701 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0026.fits10:55:19 APO.apo_2.jaeger 2711 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0027.fits10:56:10 APO.apo_2.jaeger 2711 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0028.fits10:56:52 APO.apo_2.jaeger 2711 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0029.fits10:49:23 APO.apo_2.jaeger 2701 jaeger i = fvc_perc_95=3D89.4310:50:08 APO.apo_2.jaeger 2701 jaeger = i fvc_perc_95=3D26.7810:55:23 APO.apo_2.jaeger 2711 = jaeger i fvc_perc_95=3D89.5310:56:14 APO.apo_2.jaeger = 2711 jaeger i fvc_perc_95=3D30.1110:56:56 = APO.apo_2.jaeger 2711 jaeger i fvc_perc_95=3D18.1910:56:56 FVC Loop - RMS: 9.92 Delta RMS: = 5.37 Image #: 0029BOSS = cals:10:49:12 boss exposure 4.0, = file=3D33806110:57:33 boss exposure = 25.0, file=3D338062DATA:11:01:34 boss exposure 900.0, file=3D33806311:01:34 apogee.expose=3DapRaw-40740057, 43, A, = Object11:09:15 apogee.expose=3DapRaw-40740058, 43, = B, Object11:18:06 = apogee.expose=3DapRaw-40740059, 5, B, DomeFlat=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3DNext design from Kronos:11:18:49 Config Loaded: 10857-3755HARTMANN:11:20:53 boss exposure = 4.0, file=3D33806411:21:34 boss = exposure 4.0, file=3D33806511:22:16 = sp1.motor.move=3D 689, 693, 69211:22:16 = Hartmann collimate output sp1: offset: r=3D = 1319 (Out of focus); b=3D -0.2 (In Focus) sp1: = pred. move: spAverageMove=3D 691 sp1: pred. resid: = r=3D 627, b=3D 2.0, txt=3D OK, spTemp =3D 1.4FVC Loop:11:22:46 APO.apo_2.jaeger 2747 jaeger = i text=3D"[FVC]: RMS full fit 46.380um."11:23:30 APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS = full fit 14.290um."11:24:11 = APO.apo_2.jaeger 2747 jaeger i text=3D"[FVC]: RMS full fit 11.490um."11:24:52 APO.apo_2.jaeger 2747 jaeger i = text=3D"[FVC]: RMS full fit 9.800um."11:22:42 APO.apo_2.jaeger 2747 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0030.fits11:23:26 APO.apo_2.jaeger 2747 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0031.fits11:24:07 APO.apo_2.jaeger 2747 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0032.fits11:24:48 APO.apo_2.jaeger 2747 jaeger dfvc_filename=3D/data/fcam/59636/fimg-fvc1n-0033.fits11:22:46 APO.apo_2.jaeger 2747 jaeger i = fvc_perc_95=3D82.7911:23:31 APO.apo_2.jaeger 2747 jaeger = i fvc_perc_95=3D27.3811:24:11 APO.apo_2.jaeger 2747 = jaeger i fvc_perc_95=3D21.9711:24:52 APO.apo_2.jaeger = 2747 jaeger i fvc_perc_95=3D20.5811:24:52 = FVC Loop - RMS: 9.80 Delta RMS: 1.69 Image #: = 0033BOSS cals:11:22:35 = boss exposure 4.0, file=3D33806611:25:33 boss exposure 25.0, file=3D338067DATA:11:29:33 = apogee.expose=3DapRaw-40740060, 43, A, Object11:29:34= boss exposure 900.0, file=3D33806811:37:14 = apogee.expose=3DapRaw-40740061, 43, B, Object11:44:53 Config Loaded: 10858-375611:46:08= boss exposure 900.0, file=3D33806911:46:10 = apogee.expose=3DapRaw-40740062, 43, A, Object11:53:51= apogee.expose=3DapRaw-40740063, 43, B, Object12:01:40 apogee.expose=3DapRaw-40740064, 5, B, = DomeFlatKronos shows the B1 S/N is too = low. Going to stay on this design andtakemore data. However, we have already loaded the next = design:12:01:33 Config Loaded: 9196-375712:05:02 boss exposure 900.0, = file=3D338070 <--abort12:05:03 = apogee.expose=3DapRaw-40740065, 43, A, Object <--abortWe've aborted these exposures because the = headers are being populatedwiththedesign information of a design we don't want to start.Reloaded the previous design:12:05:58 Config Loaded: 10858-3758Now taking data again in this design to get more S/N for = b1.12:06:54 = apogee.expose=3DapRaw-40740066, 43, A, Object12:07:00= boss exposure 900.0, file=3D33807012:14:35 = apogee.expose=3DapRaw-40740067, 43, B, Object12:11Z Boson is slowing down on obs2 again. Will = restart to avoid acrash.See problems in = details for additional error message that popped up.12:23Z Unwind = and powered down FPS12:28:47 encl25m = : closed;12:34Z Started morning cals.12:45Z Received a critical alert on BOSS. boss = ping shows sp1cam isdead.Tried to reload = controllers, and boss ping shows everything is ok.Sincewe are running morning boss cals, the biases keep going. = another bosspingshows that sp1daq is = dead. Tried to reload controllers and is ok. Butsp1cam now shows it is dead.boss = exposure stop does not stop the morning cal script from the controlroom.The alerts window does not = show any critical alerts, so it must havecleareditself?morning boss biases = appear to be still going and the bias levels in theimagesare around 2100 counts. They look = normal.Not entirely sure if we are having = a netburner issue or just acommunicationshiccup??Data appears to be = written to disk.13:18:03 CmdStarted: = OBSERVER.karen 18 boss ping13:18:03 OBSERVER.karen 18 = boss i text=3D"sp1daq: OK"13:18:04 OBSERVER.karen 18 boss = i text=3D"sp1cam: OK"13:18:04 OBSERVER.karen 18 boss i = text=3D"Response parsed."13:18:04 OBSERVER.karen 18 boss = i text=3D"sp1mech: OK"13:18:04 OBSERVER.karen 18 boss = :Everything looks like it is connected and = communicating.Maybe a communications = hiccup? Can someone please look into this? Thisproblemmay be increasing in frequency?---- Mirror Numbers ----PRIMARY:--------Scale: 1.000000MIGS TONIGHT = NOMINALAxial A: 0.0020 0.0040Axial B: = -0.0010 0.0030Axial C: -0.1110 -0.1150Trans = D: -0.0342 -0.0338Lateral E: 0.3315 0.3315Lateral F: 0.5350 0.5350GALILSCommanded: 12500 -1600 5300 47050 -8800 -8400Actual: 12500 -1600 5300 47050 -8800 = -8400SETMIR VALUESPrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3PrimOrient: 1.07 -59.51 -9.21 -512.13 = 1906.31SECONDARY:----------Focus: = 0.0000Air temp: = 4.50Altitude: 30.0MIGS TONIGHT NOMINALAxial A: = -9.6550 -9.6570Axial B: -9.6680 -9.6710Axial= C: -9.6950 -9.6970Trans D: 0.1120 0.1140GALILSCommanded: 4893800 4893300 4914250 -50 = -3450Actual: 4859199 4859280 4859230 = -50 -3450SETMIR VALUESSecDesOrient: 3857.0 0.0 0.0 0.0 42.22SecOrient:= 3857.01 0.01 0.02 0.01 42.86---- Telescope Status ----23:22Z Started = ventilation00:59Z encl25m : = open12:28Z encl25m : closedNo interlocks bypassedStatus at:12:35ZTelescope stowed at: = 121.0, 30.0, 0.0 mountInstrument mounted: fpsCounterweights at: 685 687 704 = 704LN2 autofill systems: Connected and turned = on180L LN2 dewar scales: SP1 221 = lbs, 22.7 psi---- Software = Used ----Get Versions, 02/25/22, = 22:12:37-- STUI software:STUI = : 1.7.17b1alerts : 2.2.0boss : = 6.0.1-boss.specMec : 3.0.4guider = : FAILEDecamera = : FAILEDapo = : 3.0.1fliswarm : 0.2.1-alpha.0jaeger : = 0.14.1-alpha.0kaiju = : 1.2.2-alpha.1coordio : = 1.2.2-alpha.1fps_calibrati : APO.2021.12.25+960cb05cherno : = 0.1.1-alpha.0hal = : = 0.1.1-alpha.0hartmann : = 2.0.2hub = : 5.0.1a0mcp = : 2.1-mcp.plc : 34-mcp.azFiduci : v1_148-mcp.altFiduc : = v1_148-mcp.rotFiduc : v1_148tcc = : 1.4.0apogee : not = availbleapogeecal : not = availbleapogeeql : = FAILEDSTUIAdditions : 3.1.12-- done ------ APOGEE Data = Summary ----APOGEE data list, = mjd=3D59636, allraw_data: = /data/apogee/utr_cdr/59636/apRaw-*.fitsarchive: = /data/apogee/archive/59636/apR-[a,b,c]-*.apzquickred:= /data/apogee/quickred/59636/apq-*.fits---------------------------------------------------------------= ---------------mjd i = UT File/Exp Imtype Nread A/B Dth = Design-Cfg Arch Offset%Flux Comm---------------------------------------------------------------= ---------------59636 1 22:25 40740001 = Dark 60 A 13.0 = ---------- a-b-c - -59636 2 22:27 40740002 QuarFlat 10 = A 13.0 ---------- a-b-c - 9859636 3 22:29 = 40740003 Arc-Thar 12 B 13.5 ---------- = a-b-c 1.54-59636 4 = 22:36 40740004 Arc-Une 40 B 13.5 = ---------- a-b-c - -59636 5 22:39 40740005 Arc-Thar 12 = A 13.0 ---------- a-b-c 0.96-59636 6 22:46 40740006 = Arc-Une 40 A 13.0 ---------- a-b-c = - -59636 = 7 22:57 40740007 Dark 60 = A 13.0 ---------- a-b-c - -59636 8 23:02 = 40740008 Arc---- 30 A 13.0 = ---------- a-b-c - - = FPI59636 9 02:01 40740009 = Object 43 A 13.0 16716-3729 = a-b-c 0.93-59636 10 = 02:08 40740010 Object 43 B 13.5 = 16716-3729 a-b-c 1.43-59636 11 02:17 40740011 Object = 43 A 13.0 16716-3730 a-b-c 0.93-59636 12 02:25 40740012 = Object 43 B 13.5 16716-3730 = a-b-c 1.42-59636 13 = 02:34 40740013 Object 43 A 13.0 = 16716-3731 a-b-c 0.94-59636 14 02:42 40740014 Object = 43 B 13.5 16716-3731 a-b-c 1.43-59636 15 02:48 40740015 = Object 28 A 13.0 16716-3732 = a-b-c 0.99-59636 16 = 02:58 40740016 Object 43 A 13.0 = 16716-3732 a-b-c 0.94-59636 17 03:06 40740017 Object = 43 B 13.5 16716-3732 a-b-c 1.43-59636 18 03:07 40740018 = DomeFlat 5 B 13.5 16716-3732 a-b-c = -14259636 19 03:27 = 40740019 Object 43 A 13.0 = 4791-3733 a-b-c 0.93-59636 20 03:35 40740020 Object = 43 B 13.5 4791-3733 a-b-c 1.43-59636 21 03:36 = 40740021 DomeFlat 5 B 13.5 4791-3733 = a-b-c -14559636 = 22 03:56 40740022 Object 43 A = 13.0 36183-3734 a-b-c 0.93-59636 23 04:03 40740023 Object = 43 B 13.5 36183-3734 a-b-c 1.43-59636 24 04:12 40740024 = Object 43 A 13.0 36183-3735 = a-b-c 0.93-59636 25 = 04:20 40740025 Object 43 B 13.5 = 36183-3735 a-b-c 1.43-59636 26 04:31 40740026 Object = 43 A 13.0 36183-3736 a-b-c 0.93-59636 27 04:38 40740027 = Object 43 B 13.5 36183-3736 = a-b-c 1.43-59636 28 = 04:47 40740028 Object 43 A 13.0 = 36183-3737 a-b-c 0.94-59636 29 04:55 40740029 Object = 43 B 13.5 36183-3737 a-b-c 1.43-59636 30 05:04 40740030 = Object 43 A 13.0 36183-3739 = a-b-c 0.94-59636 31 = 05:12 40740031 Object 43 B 13.5 = 36183-3739 a-b-c 1.42-59636 32 05:21 40740032 Object = 43 A 13.0 36183-3740 a-b-c 0.93-59636 33 05:29 40740033 = Object 43 B 13.5 36183-3740 = a-b-c 1.43-59636 34 = 05:39 40740034 Object 43 A 13.0 = 36183-3741 a-b-c 0.93-59636 35 05:46 40740035 Object = 43 B 13.5 36183-3741 a-b-c 1.44-59636 36 06:16 40740036 = DomeFlat 5 B 13.5 36183-3742 a-b-c = -14459636 37 06:54 = 40740037 Object 43 A 13.0 = 28911-3743 a-b-c 0.94-59636 38 07:02 40740038 Object = 43 B 13.5 28911-3743 a-b-c 1.43-59636 39 08:20 40740039 = Object 43 A 13.0 28912-3744 = a-b-c 0.94-59636 40 = 08:28 40740040 Object 43 B 13.5 = 28912-3744 a-b-c 1.43-59636 41 08:40 40740041 Object = 43 A 13.0 28913-3745 a-b-c 0.94-59636 42 08:48 40740042 = Object 43 B 13.5 28913-3745 = a-b-c 1.43-59636 43 = 08:58 40740043 Object 43 A 13.0 = 28914-3746 a-b-c 0.94-59636 44 09:05 40740044 Object = 43 B 13.5 28914-3746 a-b-c 1.43-59636 45 09:14 40740045 = Object 43 A 13.0 28911-3747 = a-b-c 0.94-59636 46 = 09:22 40740046 Object 43 B 13.5 = 28911-3747 a-b-c 1.43-59636 47 09:23 40740047 DomeFlat 5 = B 13.5 34479-3748 a-b-c -15059636 48 09:43 40740048 = Object 43 A 13.0 34479-3748 = a-b-c 0.94-59636 49 = 09:50 40740049 Object 43 B 13.5 = 34479-3748 a-b-c 1.43-59636 50 10:02 40740050 Object = 43 A 13.0 34480-3749 a-b-c 0.94-59636 51 10:09 40740051 = Object 43 B 13.5 34480-3749 = a-b-c 1.43-59636 52 = 10:18 40740052 Object 43 A 13.0 = 34481-3750 a-b-c 0.94-59636 53 10:26 40740053 Object = 43 B 13.5 34481-3750 a-b-c 1.43-59636 54 10:35 40740054 = Object 43 A 13.0 34482-3751 = a-b-c 0.93-59636 55 = 10:43 40740055 Object 43 B 13.5 = 34482-3751 a-b-c 1.42-59636 56 10:44 40740056 DomeFlat 5 = B 13.5 34482-3751 a-b-c -14659636 57 11:08 40740057 = Object 43 A 13.0 14688-3754 = a-b-c 0.93-59636 58 = 11:16 40740058 Object 43 B 13.5 = 14688-3754 a-b-c 1.42-59636 59 11:18 40740059 DomeFlat 5 = B 13.5 14688-3754 a-b-c -14759636 60 11:36 40740060 = Object 43 A 13.0 10857-3755 = a-b-c 0.93-59636 61 = 11:44 40740061 Object 43 B 13.5 = 10857-3755 a-b-c 1.43-59636 62 11:53 40740062 Object = 43 A 13.0 10858-3756 a-b-c 0.94-59636 63 12:01 40740063 = Object 43 B 13.5 10858-3756 = a-b-c 1.42-59636 64 = 12:02 40740064 DomeFlat 5 B 13.5 = 9196-3757 a-b-c -14859636 65 12:06 40740065 Object = 10 A 13.0 10858-3758 a-b-c 0.94-59636 66 12:14 40740066 = Object 43 A 13.0 10858-3758 = a-b-c 0.94-59636 67 = 12:21 40740067 Object 43 B 13.5 = 10858-3758 a-b-c 1.43- cannot read file : = /data/apogee/utr_cdr/59636/apRaw-40740068.fits---------------------------------------------------------------= ------------------- eBOSS Data Summary ----Reading FITS from /data/spectro//59636- - - - = - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- -n Time Filename = design-field cfg flav shu Exp = colA colB colC = Hrt- - - - - - - - - - - - - - - - - - - - - - - - - - - = - - - - - - - - --- -1 = 22:14 b1-00338009 ----------- ---- bia Clo 0.0 = -6689 -6539-79202 22:14 = r1-00338009 ----------- ---- bia Clo 0.0 -6689 = -6539-79203 22:16 b1-00338010 = ----------- ---- dar Clo 20.0 -6689 -6539-79204 22:16 r1-00338010 ----------- ---- dar = Clo 20.0 -6689 -6539-79205 22:17 r1-00338011 34479-16169 3726 arc Lef = 4.1 -6689 -6539-7920HART6 22:17 b1-00338011 34479-16169 3726 arc = Lef 4.1 -6689 -6539-7920HART7 22:18 r1-00338012 34479-16169 3726 arc = Rig 4.1 -6689 -6539-7920HART8 22:18 b1-00338012 34479-16169 3726 arc = Rig 4.1 -6689 -6539-7920HART9 22:19 b1-00338013 34479-16169 3726 arc = Out 4.1 -5194 -5043-642510 22:19 r1-00338013 34479-16169 3726 arc Out = 4.1 -5194 -5043-642511 22:25 b1-00338014 34479-16169 3726 fla Out = 30.1 -5194 -5043-642512 22:25 r1-00338014 34479-16169 3726 fla Out = 30.1 -5194 -5043-642513 01:29 b1-00338015 16716-19942 3729 arc Lef = 4.1 -5194 -5043-6425HART14 01:29 r1-00338015 16716-19942 3729 arc = Lef 4.1 -5194 -5043-6425HART15 01:30 b1-00338016 16716-19942 3729 arc = Rig 4.1 -5194 -5043-6425HART16 01:30 r1-00338016 16716-19942 3729 arc = Rig 4.1 -5194 -5043-6425HART17 01:31 r1-00338017 16716-19942 3729 arc = Out 4.1 -2727 -2577-395818 01:31 b1-00338017 16716-19942 3729 arc Out = 4.1 -2727 -2577-395819 01:34 b1-00338018 16716-19942 3729 fla Out = 25.1 -2727 -2577-395820 01:34 r1-00338018 16716-19942 3729 fla Out = 25.1 -2727 -2577-395821 01:53 b1-00338019 16716-19942 3729 sci Out 900.1 = -2727 -2577-395822 01:53 = r1-00338019 16716-19942 3729 sci Out 900.1 -2727 = -2577-395823 02:10 b1-00338020 = 16716-19942 3730 sci Out 900.1 -2727 -2577-395824 02:10 r1-00338020 16716-19942 3730 sci = Out 900.1 -2727 -2577-395825 02:27 r1-00338021 16716-19942 3731 sci Out 900.0 = -2727 -2577-395826 02:27 = b1-00338021 16716-19942 3731 sci Out 900.0 -2727 = -2577-395827 02:51 r1-00338023 = 16716-19942 3732 sci Out 900.1 -2727 -2577-395828 02:51 b1-00338023 16716-19942 3732 sci = Out 900.1 -2727 -2577-395829 03:12 r1-00338024 4791-17049 3733 arc Lef = 4.1 -2727 -2577 -3958HART30 03:12 b1-00338024 4791-17049 3733 arc = Lef 4.1 -2727 -2577 -3958HART31 03:13 r1-00338025 4791-17049 3733 arc = Rig 4.1 -2727 -2577 -3958HART32 03:13 b1-00338025 4791-17049 3733 arc = Rig 4.1 -2727 -2577 -3958HART33 03:14 r1-00338026 4791-17049 3733 arc = Out 4.1 -4643 -4494 -587634 03:14 b1-00338026 4791-17049 3733 arc Out = 4.1 -4643 -4494 -587635= 03:17 b1-00338027 4791-17049 3733 fla Out 25.1 -4643 = -4494 -587636 03:17 r1-00338027 4791-17049 = 3733 fla Out 25.1 -4643 -4494 -587637 03:20 b1-00338028 4791-17049 3733 sci Out 900.1 = -4643 -4494 -587638 03:20 r1-00338028 = 4791-17049 3733 sci Out 900.1 -4643 -4494 = -587639 03:40 r1-00338029 36183-21152 3734 arc Lef = 4.1 -4643 -4494-5876HART40 03:40 b1-00338029 36183-21152 3734 arc = Lef 4.1 -4643 -4494-5876HART41 03:40 r1-00338030 36183-21152 3734 arc = Rig 4.1 -4643 -4494-5876HART42 03:40 b1-00338030 36183-21152 3734 arc = Rig 4.1 -4643 -4494-5876HART43 03:41 b1-00338031 36183-21152 3734 arc = Out 4.1 -4112 -3962-534344 03:41 r1-00338031 36183-21152 3734 arc Out = 4.1 -4112 -3962-534345 03:44 r1-00338032 36183-21152 3734 fla Out = 25.1 -4112 -3962-534346 03:44 b1-00338032 36183-21152 3734 fla Out = 25.1 -4112 -3962-534347 03:49 r1-00338033 36183-21152 3734 sci Out 900.1 = -4112 -3962-534348 03:49 = b1-00338033 36183-21152 3734 sci Out 900.1 -4112 = -3962-534349 04:05 r1-00338034 = 36183-21152 3735 sci Out 900.1 -4112 -3962-534350 04:05 b1-00338034 36183-21152 3735 sci = Out 900.1 -4112 -3962-534351 04:23 b1-00338035 36183-21152 3736 sci Out 900.1 = -4112 -3962-534352 04:23 = r1-00338035 36183-21152 3736 sci Out 900.1 -4112 = -3962-534353 04:40 r1-00338036 = 36183-21152 3737 sci Out 900.1 -4112 -3962-534354 04:40 b1-00338036 36183-21152 3737 sci = Out 900.1 -4112 -3962-534355 04:57 r1-00338037 36183-21152 3739 sci Out 900.1 = -4112 -3962-534356 04:57 = b1-00338037 36183-21152 3739 sci Out 900.1 -4112 = -3962-534357 05:14 r1-00338038 = 36183-21152 3740 sci Out 900.1 -4112 -3962-534358 05:14 b1-00338038 36183-21152 3740 sci = Out 900.1 -4112 -3962-534359 05:32 b1-00338039 36183-21152 3741 sci Out 900.1 = -4112 -3962-534360 05:32 = r1-00338039 36183-21152 3741 sci Out 900.1 -4112 = -3962-534361 06:23 r1-00338040 = 28911-16165 3743 arc Lef 4.1 -4112 = -3962-5343HART62 = 06:23 b1-00338040 28911-16165 3743 arc Lef 4.1 = -4112 -3962-5343HART63 06:24 b1-00338041 28911-16165 3743 arc Rig = 4.1 -4112 -3962-5343HART64 06:24 r1-00338041 28911-16165 3743 arc = Rig 4.1 -4112 -3962-5343HART65 06:32 r1-00338042 28911-16165 3743 arc = Lef 4.1 -4875 -4726-6109HART66 06:32 b1-00338042 28911-16165 3743 arc = Lef 4.1 -4875 -4726-6109HART67 06:33 r1-00338043 28911-16165 3743 arc = Rig 4.1 -4875 -4726-6109HART68 06:33 b1-00338043 28911-16165 3743 arc = Rig 4.1 -4875 -4726-6109HART69 06:34 r1-00338044 28911-16165 3743 arc = Out 4.1 -4023 -3873-525470 06:34 b1-00338044 28911-16165 3743 arc Out = 4.1 -4023 -3873-525471 06:37 r1-00338045 28911-16165 3743 fla Out = 25.1 -4023 -3873-525472 06:37 b1-00338045 28911-16165 3743 fla Out = 25.1 -4023 -3873-525473 06:47 b1-00338046 28911-16165 3743 sci Out 900.1 = -4023 -3873-525474 06:47 = r1-00338046 28911-16165 3743 sci Out 900.1 -4023 = -3873-525475 08:13 b1-00338047 = 28912-16165 3744 sci Out 900.1 -4023 -3873-525476 08:13 r1-00338047 28912-16165 3744 sci = Out 900.1 -4023 -3873-525477 08:33 r1-00338048 28913-16165 3745 sci Out 900.1 = -4023 -3873-525478 08:33 = b1-00338048 28913-16165 3745 sci Out 900.1 -4023 = -3873-525479 08:50 b1-00338049 = 28914-16165 3746 sci Out 900.1 -4023 -3873-525480 08:50 r1-00338049 28914-16165 3746 sci = Out 900.1 -4023 -3873-525481 09:07 r1-00338050 28911-16165 3747 sci Out 900.1 = -4023 -3873-525482 09:07 = b1-00338050 28911-16165 3747 sci Out 900.1 -4023 = -3873-525483 09:27 b1-00338051 = 34479-16169 3748 arc Lef 4.1 -4023 = -3873-5254HART84 = 09:27 r1-00338051 34479-16169 3748 arc Lef 4.1 = -4023 -3873-5254HART85 09:27 r1-00338052 34479-16169 3748 arc Rig = 4.1 -4023 -3873-5254HART86 09:27 b1-00338052 34479-16169 3748 arc = Rig 4.1 -4023 -3873-5254HART87 09:28 b1-00338053 34479-16169 3748 arc = Out 4.1 -4155 -4006-538688 09:28 r1-00338053 34479-16169 3748 arc Out = 4.1 -4155 -4006-538689 09:32 r1-00338054 34479-16169 3748 fla Out = 25.1 -4155 -4006-538690 09:32 b1-00338054 34479-16169 3748 fla Out = 25.1 -4155 -4006-538691 09:35 r1-00338055 34479-16169 3748 sci Out 900.1 = -4155 -4006-538692 09:35 = b1-00338055 34479-16169 3748 sci Out 900.1 -4155 = -4006-538693 09:55 b1-00338056 = 34480-16169 3749 sci Out 900.1 -4155 -4006-538694 09:55 r1-00338056 34480-16169 3749 sci = Out 900.1 -4155 -4006-538695 10:11 r1-00338057 34481-16169 3750 sci Out 900.1 = -4155 -4006-538696 10:11 = b1-00338057 34481-16169 3750 sci Out 900.1 -4155 = -4006-538697 10:28 b1-00338058 = 34482-16169 3751 sci Out 900.1 -4155 -4006-538698 10:28 r1-00338058 34482-16169 3751 sci = Out 900.1 -4155 -4006-538699 10:47 b1-00338059 14688-19484 3752 arc Lef = 4.1 -4155 -4006-5386HART100 10:47 r1-00338059 14688-19484 3752 arc = Lef 4.1 -4155 -4006-5386HART101 10:48 b1-00338060 14688-19484 3752 arc = Rig 4.1 -4155 -4006-5386HART102 10:48 r1-00338060 14688-19484 3752 arc = Rig 4.1 -4155 -4006-5386HART103 10:49 b1-00338061 14688-19484 3752 arc = Out 4.1 -4125 -3976-5358104 10:49 r1-00338061 14688-19484 3752 arc Out = 4.1 -4125 -3976-5358105 10:57 b1-00338062 14688-19484 3754 fla Out = 25.1 -4125 -3976-5358106 10:57 r1-00338062 14688-19484 3754 fla Out = 25.1 -4125 -3976-5358107 11:01 r1-00338063 14688-19484 3754 sci Out 900.1 = -4125 -3976-5358108 11:01 = b1-00338063 14688-19484 3754 sci Out 900.1 -4125 = -3976-5358109 11:20 r1-00338064 = 10857-18559 3755 arc Lef 4.1 -4125 = -3976-5358HART110 = 11:20 b1-00338064 10857-18559 3755 arc Lef 4.1 = -4125 -3976-5358HART111 11:21 r1-00338065 10857-18559 3755 arc Rig = 4.1 -4125 -3976-5358HART112 11:21 b1-00338065 10857-18559 3755 arc = Rig 4.1 -4125 -3976-5358HART113 11:22 b1-00338066 10857-18559 3755 arc = Out 4.1 -3436 -3283-4666114 11:22 r1-00338066 10857-18559 3755 arc Out = 4.1 -3436 -3283-4666115 11:25 r1-00338067 10857-18559 3755 fla Out = 25.1 -3436 -3283-4666116 11:25 b1-00338067 10857-18559 3755 fla Out = 25.1 -3436 -3283-4666117 11:29 r1-00338068 10857-18559 3755 sci Out 900.1 = -3436 -3283-4666118 11:29 = b1-00338068 10857-18559 3755 sci Out 900.1 -3436 = -3283-4666119 11:46 r1-00338069 = 10858-18559 3756 sci Out 900.1 -3436 -3283-4666120 11:46 b1-00338069 10858-18559 3756 = sci Out 900.1 -3436 -3283-4666121 12:07 r1-00338071 10858-18559 3758 sci Out 900.1 = -3436 -3283-4666122 12:07 = b1-00338071 10858-18559 3758 sci Out 900.1 -3436 = -3283-4666123 12:32 r1-00338072 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666124 12:32 b1-00338072 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666125 12:33 r1-00338073 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666126 12:33 b1-00338073 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666127 12:34 b1-00338074 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666128 12:34 r1-00338074 = ----------- ---- bia Clo 0.0 -3436 = -3283-4666---- BOSS Spectrographs Collimation ----Time TSP1 = R1 B1 Move1 = B1Resid=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D22:19:00 2.8 1319 -5.2 = 1495 -0.601:30:40 2.0 = 1979 -9.3 2467 -1.503:13:50 1.4 -1649 6.8 = -1917 0.803:41:30 1.5 = 1319 0.8 531 = 2.506:24:40 2.0 = 659 6.8 -763 = 4.506:34:00 2.0 = 1319 -1.2 852 1.509:28:20 1.6 -329 -0.2 = -132 -0.610:48:40 1.2 = -329 -1.2 28 -1.111:22:10 1.2 1319 -0.2 = 691 2.0---- Miscellaneous ----[observer@sdss5-hub: sdss5]$ list_ap -m 59635APOGEE data list, mjd=3D59635, allraw_data: /data/apogee/utr_cdr/59635/apRaw-*.fitsarchive: = /data/apogee/archive/59635/apR-[a,b,c]-*.apzquickred:= /data/apogee/quickred/59635/apq-*.fits---------------------------------------------------------------= ---------------mjd i = UT File/Exp Imtype Nread A/B Dth = Design-Cfg Arch Offset%Flux Comm---------------------------------------------------------------= ---------------59635 53 11:52 40730053 = Dark 60 B 13.5 = ---------- a-b-c - -59635 54 12:02 40730054 Dark = 60 B 13.5 ---------- a-b-c = - -59635 55 = 12:13 40730055 Dark 60 B = 13.5 ---------- a-b-c - -59635 56 12:15 40730056 = QuarFlat 10 B 13.5 ---------- a-b-c = - 9859635 57 = 12:17 40730057 QuarFlat 10 B 13.5 = ---------- a-b-c - 9859635 58 12:18 40730058 QuarFlat 10 = B 13.5 ---------- a-b-c - 9959635 59 12:21 40730059 = Arc-Thar 12 B 13.5 ---------- a-b-c = 1.58-59635 60 12:28 = 40730060 Arc-Une 40 B 13.5 = ---------- a-b-c - -59635 61 12:30 40730061 Arc-Thar 12 A = 13.0 ---------- a-b-c 0.99-59635 62 12:37 40730062 Arc-Une 40 = A 13.0 ---------- a-b-c - -59635 63 12:43 40730063 = Dark 30 A 13.0 = ---------- a-b-c - -59635 64 12:48 40730064 InteFlat 30 A = 13.0 ---------- a-b-c -27959635 65 12:53 40730065 = InteFlat 30 A 13.0 ---------- a-b-c = -27959635 66 12:59 = 40730066 InteFlat 30 A 13.0 ---------- = a-b-c -27959635 = 67 13:04 40730067 Dark 30 = A 13.0 ---------- a-b-c - -59635 68 13:10 40730068 = Arc---- 30 A 13.0 ---------- a-b-c = - - FPI---------------------------------------------------------------= ------------------- = Problems in Detail ----This problem was = seen previously on Feb 9th. The APOGEE exposureabortedafter26 reads. We = used the same protocol to restart the exposure. No otherinformation or resolution of this problem since the 9th.02:48:17 APO.apo_2.apogee 2385 = apogee f errorMessage=3D"cannot executecommand: = Controller is busy..."02:48:17 CmdDone: APO.apo_2.apogee = 2385 apogee expose time=3D459.0object=3Dobject02:48:17 APO.apo_2 34 hal e error=3D"Command 'apogee expose = time=3D459.0object=3Dobject' failed."02:48:17 APO.apo_2.cherno 2355 cherno f error=3D"Command = 'acquire -c -t15.0' failed because of an uncaught error = 'ExposerError: Expose commandfailed.'. See traceback in = the log for more information.02:48:17 APO.apo_2 34 hal w = text=3D"Running cleanup tasks."02:48:22 APO.apo_2 34 hal = w text=3D"Cancelling current APOGEE exposure."02:48:22 = APO.apo_2 34 hal w text=3D"Cancelling current BOSS exposure."02:48:22 APO.apo_2.boss 2381 boss f text=3D"exposure = aborted"02:48:22 CmdDone: APO.apo_2.boss 2381 boss = exposure science itime=3D900.002:48:22 .boss 466 boss w = text=3D"this command has already beenfinished!!!!(client.v1451 466): exposure science itime=3D900.0"02:48:22 .boss 466 boss w text=3D"this command has already = beenfinished!!!!(client.v1451 466): = exposure science itime=3D900.0"12:13Z = Boson on obs2 error message when restarting it. Message = appearedin apopup window indicating a Java = Script error in the main process:Uncaught = Exception:Error: The 'screen' module can't be used before = the app 'ready' eventat createScreenIfNeeded = (node:electron/js2c/browser_init:125:261)at Object.get = (node:electron/js2c/browser_init:125:303)at = createWindow(/Applications/boson.app/Contents/Resources/app.asar/build/src/= main/main.js:99:40)at App.(/Applications/boson.app/Contents/Resources/app.asar/build/src/= main/main.js:198:9)at App.emit (node:events:390:28)Clicking ok on the window brought the Boson = windows up. Not sure whathappened.____________________________________________________________Logs of Nightly APO Activities https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/= index.html__________________________________________________= __________Logs of Nightly APO Activities https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/= index.html= --Apple-Mail=_51FD160B-7F3F-4423-9903-4D0B2DB4D0AC--