Subject: 2.5m obslog 20220901 (SJD 59824) From: kgrabowski@apo.nmsu.edu Date: Fri, 2 Sep 2022 10:53:22 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday September 01, 2022 (SJD 59824) ---- Observing Team ---- Katie Grabowski Audrey Oravetz Dylan Gatlin (testing FVC code) ---- Observing Plan ---- Thu 01 Sep 2022 59824 0.34 02:22 02:37 11:28 18:19 03:11 --- dark ( 8.9 h) plus 0.3 h for 12 deg design ---- Observing Summary ---- Lost entire night due to humidity and clouds. Tried new cloudy night task with different designs that have been skipped, at different altitudes. Observed: --------- Time field-dsgn-conf Design type BOSS/APOGEE exp complete? Comment =========================================================================== 03:25:53 101740-119127-6510 Alt=40, Design failed due to positioner 437 03:35:42 101740-119127-6512 Alt=60, --no-clone, design failed 03:41:41 101740-119127-6513 Alt=80, executing design failed 03:48:14 101159-116799-6514 alt=80 Took FVC loops at different designs 04:00:56 101159-116799-6516 alt=60 known successful design with data 04:07:20 101159-116799-6517 alt=40 04:20:14 101731-119026-6519 alt=40 No trouble with this design. Previous 04:38:00 101731-119026-6522 alt=60 SJD it failed but was observed later. 04:47:04 101731-119026-6523 alt=80 04:55:40 100524-39030-6524 alt=80 Design failed due to positioner 1201 05:00:03 100524-39030-6525 alt=60 regardless of altitude 05:03:08 100524-39030-6526 alt=40 05:06:01 101728-119013-6527 alt=40 No trouble with this design tonight. 05:11:51 101728-119013-6528 alt=60 First night it was attempted and skipped. 05:18:54 101728-119013-6529 alt=80 Following night it was observed. 05:23:58 104598-57351-6530 alt=80 No trouble with this design tonight. 05:33:35 104598-57351-6531 alt=60 Positioner 1093 was previously disabled. 05:40:24 104598-57351-6532 alt=40 05:46:23 100524-39030-6533 (alt=30) Same positioner errors as above 05:48:20 100524-39030-6534 --no-clone 05:50:51 101740-119127-6535 (alt=30) 05:53:06 101740-119127-6536 --no-clone Notes: ------ The optidew sensors are the only values on the weather status page reading the correct RH value of 90%. It is likely because the other dewpoints are close to zero (Our dewpoint is 0.3, and the 3.5m Air dewpoint is reading -0.3C), while the Optidew is reading 10.1C. We know the difference is likely closer to 1.5C than other values because the railing and enclosure door have condensation. Enclosure is actually reading 87% humidity. ---- Observing Log ---- Afternoon: =========== All systems alive and responsive. 08:27Z-Started APOGEE calibrations. 00:09:52 boss exposure 0.0, file=345721 00:11:15 boss exposure 20.0, file=345722 00:13:02 boss exposure 4.0, file=345723 00:13:43 boss exposure 4.0, file=345724 00:14:26 sp1.motor.move= 1326, 1325, 1325 00:14:26 Hartmann collimate output sp1: offset: r= 659 (In Focus); b= -6.2 (Out of focus) sp1: pred. move: spAverageMove= 1325 sp1: pred. resid: r= -666, b= -2.1, txt= OK, spTemp = 10.3 00:14:45 boss exposure 4.0, file=345725 00:16:21 boss exposure 25.0, file=345726 00:26:27 OBSERVER.kgrabow 188 fliswarm i filename=fvc,fvc1n,/data/fcam/59824/fimg-fvc1n-0001.fits 00:25:22 boss exposure 300.0, file=345727 No errant light in images. Fiducials ok. Telescope ready to go. Delayed ventilation due to thick clouds and humidity. Night: ======= 02:12:06 Config Loaded: -999--999-6509 Dylan tested some FVC loop code. 02:12:54 APO.dgatlin 6 jaeger d text="[FVC]: Finished processing /data/fcam/59824/fimg-fvc1n-0002.fits" 02:12:54 APO.dgatlin 6 jaeger i fvc_rms=45.580000000000005 02:12:54 APO.dgatlin 6 jaeger i fvc_perc_90=66.60000000000001 02:12:54 APO.dgatlin 6 jaeger i fvc_percent_reached=1.2 Output from FVC fit log: 02:12:59 RMS: 45.58 Delta: 31.84 Image: 0002 02:47:05 APO.dgatlin 8 jaeger i fvc_rms=45.73 02:47:05 APO.dgatlin 8 jaeger i fvc_perc_90=67.0 02:47:05 APO.dgatlin 8 jaeger i fvc_percent_reached=1.2 02:47:10 RMS: 45.73 Delta: 31.84 Image: 0003 02:48:48 APO.dgatlin 9 jaeger i fvc_rms=45.5 02:48:48 APO.dgatlin 9 jaeger i fvc_perc_90=66.10000000000001 02:48:48 APO.dgatlin 9 jaeger i fvc_percent_reached=1.8 02:48:52 RMS: 45.5 Delta: 31.84 Image: 0004 02:50:51 APO.dgatlin 10 jaeger i fvc_rms=45.690000000000005 02:50:51 APO.dgatlin 10 jaeger i fvc_perc_90=66.5 02:50:51 APO.dgatlin 10 jaeger i fvc_percent_reached=1.0 02:50:55 RMS: 45.69 Delta: 31.84 Image: 0005 02:51:52 APO.dgatlin 11 jaeger i fvc_rms=45.49 02:51:52 APO.dgatlin 11 jaeger i fvc_perc_90=67.2 02:51:52 APO.dgatlin 11 jaeger i fvc_percent_reached=2.4 02:51:57 RMS: 45.49 Delta: 31.84 Image: 0006 Cloudy night task: troublesome designs at various altitudes ------------------------------------------------------------- Sample of script to load a design and take an fvc loop: tcc track 121,40 mount jaeger configuration load 119026 jaeger configuration execute tcc axis stop rot jaeger fvc loop jaeger configuration reverse 03:25:53 Config Loaded: 101740-119127-6510 Altitude 40 degrees: 03:29:03 .jaeger 0 jaeger w text="Positioner 437 replied to SEND_TRAJECTORY_DATA UID=68486 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:29:03 .jaeger 0 jaeger w text="Positioner 437 replied to SEND_TRAJECTORY_DATA UID=68486 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:29:03 OBSERVER.kgrabow 196 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" Robots didn't move, no FVC loop taken. Altitude 60 degrees: 03:34:33 Config Loaded: 101740-119127-6511 (cloned) 03:35:42 Config Loaded: 101740-119127-6512 [loaded with --no-clone] 03:36:23 .jaeger 0 jaeger w text="Positioner 437 replied to SEND_TRAJECTORY_DATA UID=68505 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:36:23 OBSERVER.kgrabow 202 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0002.json 03:36:23 OBSERVER.kgrabow 202 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" Robots didn't move, no FVC loop taken. Altitude 80 degrees: 03:41:41 Config Loaded: 101740-119127-6513 03:41:59 .jaeger 0 jaeger w text="Positioner 437 replied to SEND_TRAJECTORY_DATA UID=68523 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 03:41:59 OBSERVER.kgrabow 205 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0003.json 03:41:59 OBSERVER.kgrabow 205 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 03:41:59 CmdDone: OBSERVER.kgrabow 205 jaeger configuration execute The offending robot and configuration doesn't seem to change with altitude. This design was also attempted on SJD 59806 and had trouble with the same robot. We will try configuring a successful design to see how it is affected by altitude. Altitude 80 degrees 03:48:14 Config Loaded: 101159-116799-6514 03:49:30 OBSERVER.kgrabow 209 jaeger i text="FVC iteration 1" 03:49:50 OBSERVER.kgrabow 209 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0007.fits 03:49:56 OBSERVER.kgrabow 209 jaeger i fvc_rms=45.510000000000005 03:49:56 OBSERVER.kgrabow 209 jaeger i fvc_perc_90=63.9 03:49:56 OBSERVER.kgrabow 209 jaeger i fvc_percent_reached=1.7 03:50:12 OBSERVER.kgrabow 209 jaeger i text="FVC iteration 2" 03:50:32 OBSERVER.kgrabow 209 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0008.fits 03:50:38 OBSERVER.kgrabow 209 jaeger i fvc_rms=7.52 03:50:38 OBSERVER.kgrabow 209 jaeger i fvc_deltarms=37.99000000000001 03:50:38 OBSERVER.kgrabow 209 jaeger i fvc_perc_90=9.6 03:50:38 OBSERVER.kgrabow 209 jaeger i fvc_percent_reached=56.6 03:50:38 OBSERVER.kgrabow 209 jaeger i text="Target 90% percentile reached." 03:50:54 RMS: 7.52 Delta: 37.99 Image: 0008 jaeger configuration reverse Altitude 60 degrees: 04:00:56 Config Loaded: 101159-116799-6516 [--no-clone option] 04:02:48 OBSERVER.kgrabow 214 jaeger i text="FVC iteration 1" 04:03:08 OBSERVER.kgrabow 214 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0009.fits 04:03:14 OBSERVER.kgrabow 214 jaeger i fvc_rms=50.56 04:03:14 OBSERVER.kgrabow 214 jaeger i fvc_perc_90=65.5 04:03:14 OBSERVER.kgrabow 214 jaeger i fvc_percent_reached=2.1 04:03:31 OBSERVER.kgrabow 214 jaeger i text="FVC iteration 2" 04:03:50 OBSERVER.kgrabow 214 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0010.fits 04:03:57 OBSERVER.kgrabow 214 jaeger i fvc_rms=8.07 04:03:57 OBSERVER.kgrabow 214 jaeger i fvc_deltarms=42.49 04:03:57 OBSERVER.kgrabow 214 jaeger i fvc_perc_90=11.299999999999999 04:03:57 OBSERVER.kgrabow 214 jaeger i fvc_percent_reached=41.9 04:03:57 OBSERVER.kgrabow 214 jaeger i text="Target 90% percentile reached." 04:04:13 RMS: 8.07 Delta: 42.49 Image: 0010 jaeger configuration reverse Altitude 40 degrees: 04:07:20 Config Loaded: 101159-116799-6517 04:08:44 OBSERVER.kgrabow 218 jaeger i text="FVC iteration 1" 04:09:03 OBSERVER.kgrabow 218 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0011.fits 04:09:10 OBSERVER.kgrabow 218 jaeger i fvc_rms=50.07 04:09:10 OBSERVER.kgrabow 218 jaeger i fvc_perc_90=64.3 04:09:10 OBSERVER.kgrabow 218 jaeger i fvc_percent_reached=1.6 04:09:26 OBSERVER.kgrabow 218 jaeger i text="FVC iteration 2" 04:09:46 OBSERVER.kgrabow 218 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0012.fits 04:09:52 OBSERVER.kgrabow 218 jaeger i fvc_rms=7.23 04:09:52 OBSERVER.kgrabow 218 jaeger i fvc_deltarms=42.84 04:09:52 OBSERVER.kgrabow 218 jaeger i fvc_perc_90=9.299999999999999 04:09:52 OBSERVER.kgrabow 218 jaeger i fvc_percent_reached=57.6 04:09:52 OBSERVER.kgrabow 218 jaeger i text="Target 90% percentile reached." 04:10:08 RMS: 7.23 Delta: 42.84 Image: 0012 04:20:14 Config Loaded: 101731-119026-6519 04:23:03 OBSERVER.kgrabow 224 jaeger i text="FVC iteration 1" 04:23:22 OBSERVER.kgrabow 224 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0013.fits 04:23:28 OBSERVER.kgrabow 224 jaeger i fvc_rms=46.1 04:23:28 OBSERVER.kgrabow 224 jaeger i fvc_perc_90=68.6 04:23:28 OBSERVER.kgrabow 224 jaeger i fvc_percent_reached=1.0 04:23:45 OBSERVER.kgrabow 224 jaeger i text="FVC iteration 2" 04:24:04 OBSERVER.kgrabow 224 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0014.fits 04:23:45 OBSERVER.kgrabow 224 jaeger i text="FVC iteration 2" 04:23:45 OBSERVER.kgrabow 224 jaeger d text="Taking exposure with fliswarm." 04:24:04 OBSERVER.kgrabow 224 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0014.fits 04:24:26 RMS: 9.54 Delta: 36.56 Image: 0014 No trouble with this design. When observed the night of 59806, it failed the first time, but not the second time it was attempted later in the night. We will try at other altitudes to see if there is a "sticking point" that will cause positioner 818 to cause problems with the trajectory. Altitude 60 degrees: 04:38:00 Config Loaded: 101731-119026-6522 04:41:44 OBSERVER.kgrabow 244 jaeger i text="FVC iteration 1" 04:42:03 OBSERVER.kgrabow 244 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0015.fits 04:42:10 OBSERVER.kgrabow 244 jaeger i fvc_rms=48.099999999999994 04:42:10 OBSERVER.kgrabow 244 jaeger i fvc_perc_90=68.7 04:42:10 OBSERVER.kgrabow 244 jaeger i fvc_percent_reached=2.1 04:42:26 OBSERVER.kgrabow 244 jaeger i text="FVC iteration 2" 04:42:45 OBSERVER.kgrabow 244 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0016.fits 04:42:52 OBSERVER.kgrabow 244 jaeger i fvc_rms=25.49 04:42:52 OBSERVER.kgrabow 244 jaeger i fvc_deltarms=22.609999999999996 04:42:52 OBSERVER.kgrabow 244 jaeger i fvc_perc_90=10.1 04:42:52 OBSERVER.kgrabow 244 jaeger i fvc_percent_reached=50.2 04:42:52 OBSERVER.kgrabow 244 jaeger i text="Target 90% percentile reached." 04:43:08 RMS: 25.49 Delta: 22.61 Image: 0016 Altitude 80 degrees: 04:47:04 Config Loaded: 101731-119026-6523 04:49:00 OBSERVER.kgrabow 250 jaeger i text="FVC iteration 1" 04:49:19 OBSERVER.kgrabow 250 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0017.fits 04:49:26 OBSERVER.kgrabow 250 jaeger i fvc_rms=50.8 04:49:26 OBSERVER.kgrabow 250 jaeger i fvc_perc_90=69.6 04:49:26 OBSERVER.kgrabow 250 jaeger i fvc_percent_reached=1.0 04:49:42 OBSERVER.kgrabow 250 jaeger i text="FVC iteration 2" 04:50:01 OBSERVER.kgrabow 250 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0018.fits 04:50:08 OBSERVER.kgrabow 250 jaeger i fvc_rms=8.52 04:50:08 OBSERVER.kgrabow 250 jaeger i fvc_deltarms=42.28 04:50:08 OBSERVER.kgrabow 250 jaeger i fvc_perc_90=9.299999999999999 04:50:08 OBSERVER.kgrabow 250 jaeger i fvc_percent_reached=51.5 04:50:08 OBSERVER.kgrabow 250 jaeger i text="Target 90% percentile reached." 04:50:24 RMS: 8.52 Delta: 42.28 Image: 0018 No issues loading this design at all tonight. 05:03:08 Config Loaded: 100524-39030-6526 05:03:21 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=69613 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 05:03:21 OBSERVER.kgrabow 259 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0026.json 05:03:21 OBSERVER.kgrabow 259 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 05:03:21 CmdDone: OBSERVER.kgrabow 259 jaeger configuration execute Altitude 80 degrees: 04:55:40 Config Loaded: 100524-39030-6524 04:55:45 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=69583 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 04:55:46 OBSERVER.kgrabow 253 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0024.json 04:55:46 OBSERVER.kgrabow 253 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 04:55:46 CmdDone: OBSERVER.kgrabow 253 jaeger configuration execute Same positioner as SJD 59805 Also failed at 60 and 40 degree altitudes 05:00:03 Config Loaded: 100524-39030-6525 (alt=60) 05:00:40 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=69598 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 05:00:40 OBSERVER.kgrabow 256 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0025.json 05:00:40 OBSERVER.kgrabow 256 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 05:00:40 CmdDone: OBSERVER.kgrabow 256 jaeger configuration execute 05:03:08 Config Loaded: 100524-39030-6526 (alt=40) 05:03:21 .jaeger 0 jaeger w text="Positioner 1201 replied to SEND_TRAJECTORY_DATA UID=69613 with 'VALUE_OUT_OF_RANGE'. (JaegerUserWarning)" 05:03:21 OBSERVER.kgrabow 259 jaeger d trajectory_dump_file=/data/logs/jaeger/trajectories/59824/trajectory-59824-0026.json 05:03:21 OBSERVER.kgrabow 259 jaeger f error="Trajectory failed with error: Something went wrong sending the trajectory: At least one SEND_TRAJECTORY_COMMAND failed" 05:03:21 CmdDone: OBSERVER.kgrabow 259 jaeger configuration execute 05:06:01 Config Loaded: 101728-119013-6527 (alt=40) 05:08:16 OBSERVER.kgrabow 263 jaeger i text="FVC iteration 1" 05:08:36 OBSERVER.kgrabow 263 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0019.fits 05:08:42 OBSERVER.kgrabow 263 jaeger i fvc_rms=46.65 05:08:42 OBSERVER.kgrabow 263 jaeger i fvc_perc_90=73.5 05:08:42 OBSERVER.kgrabow 263 jaeger i fvc_percent_reached=2.5 05:08:59 OBSERVER.kgrabow 263 jaeger i text="FVC iteration 2" 05:09:18 OBSERVER.kgrabow 263 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0020.fits 05:09:25 OBSERVER.kgrabow 263 jaeger i fvc_rms=7.43 05:09:25 OBSERVER.kgrabow 263 jaeger i fvc_deltarms=39.22 05:09:25 OBSERVER.kgrabow 263 jaeger i fvc_perc_90=9.299999999999999 05:09:25 OBSERVER.kgrabow 263 jaeger i fvc_percent_reached=59.1 05:09:25 OBSERVER.kgrabow 263 jaeger i text="Target 90% percentile reached." 05:09:41 RMS: 7.43 Delta: 39.22 Image: 0020 Altitude 60 degrees: 05:11:51 Config Loaded: 101728-119013-6528 05:13:59 OBSERVER.kgrabow 270 jaeger i text="FVC iteration 1" 05:14:18 OBSERVER.kgrabow 270 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0021.fits 05:14:24 OBSERVER.kgrabow 270 jaeger i fvc_rms=47.169999999999995 05:14:24 OBSERVER.kgrabow 270 jaeger i fvc_perc_90=72.7 05:14:24 OBSERVER.kgrabow 270 jaeger i fvc_percent_reached=2.7 05:14:41 OBSERVER.kgrabow 270 jaeger i text="FVC iteration 2" 05:15:00 OBSERVER.kgrabow 270 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0022.fits 05:15:22 RMS: 8.43 Delta: 38.74 Image: 0022 Altitude 80 degrees: 05:18:54 Config Loaded: 101728-119013-6529 05:20:19 OBSERVER.kgrabow 276 jaeger i text="FVC iteration 1" 05:20:38 OBSERVER.kgrabow 276 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0023.fits 05:20:45 OBSERVER.kgrabow 276 jaeger i fvc_rms=47.239999999999995 05:20:45 OBSERVER.kgrabow 276 jaeger i fvc_perc_90=71.7 05:20:45 OBSERVER.kgrabow 276 jaeger i fvc_percent_reached=2.9 05:21:01 OBSERVER.kgrabow 276 jaeger i text="FVC iteration 2" 05:21:21 OBSERVER.kgrabow 276 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0024.fits 05:21:27 OBSERVER.kgrabow 276 jaeger i fvc_rms=8.68 05:21:27 OBSERVER.kgrabow 276 jaeger i fvc_deltarms=38.559999999999995 05:21:27 OBSERVER.kgrabow 276 jaeger i fvc_perc_90=9.799999999999999 05:21:27 OBSERVER.kgrabow 276 jaeger i fvc_percent_reached=47.6 05:21:27 OBSERVER.kgrabow 276 jaeger i text="Target 90% percentile reached." 05:21:43 RMS: 8.68 Delta: 38.56 Image: 0024 Altitude 80 degrees: 05:23:58 Config Loaded: 104598-57351-6530 05:25:05 OBSERVER.kgrabow 280 jaeger i text="FVC iteration 1" 05:25:25 OBSERVER.kgrabow 280 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0025.fits 05:25:31 OBSERVER.kgrabow 280 jaeger i fvc_rms=51.53 05:25:31 OBSERVER.kgrabow 280 jaeger i fvc_perc_90=74.39999999999999 05:25:31 OBSERVER.kgrabow 280 jaeger i fvc_percent_reached=1.0 05:25:47 OBSERVER.kgrabow 280 jaeger i text="FVC iteration 2" 05:26:07 OBSERVER.kgrabow 280 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0026.fits 05:26:14 OBSERVER.kgrabow 280 jaeger i fvc_rms=7.63 05:26:14 OBSERVER.kgrabow 280 jaeger i fvc_deltarms=43.9 05:26:14 OBSERVER.kgrabow 280 jaeger i fvc_perc_90=10.0 05:26:14 OBSERVER.kgrabow 280 jaeger i fvc_percent_reached=56.0 05:26:14 OBSERVER.kgrabow 280 jaeger i text="Target 90% percentile reached." 05:26:29 RMS: 7.63 Delta: 43.9 Image: 0026 Snapshot image 31 shows 1176 and 1300 red Kaiju-collided. The robot that previously complained was 1093, which has been disabled. No trouble with jaeger configuration reverse. Altitude 60 degrees: 05:33:35 Config Loaded: 104598-57351-6531 05:35:29 OBSERVER.kgrabow 288 jaeger i text="FVC iteration 1" 05:35:48 OBSERVER.kgrabow 288 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0027.fits 05:35:54 OBSERVER.kgrabow 288 jaeger i fvc_rms=50.91 05:35:54 OBSERVER.kgrabow 288 jaeger i fvc_perc_90=72.0 05:35:54 OBSERVER.kgrabow 288 jaeger i fvc_percent_reached=1.7 05:36:11 OBSERVER.kgrabow 288 jaeger i text="FVC iteration 2" 05:36:31 OBSERVER.kgrabow 288 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0028.fits 05:36:37 OBSERVER.kgrabow 288 jaeger i fvc_rms=7.609999999999999 05:36:37 OBSERVER.kgrabow 288 jaeger i fvc_deltarms=43.3 05:36:37 OBSERVER.kgrabow 288 jaeger i fvc_perc_90=9.9 05:36:37 OBSERVER.kgrabow 288 jaeger i fvc_percent_reached=58.5 05:36:53 RMS: 7.61 Delta: 43.3 Image: 0028 Snapshot 34, robots 1300 and 1176 Kaiju-collided, but no trouble with reverse. Altitude 40 degrees: 05:40:24 Config Loaded: 104598-57351-6532 05:42:06 OBSERVER.kgrabow 294 jaeger i text="FVC iteration 1" 05:42:26 OBSERVER.kgrabow 294 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0029.fits 05:42:32 OBSERVER.kgrabow 294 jaeger i fvc_rms=50.63 05:42:32 OBSERVER.kgrabow 294 jaeger i fvc_perc_90=72.0 05:42:32 OBSERVER.kgrabow 294 jaeger i fvc_percent_reached=1.7 05:42:49 OBSERVER.kgrabow 294 jaeger i text="FVC iteration 2" 05:43:08 OBSERVER.kgrabow 294 jaeger d fvc_filename=/data/fcam/59824/fimg-fvc1n-0030.fits 05:43:14 OBSERVER.kgrabow 294 jaeger i fvc_rms=7.56 05:43:14 OBSERVER.kgrabow 294 jaeger i fvc_deltarms=43.07 05:43:15 OBSERVER.kgrabow 294 jaeger i fvc_perc_90=10.3 05:43:15 OBSERVER.kgrabow 294 jaeger i fvc_percent_reached=55.2 05:43:15 OBSERVER.kgrabow 294 jaeger i text="Target 90% percentile reached." 05:43:31 RMS: 7.56 Delta: 43.07 Image: 0030 No trouble at all reversing. Tested the execution of designs 39030 and 119127 at 30 degrees as well. Same positioner had errors as above, even when loading --no-clone. 05:46:23 Config Loaded: 100524-39030-6533 05:48:20 Config Loaded: 100524-39030-6534 05:50:51 Config Loaded: 101740-119127-6535 05:53:06 Config Loaded: 101740-119127-6536 Humidity and clouds kept us closed all night. 10:44Z- Started APOGEE cals. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0050 0.0060 Axial B: -0.0030 -0.0030 Axial C: 0.0010 0.0000 Trans D: 0.0130 0.0180 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5345 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 14.61 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -0.0480 -0.0490 Axial B: -0.0410 -0.0430 Axial C: -0.0660 -0.0670 Trans D: -0.2250 -0.2460 GALILS Commanded: 4908750 4881950 4981100 0 -3400 Actual: 4859186 4859236 4859236 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.02 0.01 0.02 0.01 41.64 ---- Telescope Status ---- No interlocks bypassed Status at:10:51Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 694/713 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 151 lbs, 18.9 psi ---- Software Used ---- Get Versions, 09/02/22, 00:09:06 -- STUI software: STUI : 1.7.17b1 alerts : 2.2.2 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.3.1a0 jaeger : 0.16.2a0 kaiju : 1.2.4-alpha.0 coordio : 1.4.0-alpha.0 fps_calibrati : APO.2022.08.02 cherno : 0.1.1-alpha.0 hal : 0.2.1a0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 35 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.16 --------------Other Versions-------------- sdss-obstools : 3.9.0 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V35 Fiducials : v1_148 idlspec2d : v6_0_7 Kronos : 1.4.0a roboscheduler : 1.2.2 /dev/sdb1 2.0T 189G 1.9T 10% /home 10.25.1.230:/data 21T 13T 7.5T 63% /data ---- APOGEE Data Summary ---- APOGEE data list, mjd=59823, all raw_data: /data/apogee/utr_cdr/59823/apRaw-*.fits archive: /data/apogee/archive/59823/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59823/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 59823 10 10:35 42610010 Dark 60 A 13.0 ---------- a-b-c - - 59823 11 10:46 42610011 Dark 60 A 13.0 ---------- a-b-c - - 59823 12 10:56 42610012 Dark 60 A 13.0 ---------- a-b-c - - 59823 13 10:58 42610013 QuarFlat 10 A 13.0 ---------- a-b-c - - 59823 14 11:00 42610014 QuarFlat 10 A 13.0 ---------- a-b-c - - 59823 15 11:02 42610015 QuarFlat 10 A 13.0 ---------- a-b-c - - 59823 16 11:04 42610016 Arc-Thar 12 B 13.5 ---------- a-b-c 3.17 - 59823 17 11:11 42610017 Arc-Une 40 B 13.5 ---------- a-b-c - - 59823 18 11:14 42610018 Arc-Thar 12 A 13.0 ---------- a-b-c 2.66 - 59823 19 11:21 42610019 Arc-Une 40 A 13.0 ---------- a-b-c - - 59823 20 11:26 42610020 Dark 30 A 13.0 ---------- a-b-c - - 59823 21 11:32 42610021 InteFlat 30 A 13.0 ---------- a-b-c - - 59823 22 11:37 42610022 InteFlat 30 A 13.0 ---------- a-b-c - - 59823 23 11:42 42610023 InteFlat 30 A 13.0 ---------- a-b-c - - 59823 24 11:48 42610024 Dark 30 A 13.0 ---------- a-b-c - - 59823 25 11:53 42610025 Arc---- 30 A 13.0 ---------- a-b-c - 97 FPI ------------------------------------------------------------------------------ APOGEE data list, mjd=59824, all raw_data: /data/apogee/utr_cdr/59824/apRaw-*.fits archive: /data/apogee/archive/59824/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59824/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 59824 1 00:06 42620001 Dark 3 A 13.0 ---------- a-b-c - - 59824 2 00:18 42620002 Dark 60 A 13.0 ---------- a-b-c - - 59824 3 00:20 42620003 QuarFlat 10 A 13.0 ---------- a-b-c - - 59824 4 00:23 42620004 Arc-Thar 12 B 13.5 ---------- a-b-c 3.13 - 59824 5 00:30 42620005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59824 6 00:32 42620006 Arc-Thar 12 A 13.0 ---------- a-b-c 2.65 - 59824 7 00:39 42620007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59824 8 00:50 42620008 Dark 60 A 13.0 ---------- a-b-c - - 59824 9 00:56 42620009 Arc---- 30 A 13.0 ---------- a-b-c - 92 FPI ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59824 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 00:09 b1-00345721 ----------- ---- bia Clo 0.0 2167 2270 902 2 00:09 r1-00345721 ----------- ---- bia Clo 0.0 2167 2270 902 3 00:11 b1-00345722 ----------- ---- dar Clo 20.0 2167 2270 902 4 00:11 r1-00345722 ----------- ---- dar Clo 20.0 2167 2270 902 5 00:13 b1-00345723 -999--999 6504 arc Lef 4.1 2167 2270 902 HART 6 00:13 r1-00345723 -999--999 6504 arc Lef 4.1 2167 2270 902 HART 7 00:13 b1-00345724 -999--999 6504 arc Rig 4.1 2167 2270 902 HART 8 00:13 r1-00345724 -999--999 6504 arc Rig 4.1 2167 2270 902 HART 9 00:14 b1-00345725 -999--999 6504 arc Out 4.1 3493 3595 2227 10 00:14 r1-00345725 -999--999 6504 arc Out 4.1 3493 3595 2227 11 00:16 b1-00345726 -999--999 6504 fla Out 25.1 3493 3595 2227 12 00:16 r1-00345726 -999--999 6504 fla Out 25.1 3493 3595 2227 13 00:25 b1-00345727 -999--999 6504 sci Out 300.1 3493 3595 2227 14 00:25 r1-00345727 -999--999 6504 sci Out 300.1 3493 3595 2227 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 00:14:20 9.7 659 -6.2 1325 -2.1 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 59824 Fill night time in Hours below *=*=*= Total bright time : 0.3 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 0.3 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 8.9 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 8.9 *=*=*= Dark time lost to technical issues : 0