Subject: 2.5m obslog 20231027 (SJD 60245) From: dmbiz@apo.nmsu.edu Date: Sat, 28 Oct 2023 13:08:46 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Friday October 27, 2023 (SJD 60245) ---- Observing Team ---- Dmitry Bizyaev Kaike Pan (troubleshooting in STUI in the first part of the night) Conor Sayres (GFA/FVC troubleshooting in STUI) Jose Sanchez-Gallego (GFA/FVC troubleshooting in STUI) John Downey (GFA/FVC troubleshooting, over the phone) ---- Observing Plan ---- Fri 27 Oct 2023 60245 1.00 01:11 01:25 12:08 20:46 07:31 Night bright (11.0 h, w/ 0.2 h for 12 deg design) ---- Observing Summary ---- Clear night with variable seeing from very good to bad. Notes ----- - dust collected: 14K - Performed Conor's test #3 (4 GFA course focus sweeps), see log. Since GFA4 is off, we could do only test #5, but seeing is worse than required. - Lost 1.1 h to the FVC/GFA4 problem, and 0.25h to M2 process restart, instrument update and focus update. ---- Automatic Summary ---- Time Field-Design-Conf DesignType BOSS/APOGEE Seeing Overhead Complete? Comment 02:12:24 100498-381477-11255 bright_time 1x900/1xAB 1.6" 0:00 DONE clear 02:55:14 100539-382159-11256 bright_time 1x900/1xAB 1.6" 10:26 DONE clear 03:20:40 100469-381001-11257 bright_time 1x900/1xAB 1.9" 6:33 DONE clear 04:00:38 101709-387402-11258 bright_time 1x900/1xAB 1.2" 24:18 DONE clear 04:21:34 100608-383677-11259 bright_time 1x900/1xAB 1.4" 5:53 DONE clear 04:42:27 100600-383641-11260 bright_time 1x900/1xAB 1.3" 6:22 DONE clear 05:03:48 101781-388136-11261 bright_time 1x900/1xAB 1.5" 6:20 DONE clear 06:31:53 101689-387270-11267 bright_time 1x900/1xAB 1.8" --- DONE clear 06:54:18 101718-387443-11268 bright_time 1x900/1xAB 2.4" 6:44 DONE clear 07:16:07 101727-387487-11269 bright_time 1x900/1xAB 2.4" 6:31 DONE clear 07:37:43 102064-389557-11270 bright_time 1x900/1xAB 2.3" 7:15 DONE clear 07:59:59 100580-383523-11271 bright_time 1x900/1xAB 2.2" 6:30 DONE clear 08:21:29 102058-389542-11272 bright_time 1x900/1xAB 1.5" 6:36 DONE clear 08:43:06 103429-393603-11273 bright_time 1x900/1xAB 1.6" 6:32 DONE clear 09:04:39 103382-393439-11274 bright_time 1x900/1xAB 1.9" 5:46 DONE clear 09:25:27 103375-393426-11275 bright_time 1x900/1xAB 1.8" 5:53 DONE clear 09:46:20 103794-394663-11276 bright_time 1x900/1xAB 1.7" 6:45 DONE clear 10:08:06 103415-393566-11277 bright_time 1x900/1xAB 2.4" 6:37 DONE clear 10:29:45 103679-394184-11278 bright_time 1x900/1xAB 3.6" 6:46 not finished haze 10:51:33 103770-394563-11279 bright_time 1x900/1xAB 1.6" 9:09 DONE clear 11:15:35 103685-394216-11280 bright_time 1x900/1xAB 1.9" 6:17 DONE some haze 11:36:56 103727-394403-11281 bright_time 1x900/1xAB 1.9" 5:50 DONE clear 11:57:47 103374-393423-11282 bright_time 1x900/1xAB 2.1" 6:21 DONE some haze 12:19:12 103739-394450-11283 bright_time 1x900/1xAB 1.8" 6:21 DONE clear ---- Engineering Issues ---- We had problem with starting fliswarm in general, and later with starting the FVC camera. fliswarm: the root of the problem is the same trouble with GFA4 as we've had before. Jose checked it and found the computer went to the safe mode and apparently the file system status is bad again. When the GFA4 was disabled, fliswarm actor restarted without problems. - So, the GFA4 is out of order now. The problem with FVC was sorted out after communication with John Downey, Conor and Jose. Apparently, there was a power outage today, and the FVC camera was affected since it was plugged to a UPS left in bypass mode after its installation. It was fixed today. The command that I issued "jaeger fvc nuc on" was not for the camera. Conor found that it is necessary to say "jaeger fvc camera on". Upon solving, I power cycled the FVC FLI camera, and Conor resurrected it with that command. - we noticed periodic warnings (not errors) like: 03:30:48 .tcc 0 tcc w Text="Collimation Failure: " Not sure what happens. - the best focus was found at an unusual value +4050. Kaike noticed that I didn't set correct instrument, but after switching to FPS the best focus didn't change. It was strange because engcamera has default offset 800, and FPS has 4000. Switching instrument didn't apply offsets, although tcc show block inst shows correct instrument (FPS) and correct offset. Later we noticed that the focus correction was not applied with an error that it cannot move. We stopped observing, restarted secondary process and reloaded the instrument again. M2 got responsive and the best focus moved to 700. ---- Observing Log ---- Afternoon --------- Most systems are doing well. Fliswarm reconnect fails with an error, see "Problems section. I tried to power on GFA4 separately, no errors, responds well, but the error doesn't go away. Jaeger doesn't want to take FVC images: 23:53:22 APO.dmbiz 54 jaeger e error="Failed processing image: The exposure succeeded but did not output the filename." 23:54:36 APO.dmbiz 55 fliswarm w text="Failed connecting to fvc." Also, jaeger cannot take any gfa images: 23:55:17 CmdStarted: APO.dmbiz 61 fliswarm talk -c gfa expose --bias --count 1 23:55:17 APO.dmbiz 61 fliswarm > 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa4." 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa3." 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa2." 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa5." 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa1." 23:55:17 APO.dmbiz 61 fliswarm w text="Failed connecting to gfa6." I restarted jaeger actor - goes as expected. I restarted fliswarm actor - problems: (guiderActor-sdss5) [sdss5@sdss5-hub ~]$ systemctl --user status fliswarm fliswarm.service - fliswarm actor Loaded: loaded (/home/sdss5/config/services/services/fliswarm.service; enabled; vendor preset: enabled) Active: failed (Result: exit-code) since Fri 2023-10-27 23:59:49 UTC; 25s ago Process: 2932 ExecStart=/home/sdss5/config/services/execScripts/fliswarm.sh (code=exited, status=1/FAILURE) Main PID: 2932 (code=exited, status=1/FAILURE) Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: File "/home/sdss5/opt/pyenv/ver..._ Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: self.api = APIClient(*args, **k...) Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: File "/home/sdss5/opt/pyenv/ver..._ Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: self._version = self._retrieve_...) Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: File "/home/sdss5/opt/pyenv/ver...n Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: raise DockerException( Oct 27 23:59:49 sdss5-hub fliswarm.sh[2932]: docker.errors.DockerException: E... Oct 27 23:59:49 sdss5-hub systemd[2262]: fliswarm.service: main process exit...E Oct 27 23:59:49 sdss5-hub systemd[2262]: Unit fliswarm.service entered faile.... Oct 27 23:59:49 sdss5-hub systemd[2262]: fliswarm.service failed. One more issue - I believe connected to it, it that Grafana doesn't have information about GFA/FVC. 00:01:34 Hartmann collimate output sp1: offset: r= -659 (In Focus); b= -3.2 (In Focus) sp1: pred. move: spAverageMove= 184 sp1: pred. resid: r= -843, b= -2.6, txt= OK, spTemp = 7.2 The BOSS collimation looks good. 23:31:07 boss exposure 0 sec file=0360588 bias 23:31:37 apogee exposure file= apRaw-46830001 3 A ArcLamp 23:44:02 apogee exposure file= apRaw-46830002 60 A Dark 23:44:28 boss exposure 20 sec file=0360589 dark =================================================== =====>>>>> 23:53:06 Config Loaded: -999--999-11253 =================================================== 23:55:01 apogee exposure file= apRaw-46830003 10 A QuartzFlat 23:56:56 apogee exposure file= apRaw-46830004 12 B ArcLamp 23:59:08 apogee exposure file= apRaw-46830005 40 B ArcLamp 23:59:33 boss exposure 4 sec file=0360590 arc 00:00:14 boss exposure 4 sec file=0360591 arc 00:01:30 Hartmann: offset r= -659 (In Focus) b = -3.2 (In Focus) pred_move = 184 pred_resid r= -843 b= -2.6 cmnt=OK =================================================== =====>>>>> 00:04:11 Config Loaded: -999--999-11254 =================================================== 00:06:26 apogee exposure file= apRaw-46830006 12 A ArcLamp 00:08:38 apogee exposure file= apRaw-46830007 40 A ArcLamp 00:16:05 apogee exposure file= apRaw-46830008 60 A Dark 00:26:56 apogee exposure file= apRaw-46830009 30 A ArcLamp 23:50Z ventilation started Night ----- 00:26Z enclosure open. 00:34:50 apogee exposure file= apRaw-46830010 5 A DomeFlat 00:36:39 apogee exposure file= apRaw-46830011 5 A DomeFlat 00:37:53 apogee exposure file= apRaw-46830012 5 A DomeFlat MJD DomeFlat MTPs:1 2 3 4 5 6 7 8 9 10 AZ ALT ROT 60245 46830010 1.01 1.01 1.03 1.01 1.02 1.01 0.99 1.00 0.98 0.95 121.0 30.0 0.0 60245 46830011 1.02 1.01 1.02 1.01 1.02 1.00 0.99 1.00 0.99 0.95 121.0 30.0 0.0 60245 46830012 1.02 1.01 1.02 1.01 1.02 1.00 0.98 1.00 0.98 0.95 121.0 30.0 0.0 00:48Z I disabled GFA4 and was able to restart the fliswarm actor to good condition, and to reconnect it to STUI. Telemetry started coming to Grafana. One remaining problem: it is still unable to take FVC images: 00:51:03 CmdDone: jaeger.jaeger 11 fliswarm talk -c fvc expose 5.0 00:51:03 APO.dmbiz 118 jaeger e error="Failed processing image: The exposure succeeded but did not output the filename." Trying to reconnect the FVC alone, but it doesn't work well: 01:03:06 CmdDone: APO.dmbiz 124 fliswarm reconnect -n fvc 01:03:32 APO.dmbiz 125 fliswarm w text=fvc,"no cameras connected." =================================================== =====>>>>> 00:04:11 Config Loaded: -999--999-11254 =================================================== 00:06:26 apogee exposure file= apRaw-46830006 12 A ArcLamp 00:08:38 apogee exposure file= apRaw-46830007 40 A ArcLamp 00:16:05 apogee exposure file= apRaw-46830008 60 A Dark 00:26:56 apogee exposure file= apRaw-46830009 30 A ArcLamp 00:34:50 apogee exposure file= apRaw-46830010 5 A DomeFlat 00:36:39 apogee exposure file= apRaw-46830011 5 A DomeFlat 00:37:53 apogee exposure file= apRaw-46830012 5 A DomeFlat 00:39:18 boss exposure 25 sec file=0360592 flat 00:41:05 boss exposure 25 sec file=0360593 flat 00:42:53 boss exposure 25 sec file=0360594 flat 02:00Z we've got the FVC camera back. See the "Engineering issues" with the explanation. 02:01:27 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0003.fits 02:01:19 fvc_perc_90= 57.4 fvc_percent_reached= 2.6 fvc_rms= 38.03 =================================================== =====>>>>> 02:12:24 Config Loaded: 100498-381477-11255 =================================================== 02:17:42 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0004.fits 02:17:24 fvc_perc_90= 69.9 fvc_percent_reached= 0.8 fvc_rms= 49.14 02:18:02 fvc_perc_90= 10.9 fvc_percent_reached= 55.3 fvc_rms= 9.87 02:18:22 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0005.fits 02:18:38 boss exposure 25 sec file=0360595 flat 02:19:45 boss exposure 4 sec file=0360596 arc 02:20:25 boss exposure 4 sec file=0360597 arc 02:21:41 Hartmann: offset r= 2308 (Out of focus) b = -4.2 (Out of focus) pred_move = 1828 pred_resid r= 479 b= 1.5 cmnt=OK 02:22:18 boss exposure 4 sec file=0360598 arc 02:37:06 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0006.fits 02:36:47 fvc_perc_90= 74.0 fvc_percent_reached= 1.8 fvc_rms= 52.58 02:37:25 fvc_perc_90= 10.8 fvc_percent_reached= 49.5 fvc_rms= 20.51 02:37:45 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0007.fits 02:38:18 boss exposure 4 sec file=0360599 arc 02:39:35 apogee exposure file= apRaw-46830013 43 A Object 02:40:00 boss exposure 900 sec file=0360600 science 02:47:16 apogee exposure file= apRaw-46830014 43 B Object The instrument was ecamera - I didn't switch it. May be partly because of it the best focus is 4000. Will set it to fps after this field. =================================================== =====>>>>> 02:55:14 Config Loaded: 100539-382159-11256 =================================================== 03:01:44 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0008.fits 03:01:28 fvc_perc_90= 80.3 fvc_percent_reached= 1.6 fvc_rms= 56.67 03:02:04 fvc_perc_90= 11.6 fvc_percent_reached= 52.2 fvc_rms= 15.96 03:02:24 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0009.fits 03:02:58 boss exposure 4 sec file=0360601 arc 03:05:09 apogee exposure file= apRaw-46830015 43 A Object 03:05:31 boss exposure 900 sec file=0360602 science 03:12:50 apogee exposure file= apRaw-46830016 43 B Object =================================================== =====>>>>> 03:20:40 Config Loaded: 100469-381001-11257 =================================================== 03:23:18 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0010.fits 03:22:59 fvc_perc_90= 80.0 fvc_percent_reached= 1.4 fvc_rms= 55.96 03:23:38 fvc_perc_90= 10.2 fvc_percent_reached= 52.5 fvc_rms= 9.86 03:23:58 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0011.fits 03:24:29 boss exposure 4 sec file=0360603 arc 03:26:44 apogee exposure file= apRaw-46830017 43 A Object 03:27:00 boss exposure 900 sec file=0360604 science 03:34:25 apogee exposure file= apRaw-46830018 43 B Object We noticed warning messages 03:30:48 .tcc 0 tcc w Text="Collimation Failure: " Also while not complained, the focus didn't update and the M2 didn't move, although there was no any warning about it. We stopped observing, applied stop button and restarted the secondary mirror process. At the same time reverted instrument to fps again, and this time the focus values turned to be more familiar (was 4000, become ~800). =================================================== =====>>>>> 04:00:38 Config Loaded: 101709-387402-11258 =================================================== 04:02:32 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0012.fits 04:02:13 fvc_perc_90= 71.7 fvc_percent_reached= 1.6 fvc_rms= 50.29 04:02:52 fvc_perc_90= 10.9 fvc_percent_reached= 51.6 fvc_rms= 9.43 04:03:12 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0013.fits 04:03:45 boss exposure 4 sec file=0360605 arc 04:06:03 apogee exposure file= apRaw-46830019 43 A Object 04:06:20 boss exposure 900 sec file=0360606 science 04:13:44 apogee exposure file= apRaw-46830020 43 B Object =================================================== =====>>>>> 04:21:34 Config Loaded: 100608-383677-11259 =================================================== 04:24:02 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0014.fits 04:23:43 fvc_perc_90= 63.4 fvc_percent_reached= 1.8 fvc_rms= 44.81 04:24:22 fvc_perc_90= 10.1 fvc_percent_reached= 50.3 fvc_rms= 16.63 04:24:42 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0015.fits 04:25:14 boss exposure 4 sec file=0360607 arc 04:26:56 apogee exposure file= apRaw-46830021 43 A Object 04:27:14 boss exposure 900 sec file=0360608 science 04:34:37 apogee exposure file= apRaw-46830022 43 B Object =================================================== =====>>>>> 04:42:27 Config Loaded: 100600-383641-11260 =================================================== 04:44:55 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0016.fits 04:44:36 fvc_perc_90= 76.0 fvc_percent_reached= 1.4 fvc_rms= 51.75 04:45:15 fvc_perc_90= 11.1 fvc_percent_reached= 50.3 fvc_rms= 85.15 04:45:35 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0017.fits 04:46:07 boss exposure 4 sec file=0360609 arc 04:48:18 apogee exposure file= apRaw-46830023 43 A Object 04:48:36 boss exposure 900 sec file=0360610 science 04:55:58 apogee exposure file= apRaw-46830024 43 B Object =================================================== =====>>>>> 05:03:48 Config Loaded: 101781-388136-11261 =================================================== 05:06:16 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0018.fits 05:05:57 fvc_perc_90= 69.6 fvc_percent_reached= 1.6 fvc_rms= 47.89 05:06:36 fvc_perc_90= 10.0 fvc_percent_reached= 49.8 fvc_rms= 9.15 05:06:57 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0019.fits 05:07:29 boss exposure 4 sec file=0360611 arc 05:09:41 apogee exposure file= apRaw-46830025 43 A Object 05:09:58 boss exposure 900 sec file=0360612 science 05:17:22 apogee exposure file= apRaw-46830026 43 B Object Conor's test #3 4 GFA course focus sweeps Seeing ~ 1.4" =================================================== =====>>>>> 05:27:10 Config Loaded: 16183-35884-11262 =================================================== =================================================== =====>>>>> 05:31:23 Config Loaded: 16182-35883-11263 =================================================== Airmass = 1.008. Rotator ~ 2 deg (0 obj) Best focus = 680 Focus GFA# 280 284 380 285 480 286 580 287 680 288 780 289 880 290 980 291 1080 292 tcc rotate 180 object 1080 293 980 294 880 295 780 296 680 297 580 298 480 299 380 300 280 301 =================================================== =====>>>>> 05:59:35 Config Loaded: 16194-35895-11264 =================================================== =================================================== =====>>>>> 06:02:44 Config Loaded: 20889-35920-11265 =================================================== =================================================== =====>>>>> 06:06:52 Config Loaded: 20881-35912-11266 =================================================== Position in the sky with Airmass = 1.5 Foc. GFA# 680. 302 280. 303 380. 304 480. 305 580. 306 680. 307 780. 308 880. 309 980. 310 1080 311 tcc rotate 180 object 1080 312 980 313 880 314 780 315 680 316 580 317 480 318 380 319 280 320 =================================================== =====>>>>> 06:31:53 Config Loaded: 101689-387270-11267 =================================================== 06:34:07 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0020.fits 06:33:48 fvc_perc_90= 76.1 fvc_percent_reached= 0.4 fvc_rms= 52.52 06:34:21 boss exposure 4 sec file=0360613 arc 06:34:27 fvc_perc_90= 9.9 fvc_percent_reached= 56.5 fvc_rms= 9.89 06:34:47 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0021.fits 06:35:01 boss exposure 4 sec file=0360614 arc 06:36:17 Hartmann: offset r= -2638 (Out of focus) b = 5.8 (Out of focus) pred_move = -2250 pred_resid r= -387 b= -1.2 cmnt=OK 06:36:49 boss exposure 4 sec file=0360615 arc 06:38:47 apogee exposure file= apRaw-46830027 43 B Object 06:39:12 boss exposure 900 sec file=0360616 science 06:46:32 apogee exposure file= apRaw-46830028 43 A Object =================================================== =====>>>>> 06:54:18 Config Loaded: 101718-387443-11268 =================================================== 06:57:11 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0022.fits 06:56:52 fvc_perc_90= 69.8 fvc_percent_reached= 1.4 fvc_rms= 52.06 06:57:31 fvc_perc_90= 11.2 fvc_percent_reached= 49.7 fvc_rms= 12.15 06:57:51 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0023.fits 06:58:24 boss exposure 4 sec file=0360617 arc 07:00:32 apogee exposure file= apRaw-46830029 43 A Object 07:00:57 boss exposure 900 sec file=0360618 science 07:08:12 apogee exposure file= apRaw-46830030 43 B Object =================================================== =====>>>>> 07:16:07 Config Loaded: 101727-387487-11269 =================================================== 07:18:43 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0024.fits 07:18:24 fvc_perc_90= 73.4 fvc_percent_reached= 1.4 fvc_rms= 51.05 07:19:02 fvc_perc_90= 10.7 fvc_percent_reached= 54.8 fvc_rms= 8.69 07:19:22 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0025.fits 07:19:55 boss exposure 4 sec file=0360619 arc 07:22:12 apogee exposure file= apRaw-46830031 43 A Object 07:22:29 boss exposure 900 sec file=0360620 science 07:29:53 apogee exposure file= apRaw-46830032 43 B Object =================================================== =====>>>>> 07:37:43 Config Loaded: 102064-389557-11270 =================================================== 07:40:12 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0026.fits 07:39:55 fvc_perc_90= 69.9 fvc_percent_reached= 1.6 fvc_rms= 48.03 07:40:32 fvc_perc_90= 10.6 fvc_percent_reached= 53.1 fvc_rms= 7.48 07:40:52 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0027.fits 07:41:25 boss exposure 4 sec file=0360621 arc 07:44:28 apogee exposure file= apRaw-46830033 43 A Object 07:44:45 boss exposure 900 sec file=0360622 science 07:52:09 apogee exposure file= apRaw-46830034 43 B Object =================================================== =====>>>>> 07:59:59 Config Loaded: 100580-383523-11271 =================================================== 08:02:28 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0028.fits 08:02:11 fvc_perc_90= 76.3 fvc_percent_reached= 0.8 fvc_rms= 54.66 08:02:48 fvc_perc_90= 11.1 fvc_percent_reached= 49.2 fvc_rms= 12.59 08:03:08 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0029.fits 08:03:44 boss exposure 4 sec file=0360623 arc 08:05:59 apogee exposure file= apRaw-46830035 43 A Object 08:13:40 apogee exposure file= apRaw-46830036 43 B Object 08:06:15 boss exposure 900 sec file=0360624 science =================================================== =====>>>>> 08:21:29 Config Loaded: 102058-389542-11272 =================================================== 08:24:01 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0030.fits 08:23:42 fvc_perc_90= 65.9 fvc_percent_reached= 0.2 fvc_rms= 50.62 08:24:21 fvc_perc_90= 9.6 fvc_percent_reached= 54.1 fvc_rms= 19.28 08:24:42 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0031.fits 08:25:13 boss exposure 4 sec file=0360625 arc 08:27:36 apogee exposure file= apRaw-46830037 43 A Object 08:27:53 boss exposure 900 sec file=0360626 science 08:35:17 apogee exposure file= apRaw-46830038 43 B Object =================================================== =====>>>>> 08:43:06 Config Loaded: 103429-393603-11273 =================================================== 08:45:44 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0032.fits 08:45:26 fvc_perc_90= 66.7 fvc_percent_reached= 1.0 fvc_rms= 47.5 08:46:23 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0033.fits 08:46:04 fvc_perc_90= 10.5 fvc_percent_reached= 54.7 fvc_rms= 7.76 08:46:55 boss exposure 4 sec file=0360627 arc 08:49:08 apogee exposure file= apRaw-46830039 43 A Object 08:49:25 boss exposure 900 sec file=0360628 science 08:56:50 apogee exposure file= apRaw-46830040 43 B Object =================================================== =====>>>>> 09:04:39 Config Loaded: 103382-393439-11274 =================================================== 09:07:01 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0034.fits 09:06:42 fvc_perc_90= 73.7 fvc_percent_reached= 1.6 fvc_rms= 53.36 09:07:21 fvc_perc_90= 11.3 fvc_percent_reached= 46.2 fvc_rms= 16.05 09:07:41 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0035.fits 09:08:12 boss exposure 4 sec file=0360629 arc 09:09:56 apogee exposure file= apRaw-46830041 43 A Object 09:10:12 boss exposure 900 sec file=0360630 science 09:17:37 apogee exposure file= apRaw-46830042 43 B Object =================================================== =====>>>>> 09:25:27 Config Loaded: 103375-393426-11275 =================================================== 09:27:56 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0036.fits 09:27:39 fvc_perc_90= 73.1 fvc_percent_reached= 0.4 fvc_rms= 49.67 09:28:15 fvc_perc_90= 10.5 fvc_percent_reached= 50.1 fvc_rms= 10.31 09:28:35 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0037.fits 09:29:07 boss exposure 4 sec file=0360631 arc 09:30:50 apogee exposure file= apRaw-46830043 43 A Object 09:31:07 boss exposure 900 sec file=0360632 science 09:38:31 apogee exposure file= apRaw-46830044 43 B Object =================================================== =====>>>>> 09:46:20 Config Loaded: 103794-394663-11276 =================================================== 09:49:08 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0038.fits 09:48:50 fvc_perc_90= 72.8 fvc_percent_reached= 0.6 fvc_rms= 49.65 09:49:28 fvc_perc_90= 10.3 fvc_percent_reached= 52.8 fvc_rms= 8.39 09:49:48 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0039.fits 09:50:19 boss exposure 4 sec file=0360633 arc 09:52:36 apogee exposure file= apRaw-46830045 43 A Object 09:52:53 boss exposure 900 sec file=0360634 science 10:00:17 apogee exposure file= apRaw-46830046 43 B Object =================================================== =====>>>>> 10:08:06 Config Loaded: 103415-393566-11277 =================================================== 10:10:28 fvc_perc_90= 80.7 fvc_percent_reached= 0.6 fvc_rms= 55.66 10:10:48 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0040.fits 10:11:08 fvc_perc_90= 10.9 fvc_percent_reached= 50.2 fvc_rms= 15.78 10:11:28 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0041.fits 10:11:59 boss exposure 4 sec file=0360635 arc 10:14:14 apogee exposure file= apRaw-46830047 43 A Object 10:14:31 boss exposure 900 sec file=0360636 science 10:21:55 apogee exposure file= apRaw-46830048 43 B Object =================================================== =====>>>>> 10:29:45 Config Loaded: 103679-394184-11278 =================================================== 10:32:20 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0042.fits 10:32:01 fvc_perc_90= 72.3 fvc_percent_reached= 2.6 fvc_rms= 48.86 10:32:40 fvc_perc_90= 10.1 fvc_percent_reached= 52.9 fvc_rms= 8.93 10:33:00 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0043.fits 10:33:31 boss exposure 4 sec file=0360637 arc 10:36:01 apogee exposure file= apRaw-46830049 43 A Object 10:36:19 boss exposure 900 sec file=0360638 science 10:43:42 apogee exposure file= apRaw-46830050 43 B Object =================================================== =====>>>>> 10:51:33 Config Loaded: 103770-394563-11279 =================================================== 10:54:00 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0044.fits 10:53:41 fvc_perc_90= 68.6 fvc_percent_reached= 1.4 fvc_rms= 50.16 10:54:20 fvc_perc_90= 10.8 fvc_percent_reached= 51.0 fvc_rms= 14.56 10:54:40 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0045.fits 10:55:11 boss exposure 4 sec file=0360639 arc 11:00:03 apogee exposure file= apRaw-46830051 43 B Object 11:00:28 boss exposure 900 sec file=0360640 science 11:07:48 apogee exposure file= apRaw-46830052 43 A Object =================================================== =====>>>>> 11:15:35 Config Loaded: 103685-394216-11280 =================================================== 11:17:44 fvc_perc_90= 75.4 fvc_percent_reached= 1.6 fvc_rms= 53.95 11:18:04 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0046.fits 11:18:43 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0047.fits 11:18:24 fvc_perc_90= 9.8 fvc_percent_reached= 51.0 fvc_rms= 9.49 11:19:19 boss exposure 4 sec file=0360641 arc 11:21:21 apogee exposure file= apRaw-46830053 43 A Object 11:21:46 boss exposure 900 sec file=0360642 science 11:29:02 apogee exposure file= apRaw-46830054 43 B Object =================================================== =====>>>>> 11:36:56 Config Loaded: 103727-394403-11281 =================================================== 11:39:20 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0048.fits 11:39:01 fvc_perc_90= 72.6 fvc_percent_reached= 1.2 fvc_rms= 52.73 11:39:59 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0049.fits 11:39:40 fvc_perc_90= 11.0 fvc_percent_reached= 50.0 fvc_rms= 48.42 11:40:32 boss exposure 4 sec file=0360643 arc 11:42:17 apogee exposure file= apRaw-46830055 43 A Object 11:42:37 boss exposure 900 sec file=0360644 science 11:49:57 apogee exposure file= apRaw-46830056 43 B Object =================================================== =====>>>>> 11:57:47 Config Loaded: 103374-393423-11282 =================================================== 12:00:15 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0050.fits 11:59:56 fvc_perc_90= 76.6 fvc_percent_reached= 0.2 fvc_rms= 56.75 12:00:34 fvc_perc_90= 10.8 fvc_percent_reached= 52.5 fvc_rms= 9.98 12:00:54 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0051.fits 12:01:26 boss exposure 4 sec file=0360645 arc 12:03:42 apogee exposure file= apRaw-46830057 43 A Object 12:03:58 boss exposure 900 sec file=0360646 science 12:11:23 apogee exposure file= apRaw-46830058 43 B Object =================================================== =====>>>>> 12:19:12 Config Loaded: 103739-394450-11283 =================================================== 12:21:18 fvc_perc_90= 74.0 fvc_percent_reached= 1.8 fvc_rms= 51.45 12:21:41 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0052.fits 12:21:57 fvc_perc_90= 10.4 fvc_percent_reached= 49.7 fvc_rms= 8.49 12:22:17 FVC exposure /data/fcam/60245/proc-fimg-fvc1n-0053.fits 12:22:50 boss exposure 4 sec file=0360647 arc 12:25:04 apogee exposure file= apRaw-46830059 43 A Object 12:25:24 boss exposure 900 sec file=0360648 science 12:32:45 apogee exposure file= apRaw-46830060 43 B Object 12:41:59 apogee exposure file= apRaw-46830061 5 B DomeFlat 12:43:15 apogee exposure file= apRaw-46830062 5 B DomeFlat 12:44:44 apogee exposure file= apRaw-46830063 5 B DomeFlat 60245 46830061 1.00 1.01 1.02 1.02 1.02 1.00 0.97 0.99 1.00 0.95 -133.9 36.2 99.6 60245 46830062 1.01 1.01 1.02 1.01 1.02 1.00 0.97 0.99 0.99 0.95 -133.9 36.0 99.9 60245 46830063 1.02 1.02 1.02 1.01 1.02 1.00 0.97 0.98 0.99 0.95 -134.0 35.8 100.1 12:58Z enlcosure closed calibrations started LN2 fill started (observers39) [observer@sdss5-hub: ~]$ check_ap 60245 [ (46830001, 3, 3, '/data/apogee/raw/60245/apRaw-46830001-001.fits', 'ARCLAMP', 'None', '0', '11252', '394956 ', '103952', 32.041, '2023-10-27T23:31:37.370', 'Podium', 'Closed', 'Closed', 60245, 'APO', 12.994)] problem with exposure: 46830001 Using nfowler=1 for DOMEFLAT Using nfowler=1 for DOMEFLAT Using nfowler=1 for DOMEFLAT Using nfowler=1 for DOMEFLAT num field design config exptype dithpix nread relflux okay dx dy sigx sigy fpi1 fpi 2 -------- ------ ------ ------ ------------ ------- ----- ------- ----- ------- ------- ------ ------ ---- --- - 46830001 103952 394956 11252 ARCLAMP-None 13.0 3 0 False 0.00 0.00 0.00 0.00 0 0 46830002 103952 394956 11252 DARK 13.0 60 -10 True -- -- -- -- -- - - 46830003 -999 -999 11253 QUARTZFLAT 13.0 10 107 True -- -0.29 -- 0.87 -- - - 46830004 -999 -999 11253 ARCLAMP-THAR 13.5 12 95 True 1.60 0.56 1.05 0.87 -- - - 46830005 -999 -999 11253 ARCLAMP-UNE 13.5 40 91 True 1.22 0.33 1.12 0.90 -- - - 46830006 -999 -999 11254 ARCLAMP-THAR 13.0 12 100 True 1.10 0.53 1.07 0.89 -- - - 46830007 -999 -999 11254 ARCLAMP-UNE 13.0 40 93 True 0.71 0.36 1.11 0.89 -- - - 46830008 -999 -999 11254 DARK 13.0 60 -2 True -- -- -- -- -- - - 46830009 -999 -999 11254 FPI 13.0 30 141 True -12.08 0.31 1.16 0.88 -- - - 46830010 -999 -999 11254 DOMEFLAT 13.0 5 114 True -- -0.29 -- 0.85 -- - - 46830011 -999 -999 11254 DOMEFLAT 13.0 5 110 True -- -0.27 -- 0.86 -- - - 46830012 -999 -999 11254 DOMEFLAT 13.0 5 111 True -- -0.27 -- 0.84 -- - - 46830013 100498 381477 11255 OBJECT 13.0 43 134 True 1.12 -0.26 1.81 0.89 113 10 0 46830014 100498 381477 11255 OBJECT 13.5 43 149 True 1.61 -0.27 1.80 0.86 113 9 9 46830015 100539 382159 11256 OBJECT 13.0 43 186 True 1.10 -0.27 1.86 0.95 113 10 0 46830016 100539 382159 11256 OBJECT 13.5 43 188 True 1.57 -0.31 1.86 0.94 115 10 0 46830017 100469 381001 11257 OBJECT 13.0 43 139 True 1.11 -0.28 1.76 0.88 113 10 0 46830018 100469 381001 11257 OBJECT 13.5 43 153 True 1.60 -0.27 1.77 0.86 116 9 8 46830019 101709 387402 11258 OBJECT 13.0 43 113 True 1.12 -0.27 1.75 0.88 113 10 1 46830020 101709 387402 11258 OBJECT 13.5 43 121 True 1.60 -0.27 1.75 0.86 114 9 8 46830021 100608 383677 11259 OBJECT 13.0 43 126 True 1.11 -0.27 1.76 0.88 106 98 46830022 100608 383677 11259 OBJECT 13.5 43 121 True 1.58 -0.26 1.75 0.86 116 101 46830023 100600 383641 11260 OBJECT 13.0 43 116 True 1.11 -0.26 1.75 0.88 106 99 46830024 100600 383641 11260 OBJECT 13.5 43 117 True 1.60 -0.26 1.75 0.85 113 99 46830025 101781 388136 11261 OBJECT 13.0 43 166 True 1.05 -0.24 1.95 0.91 112 100 46830026 101781 388136 11261 OBJECT 13.5 43 157 True 1.55 -0.26 1.99 0.87 113 99 46830027 101689 387270 11267 OBJECT 13.5 43 114 True 1.58 -0.25 1.81 0.86 112 100 46830028 101689 387270 11267 OBJECT 13.0 43 114 True 1.10 -0.22 1.82 0.89 110 99 46830029 101718 387443 11268 OBJECT 13.0 43 122 True 1.11 -0.25 1.75 0.88 109 99 46830030 101718 387443 11268 OBJECT 13.5 43 138 True 1.59 -0.25 1.76 0.86 110 99 46830031 101727 387487 11269 OBJECT 13.0 43 101 True 1.09 -0.25 1.75 0.88 108 100 46830032 101727 387487 11269 OBJECT 13.5 43 99 True 1.59 -0.24 1.76 0.86 113 99 46830033 102064 389557 11270 OBJECT 13.0 43 89 True 1.09 -0.24 1.75 0.87 109 101 46830034 102064 389557 11270 OBJECT 13.5 43 95 True 1.58 -0.24 1.76 0.86 113 98 46830035 100580 383523 11271 OBJECT 13.0 43 116 True 1.11 -0.24 1.77 0.87 107 99 46830036 100580 383523 11271 OBJECT 13.5 43 125 True 1.60 -0.24 1.77 0.86 113 100 46830037 102058 389542 11272 OBJECT 13.0 43 108 True 1.09 -0.24 1.75 0.87 110 101 46830038 102058 389542 11272 OBJECT 13.5 43 110 True 1.58 -0.24 1.76 0.86 113 10 46830039 103429 393603 11273 OBJECT 13.0 43 135 True 1.10 -0.23 1.76 0.88 109 99 46830040 103429 393603 11273 OBJECT 13.5 43 136 True 1.58 -0.24 1.76 0.87 113 119 46830041 103382 393439 11274 OBJECT 13.0 43 144 True 1.10 -0.23 1.77 0.88 109 98 46830042 103382 393439 11274 OBJECT 13.5 43 152 True 1.59 -0.23 1.77 0.87 109 100 46830043 103375 393426 11275 OBJECT 13.0 43 145 True 1.09 -0.23 1.76 0.88 112 100 46830044 103375 393426 11275 OBJECT 13.5 43 141 True 1.58 -0.23 1.76 0.87 108 100 46830045 103794 394663 11276 OBJECT 13.0 43 100 True 1.05 -0.23 1.85 0.87 112 98 46830046 103794 394663 11276 OBJECT 13.5 43 110 True 1.54 -0.22 1.86 0.86 112 101 46830047 103415 393566 11277 OBJECT 13.0 43 122 True 1.10 -0.23 1.77 0.88 110 101 46830048 103415 393566 11277 OBJECT 13.5 43 129 True 1.58 -0.23 1.77 0.86 114 99 46830049 103679 394184 11278 OBJECT 13.0 43 145 True 1.10 -0.22 1.77 0.88 110 97 46830050 103679 394184 11278 OBJECT 13.5 43 166 True 1.58 -0.23 1.78 0.88 115 100 46830051 103770 394563 11279 OBJECT 13.5 43 119 True 1.58 -0.22 1.76 0.86 115 99 46830052 103770 394563 11279 OBJECT 13.0 43 123 True 1.10 -0.21 1.76 0.88 111 99 46830053 103685 394216 11280 OBJECT 13.0 43 179 True 1.08 -0.19 1.82 0.93 108 100 46830054 103685 394216 11280 OBJECT 13.5 43 184 True 1.58 -0.24 1.83 0.92 115 99 46830055 103727 394403 11281 OBJECT 13.0 43 177 True 1.08 -0.19 1.84 0.92 112 98 46830056 103727 394403 11281 OBJECT 13.5 43 182 True 1.57 -0.22 1.84 0.90 114 98 46830057 103374 393423 11282 OBJECT 13.0 43 118 True 1.09 -0.21 1.75 0.88 112 100 46830058 103374 393423 11282 OBJECT 13.5 43 121 True 1.58 -0.21 1.76 0.86 113 100 46830059 103739 394450 11283 OBJECT 13.0 43 167 True 1.08 -0.19 1.80 0.92 109 98 46830060 103739 394450 11283 OBJECT 13.5 43 176 True 1.58 -0.22 1.80 0.89 115 98 46830061 103739 394450 11283 DOMEFLAT 13.5 5 119 True -- -0.22 -- 0.87 -- -- num exptype nread mtp1 mtp2 mtp3 mtp4 mtp5 mtp6 mtp7 mtp8 mtp9 mtp10 -------- ---------- ----- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----- 46830003 QUARTZFLAT 10 70 76 83 93 94 89 89 91 91 84 46830010 DOMEFLAT 5 82 91 101 108 116 104 109 113 108 103 46830011 DOMEFLAT 5 81 91 98 105 113 101 107 111 105 101 46830012 DOMEFLAT 5 84 93 100 108 115 102 109 113 107 103 46830061 DOMEFLAT 5 81 90 101 108 116 103 105 112 109 103 ---- Mirror Numbers ---- Taken with wrong instrument. PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.5040 0.5030 Axial B: -0.1960 -0.1960 Axial C: -0.1120 -0.1120 Trans D: 1.9080 1.9080 Lateral E: 0.3395 0.3400 Lateral F: 0.5460 0.5455 GALILS Commanded: 5650 1750 8800 -4500 -3400 -3100 Actual: 5650 1750 8800 -4500 -3400 -3100 SETMIR VALUES PrimDesOrient: 0.0 44.5 -7.8 -427.0 -2433.9 PrimOrient: 1.07 44.57 -7.9 -426.41 -2433.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 0.00 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: 2.9660 2.2550 Axial B: 2.9330 2.2200 Axial C: 2.8980 2.1880 Trans D: -0.1140 -0.0990 GALILS Commanded: 853250 789150 912850 -1800 -7750 Actual: 844344 772136 866561 -1800 -7750 SETMIR VALUES SecDesOrient: 657.0 -24.5 -17.5 18.0 125.41 SecOrient: 656.89 -24.43 -17.58 17.44 125.15 ---- Focus Log ---- Time Field-Design-Conf AZ ALT ROT Focus rms OffX OffY Seeing T,C WndSpd WndDir 02:39:53 100498-381477-11255 -66.85 41.71 152.89 4050 0.195 5 -9 1.59 5.8 nan nan 03:05:20 100539-382159-11256 -68.25 30.34 153.32 4050 0.245 -11 3 1.66 5.7 nan nan 03:26:54 100469-381001-11257 -77.87 40.52 151.18 4050 0.193 -10 1 1.96 5.7 nan nan 04:06:13 101709-387402-11258 -148.07 62.73 68.83 760 0.244 -1 -8 1.33 5.7 nan nan 04:27:07 100608-383677-11259 -139.45 60.88 81.22 700 0.219 -2 -5 1.29 5.8 nan nan 04:48:30 100600-383641-11260 -146.57 61.52 78.40 680 0.214 -1 -7 1.24 5.8 nan nan 05:09:51 101781-388136-11261 -145.12 52.06 86.86 680 0.262 0 -8 1.42 5.9 nan nan 06:39:05 101689-387270-11267 199.45 53.38 100.03 680 0.191 -3 -2 1.82 5.8 nan nan 07:00:50 101718-387443-11268 227.03 35.21 116.55 730 0.225 -1 -6 2.49 5.7 nan nan 07:22:22 101727-387487-11269 212.25 41.48 115.42 700 0.239 1 -3 2.32 5.6 nan nan 07:44:38 102064-389557-11270 180.17 51.10 52.96 700 0.255 -14 -10 2.15 5.6 nan nan 08:06:09 100580-383523-11271 216.53 42.32 124.06 700 0.242 -1 -1 2.03 5.6 nan nan 08:27:46 102058-389542-11272 191.60 49.83 71.51 700 0.254 -6 -8 1.55 5.6 nan nan 08:49:19 103429-393603-11273 50.09 36.33 254.35 700 0.224 -17 14 1.96 5.6 nan nan 09:10:06 103382-393439-11274 48.86 31.94 255.90 700 0.238 -18 12 1.73 5.7 nan nan 09:31:00 103375-393426-11275 43.59 32.87 244.85 700 0.203 -17 11 2.34 5.7 nan nan 09:52:46 103794-394663-11276 201.19 66.72 46.32 700 0.185 -3 -10 1.40 5.7 nan nan 10:14:24 103415-393566-11277 25.95 45.11 235.39 700 0.244 -17 17 2.36 5.7 nan nan 10:36:11 103679-394184-11278 -147.39 35.76 121.20 700 0.487 -4 -2 2.93 5.5 nan nan 11:00:21 103770-394563-11279 -140.69 55.60 72.48 800 0.237 -1 -9 3.21 5.2 nan nan 11:21:39 103685-394216-11280 -143.69 35.53 138.70 850 0.238 -4 0 1.58 5.2 nan nan 11:42:30 103727-394403-11281 -134.81 43.42 146.97 850 0.214 -5 0 1.68 5.2 nan nan 12:03:52 103374-393423-11282 -0.46 46.74 210.16 850 0.195 -16 11 2.25 5.2 nan nan ---- Telescope Status ---- 23:50Z Started ventilation 00:26Z encl25m : open 12:58Z encl25m : closed No interlocks bypassed Status at: 13:06Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 694 / 713 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 292 lbs, 21 psi FPS Status ========== CP10 Loop = 7.22 L/min GFA Loop = 2.26 L/min Supply pressure = 39.7 psi Return pressure = 29.0 psi Chiller Status ============== Set temperarature = 8.0 C Flow = 5.2 Gpm ---- Software Used ---- STUI : 1.7.19 alerts : 2.3.0 boss : 6.0.2-alpha.0 -boss.specMec : 3.0.4 apo : 0.4.0b1 fliswarm : 0.4.0 jaeger : 1.5.0 kaiju : 1.3.1 coordio : 1.9.0 fps_calibrati : 2023.09.29 cherno : 0.6.3 astrometrynet : 0.93 hal : 0.6.0b5 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1-1-ge461 -mcp.plc : 35 -mcp.azFiduci : v1_149 -mcp.altFiduc : v1_149 -mcp.rotFiduc : v1_149 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.20 Boson : 0.3.2 --------------Other Versions-------------- sdss-obstools : 3.9.3 TPM : 1.2-31-gd7eb MCP : 2.1-1-ge461 idlspec2d : v6_1_0 Kronos : 1.6.2a roboscheduler : 1.4.0 /dev/sdb1 2.0T 295G 1.8T 15% /home /dev/sdd1 22T 14T 7.2T 66% /data ---- APOGEE Data Summary ---- Last morning looks OK: 60244 10 12:47 46820010 Dark 60 A 13.0 ---------- a-b-c - - 60244 11 12:58 46820011 Dark 60 A 13.0 ---------- a-b-c - - 60244 12 13:08 46820012 Dark 60 A 13.0 ---------- a-b-c - - 60244 13 13:10 46820013 QuarFlat 10 A 13.0 ---------- a-b-c - - 60244 14 13:12 46820014 QuarFlat 10 A 13.0 ---------- a-b-c - - 60244 15 13:14 46820015 QuarFlat 10 A 13.0 ---------- a-b-c - - 60244 16 13:16 46820016 Arc-Thar 12 B 13.5 ---------- a-b-c 1.48 - 60244 17 13:23 46820017 Arc-Une 40 B 13.5 ---------- a-b-c - - 60244 18 13:26 46820018 Arc-Thar 12 A 13.0 ---------- a-b-c 1.07 - 60244 19 13:33 46820019 Arc-Une 40 A 13.0 ---------- a-b-c - - 60244 20 13:38 46820020 Dark 30 A 13.0 ---------- a-b-c - - 60244 21 13:44 46820021 InteFlat 30 A 13.0 ---------- a-b-c - - 60244 22 13:49 46820022 InteFlat 30 A 13.0 ---------- a-b-c - - 60244 23 13:54 46820023 InteFlat 30 A 13.0 ---------- a-b-c - - 60244 24 14:00 46820024 Dark 30 A 13.0 ---------- a-b-c - - 60244 25 14:06 46820025 Arc---- 30 A 13.0 ---------- a-b-c - 86 FPI APOGEE data list, mjd=60245, all raw_data: /data/apogee/utr_cdr/60245/apRaw-*.fits archive: /data/apogee/archive/60245/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/60245/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 60245 1 23:31 46830001 Arc---- 3 A 13.0 ---------- a-b-c - -8 test 60245 2 23:54 46830002 Dark 60 A 13.0 ---------- a-b-c - - 60245 3 23:56 46830003 QuarFlat 10 A 13.0 ---------- a-b-c - - 60245 4 23:58 46830004 Arc-Thar 12 B 13.5 ---------- a-b-c 1.49 - 60245 5 00:05 46830005 Arc-Une 40 B 13.5 ---------- a-b-c - - 60245 6 00:08 46830006 Arc-Thar 12 A 13.0 ---------- a-b-c 1.03 - 60245 7 00:15 46830007 Arc-Une 40 A 13.0 ---------- a-b-c - - 60245 8 00:26 46830008 Dark 60 A 13.0 ---------- a-b-c - - 60245 9 00:31 46830009 Arc---- 30 A 13.0 ---------- a-b-c - 80 FPI 60245 10 00:35 46830010 DomeFlat 5 A 13.0 -999-11254 a-b-c - 148 60245 11 00:37 46830011 DomeFlat 5 A 13.0 -999-11254 a-b-c - 144 60245 12 00:38 46830012 DomeFlat 5 A 13.0 -999-11254 a-b-c - 146 60245 13 02:46 46830013 Object 43 A 13.0 381477-11255 a-b-c 0.93 1,1 60245 14 02:54 46830014 Object 43 B 13.5 381477-11255 a-b-c 1.42 1,1 60245 15 03:12 46830015 Object 43 A 13.0 382159-11256 a-b-c 0.91 1,1 60245 16 03:20 46830016 Object 43 B 13.5 382159-11256 a-b-c 1.40 1,1 60245 17 03:33 46830017 Object 43 A 13.0 381001-11257 a-b-c 0.95 1,1 60245 18 03:41 46830018 Object 43 B 13.5 381001-11257 a-b-c 1.43 1,1 60245 19 04:13 46830019 Object 43 A 13.0 387402-11258 a-b-c 0.95 1,1 60245 20 04:20 46830020 Object 43 B 13.5 387402-11258 a-b-c 1.42 1,1 60245 21 04:34 46830021 Object 43 A 13.0 383677-11259 a-b-c 0.95 1,1 60245 22 04:41 46830022 Object 43 B 13.5 383677-11259 a-b-c 1.42 1,1 60245 23 04:55 46830023 Object 43 A 13.0 383641-11260 a-b-c 0.95 1,1 60245 24 05:03 46830024 Object 43 B 13.5 383641-11260 a-b-c 1.43 1,1 60245 25 05:16 46830025 Object 43 A 13.0 388136-11261 a-b-c 0.95 1,1 60245 26 05:24 46830026 Object 43 B 13.5 388136-11261 a-b-c 1.42 1,1 60245 27 06:46 46830027 Object 43 B 13.5 387270-11267 a-b-c 1.41 1,1 60245 28 06:53 46830028 Object 43 A 13.0 387270-11267 a-b-c 0.94 1,1 60245 29 07:07 46830029 Object 43 A 13.0 387443-11268 a-b-c 0.94 1,1 60245 30 07:15 46830030 Object 43 B 13.5 387443-11268 a-b-c 1.42 1,1 60245 31 07:29 46830031 Object 43 A 13.0 387487-11269 a-b-c 0.94 1,1 60245 32 07:37 46830032 Object 43 B 13.5 387487-11269 a-b-c 1.42 1,1 60245 33 07:51 46830033 Object 43 A 13.0 389557-11270 a-b-c 0.93 1,1 60245 34 07:59 46830034 Object 43 B 13.5 389557-11270 a-b-c 1.42 1,1 60245 35 08:13 46830035 Object 43 A 13.0 383523-11271 a-b-c 0.94 1,1 60245 36 08:20 46830036 Object 43 B 13.5 383523-11271 a-b-c 1.42 1,1 60245 37 08:34 46830037 Object 43 A 13.0 389542-11272 a-b-c 0.94 1,1 60245 38 08:42 46830038 Object 43 B 13.5 389542-11272 a-b-c 1.42 1,1 60245 39 08:56 46830039 Object 43 A 13.0 393603-11273 a-b-c 0.94 1,1 60245 40 09:04 46830040 Object 43 B 13.5 393603-11273 a-b-c 1.43 1,1 60245 41 09:17 46830041 Object 43 A 13.0 393439-11274 a-b-c 0.94 1,1 60245 42 09:24 46830042 Object 43 B 13.5 393439-11274 a-b-c 1.42 1,1 60245 43 09:38 46830043 Object 43 A 13.0 393426-11275 a-b-c 0.94 1,1 60245 44 09:45 46830044 Object 43 B 13.5 393426-11275 a-b-c 1.42 1,1 60245 45 09:59 46830045 Object 43 A 13.0 394663-11276 a-b-c 0.94 1,1 60245 46 10:07 46830046 Object 43 B 13.5 394663-11276 a-b-c 1.42 1,1 60245 47 10:21 46830047 Object 43 A 13.0 393566-11277 a-b-c 0.94 1,1 60245 48 10:29 46830048 Object 43 B 13.5 393566-11277 a-b-c 1.43 1,1 60245 49 10:43 46830049 Object 43 A 13.0 394184-11278 a-b-c 0.93 1,1 60245 50 10:50 46830050 Object 43 B 13.5 394184-11278 a-b-c 1.42 1,1 60245 51 11:07 46830051 Object 43 B 13.5 394563-11279 a-b-c 1.43 1,1 60245 52 11:15 46830052 Object 43 A 13.0 394563-11279 a-b-c 0.93 1,1 60245 53 11:28 46830053 Object 43 A 13.0 394216-11280 a-b-c 0.92 1,1 60245 54 11:36 46830054 Object 43 B 13.5 394216-11280 a-b-c 1.42 1,1 60245 55 11:49 46830055 Object 43 A 13.0 394403-11281 a-b-c 0.92 1,1 60245 56 11:57 46830056 Object 43 B 13.5 394403-11281 a-b-c 1.41 1,1 60245 57 12:10 46830057 Object 43 A 13.0 393423-11282 a-b-c 0.95 1,1 60245 58 12:18 46830058 Object 43 B 13.5 393423-11282 a-b-c 1.43 1,1 60245 59 12:32 46830059 Object 43 A 13.0 394450-11283 a-b-c 0.93 1,1 60245 60 12:40 46830060 Object 43 B 13.5 394450-11283 a-b-c 1.43 1,1 60245 61 12:42 46830061 DomeFlat 5 B 13.5 394450-11283 a-b-c - 147 60245 62 12:43 46830062 DomeFlat 5 B 13.5 394450-11283 a-b-c - 145 60245 63 12:45 46830063 DomeFlat 5 B 13.5 394450-11283 a-b-c - 148 ------------------------------------------------------------------------------ ---- BOSS Data Summary ---- Reading FITS from /data/spectro//60245 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:31 b1-00360588 ----------- ---- bia Clo 0.0 29239 30179 28214 2 23:31 r1-00360588 ----------- ---- bia Clo 0.0 29239 30179 28214 3 23:44 b1-00360589 ----------- ---- dar Clo 20.0 29239 30179 28214 4 23:44 r1-00360589 ----------- ---- dar Clo 20.0 29239 30179 28214 5 00:00 b1-00360590 -999--999 11253 arc Lef 4.1 29239 30179 28214 HART 6 00:00 r1-00360590 -999--999 11253 arc Lef 4.1 29239 30179 28214 HART 7 00:00 r1-00360591 -999--999 11253 arc Rig 4.1 29239 30179 28214 HART 8 00:00 b1-00360591 -999--999 11253 arc Rig 4.1 29239 30179 28214 HART 9 00:39 b1-00360592 -999--999 11254 fla Out 25.1 29421 30363 28398 10 00:39 r1-00360592 -999--999 11254 fla Out 25.1 29421 30363 28398 11 00:41 r1-00360593 -999--999 11254 fla Out 25.1 29421 30363 28398 12 00:41 b1-00360593 -999--999 11254 fla Out 25.1 29421 30363 28398 13 00:42 b1-00360594 -999--999 11254 fla Out 25.1 29421 30363 28398 14 00:42 r1-00360594 -999--999 11254 fla Out 25.1 29421 30363 28398 15 02:18 b1-00360595 381477-100498 11255 fla Out 25.1 29421 30363 28398 16 02:18 r1-00360595 381477-100498 11255 fla Out 25.1 29421 30363 28398 17 02:20 r1-00360596 381477-100498 11255 arc Lef 4.1 29421 30363 28398 HART 18 02:20 b1-00360596 381477-100498 11255 arc Lef 4.1 29421 30363 28398 HART 19 02:21 r1-00360597 381477-100498 11255 arc Rig 4.0 29421 30363 28398 HART 20 02:21 b1-00360597 381477-100498 11255 arc Rig 4.0 29421 30363 28398 HART 21 02:22 r1-00360598 381477-100498 11255 arc Out 4.1 31250 32191 30226 22 02:22 b1-00360598 381477-100498 11255 arc Out 4.1 31250 32191 30226 23 02:38 r1-00360599 381477-100498 11255 arc Out 4.0 31250 32191 30226 24 02:38 b1-00360599 381477-100498 11255 arc Out 4.0 31250 32191 30226 25 02:39 b1-00360600 381477-100498 11255 sci Out 900.1 31250 32191 30226 26 02:39 r1-00360600 381477-100498 11255 sci Out 900.1 31250 32191 30226 27 03:02 r1-00360601 382159-100539 11256 arc Out 4.1 31250 32191 30226 28 03:02 b1-00360601 382159-100539 11256 arc Out 4.1 31250 32191 30226 29 03:05 r1-00360602 382159-100539 11256 sci Out 900.1 31250 32191 30226 30 03:05 b1-00360602 382159-100539 11256 sci Out 900.1 31250 32191 30226 31 03:24 b1-00360603 381001-100469 11257 arc Out 4.1 31250 32191 30226 32 03:24 r1-00360603 381001-100469 11257 arc Out 4.1 31250 32191 30226 33 03:26 b1-00360604 381001-100469 11257 sci Out 900.1 31250 32191 30226 34 03:26 r1-00360604 381001-100469 11257 sci Out 900.1 31250 32191 30226 35 04:03 r1-00360605 387402-101709 11258 arc Out 4.1 31250 32191 30226 36 04:03 b1-00360605 387402-101709 11258 arc Out 4.1 31250 32191 30226 37 04:06 b1-00360606 387402-101709 11258 sci Out 900.1 31250 32191 30226 38 04:06 r1-00360606 387402-101709 11258 sci Out 900.1 31250 32191 30226 39 04:25 b1-00360607 383677-100608 11259 arc Out 4.1 31250 32191 30226 40 04:25 r1-00360607 383677-100608 11259 arc Out 4.1 31250 32191 30226 41 04:27 b1-00360608 383677-100608 11259 sci Out 900.0 31250 32191 30226 42 04:27 r1-00360608 383677-100608 11259 sci Out 900.0 31250 32191 30226 43 04:46 b1-00360609 383641-100600 11260 arc Out 4.1 31250 32191 30226 44 04:46 r1-00360609 383641-100600 11260 arc Out 4.1 31250 32191 30226 45 04:48 r1-00360610 383641-100600 11260 sci Out 900.0 31250 32191 30226 46 04:48 b1-00360610 383641-100600 11260 sci Out 900.0 31250 32191 30226 47 05:07 r1-00360611 388136-101781 11261 arc Out 4.1 31250 32191 30226 48 05:07 b1-00360611 388136-101781 11261 arc Out 4.1 31250 32191 30226 49 05:09 b1-00360612 388136-101781 11261 sci Out 900.0 31250 32191 30226 50 05:09 r1-00360612 388136-101781 11261 sci Out 900.0 31250 32191 30226 51 06:34 r1-00360613 387270-101689 11267 arc Lef 4.1 31250 32191 30226 HART 52 06:34 b1-00360613 387270-101689 11267 arc Lef 4.1 31250 32191 30226 HART 53 06:35 b1-00360614 387270-101689 11267 arc Rig 4.1 31250 32191 30226 HART 54 06:35 r1-00360614 387270-101689 11267 arc Rig 4.1 31250 32191 30226 HART 55 06:36 r1-00360615 387270-101689 11267 arc Out 4.1 29000 29941 27977 56 06:36 b1-00360615 387270-101689 11267 arc Out 4.1 29000 29941 27977 57 06:39 b1-00360616 387270-101689 11267 sci Out 900.0 29000 29941 27977 58 06:39 r1-00360616 387270-101689 11267 sci Out 900.0 29000 29941 27977 59 06:58 r1-00360617 387443-101718 11268 arc Out 4.0 29000 29941 27977 60 06:58 b1-00360617 387443-101718 11268 arc Out 4.0 29000 29941 27977 61 07:00 b1-00360618 387443-101718 11268 sci Out 900.0 29000 29941 27977 62 07:00 r1-00360618 387443-101718 11268 sci Out 900.0 29000 29941 27977 63 07:19 r1-00360619 387487-101727 11269 arc Out 4.1 29000 29941 27977 64 07:19 b1-00360619 387487-101727 11269 arc Out 4.1 29000 29941 27977 65 07:22 r1-00360620 387487-101727 11269 sci Out 900.1 29000 29941 27977 66 07:22 b1-00360620 387487-101727 11269 sci Out 900.1 29000 29941 27977 67 07:41 r1-00360621 389557-102064 11270 arc Out 4.0 29000 29941 27977 68 07:41 b1-00360621 389557-102064 11270 arc Out 4.0 29000 29941 27977 69 07:44 b1-00360622 389557-102064 11270 sci Out 900.1 29000 29941 27977 70 07:44 r1-00360622 389557-102064 11270 sci Out 900.1 29000 29941 27977 71 08:03 r1-00360623 383523-100580 11271 arc Out 4.1 29000 29941 27977 72 08:03 b1-00360623 383523-100580 11271 arc Out 4.1 29000 29941 27977 73 08:06 r1-00360624 383523-100580 11271 sci Out 900.0 29000 29941 27977 74 08:06 b1-00360624 383523-100580 11271 sci Out 900.0 29000 29941 27977 75 08:25 b1-00360625 389542-102058 11272 arc Out 4.1 29000 29941 27977 76 08:25 r1-00360625 389542-102058 11272 arc Out 4.1 29000 29941 27977 77 08:27 b1-00360626 389542-102058 11272 sci Out 900.0 29000 29941 27977 78 08:27 r1-00360626 389542-102058 11272 sci Out 900.0 29000 29941 27977 79 08:46 b1-00360627 393603-103429 11273 arc Out 4.1 29000 29941 27977 80 08:46 r1-00360627 393603-103429 11273 arc Out 4.1 29000 29941 27977 81 08:49 r1-00360628 393603-103429 11273 sci Out 900.1 29000 29941 27977 82 08:49 b1-00360628 393603-103429 11273 sci Out 900.1 29000 29941 27977 83 09:08 r1-00360629 393439-103382 11274 arc Out 4.1 29000 29941 27977 84 09:08 b1-00360629 393439-103382 11274 arc Out 4.1 29000 29941 27977 85 09:10 r1-00360630 393439-103382 11274 sci Out 900.1 29000 29941 27977 86 09:10 b1-00360630 393439-103382 11274 sci Out 900.1 29000 29941 27977 87 09:29 b1-00360631 393426-103375 11275 arc Out 4.1 29000 29941 27977 88 09:29 r1-00360631 393426-103375 11275 arc Out 4.1 29000 29941 27977 89 09:31 b1-00360632 393426-103375 11275 sci Out 900.1 29000 29941 27977 90 09:31 r1-00360632 393426-103375 11275 sci Out 900.1 29000 29941 27977 91 09:50 r1-00360633 394663-103794 11276 arc Out 4.1 29000 29941 27977 92 09:50 b1-00360633 394663-103794 11276 arc Out 4.1 29000 29941 27977 93 09:52 b1-00360634 394663-103794 11276 sci Out 900.1 29000 29941 27977 94 09:52 r1-00360634 394663-103794 11276 sci Out 900.1 29000 29941 27977 95 10:11 r1-00360635 393566-103415 11277 arc Out 4.1 29000 29941 27977 96 10:11 b1-00360635 393566-103415 11277 arc Out 4.1 29000 29941 27977 97 10:14 r1-00360636 393566-103415 11277 sci Out 900.1 29000 29941 27977 98 10:14 b1-00360636 393566-103415 11277 sci Out 900.1 29000 29941 27977 99 10:33 b1-00360637 394184-103679 11278 arc Out 4.1 29000 29941 27977 100 10:33 r1-00360637 394184-103679 11278 arc Out 4.1 29000 29941 27977 101 10:36 b1-00360638 394184-103679 11278 sci Out 900.1 29000 29941 27977 102 10:36 r1-00360638 394184-103679 11278 sci Out 900.1 29000 29941 27977 103 10:55 r1-00360639 394563-103770 11279 arc Out 4.1 29000 29941 27977 104 10:55 b1-00360639 394563-103770 11279 arc Out 4.1 29000 29941 27977 105 11:00 b1-00360640 394563-103770 11279 sci Out 900.1 29000 29941 27977 106 11:00 r1-00360640 394563-103770 11279 sci Out 900.1 29000 29941 27977 107 11:19 r1-00360641 394216-103685 11280 arc Out 4.1 29000 29941 27977 108 11:19 b1-00360641 394216-103685 11280 arc Out 4.1 29000 29941 27977 109 11:21 b1-00360642 394216-103685 11280 sci Out 900.1 29000 29941 27977 110 11:21 r1-00360642 394216-103685 11280 sci Out 900.1 29000 29941 27977 111 11:40 r1-00360643 394403-103727 11281 arc Out 4.1 29000 29941 27977 112 11:40 b1-00360643 394403-103727 11281 arc Out 4.1 29000 29941 27977 113 11:42 b1-00360644 394403-103727 11281 sci Out 900.1 29000 29941 27977 114 11:42 r1-00360644 394403-103727 11281 sci Out 900.1 29000 29941 27977 115 12:01 r1-00360645 393423-103374 11282 arc Out 4.1 29000 29941 27977 116 12:01 b1-00360645 393423-103374 11282 arc Out 4.1 29000 29941 27977 117 12:03 r1-00360646 393423-103374 11282 sci Out 900.1 29000 29941 27977 118 12:03 b1-00360646 393423-103374 11282 sci Out 900.1 29000 29941 27977 119 12:22 r1-00360647 394450-103739 11283 arc Out 4.1 29000 29941 27977 120 12:22 b1-00360647 394450-103739 11283 arc Out 4.1 29000 29941 27977 121 12:25 r1-00360648 394450-103739 11283 sci Out 900.0 29000 29941 27977 122 12:25 b1-00360648 394450-103739 11283 sci Out 900.0 29000 29941 27977 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 00:01:30 6.8 -659 -3.2 184 -2.6 02:21:40 5.8 2308 -4.2 1828 1.5 06:36:10 5.8 -2638 5.8 -2250 -1.2 ---- Weather Log ---- Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 60245 Fill night time in Hours below *=*=*= Total bright time : 11.0 *=*=*= Bright time, queued observations : 8.5 *=*=*= Bright time, commissioning/engineering: 1.1 *=*=*= Bright time lost to weather : 0 *=*=*= Bright time lost to technical issues : 1.4 *=*=*= Total dark time : 0 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 0 ---- Problems in Detail ---- fliswarm reconnect: 23:50:10 APO.dmbiz 50 fliswarm f error="Command 'reconnect' failed because of an uncaught error 'DockerException: Error while fetching server API version: HTTPConnectionPool(host='sdss-gfa4', port=2375): Max retries exceeded with url: /version (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused'))'. See traceback in the log for more information." 23:50:10 CmdDone: APO.dmbiz 50 fliswarm reconnect