Subject: 2.5m obslog 20221205 (SJD 59919) From: dmbiz@apo.nmsu.edu Date: Tue, 6 Dec 2022 11:44:25 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Monday December 05, 2022 (SJD 59919) ---- Observing Team ---- Dmitry Bizyaev ---- Observing Plan ---- Mon 05 Dec 2022 59919 0.97 00:54 01:09 12:39 23:05 10:36 Day bright (11.7 h, w/ 0.3 h for 12 deg design) ---- Observing Summary ---- The entire night was lost due to high humidity, fog and cloudy sky. Notes ----- - evening APOGEE calibrations are mislabeled again. Then we tried to run them again, and finally fixed the problem, see below. The last set of evening calibrations is labelled correctly. - the problem of not matching keywords in the headers of some APOGEE calibration (at least) files was found and fixed. Developers ran an experimental version of apogeeql. After we rolled back to the standard version of apogeeql, the problem disappeared. ---- Engineering Issues ---- none ---- Observing Log ---- Afternoon --------- All systems found responsive. Jaeger actor was restarted. BOSS collimation looks OK, blue ring is not adjusted. 22:53:49 Hartmann collimate output sp1: offset: r= -2308 (Out of focus); b= 0.8 (In Focus) sp1: pred. move: spAverageMove= -1282 sp1: pred. resid: r= -1025, b= -3.2, txt= OK, spTemp = 5.5 Ventilation postponed due to high humidity and nearby radars. Night ----- 22:24:49 apogee exposure file= apRaw-43570002 60 A Dark 22:25:02 apogee exposure file= apRaw-43570003 10 A QuartzFlat 22:26:57 apogee exposure file= apRaw-43570004 12 B ArcLamp 22:29:10 apogee exposure file= apRaw-43570005 40 B ArcLamp 22:36:28 apogee exposure file= apRaw-43570006 12 A ArcLamp 22:38:40 apogee exposure file= apRaw-43570007 40 A ArcLamp 22:46:06 apogee exposure file= apRaw-43570008 60 A Dark 22:48:11 boss exposure 0 sec file=0349542 bias 22:50:28 boss exposure 20 sec file=0349543 dark 22:51:46 boss exposure 4 sec file=0349544 arc 22:52:28 boss exposure 4 sec file=0349545 arc 22:53:55 Hartmann: offset r= -2308 (Out of focus) b = 0.8 (In Focus) pred_move = -1282 pred_resid r= -1025 b= -3.2 cmnt=OK 22:56:58 apogee exposure file= apRaw-43570009 30 A ArcLamp 00:28:25 apogee exposure file= apRaw-43570010 60 A Dark 00:39:24 apogee exposure file= apRaw-43570011 10 A QuartzFlat 00:41:19 apogee exposure file= apRaw-43570012 12 B ArcLamp 00:43:31 apogee exposure file= apRaw-43570013 40 B ArcLamp 00:50:48 apogee exposure file= apRaw-43570014 12 A ArcLamp 00:53:01 apogee exposure file= apRaw-43570015 40 A ArcLamp 01:00:33 apogee exposure file= apRaw-43570016 60 A Dark 01:11:25 apogee exposure file= apRaw-43570017 30 A ArcLamp 01:45:10 apogee exposure file= apRaw-43570018 60 A Dark 01:56:09 apogee exposure file= apRaw-43570019 10 A QuartzFlat 01:58:04 apogee exposure file= apRaw-43570020 12 B ArcLamp 02:00:16 apogee exposure file= apRaw-43570021 40 B ArcLamp 02:07:34 apogee exposure file= apRaw-43570022 12 A ArcLamp 02:09:46 apogee exposure file= apRaw-43570023 40 A ArcLamp 02:17:12 apogee exposure file= apRaw-43570024 60 A Dark 02:28:04 apogee exposure file= apRaw-43570025 30 A ArcLamp 02:39:25 apogee exposure file= apRaw-43570026 60 A Dark 02:50:24 apogee exposure file= apRaw-43570027 10 A QuartzFlat 02:52:19 apogee exposure file= apRaw-43570028 12 B ArcLamp 02:54:32 apogee exposure file= apRaw-43570029 40 B ArcLamp 03:01:49 apogee exposure file= apRaw-43570030 12 A ArcLamp 03:04:02 apogee exposure file= apRaw-43570031 40 A ArcLamp 03:11:28 apogee exposure file= apRaw-43570032 60 A Dark 03:22:20 apogee exposure file= apRaw-43570033 30 A ArcLamp IGNORE THE FOLLOWING DESIGN AND EXPOSURES, below: they are not real and were taken for test. There is no signal in them. =================================================== =====>>>>> 07:32:11 Config Loaded: 104415-128158-7816 =================================================== 07:33:49 apogee exposure file= apRaw-43570034 44 A Object 07:34:06 boss exposure 900 sec file=0349546 science 07:41:46 apogee exposure file= apRaw-43570035 44 B Object 11:40Z calibrations started LN2 force filled ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0110 0.0080 Axial B: 0.0080 0.0040 Axial C: -0.0230 -0.0290 Trans D: 0.0420 0.0320 Lateral E: 0.3315 0.3320 Lateral F: 0.5355 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 92.83 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -0.0310 -0.0330 Axial B: -0.0240 -0.0290 Axial C: -0.0490 -0.0450 Trans D: -0.2740 -0.3170 GALILS Commanded: 4894200 4865200 4960950 -50 -3450 Actual: 4859463 4859356 4859463 -50 -3450 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.17 -0.02 -0.03 -0.02 42.88 ---- Telescope Status ---- We didn't open No interlocks bypassed Status at: 11:42Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 696/715 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 167 lbs, 23 psi FPS Status ========== CP10 Loop = 7.15 L/min GFA Loop = 1.64 L/min Supply pressure = 41.3 psi Return pressure = 28.6 psi Chiller Status ============== Set temperarature = 5.5 C Flow = 5.2 Gpm ---- Software Used ---- STUI : 1.7.18b1 alerts : 2.3.0 boss : 6.0.2-alpha.0 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.3.1 jaeger : 1.2.0b1 kaiju : 1.3.0 coordio : 1.5.0b1 fps_calibrati : 2022.09.11+7ffa0ab cherno : 0.4.0b3 astrometrynet : 0.91 hal : 0.3.1a0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 35 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : 2.0.0a0 STUIAdditions : FAILED Boson : 0.1.2-beta.1 --------------Other Versions-------------- sdss-obstools : 3.9.2 TPM : 1.2-31-gd7eb MCP : 2.1 PLC : V35 Fiducials : v1_148 idlspec2d : v6_0_9 Kronos : 1.5.0 roboscheduler : 1.2.2 /dev/sdb1 2.0T 223G 1.8T 11% /home 10.25.1.230:/data 21T 8.9T 12T 45% /data ---- APOGEE Data Summary ---- APOGEE data list, mjd=59919, all raw_data: /data/apogee/utr_cdr/59919/apRaw-*.fits archive: /data/apogee/archive/59919/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59919/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 59919 1 22:11 43570001 Dark 3 A 13.0 ---------- a-b-c - - 59919 2 22:24 43570002 Dark 60 A 13.0 ---------- a-b-c - - 59919 3 22:26 43570003 QuarFlat 10 A 13.0 ---------- a-b-c - - 59919 4 22:28 43570004 Arc-Une 12 B 13.5 ---------- a-b-c - - cannot read file : /data/apogee/quickred/59919/apq-43570005.fits 59919 6 22:38 43570006 Arc-Une 12 A 13.0 ---------- a-b-c - - cannot read file : /data/apogee/quickred/59919/apq-43570007.fits 59919 8 22:56 43570008 Dark 60 A 13.0 ---------- a-b-c - - 59919 9 23:02 43570009 Arc---- 30 A 13.0 ---------- a-b-c - 86 FPI 59919 10 00:38 43570010 Dark 60 A 13.0 ---------- a-b-c - - 59919 11 00:41 43570011 QuarFlat 10 A 13.0 ---------- a-b-c - - 59919 12 00:43 43570012 Arc-Une 12 B 13.5 ---------- a-b-c - - cannot read file : /data/apogee/quickred/59919/apq-43570013.fits 59919 14 00:52 43570014 Arc-Une 12 A 13.0 ---------- a-b-c - - 59919 15 00:59 43570015 Arc---- 40 A 13.0 ---------- a-b-c - 8 59919 16 01:10 43570016 Dark 60 A 13.0 ---------- a-b-c - - 59919 17 01:16 43570017 Arc---- 30 A 13.0 ---------- a-b-c - 86 FPI 59919 18 01:55 43570018 Dark 60 A 13.0 ---------- a-b-c - - 59919 19 01:57 43570019 QuarFlat 10 A 13.0 ---------- a-b-c - - 59919 20 02:00 43570020 Arc-Une 12 B 13.5 ---------- a-b-c - - cannot read file : /data/apogee/utr_cdr/59919/apRaw-43570021.fits 59919 22 02:09 43570022 Arc-Thar 12 A 13.0 ---------- a-b-c 2.61 - 59919 23 02:16 43570023 Arc-Une 40 A 13.0 ---------- a-b-c - - 59919 24 02:27 43570024 Dark 60 A 13.0 ---------- a-b-c - - 59919 25 02:33 43570025 Arc---- 30 A 13.0 ---------- a-b-c - 87 FPI 59919 26 02:49 43570026 Dark 60 A 13.0 ---------- a-b-c - - 59919 27 02:52 43570027 QuarFlat 10 A 13.0 ---------- a-b-c - - 59919 28 02:54 43570028 Arc-Thar 12 B 13.5 ---------- a-b-c 3.08 - 59919 29 03:01 43570029 Arc-Une 40 B 13.5 ---------- a-b-c - - 59919 30 03:03 43570030 Arc-Thar 12 A 13.0 ---------- a-b-c 2.62 - 59919 31 03:10 43570031 Arc-Une 40 A 13.0 ---------- a-b-c - - 59919 32 03:21 43570032 Dark 60 A 13.0 ---------- a-b-c - - 59919 33 03:27 43570033 Arc---- 30 A 13.0 ---------- a-b-c - 86 FPI 59919 34 07:41 43570034 Object 44 A 13.0 128158-7816 a-b-c err 0,0 test 59919 35 07:49 43570035 Object 44 B 13.5 128158-7816 a-b-c err 0,0 test cannot read file : /data/apogee/utr_cdr/59919/apRaw-43570036.fits ------------------------------------------------------------------------------ ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 22:53:50 4.8 -2308 0.8 -1282 -3.2 ---- Weather Log ---- Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma 19:00 5.9 1.4 19.4 250.4 dpDep 19:15 4.8 1.4 18.3 276.5 dpDep 19:30 5.1 1.4 18.0 240.5 dpDep 19:45 6.1 1.4 20.3 248.7 dpDep 20:00 6.6 1.4 21.2 261.8 dpDep 20:15 5.0 1.3 22.4 280.2 dpDep 20:30 5.2 1.3 23.0 281.0 dpDep 20:45 5.7 1.3 23.9 264.6 dpDep 21:00 6.0 1.3 22.1 256.3 dpDep 21:15 5.1 1.3 18.9 255.2 dpDep 21:30 4.5 1.3 16.7 278.5 dpDep 21:45 5.8 1.1 23.8 254.6 dpDep 22:00 5.1 1.3 19.7 274.6 dpDep 22:15 5.1 1.2 17.4 259.8 dpDep 22:30 5.3 1.3 19.9 273.0 dpDep 22:45 5.2 1.3 15.1 269.5 dpDep 23:00 5.7 1.3 14.0 268.8 dpDep 23:15 5.3 1.3 13.3 265.5 dpDep 23:30 5.4 1.3 13.1 245.2 dpDep 23:45 5.2 1.3 16.2 244.9 dpDep 00:00 4.9 1.2 15.9 233.1 dpDep 00:15 5.0 1.3 15.3 225.9 dpDep 00:30 4.9 1.1 15.2 258.6 dpDep 398 69.62 00:45 4.8 1.2 16.7 241.4 dpDep 393 86.91 01:00 4.8 1.2 6.3 257.4 dpDep 335 85.80 01:15 4.9 1.2 18.9 272.0 dpDep 343 34.68 01:30 4.7 1.2 9.2 271.5 dpDep 342 4.39 01:45 4.8 1.2 14.7 272.6 dpDep 348 53.62 02:00 4.6 1.0 15.8 258.8 dpDep 365 83.74 02:15 4.8 1.2 15.8 244.6 dpDep 467 27.61 02:30 4.8 0.7 14.9 250.3 dpDep 460 34.31 02:45 4.7 -0.4 15.5 262.1 dpDep 387 25.94 03:00 4.8 0.9 10.2 265.7 dpDep 475 11.84 03:15 4.8 0.3 15.1 267.4 dpDep 497 8.86 03:30 4.9 0.6 16.4 267.6 dpDep 489 21.34 03:45 4.8 1.1 17.6 268.4 dpDep 514 5.00 04:00 4.9 0.6 18.5 266.5 dpDep 524 4.93 04:15 5.0 0.8 18.5 257.0 dpDep 524 4.73 04:30 5.0 1.1 19.7 268.1 dpDep 523 7.64 04:45 5.1 0.8 19.8 250.2 dpDep 525 5.03 05:00 5.1 0.9 25.1 261.6 dpDep 512 21.53 05:15 5.0 0.9 15.9 267.3 dpDep 520 4.81 05:30 5.0 0.7 25.6 254.6 dpDep 500 5.28 05:45 4.9 0.9 23.5 266.0 dpDep 516 5.66 06:00 4.9 0.8 15.8 267.1 dpDep 521 6.29 06:15 4.8 0.8 23.1 263.8 dpDep 518 6.06 06:30 4.7 0.1 23.4 266.9 dpDep 518 5.02 06:45 4.6 0.6 23.3 265.9 dpDep 503 5.95 07:00 4.6 0.9 22.1 272.7 dpDep 516 7.85 07:15 4.6 0.7 22.7 267.3 dpDep 318 5.87 07:30 4.4 0.8 23.6 270.3 dpDep 516 6.00 07:45 4.4 0.6 22.6 263.9 dpDep 516 4.74 08:00 4.3 -1.2 22.4 257.8 dpDep 516 4.59 08:15 4.3 0.2 20.7 259.6 dpDep 517 5.07 08:30 4.3 0.8 22.1 269.1 dpDep 516 4.84 08:45 4.2 0.7 29.1 270.5 dpDep 515 4.74 09:00 4.1 -0.8 21.5 259.5 dpDep 514 5.22 09:15 4.0 0.1 19.9 256.0 dpDep 513 5.80 09:30 3.9 0.1 25.1 247.5 dpDep 514 4.65 09:45 3.7 1.2 23.1 263.2 dpDep 507 6.03 10:00 3.4 -0.2 25.5 268.1 dpDep 494 16.07 10:15 3.1 0.1 19.5 264.9 dpDep 377 15.31 10:30 3.1 0.9 16.6 245.1 dpDep 502 5.46 10:45 3.1 0.4 20.7 262.3 dpDep 504 6.63 11:00 2.9 -0.5 19.3 271.6 dpDep 501 18.07 11:15 2.7 0.6 22.2 270.9 dpDep 393 65.50 11:30 2.6 0.8 18.9 269.6 dpDep 496 28.10 ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 59919 Fill night time in Hours below *=*=*= Total bright time : 11.7 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 11.7 *=*=*= Bright time lost to technical issues : 0 *=*=*= Total dark time : 0 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 0 ---- Problems in Detail ---- 22:57:08 OBSERVER.dmbiz 39 jaeger f error="Command 'power on --gfas' failed because of an uncaught error 'JaegerError: Some positioners failed to initialise: Positioner 1318: failed retrieving firmware version.'. See traceback in the log for more information." 23:00:59 OBSERVER.dmbiz 46 jaeger f error="Command 'power on' failed because of an uncaught error 'JaegerError: Some positioners failed to initialise: Positioner 103: cannot get status.'. See traceback in the log for more information."