Subject: 2.5m obslog 20210321 (SJD 59295) From: dmbiz@apo.nmsu.edu Date: Mon, 22 Mar 2021 11:42:07 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday March 21, 2021 (SJD 59295) ---- Observing Team ---- Dan Oravetz Dmitry Bizyaev ---- Observing Plan ---- Sun 21 Mar 2021 59295 MWM until 09:00 (7.2 h), then BHM (2.9 h) ---- Observing Summary ---- The entire night was lost to nearby radars and clouds. MWM lost 7.2 h, then BHM lost 2.9 h. Notes: - Although we did not open completely, some dust was accumulated during the ventilation. We estimate it was 3K. - We had to bypass the control room stop in the NW interlocks rack. DanO connected the CR-estop port (WB3-73) with an available +24Volts port (WB3-71). We are able to use telescope now, but THE E-STOP BUTTON IN THE CONTROL ROOM IS BYPASSED, i.e. it won't work. APO-23 ticket opened for this problem. - at 2:10Z we've had the AZ moving problem, and the wind_az_ready bit was set red. When we actually tried to move in those conditions, the telescope platform moved in Az, but the wind baffle stayed still (which is expected, given the interlock), and then the AZ axis went out of closed loop. We went downstairs, took pictures of the wind baffle box insides, and then power cycled the box. Visually noticed that the LED configuration did not change after the power cycling, but the red bit turned green, and AZ axis was able to move. DanO has attached pictures to APO-22 Jira ticket. - SoS raised warnings like WARNING: SOS disk /data/boss/sos/59295 is 96% full Kaike allowed to clean space in /data/boss/sos/ up to the end of 2015. We cleaned /data/boss/sos/ files up to MJD=57388, which is December 31, 2015. We freed 129 Gb, but since the SoS space is a part of /data/, it feed only 1%. Now: 10.26.1.1:/data 11T 11T 635G 95% /data So the problem is not in SoS data per se - /data/ disk should be cleaned, globally. According to Nathan's correspondence from today, transferring to the new disk is still going. ---- Observing Log ---- ================================================================================ AFTERNOON CHECKOUT ================================================================================ My first attempts at initializing the telescope axes have so far failed this afternoon. The Control Room E-stop is constantly reporting an 'ON' state in the Interlocks even though it is disengaged. It doesn't appear to be a stale Interlocks display either because the other E-stops register quickly in the various Interlocks displays (both down at the podium laptop and in the control room). ================================================================================ NIGHT ================================================================================ Opening delayed due to the overcast sky and nearby radars. Before the sunset we contacted Ryan about the stop button. Ryan recommended to bypass the control room stop in the NW interlocks rack. We were able to find the CR-estop connector, and DanO short wired it with +24Volts port. In terms of numbers inside the rack, port 71 was connected with port 73 in the 3rd stand from the left. Corresponding PLC red-LED indicator in the same rack, on top on the stand went on, and the red button in the MCP Interlocks menu turned green. 2:25Z conditions permit. We started ventilation. 04:01Z the dust is peaking sharply. We stopped ventilation and closed doors. We did not have a chance to open. The last part of the night was lost to nearby radars and cloudy sky. 11:35Z morning cals started. ---- BOSS Spectrograph Collimation Summary ---- Afternoon focus check ===================== 23:01:46 boss exposure 4.0, file=327732 23:02:56 boss exposure 4.0, file=327733 23:04:17 sp1.motor.move= -145, -145, -145 23:04:17 Hartmann collimate output on cart #5 sp1: offset: r= -1319 (Out of focus); b= -3.2 (In Focus) sp1: pred. move: spAverageMove= -145 sp1: pred. resid: r= -1173, b= -3.7, txt= OK, spTemp = 6.5 23:04:13 OBSERVER.doravetz.sop 59 hartmann w r1MeanOffset=-0.20,"Out of focus" 23:04:13 OBSERVER.doravetz.sop 59 hartmann i b1MeanOffset=0.16,"In Focus No adjustments made to the blue focus ring based on last night's residuals and tonight's temperature forecast. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9280 -4.9280 Axial B: -4.6680 -4.6660 Axial C: -5.7680 -5.7770 Trans D: -4.3540 -4.3890 Lateral E: 0.3745 0.3750 Lateral F: 0.5695 0.5675 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 9.11 Altitude: 30.000038956303893 MIGS TONIGHT NOMINAL Axial A: -9.4430 -9.4420 Axial B: -9.4080 -9.4070 Axial C: -9.4860 -9.4960 Trans D: 0.0500 0.0420 GALILS Commanded: 4618200 4600700 4660200 -2000 -6600 Actual: 4605309 4587262 4633549 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3658.12 -13.98 -2.85 12.73 114.19 ---- Telescope Status ---- 02:25Z Started ventilation 04:01Z stopped ventilation THE E-STOP BUTTON IN THE CONTROL ROOM IS BYPASSED Status at: 11:40Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 5 Counterweights at: 448 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 200 lbs, 24 psi ---- Software Used ---- --- Afternoon disk space --- /dev/vdd 688G 602G 86G 88% /home /dev/vdc1 11T 11T 549G 96% /data 10.25.1.230:/data 21T 9.0T 12T 45% /sdss5_data Get Versions, 03/21/21, 23:43:55 --- STUI software --- STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.4 hartmann : 1.8.0 hub : v4.2.4 mcp : 2.0 -mcp.plc : 34 -mcp.azFiduci : v1_144 -mcp.altFiduc : v1_144 -mcp.rotFiduc : v1_144 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.4 --- Other versions --- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.3 autoscheduler : 1.5.4 sdss_python_module: trunk Setting up: idlspec2d Flavor: Linux64 Version: v5_7_12 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_20 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_6_7 Setting up: |sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: |psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: |idl Flavor: Linux64 Version: 7.1 Setting up: |dust Flavor: Linux64 Version: v0_1 Setting up: |photolog Flavor: Linux64 Version: trunk Setting up: actorcore Flavor: Linux64 Version: v4_1_8 Setting up: |opscore Flavor: Linux64 Version: v2_5 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: master Setting up: |plc Flavor: Linux64 Version: v30_2 Setting up: |sdsstools Flavor: Linux64 Version: v4_33 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.6.9 -- Other versions ---- ---- APOGEE Data Summary ---- [observer@sdss4-hub ~]$ list_ap -m 59294 -morning APOGEE data list, mjd=59294, morning raw_data: /data/apogee/utr_cdr/59294/apRaw-*.fits archive: /data/apogee/archive/59294/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59294/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59294 1 12:09 37320094 Dark 60 A 13.0 5-15173 a-b-c - - 59294 2 12:20 37320095 Dark 60 A 13.0 5-15173 a-b-c - - 59294 3 12:31 37320096 Dark 60 A 13.0 5-15173 a-b-c - - 59294 4 12:41 37320097 QuarFlat 10 A 13.0 5-15173 a-b-c - 46 59294 5 12:43 37320098 QuarFlat 10 A 13.0 5-15173 a-b-c - 46 59294 6 12:45 37320099 QuarFlat 10 A 13.0 5-15173 a-b-c - 45 59294 7 12:47 37320100 Arc-Thar 12 A 13.0 5-15173 a-b-c -1.44 - 59294 8 12:49 37320101 Arc-Thar 12 A 13.0 5-15173 a-b-c -1.44 - 59294 9 12:51 37320102 Arc-Une 40 A 13.0 5-15173 a-b-c - - 59294 10 12:58 37320103 Arc-Une 40 A 13.0 5-15173 a-b-c - - 59294 11 13:06 37320104 Dark 30 A 13.0 5-15173 a-b-c - - 59294 12 13:11 37320105 InteFlat 30 A 13.0 5-15173 a-b-c - 0 59294 13 13:16 37320106 InteFlat 30 A 13.0 5-15173 a-b-c - 0 59294 14 13:22 37320107 InteFlat 30 A 13.0 5-15173 a-b-c - 0 59294 15 13:27 37320108 Dark 30 A 13.0 5-15173 a-b-c - - -------------------------------------------------------------------------------- APOGEE data list, mjd=59295, all raw_data: /data/apogee/utr_cdr/59295/apRaw-*.fits archive: /data/apogee/archive/59295/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59295/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59295 1 22:58 37330001 Dark 3 A 13.0 5-15173 a-b-c - - 59295 2 23:00 37330002 Dark 60 A 13.0 5-15173 a-b-c - - 59295 3 23:11 37330003 QuarFlat 10 A 13.0 5-15173 a-b-c - 46 59295 4 23:13 37330004 Arc-Thar 12 A 13.0 5-15173 a-b-c -1.48 - 59295 5 23:15 37330005 Arc-Thar 12 A 13.0 5-15173 a-b-c -1.47 - 59295 6 23:17 37330006 Arc-Une 40 A 13.0 5-15173 a-b-c - - 59295 7 23:24 37330007 Arc-Une 40 A 13.0 5-15173 a-b-c - - 59295 8 23:32 37330008 Dark 60 A 13.0 5-15173 a-b-c - - 59295 9 11:40 37330009 Dark 60 A 13.0 ------- x-x-x - - -------------------------------------------------------------------------------- ---- BOSS Data Summary ---- Reading FITS from /data/spectro/59295/ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n time filename crt plt flav Shu Dth exp colA colB colC Hrt b1 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 22:58 b1-00327730 5 15173 arc Lef C 4.1 7738 7756 7806 HART 22:58 r1-00327730 5 15173 arc Lef C 4.1 7738 7756 7806 HART 2 22:59 b1-00327731 5 15173 arc Rig C 4.1 7738 7756 7806 HART 22:59 r1-00327731 5 15173 arc Rig C 4.1 7738 7756 7806 HART 3 23:01 b1-00327732 5 15173 arc Lef C 4.1 8730 8748 8799 HART 23:01 r1-00327732 5 15173 arc Lef C 4.1 8730 8748 8799 HART 4 23:02 b1-00327733 5 15173 arc Rig C 4.1 8730 8748 8799 HART 23:02 r1-00327733 5 15173 arc Rig C 4.1 8730 8748 8799 HART 5 23:42 b1-00327734 5 15173 bia Clo C 0.0 8585 8603 8654 23:42 r1-00327734 5 15173 bia Clo C 0.0 8585 8603 8654 6 23:44 b1-00327735 5 15173 fla Out C 25.1 8585 8603 8654 23:44 r1-00327735 5 15173 fla Out C 25.1 8585 8603 8654 7 23:46 b1-00327736 5 15173 arc Out C 4.1 8585 8603 8654 23:46 r1-00327736 5 15173 arc Out C 4.1 8585 8603 8654 8 11:31 b1-00327737 5 15173 bia Clo C 0.0 8585 8603 8654 11:31 r1-00327737 5 15173 bia Clo C 0.0 8585 8603 8654 9 11:32 b1-00327738 5 15173 bia Clo C 0.0 8585 8603 8654 11:32 r1-00327738 5 15173 bia Clo C 0.0 8585 8603 8654 10 11:33 b1-00327739 5 15173 bia Clo C 0.0 8585 8603 8654 11:33 r1-00327739 5 15173 bia Clo C 0.0 8585 8603 8654 11 11:35 b1-00327740 5 15173 bia Clo C 0.0 8585 8603 8654 11:35 r1-00327740 5 15173 bia Clo C 0.0 8585 8603 8654 12 11:36 b1-00327741 5 15173 bia Clo C 0.0 8585 8603 8654 11:36 r1-00327741 5 15173 bia Clo C 0.0 8585 8603 8654 13 11:37 b1-00327742 5 15173 bia Clo C 0.0 8585 8603 8654 11:37 r1-00327742 5 15173 bia Clo C 0.0 8585 8603 8654 14 11:39 b1-00327743 5 15173 bia Clo C 0.0 8585 8603 8654 11:39 r1-00327743 5 15173 bia Clo C 0.0 8585 8603 8654 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- OK ---