Subject: 2.5m obslog 20240430 (SJD 60431) From: asimmons@apo.nmsu.edu Date: Wed, 1 May 2024 11:04:47 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday April 30, 2024 (SJD 60431) ---- Observing Team ---- Audrey Oravetz John Downey (support) ---- Observing Plan ---- Tue 30 Apr 2024 60431 0.52 02:42 02:58 11:01 10:33 18:37 --- dark until 08:20 ( 5.4 h), then bright ( 3.7 h) ---- Observing Summary ---- The telescope was not operational tonight due to two critical points of failures. JohnD came to the site. In an attempt to open, the NE wheel truck made an increasingly loud and abnormal grinding noise. The enclosure was moved back to home. The chiller repeatedly kept shutting off - the first indicator of a leak. John found it in the south elephant trunk (same spot as last time). ---- Observing Log ---- Afternoon: ========== 21:40:48 boss exposure 0.0, file=368157 21:43:33 boss exposure 20.0, file=368158 21:45:27 boss exposure 4.0, file=368159 21:46:06 boss exposure 4.0, file=368160 21:46:50 sp1.motor.move= 1321, 1321, 1320 21:46:50 Hartmann collimate output sp1: offset: r= 329 (In Focus); b= -7.3 (Out of focus) sp1: pred. move: spAverageMove= 1321 sp1: pred. resid: r= -992, b= -3.1, txt= OK, spTemp = 7.9 21:47:17 boss exposure 4.0, file=368161 21:50:11 boss exposure 25.0, file=368162 21:51:03 Config Loaded: -999-14050 21:51:54 jaeger.jaeger 184 fliswarm i filename_bundle=/data/fcam/60431/fimg-fvc1n-0001.fits 21:51:54 jaeger.jaeger 184 fliswarm : 21:51:54 CmdDone: jaeger.jaeger 184 fliswarm talk -c fvc expose 5.0 21:53:11 APO.asimmons 84 fliswarm i filename_bundle=/data/fcam/60431/fimg-fvc1n-0002.fits 21:53:11 APO.asimmons 84 fliswarm : 21:53:12 CmdDone: APO.asimmons 84 fliswarm talk -n fvc expose 50 fliswarm talk -c gfa expose --bias --count 10 fliswarm talk -c gfa expose --dark --count 5 5 jaeger configuration random --danger jaeger configuration reverse 01:15Z - Started ventilating. (observers39) [observer@sdss5-hub: ~]$ list_ap APOGEE data list, mjd=60431, all raw_data: /data/apogee/utr_cdr/60431/apRaw-*.fits archive: /data/apogee/archive/60431/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/60431/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 60431 1 21:51 48690001 Dark 60 A 13.0 ---------- a-b-c - - 60431 2 21:53 48690002 QuarFlat 10 A 13.0 ---------- a-b-c - - 60431 3 21:55 48690003 Arc-Thar 12 B 13.5 ---------- a-b-c 0.99 - 60431 4 22:02 48690004 Arc-Une 40 B 13.5 ---------- a-b-c - - 60431 5 22:04 48690005 Arc-Thar 12 A 13.0 ---------- a-b-c 0.44 - 60431 6 22:11 48690006 Arc-Une 40 A 13.0 ---------- a-b-c - - 60431 7 22:23 48690007 Dark 60 A 13.0 ---------- a-b-c - - 60431 8 22:28 48690008 Arc---- 30 A 13.0 ---------- a-b-c - 78 FPI ------------------------------------------------------------------------------ 01:22:27 .alerts 0 alerts e alert=jaeger.alert_gfa_temp_warning,critical,"at 2024-05-01 00:20:27 UT found 1",enabled,noack,-1 Turned off the FPS. Discovered that the chiller was not running. There was no flow. Contacted JohnD. He suggested power-cycling it. Once it came back, the flow rates were re-established and everything seemed normal. There was about a 2 hr gap between the last time it was restarted and when it failed. The likelihood of it failing again seems quite high. JohnD is on his way to the site to check it out. I decided to open to fill the spectrograph and save at much time as possible once I get on sky, but as I was pulling the building, the NE truck wheel made a progressively louder grinding noise to the point where I knew something was not normal and decided to move the enclosure back to home. I'll notify JohnD when he gets here. The chiller failed again. Night: ====== Glycol leak was found in the south elephant trunk - same spot as last time. There is not enough room to work in that area, and no spare hose. The repair will have to be done tomorrow. Started APOGEE morning cals. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.2000 0.1970 Axial B: -0.0012 -0.0012 Axial C: 0.0570 0.0530 Trans D: 0.4140 0.4100 Lateral E: 0.3380 0.3380 Lateral F: 0.5460 0.5455 GALILS Commanded: 9800 -300 6750 19150 -3550 -3250 Actual: 9800 -300 6750 19150 -3550 -3250 SETMIR VALUES PrimDesOrient: 0.0 -18.5 -7.8 -427.0 -998.0 PrimOrient: 0.0 -18.23 -7.9 -427.17 -999.0 SECONDARY: ---------- Focus: 0.0000 Air temp: 0.00 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -1.0390 -1.0380 Axial B: 0.2200 0.2180 Axial C: -1.1070 -1.1050 Trans D: -0.0350 -0.0330 GALILS Commanded: 5892100 5821150 5955650 -1500 -7300 Actual: 5883592 5811706 5906162 -1500 -7300 SETMIR VALUES SecDesOrient: 4657.0 -24.5 -17.5 18.0 125.41 SecOrient: 4657.0 -24.54 -17.48 18.32 125.91 ---- Telescope Status ---- 01:15Z Started ventilation 03:39Z Stopped ventilating No interlocks bypassed Status at: Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 690/690/715/715 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 235 lbs, 25 psi ---- Software Used ---- Get Versions, 05/01/24, 03:37:24 -- STUI software: STUI : 1.7.19 alerts : 2.3.0 boss : 6.0.2 -boss.specMec : 3.0.4 apo : 4.0.0 fliswarm : 0.5.1a0 jaeger : 1.6.4a0 kaiju : 1.3.1 coordio : 1.10.0 fps_calibrati : 2024.04.01 cherno : 0.6.10a0 astrometrynet : 0.93 hal : 1.1.8 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1-1-ge461 -mcp.plc : 35 -mcp.azFiduci : v1_149 -mcp.altFiduc : v1_149 -mcp.rotFiduc : v1_149 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : FAILED Boson : 0.4.4 -- done -- --------------Other Versions-------------- sdss-obstools : 3.9.3 TPM : 1.2-31-gd7eb MCP : 2.1-1-ge461 PLC : V35 Fiducials : v1_149 idlspec2d : v6_1_3 Kronos : 1.7.0 roboscheduler : 1.4.0 /dev/sdb1 2.0T 446G 1.6T 22% /home /dev/sdd1 22T 19T 2.2T 90% /data ---- APOGEE Data Summary ---- (observers39) [observer@sdss5-hub: ~]$ list_ap -m 60430 --morning APOGEE data list, mjd=60430, all raw_data: /data/apogee/utr_cdr/60430/apRaw-*.fits archive: /data/apogee/archive/60430/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/60430/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux/FPI Comm ------------------------------------------------------------------------------ 60430 61 12:07 48680061 Dark 60 B 13.5 ---------- a-b-c - - 60430 62 12:17 48680062 Dark 60 B 13.5 ---------- a-b-c - - 60430 63 12:28 48680063 Dark 60 B 13.5 ---------- a-b-c - - 60430 64 12:30 48680064 QuarFlat 10 B 13.5 ---------- a-b-c - - 60430 65 12:32 48680065 QuarFlat 10 B 13.5 ---------- a-b-c - - 60430 66 12:34 48680066 QuarFlat 10 B 13.5 ---------- a-b-c - - 60430 67 12:36 48680067 Arc-Thar 12 B 13.5 ---------- a-b-c 1.00 - 60430 68 12:43 48680068 Arc-Une 40 B 13.5 ---------- a-b-c - - 60430 69 12:45 48680069 Arc-Thar 12 A 13.0 ---------- a-b-c 0.43 - 60430 70 12:53 48680070 Arc-Une 40 A 13.0 ---------- a-b-c - - 60430 71 12:58 48680071 Dark 30 A 13.0 ---------- a-b-c - - 60430 72 13:03 48680072 InteFlat 30 A 13.0 ---------- a-b-c - - 60430 73 13:09 48680073 InteFlat 30 A 13.0 ---------- a-b-c - - 60430 74 13:14 48680074 InteFlat 30 A 13.0 ---------- a-b-c - - 60430 75 13:20 48680075 Dark 30 A 13.0 ---------- a-b-c - - 60430 76 13:25 48680076 Arc---- 30 A 13.0 ---------- a-b-c - 78 FPI ---- Time Tracking ---- *=*=*= Observatory: APO *=*=*= MJD: 60431 Fill night time in Hours below *=*=*= Total bright time : 3.7 *=*=*= Bright time, queued observations : 0 *=*=*= Bright time, commissioning/engineering: 0 *=*=*= Bright time lost to weather : 0 *=*=*= Bright time lost to technical issues : 3.7 *=*=*= Total dark time : 5.4 *=*=*= Dark time, queued observations : 0 *=*=*= Dark time, commissioning/engineering : 0 *=*=*= Dark time lost to weather : 0 *=*=*= Dark time lost to technical issues : 5.4 Tue 30 Apr 2024 60431 0.52 02:42 02:58 11:01 10:33 18:37 --- dark until 08:20 ( 5.4 h), then bright ( 3.7 h)