Subject: 2.5m obslog 20210417 (SJD 59322) From: asimmons@apo.nmsu.edu Date: Sun, 18 Apr 2021 10:49:24 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Saturday April 17, 2021 (SJD 59322) ---- Observing Team ---- Dmitry Bizyaev Audrey Oravetz ---- Observing Plan ---- Sat 17 Apr 2021 59322 0.31 02:46 11:18 09:28 18:02 --- KK BHM ( 8.5 h) ---- Observing Summary ---- We did not open tonight due to high humidity, radar, and a few snow flurries. BHM lost 8.5hrs. - Another set of altitude fiducials was collected at 08:48Z with temperatures around 1.2C. Instead of 3 up-downs, we made 7. T=1.24C Start: 1618735069 End: 1618737177 - The 180L dewar was found very frosty upon the checkout, but it did not make a recent fill. Instead, it was gradually leaking, according to its weight plot. We will need a new one for tomorrow (currently 109 lbs). - Yesterday's (MJD 59321) morning cals were NOT ok. All of the exposures appear as darks. We verified that the cal box, collimation, dithering, actors worked properly. However, the internal shutter position triggered a limit switch which caused the shutter never to open. Luckily, no science data was taken so the reductions are not affected. Evening cals behaved completely normally without any sort of intervention from us. From the logs: NORMAL: 2021-04-18 00:20:55.632Z 'shutterPosition', '-23964' 'shutterLimitSwitch', ['true', 'false']) ABNORMAL: 2021-04-17 11:13:38.360Z 'shutterPosition', '-22375') 'shutterLimitSwitch', ['false', 'false']) - We performed ALT moves for fiducial data. Instead on 3 up-downs, we made 7. T=1.24C Start: 1618735069 End: 1618737177 ---- Observing Log ---- Afternoon --------- All systems found responsive 00:12:07 Hartmann collimate output on cart #7 sp1: offset: r= -1979 (Out of focus); b= 1.8 (In Focus) sp1: pred. move: spAverageMove= -1278 sp1: pred. resid: r= -700, b= -2.2, txt= OK, spTemp = 6.3 Collimation should be ok for tonight. Blue ring is not moved. Last morning's APOGEE calibrations were all dark. The reason is unknown. This evening's calibrations all look good. 00:38Z ventilation started Night ----- 01:53Z - Humidity rose. Radar surrounding us. We stopped ventilating. 08:45Z - Fiducials were taken. 09:24Z - Small snow flurries. 10:35Z - Started cals. Mounted cart 8. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9280 -4.9280 Axial B: -4.6670 -4.6660 Axial C: -5.7690 -5.7770 Trans D: -4.3230 -4.3890 Lateral E: 0.3745 0.3750 Lateral F: 0.5705 0.5675 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 6.06 Altitude: 30.000015622922977 MIGS TONIGHT NOMINAL Axial A: -9.4410 -9.4420 Axial B: -9.4070 -9.4070 Axial C: -9.4850 -9.4960 Trans D: 0.0440 0.0420 GALILS Commanded: 4618800 4601700 4666400 -2000 -6600 Actual: 4605246 4587319 4633700 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3658.14 -14.02 -2.81 12.75 114.22 ---- Telescope Status ---- 00:38Z Started ventilation 01:35Z Stopped ventilating No interlocks bypassed Status at: 10:36Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 7 Counterweights at: 440 LN2 autofill systems: Connected and turned on -180L LN2 dewar scales: SP1 109.0 lbs, 21.74 psi ---- Software Used ---- Filesystem Size Used Avail Use% Mounted on /dev/vdd 688G 604G 84G 88% /home /dev/vdc1 11T 6.8T 4.0T 64% /data Setting up: idlspec2d Flavor: Linux64 Version: v5_7_12 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_20 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_6_7 Setting up: |sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: |psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: |idl Flavor: Linux64 Version: 7.1 Setting up: |dust Flavor: Linux64 Version: v0_1 Setting up: |photolog Flavor: Linux64 Version: trunk Setting up: actorcore Flavor: Linux64 Version: v4_1_8 Setting up: |opscore Flavor: Linux64 Version: v2_5 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: master Setting up: |plc Flavor: Linux64 Version: v30_2 Setting up: |sdsstools Flavor: Linux64 Version: v4_33 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.6.9 -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.3 autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk exported STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.4 hartmann : 1.8.0 hub : v4.2.4 mcp : 2.0 -mcp.plc : 34 -mcp.azFiduci : v1_144 -mcp.altFiduc : v1_144 -mcp.rotFiduc : v1_144 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : master ---- APOGEE Data Summary ---- APOGEE data list, mjd=59322, all raw_data: /data/apogee/utr_cdr/59322/apRaw-*.fits archive: /data/apogee/archive/59322/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59322/ap2D-a-*.fits.fz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59322 1 00:05 37600001 Dark 3 A 13.0 7-15156 a-b-c - - 59322 2 00:10 37600002 Dark 60 A 13.0 7-15156 a-b-c - - 59322 3 00:20 37600003 QuarFlat 10 A 13.0 7-15156 a-b-c - 62 59322 4 00:22 37600004 Arc-Thar 12 A 13.0 7-15156 a-b-c -1.49 - 59322 5 00:24 37600005 Arc-Thar 12 A 13.0 7-15156 a-b-c -1.50 - 59322 6 00:27 37600006 Arc-Une 40 A 13.0 7-15156 a-b-c - - 59322 7 00:34 37600007 Arc-Une 40 A 13.0 7-15156 a-b-c - - 59322 8 00:41 37600008 Dark 60 A 13.0 7-15156 a-b-c - - 59322 9 10:48 37600009 Dark 60 A 13.0 ------- x-x-x - - -------------------------------------------------------------------------------- ---- BOSS Data Summary ---- Reading FITS from /data/spectro/59322/ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n time filename crt plt flav Shu Dth exp colA colB colC Hrt b1 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 00:05 b1-00329571 7 15156 bia Clo 0.0 5673 5643 5734 00:05 r1-00329571 7 15156 bia Clo 0.0 5673 5643 5734 2 00:06 b1-00329572 7 15156 dar Clo 20.0 5673 5643 5734 00:06 r1-00329572 7 15156 dar Clo 20.0 5673 5643 5734 3 00:09 b1-00329573 7 15156 arc Lef 4.1 5673 5643 5734 HART 00:09 r1-00329573 7 15156 arc Lef 4.1 5673 5643 5734 HART 4 00:10 b1-00329574 7 15156 arc Rig 4.1 5673 5643 5734 HART 00:10 r1-00329574 7 15156 arc Rig 4.1 5673 5643 5734 HART 5 00:16 b1-00329575 7 15156 fla Out 25.1 4395 4366 4457 00:16 r1-00329575 7 15156 fla Out 25.1 4395 4366 4457 6 00:18 b1-00329576 7 15156 arc Out 4.1 4395 4366 4457 00:18 r1-00329576 7 15156 arc Out 4.1 4395 4366 4457 7 10:42 b1-00329577 8 15173 bia Clo 0.0 4395 4366 4457 10:42 r1-00329577 8 15173 bia Clo 0.0 4395 4366 4457 8 10:44 b1-00329578 8 15173 bia Clo 0.0 4395 4366 4457 10:44 r1-00329578 8 15173 bia Clo 0.0 4395 4366 4457 9 10:45 b1-00329579 8 15173 bia Clo 0.0 4395 4366 4457 10:45 r1-00329579 8 15173 bia Clo 0.0 4395 4366 4457 10 10:46 b1-00329580 8 15173 bia Clo 0.0 4395 4366 4457 10:46 r1-00329580 8 15173 bia Clo 0.0 4395 4366 4457 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- OK --- ---- Miscellaneous ---- [observer@sdss4-hub ~]$ list_ap -m 59321 -morning mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 59321 1 10:41 37590008 Dark 60 A 13.0 7-15156 a-b-c - - 59321 2 10:52 37590009 Dark 60 A 13.0 7-15156 a-b-c - - 59321 3 11:02 37590010 Dark 60 A 13.0 7-15156 a-b-c - - 59321 4 11:13 37590011 QuarFlat 10 A 13.0 7-15156 a-b-c - 0 59321 5 11:15 37590012 QuarFlat 10 A 13.0 7-15156 a-b-c - 0 59321 6 11:17 37590013 QuarFlat 10 A 13.0 7-15156 a-b-c - 0 59321 7 11:19 37590014 Arc-Thar 12 A 13.0 7-15156 a-b-c 4.71 - 59321 8 11:21 37590015 Arc-Thar 12 A 13.0 7-15156 a-b-c err - 59321 9 11:23 37590016 Arc-Une 40 A 13.0 7-15156 a-b-c - - 59321 10 11:30 37590017 Arc-Une 40 A 13.0 7-15156 a-b-c - - 59321 11 11:37 37590018 Dark 30 A 13.0 7-15156 a-b-c - - 59321 12 11:43 37590019 InteFlat 30 A 13.0 7-15156 a-b-c - 0 59321 13 11:48 37590020 InteFlat 30 A 13.0 7-15156 a-b-c - 0 59321 14 11:53 37590021 InteFlat 30 A 13.0 7-15156 a-b-c - 0 59321 15 11:59 37590022 Dark 30 A 13.0 7-15156 a-b-c - - Today's morning cals were NOT ok. All of the exposures appear as darks. We verified that the cal box, collimation, dithering, actors worked properly. However, the internal shutter position triggered a limit switch which caused the shutter never to open. NORMAL: 2021-04-18 00:20:55.632Z 'shutterPosition', '-23964' 'shutterLimitSwitch', ['true', 'false']) ABNORMAL: 2021-04-17 11:13:38.360Z 'shutterPosition', '-22375') 'shutterLimitSwitch', ['false', 'false']) ====== Full evidence: Hub output from NORMAL morning cal sequence 2 days ago: 2021-04-16 11:28:34.991Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('vacuum', '1.078E-6'), ('vacuumAlt', '953.26E-9'), ('ln2Level', '87.622'), ('vacuumAlarm', '0'), ('ln2Alarm', '0')]) 2021-04-16 11:28:34.992Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('collOrient', ['0.0', '0.0', '0.0']), ('collMountPosition', ['0.0', '0.0', '0.0']), ('collLimitSwitch', ['false', 'false', 'false', 'false', 'false', 'false']), ('collMountLimits', ['500', '3500']), ('collIndexer', 'On')]) 2021-04-16 11:28:34.993Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('ditherPosition', ['12.994020325638637', 'A']), ('ditherLimitSwitch', ['false', 'false']), ('ditherLimits', ['1.0', '19.0']), ('ditherNamedPositions', ['12.994020325638637', '13.494020325638637']), ('ditherIndexer', 'On')]) 2021-04-16 11:28:34.993Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('shutterPosition', '-23963'), ('shutterLimitSwitch', ['true', 'false']), ('shutterLED', '0'), ('shutterIndexer', 'On')]) Hub output from ABNORMAL morning cal sequence today: 2021-04-17 11:13:32.976Z hub ? KVDict.setKVs src = 'apogeeql', keys = OrderedDict([('exposureData', ['15156', '1', '37590010', '638.82', '060', '30.01', '99.00', '0.00', '2555.28', '0.00', 'DARK', 'A'])]) 2021-04-17 11:13:38.319Z hub ? Nub registering key(ours=('0', '0'))=False for Command(xid=27981, cmdr=.apogee, cmdrCid=.apogee, cmdrMid=0, actor=apogee, cmd="None") 2021-04-17 11:13:38.319Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('vacuum', '1.12E-6'), ('vacuumAlt', '956.52E-9'), ('ln2Level', '87.641'), ('vacuumAlarm', '0'), ('ln2Alarm', '0')]) 2021-04-17 11:13:38.358Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('collOrient', ['0.0', '0.0', '0.0']), ('collMountPosition', ['0.0', '0.0', '0.0']), ('collLimitSwitch', ['false', 'false', 'false', 'false', 'false', 'false']), ('collMountLimits', ['500', '3500']), ('collIndexer', 'On')]) 2021-04-17 11:13:38.359Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('ditherPosition', ['12.994020325638637', 'A']), ('ditherLimitSwitch', ['false', 'false']), ('ditherLimits', ['1.0', '19.0']), ('ditherNamedPositions', ['12.994020325638637', '13.494020325638637']), ('ditherIndexer', 'On')]) 2021-04-17 11:13:38.360Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('shutterPosition', '-22375'), ('shutterLimitSwitch', ['false', 'false']), ('shutterLED', '0'), ('shutterIndexer', 'On')]) Hub output from NORMAL evening cal sequence today: 2021-04-18 00:20:48.572Z hub ? KVDict.setKVs src = 'apogeeql', keys = OrderedDict([('exposureData', ['15156', '1', '37600002', '638.82', '060', '30.01', '99.00', '0.00', '670.76', '0.00', 'DARK', 'A'])]) 2021-04-18 00:20:55.592Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('ditherPosition', ['12.994020325638637', 'A']), ('ditherLimitSwitch', ['false', 'false']), ('ditherLimits', ['1.0', '19.0']), ('ditherNamedPositions', ['12.994020325638637', '13.494020325638637']), ('ditherIndexer', 'On')]) 2021-04-18 00:20:55.632Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict([('shutterPosition', '-23964'), ('shutterLimitSwitch', ['true', 'false']), ('shutterLED', '0'), ('shutterIndexer', 'On')]) 2021-04-18 00:20:55.633Z hub ? KVDict.setKVs src = 'apogee', keys = OrderedDict()