Subject: 2.5m obslog 20170511 (SJD 57885) From: pgaulme@apo.nmsu.edu Date: Fri, 12 May 2017 12:03:50 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday May 11, 2017 (SJD 57885) ---- Observing Team ---- Viktor Malanushenko Patrick Gaulme Dmitry Bizyaev Jon Brinkmann Kaike Pan (on line) ---- Observing Summary ---- Clear sky and decent seeing. We spent most of the night working on the pointing model. A P O G E E Cart 6, Plate 9779; 240+60, GSOGTF, 2AB, 2C, COMPLETE! P O I N T I N G M O D E L 142 stars observed. Current result is Sky RMS = 3.73, Popn SD = 3.91 ---- Observing Plan ---- Thu 11 MAY 2017 57885.0 0.99 02:32 11:28 10:48 19:47 Both APOGEE-2 ( 8.9 h) ---- Observing Log ---- ============================================================================ AFTERNOON CHECKOUT ============================================================================ [observer@sdss4-hub ~]$ df -h Filesystem Size Used Avail Use% Mounted on /dev/vda2 7.7G 5.9G 1.5G 81% / tmpfs 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M 128M 57M 70% /boot /dev/vdb 19G 8.8G 9.2G 49% /exports/hub-local /dev/vdd 688G 505G 184G 74% /home /dev/vdc1 11T 9.8T 986G 92% /data --afternoon sets, 00:02:06 Apogee Short Darks tcc track 121,30 mount - ok tcc set scale=1.0 - ok tcc set focus=0.0 - ok sop doBossCalibs nbias=1 ndark=1 darktime=20 - ok guider dark stack=9 time=15 - ok -- done -- --Test Actors, 00:15:44 - ok platedb showActive, 00:16:37 - ok -- 00:16:25 -- APOGEE: Evening Cals -- 00:59:16-- done -- sop collimateBoss 00:27:11 Hartmann collimate output on cart #5 sp1: offset: r= 5277 (Out of focus); b= -20.3 (Out of focus) sp2: offset: r= 6312 (Out of focus); b= -18.8 (Out of focus) sp1: pred. move: spAverageMove= 5884 sp2: pred. move: spAverageMove= 6150 sp1: pred. resid: r= -607, b= -1.9, txt= OK, spTemp = 9.6 sp2: pred. resid: r= 161, b= 0.5, txt= OK, spTemp = 9.1 ---------- motorPosition sp1: 24681, 24605, 21046; sp2: 21667, 22305, 21597; ---------- Median spectrographs temperatures: Tsp1= 9.6, Tsp2= 9.1; Outside air temperature= 9.9; ---------- BOSS collimation was checked with cart 15 No adjustment was made. — to DOS MaNGA: sop doBossCalibs nflat=1 narc=1 - ok — to SOS eBOSS: guider loadCartridge cartridge=14 force sop doBossCalibs nbias=1 ndark=1 darktime=20 - ok 01:10Z on the telescope all checked and ok. 01:12Z Mounted cart 6 and start ventilation. ============================================================================ NIGHT ============================================================================ 02:48:52 encl25m : open; ============================================================================ A P O G E E ============================================================================ **************************************************** 03:00:10 loadCart: Cart 6, Plate 9779; 240+60 03:00:10 survey: APOGEE-2&MaNGA; lead: APOGEE lead **************************************************** 03:16:33 Hartmann collimate output on cart #6 sp1: offset: r= 1319 (Out of focus); b= -7.3 (Out of focus) sp2: offset: r= 631 (In Focus); b= -1.0 (In Focus) sp1: pred. move: spAverageMove= 1816 sp2: pred. move: spAverageMove= 473 sp1: pred. resid: r= -497, b= -1.6, txt= OK, spTemp = 8.6 sp2: pred. resid: r= 158, b= 0.5, txt= OK, spTemp = 7.9 GSOGTF, clear, seeing 1.3 %... Field exposures 03:29:05 apogee.expose=apRaw-23230011, 47, A, Object 03:29:11 boss exposure 900.0, file=243777, C 03:37:32 apogee.expose=apRaw-23230012, 47, B, Object 03:45:52 apogee.expose=apRaw-23230013, 47, B, Object 03:45:59 boss exposure 900.0, file=243778, C 03:54:20 apogee.expose=apRaw-23230014, 47, A, Object %... Dome flat 04:03:42 apogee.expose=apRaw-23230015, 5, A, DomeFlat Missing fibers: [181, 277] Faint fibers: [15, 34, 105, 168, 289, 292, 294] %... Darks 04:05:58 apogee.expose=apRaw-23230016, 10, A, Dark 04:07:45 apogee.expose=apRaw-23230017, 10, A, Dark ============================================================================ P O I N T I N G M O D E L ============================================================================ We had issues rebooting the MCP. Here is Dmnitry's summary of the preparation for the pointing model. --- this is what happened tonight, with the description of some unusual problems. I checked in v1_125 of the fiducial tables under the version control without any problems. The last step was to restart MCP. I followed procedure and initiated its hard reboot. It did not come up. The status was: showed PLS=-9999 Fiducials: v1_125, MCP unavailable. Then I decided that this is because of some extra information in the fiducial tables. NOT FOR THE LOG, but we decided to try to replace # Creator: observer with # Creator: observer_T=7.5C or something like this. It is a comment, so it shouldn't affect, but for the clarity of the experiment, I went back to editing the *.dat fiducial files, and left just the initial "observer" over there. This is why I made v1_126. So the v1_126 was successfully checked through SVN and all procedures were applied again. Same as in the previous attempt, MCP reboot failed, and it got stuck at the same position. Fortunately, John Brinkmann was on site, and he started investigations. He booted up MCP from a terminal session (on the terminal server), and it showed that it complains about a missing file in ~/util/ directory. The file was not found on the machine. Weird that our white board in the control room says that MCP is v6_6_18, while it started v7_0_1. We set up v6_6_18, and started, but it complained again about missing util/dscTrace.o file. The file was found, but the path that MCP used did not have this file. Jon noticed that it set path to /home/sdss3/products/ directories while it was changed to /home/sdss4/products. Jon changed the path in mcp startup script. MCP was successfully booted. Then Jon found that some files are either removed, or compressed (with xz) in the /home/sdss3 directory structure. This is why paths to /home/sdss3 brought up errors. Also, we looked at time stamps and found that the modifications were made on May 7, 2017, by somebody who is included in sdss3 group. After changing to /home/sdss4 the v7_0_1 was still unable to boot because of the missing .o file (sorry, I don't remember which one exactly). The MCP v6_6_18 was able to boot up. This is what we're running now. Proceeded to the further pointing model steps after that. We've lost significant amount of time for this problem. --- We then started the 155 star grid of stars. However it was already 07:50Z when we started because of the above-mentioned issues, and we could not complete the whole pointing grid. We stopped at 142 stars. Two stars were lost (#114 and 138) because of pointing the enclosure in one case, and unknown reason for the second. We canceled the procedure at 11:36Z because 8-degree twilight was long past (11:28Z). We ran a quick test to evaluate the quality of the pointing model: coeff change value sigma 1 IE +0.000 -7.08 1.110 2 IA -0.000 +142.33 1.341 3 PZZ1 +0.000 +120.85 3.003 4 AN -0.000 -6.34 0.455 5 AW -0.000 +6.56 0.468 6 CA +0.000 +1.96 1.030 7 HWCA2 -0.000 -0.23 0.640 8 HWSA2 -0.000 -0.46 0.621 9 HNCA1 -0.000 +2.53 0.743 10 HNSA1 -0.000 +0.23 0.731 11 ACEC -0.000 -0.05 0.795 12 ACES -0.000 -0.60 0.873 13 TX -0.000 +4.25 1.262 Sky RMS = 3.73 Popn SD = 3.91 We let Kaike appreciate whether the new one is good enough to replace the old one. ---- APOGEE Data Summary ---- APOGEE data list, mjd=57885, all raw_data: /data/apogee/utr_cdr/57885/apRaw-*.fits archive: /data/apogee/archive/57885/apR-[a,b,c]-*.apz quickred: /data/apogee/archive/57885/apR-[a,b,c]-*.apz -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 57885 1 00:02 23230001 Dark 3 A 13.0 5-9098 a-b-c - - 57885 2 00:16 23230002 Dark 60 A 13.0 5-9098 a-b-c - - 57885 3 00:27 23230003 QuarFlat 10 A 13.0 5-9098 a-b-c - 52 57885 4 00:29 23230004 Arc-Thar 12 A 13.0 5-9098 a-b-c -0.26 - 57885 5 00:31 23230005 Arc-Une 40 A 13.0 5-9098 a-b-c - - 57885 6 00:38 23230006 Arc-Thar 12 B 13.5 14-8507 a-b-c 0.25 - 57885 7 00:41 23230007 Arc-Une 40 B 13.5 14-8507 a-b-c - - 57885 8 00:48 23230008 Dark 60 A 13.0 14-8507 a-b-c - - 57885 9 02:59 23230009 Dark 10 A 13.0 6-9779 a-b-c - - 57885 10 03:01 23230010 Dark 10 A 13.0 6-9779 a-b-c - - 57885 11 03:28 23230011 Object 47 A 13.0 6-9779 a-b-c - - 57885 12 03:37 23230012 Object 47 B 13.5 6-9779 a-b-c - - 57885 13 03:45 23230013 Object 47 B 13.5 6-9779 a-b-c - - 57885 14 03:54 23230014 Object 47 A 13.0 6-9779 a-b-c - - 57885 15 04:03 23230015 DomeFlat 5 A 13.0 6-9779 a-b-c - 99 57885 16 04:05 23230016 Dark 10 A 13.0 6-9779 a-b-c - - 57885 17 04:07 23230017 Dark 10 A 13.0 6-9779 a-b-c - - 57885 18 11:40 23230018 Dark 60 A 13.0 19- 0 a-b-c - - 57885 19 12:00 23230019 Dark 60 A 13.0 ------- x-x-x - - -------------------------------------------------------------------------------- ---- eBOSS Collimation Summary ---- --- Hartmann --- Time Inst r1 b1 move1 b1pred Tsp1 r2 b2 move2 b2pred Tsp2 -------------- ---------------------------- ---------------------------- 03:15 6-9779A 1319 -7.3 1816 -1.6 8.6 631 -1.0 473 0.5 7.9 ---- eBOSS Data Summary ---- Reading FITS from /data/spectro/57885/ 1 00:39 b1-00243769 14 8507 bia Clo 0.0 24681 24605 21046 00:39 b2-00243769 14 8507 bia Clo 0.0 21667 22305 21597 00:39 r1-00243769 14 8507 bia Clo 0.0 24681 24605 21046 00:39 r2-00243769 14 8507 bia Clo 0.0 21667 22305 21597 2 00:40 b1-00243770 14 8507 dar Clo 20.0 24681 24605 21046 00:40 b2-00243770 14 8507 dar Clo 20.0 21667 22305 21597 00:40 r1-00243770 14 8507 dar Clo 20.0 24681 24605 21046 00:40 r2-00243770 14 8507 dar Clo 20.0 21667 22305 21597 3 00:44 b1-00243771 14 8507 bia Clo 0.0 24681 24605 21046 00:44 b2-00243771 14 8507 bia Clo 0.0 21667 22305 21597 00:44 r1-00243771 14 8507 bia Clo 0.0 24681 24605 21046 00:44 r2-00243771 14 8507 bia Clo 0.0 21667 22305 21597 4 00:45 b1-00243772 14 8507 dar Clo 20.0 24681 24605 21046 00:45 b2-00243772 14 8507 dar Clo 20.0 21667 22305 21597 00:45 r1-00243772 14 8507 dar Clo 20.0 24681 24605 21046 00:45 r2-00243772 14 8507 dar Clo 20.0 21667 22305 21597 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- OK --- ---- MaNGA Data Summary ---- Reading FITS from /data/spectro/57885/ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n time filename crt plt flav Shu Dth exp colA colB colC Hrt b1 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 00:03 b1-00243763 5 9098 bia Clo C 0.0 18797 18721 15162 00:03 b2-00243763 5 9098 bia Clo C 0.0 15518 16156 15448 00:03 r1-00243763 5 9098 bia Clo C 0.0 18797 18721 15162 00:03 r2-00243763 5 9098 bia Clo C 0.0 15518 16156 15448 2 00:04 b1-00243764 5 9098 dar Clo C 20.0 18797 18721 15162 00:04 b2-00243764 5 9098 dar Clo C 20.0 15518 16156 15448 00:04 r1-00243764 5 9098 dar Clo C 20.0 18797 18721 15162 00:04 r2-00243764 5 9098 dar Clo C 20.0 15518 16156 15448 3 00:24 b1-00243765 5 9098 arc Lef C 4.1 18797 18721 15162 HART 00:24 b2-00243765 5 9098 arc Lef C 4.2 15518 16156 15448 HART 00:24 r1-00243765 5 9098 arc Lef C 4.1 18797 18721 15162 HART 00:24 r2-00243765 5 9098 arc Lef C 4.2 15518 16156 15448 HART 4 00:25 b1-00243766 5 9098 arc Rig C 4.1 18797 18721 15162 HART 00:25 b2-00243766 5 9098 arc Rig C 4.2 15518 16156 15448 HART 00:25 r1-00243766 5 9098 arc Rig C 4.1 18797 18721 15162 HART 00:25 r2-00243766 5 9098 arc Rig C 4.2 15518 16156 15448 HART 5 00:29 b1-00243767 5 9098 fla Out C 25.1 24681 24605 21046 00:29 b2-00243767 5 9098 fla Out C 25.2 21667 22305 21597 00:29 r1-00243767 5 9098 fla Out C 25.1 24681 24605 21046 00:29 r2-00243767 5 9098 fla Out C 25.2 21667 22305 21597 6 00:33 b1-00243768 5 9098 arc Out C 4.1 24681 24605 21046 00:33 b2-00243768 5 9098 arc Out C 4.2 21667 22305 21597 00:33 r1-00243768 5 9098 arc Out C 4.1 24681 24605 21046 00:33 r2-00243768 5 9098 arc Out C 4.2 21667 22305 21597 7 03:15 b1-00243773 6 9779 arc Lef C 4.1 24681 24605 21046 HART 03:15 b2-00243773 6 9779 arc Lef C 4.2 21667 22303 21597 HART 03:15 r1-00243773 6 9779 arc Lef C 4.1 24681 24605 21046 HART 03:15 r2-00243773 6 9779 arc Lef C 4.2 21667 22303 21597 HART 8 03:15 b1-00243774 6 9779 arc Rig C 4.1 24681 24605 21046 HART 03:15 b2-00243774 6 9779 arc Rig C 4.2 21667 22303 21597 HART 03:15 r1-00243774 6 9779 arc Rig C 4.1 24681 24605 21046 HART 03:15 r2-00243774 6 9779 arc Rig C 4.2 21667 22303 21597 HART 9 03:17 b1-00243775 6 9779 arc Out C 4.1 26496 26421 22864 03:17 b2-00243775 6 9779 arc Out C 4.2 22141 22779 22070 03:17 r1-00243775 6 9779 arc Out C 4.1 26496 26421 22864 03:17 r2-00243775 6 9779 arc Out C 4.2 22141 22779 22070 10 03:19 b1-00243776 6 9779 fla Out C 25.1 26496 26421 22864 03:19 b2-00243776 6 9779 fla Out C 25.2 22141 22779 22070 03:19 r1-00243776 6 9779 fla Out C 25.1 26496 26421 22864 03:19 r2-00243776 6 9779 fla Out C 25.2 22141 22779 22070 11 03:29 b1-00243777 6 9779 sci Out C 900.1 26496 26421 22864 03:29 b2-00243777 6 9779 sci Out C 900.2 22141 22779 22070 03:29 r1-00243777 6 9779 sci Out C 900.1 26496 26421 22864 03:29 r2-00243777 6 9779 sci Out C 900.2 22141 22779 22070 12 03:45 b1-00243778 6 9779 sci Out C 900.1 26496 26421 22864 03:45 b2-00243778 6 9779 sci Out C 900.2 22141 22779 22070 03:45 r1-00243778 6 9779 sci Out C 900.1 26496 26421 22864 03:45 r2-00243778 6 9779 sci Out C 900.2 22141 22779 22070 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- OK --- ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Inst Az Alt Rot objArcOff guideRot calibOff -------------------------------------------------------------------------------- 03:28 6-9779A -25.8 66.3 158.2 ( -8.8, -3.1) (177.4) ( 0.0, 14.4, 0.0) apog 03:28 6-9779A -25.9 66.3 158.1 ( -8.9, -3.0) (177.6) ( 0.0, 14.4, 0.0) boss 03:36 6-9779A -30.5 65.4 154.3 ( -9.2, -3.1) (178.4) ( 0.0, 14.4, 0.0) apog 03:45 6-9779A -34.8 64.5 150.8 ( -9.4, -3.3) (178.6) ( 0.0, 14.4, 0.0) apog 03:45 6-9779A -34.8 64.5 150.8 ( -9.4, -3.3) (178.6) ( 0.0, 14.4, 0.0) boss 03:53 6-9779A -38.9 63.4 147.6 ( -9.8, -3.6) (180.3) ( 0.0, 14.4, 0.0) apog ---- Focus Log ---- --- Focus --- Time Inst Scale M1 M2 Focus Az Alt Temp Wind Dir -------------------------------------------------------------------------------- 03:28 6-9779A 1.000280 -2765 -940 210 -25.8 66.3 7.7 9 84 1.4 apog 03:28 6-9779A 1.000280 -2765 -940 213 -25.9 66.3 7.7 9 84 1.4 boss 03:36 6-9779A 1.000283 -2796 -946 230 -30.5 65.4 7.7 8 94 1.5 apog 03:45 6-9779A 1.000282 -2777 -923 235 -34.8 64.5 7.6 9 86 1.4 apog 03:45 6-9779A 1.000282 -2777 -923 236 -34.8 64.5 7.6 8 88 1.4 boss 03:53 6-9779A 1.000283 -2796 -945 224 -38.9 63.4 7.7 9 83 1.5 apog ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 03:28 6-9779A 7.7 1.4 6.3 64 9 84 256 2.0 333 1.4 apog 03:28 6-9779A 7.7 1.4 6.3 64 9 84 256 2.0 333 1.4 boss 03:36 6-9779A 7.7 1.1 6.6 62 8 94 217 2.5 333 1.5 apog 03:45 6-9779A 7.6 0.8 6.8 62 9 86 234 2.1 333 1.4 apog 03:45 6-9779A 7.6 0.8 6.8 61 8 88 234 2.5 333 1.4 boss 03:53 6-9779A 7.7 0.7 7.0 61 9 83 252 1.9 333 1.5 apog ---- Telescope Status ---- 01:12Z Started ventilation 02:48Z encl25m : open; 11:42Z encl25m : closed; No interlocks bypassed Status at: 12:01Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 19 Counterweights at: 345 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 121 lbs, 20 psi SP2 115 lbs, 21 psi ---- Software Used ---- Get Versions, 05/12/17, 01:42:31 -- STUI software: STUI : 1.7.1b6 alerts : trunk+svn66561 apo : trunk+svn158476M boss : v4_0 -boss.specMec : 3.0.4 gcamera : v2_1 guider : v3_6_1 hartmann : v1_4_6 hub : Tag: sdss4_v3_0 mcp : NOSVN -mcp.plc : 34 -mcp.azFiduci : v1_124 -mcp.altFiduc : v1_124 -mcp.rotFiduc : v1_124 platedb : v2_5_1 sop : v3_8_2 tcc : 1.2.2 apogee : not availble apogeecal : not availble apogeeql : v1_6_1 APO-local : trunk -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v6_0_9 petunia : trunk autoscheduler : v7_1_1 sdss_python_module: v2_5 mangadrp : trunk exported ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000; MIGS TONIGHT NOMINAL Axial A: 0.004 0.005 Axial B: 0.745 0.747 Axial C: 0.512 0.523 Trans D: 0.992 0.986 Lateral E: 9.1059 9.1059 Lateral F: 14.2748 14.2367 GALILS Commanded: 10250 -900 6850 16950 4850 5000 Actual: 10250 -900 6850 16950 4850 5000 SETMIR VALUES PrimDesOrient: 0.0 3.12 -1.95 -106.75 -170.8 PrimOrient: 0.0 3.04 -1.75 -107.3 -171.7 SECONDARY: ---------- Focus: 0.0000 Air temp: 13.6 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -0.0012 -0.0013 Axial B: -6.657 -6.662 Axial C: -1.302 -1.306 Trans D: -0.185 -0.184 GALILS Commanded: 1625500 1579450 1626600 -8200 -15650 Actual: 1599636 1568480 1584550 -8200 -15650 SETMIR VALUES SecDesOrient: 1257.0 -2.03 -9.35 40.0 278.8 SecOrient: 1257.03 -2.05 -9.35 40.41 278.33 PRIMARY: -------- Scale: 1.000000; MIGS TONIGHT NOMINAL Axial A: 0.003 0.005 Axial B: 0.751 0.747 Axial C: 0.515 0.523 Trans D: 0.988 0.986 Lateral E: 9.1186 9.1059 Lateral F: 14.2494 14.2367 GALILS Commanded: 10250 -900 6850 16950 5050 5150 Actual: 10250 -900 6850 16950 5050 5150 SETMIR VALUES PrimDesOrient: 0.0 3.12 -1.95 -106.75 -170.8 PrimOrient: -0.0 3.04 -1.75 -101.98 -171.7 SECONDARY: ---------- Focus: 0.0000 Air temp: 5.5 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -0.0012 -0.0013 Axial B: -6.655 -6.662 Axial C: -1.302 -1.306 Trans D: -0.179 -0.184 GALILS Commanded: 1629050 1582650 1629150 -8250 -15650 Actual: 1599926 1568002 1585633 -8250 -15650 SETMIR VALUES SecDesOrient: 1257.0 -2.03 -9.35 40.0 278.8 SecOrient: 1257.26 -2.5 -9.49 39.74 279.22