From: =?UTF-8?B?Sm9zw6kgU8OhbmNoZXotR2FsbGVnbw==?= Date: Sun, 17 Sep 2023 10:53:47 -0700 Subject: Re: [sloan-25mlog 6822] 2.5m obslog 20230916 (SJD 60204) --00000000000024f209060591b527 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Dmitry, I had a quick look at the longs and not sure what the issue is. It does seem the problem is that the guider actor did not listen to the keywords output by the ecamera actor and did not know the exposure had finished. Assuming everything was correctly connected to tron, and it seems it was, I'm not very sure what the issue is. The ecam seems to be disconnected. Can somebody connect it so I can test this during the day? I probably won't be available until relatively late tonight. Thanks, Jos=C3=A9 On 17 Sep 2023 at 03:57:22, dmbiz@apo.nmsu.edu wrote: > > APACHE POINT OBSERVATORY SDSS 2.5M > > OBSERVING LOG > Saturday September 16, 2023 > > (SJD 60204) > > ---- Observing Team ---- > > Dmitry Bizyaev > Conner Scoresby > Kaike Pan (remote support) > > > > ---- Observing Plan ---- > > Finish instrumental block update. > Run pointing model. > > Sat 16 Sep 2023 60204 0.05 02:01 02:16 11:39 18:56 04:21 --- dark ( 9.4 h= ) > plus 0.2 h for 12 deg design > > > ---- Observing Summary ---- > > Part of the night was lost to the clouds and radar. > Opened late. > > This night was not successful because of many failures. Not all issues > were fixed. > > The root of all the problems happened tonight, we think, were rather drie= d > corpses of > five bats found on the floor in the upper enclosure and at the entrance > door. > > > 1. At the beginning we saw strange structure of Ecam flats - with a > depression at the > center. We suspected that the secondary mirror was out very much. > Home/relaxed mirrors and got > good flats. So this problem was fixed. > Nominal MIGs are saved with "fps" instrument. > > 2. Tried to start with fitting the grid data taken yesterday, and got the > same very strange > numbers (like new rot angle ~ 150 deg, which is insane). We inspected > images taken yesterday > for the grid and found that the star was at the edge of the chip; for mos= t > of offsets it went away, and guider measured position of different stars. > The grid data need to be retaken. > > 3. We followed the same procedure as a few days ago to start guiderActor. > It starts, takes images, but it is unable to process them and fails. At t= he > same time, "proc-gimg" images are not made. engcamera can take images > normally. We tried many ways to restart, to run from different users, to > load specific cartridge with it (0 or 19), to take darks and flats every > time, but nothing worked. We need Jose's assistance here. > > 4. We find that pointing at bright fk5 stars doesn't bring them to the > chip. Using very bright stars we figured out that the arc offset +100", > -110" brings stars more or less to the chip, but to the center only at > Az~80 Alt~60 deg. If a star is in very different location, fk5 stars can > come to the chip, but not to the center exactly. > > To proceed, we need to review the mirror parameters, tilts and translatio= n > numbers, and we need working guiderActor. > > > > > > ---- Engineering Issues ---- > > - The Enclosure status is always Closed in the APO weather status page, > even > when the enclosure was open. > > - An attempt to turn on Ne and HgCd lamps is not successful. At the same > time, FF lamps > work well. We reported it to John Downey. > > > > > ---- Software Issues ---- > > guiderActor doesn't work completely: images are not analyzed. Scripts > based on guider analysis, including those for grid tests pointing > models, etc, do not work. > > We tried the following procedure to turn the guider actor on, > but at the end the guider doesn't analyze images. > > As sdss5@sdss5-hub: > ml guiderActor > cd $GUIDERACTOR_DIR/bin > python guiderActor_main.py > hub startNubs guider (issued in STUI) > guider loadCartridge > > ---- Observing Log ---- > > Afternoon > --------- > Checked all systems. Those that supposed to work are looking good. > > cwPositions =3D 423 426 444 443; > MCP instr =3D 19 (mounted); > ---------- > motorPosition > sp1: 25000, 25000, 24999; > ---------- > Median spectrographs temperatures: > Tsp1=3D 9.2 > Outside air temperature=3D 0.0; > ---------- > Boss CCD Temp : > sp1r0=3D 2.0 (-126.6); The camera is disconnected > sp1b2=3D -99.6 (-100.0); > sp1LN2: 10.0; > ---------- > ecameraTemp=3D 40.0 (-40.0) > ecamera simulating =3D False > Rel. Focus =3D 0.0; > objArcOff =3D 0.0, 0.0; > ---------- > Apogee: > vacuum =3D 9.374e-07 ( ln2Level =3D 93.153 ( > 85 ) > ---------- > > > 00:22Z started ventilation. > 01:43Z humidity jumped up. > A thunder front is approaching. We stopped ventilation and closed doors= . > > Took Ecam darks > > 02:09Z homed the Ecam stage > XQ#STATUS > : 1 axis homed > -000653000 commanded position > -000653000 actual position > 00065537 status word > OK > > > 02:15Z took flats. The 40K median level is achieved with 45 sec exp time. > > Inspecting the ecam flat shows that it has signal depression at the > center. This is not a saturation- it scales with the exposure time. We th= en > looked at the petals on the telescope and ensured that all FF lamps are > actually on. It was a guess that the FF illumination looks strange, at > least not usual - not it was sharp shadows from spiders and concentric > shadows, which was not like this before. > We guessed that something is wrong with the secondary mirror. Attempts to > change the focus the reflect in the motion of pistons. Restarted the mirr= or > controllers via the systemctl, but it didn't improve the situation. Then = we > decided to home M2 to find its good position. Before that we called to Jo= hn > Downey and discussed what we see and asked if works were done this mornin= g. > No works, ok to improve the focus, not ok to touch MCP. > > After homing M2 the flat improved a lot amd started looking like > yesterday. > We also took mirror numbers and find them similar to ones from yesterday. > 05:13Z the sky is less cloudy now, and the humidity is better. > LN2 fill forced, ventilation started. > > We fit the grid data taken yesterday and found crazy data - not reasonabl= e > values at all. Checked fitting last taken data (from 28 Nov 2021) and got= a > good fit. > The file inspection shows big difference between 2021 and 2023 - for > example in the position of the star at the center. Decided to re-take the > grid data first. > > 06:11Z enclosure open > > We were unable to find right stars in the field. Repeating home/relaxing > > home E, F > 0 2 i unknownReplyKey=3D"position error", "999999999, 999999999, 99999999= 9, > 999999999, 000000000, -000000050", "999999999, 999999999, 999999999, > 999999999, 000000000, -000000050 position error" > > > home D > 0 2 i unknownReplyKey=3D"position error", "999999999, 999999999, 99999999= 9, > 000000000, 999999999, 999999999", "999999999, 999999999, 999999999, > 000000000, 999999999, 999999999 position error" > > > home A, B, C > 0 2 i unknownReplyKey=3D"position error", "000000000, 000000000, 00000000= 0, > 999999999, 999999999, 999999999", "000000000, 000000000, 000000000, > 999999999, 999999999, 999999999 position error" > > > move 0.00,37.12,19.93,1088.85,-2028.25 > > relax: > 07:05:01 .tcc 6 tcc i Broadcast=3D"relax: cycle 1/4" > ... > 07:07:03 .tcc 15 tcc i Broadcast=3D"relax: cycle 4/4 and homing" > 07:07:53 .tcc 0 tcc : JobStatus=3Drelax,Done > > > Homing M2 > home D > 0 2 i unknownReplyKey=3D"position error", "999999999, 999999999, 99999999= 9, > 000000050, 999999999", "999999999, 999999999, 999999999, 000000050, > 999999999 position error" > home E > 0 2 i unknownReplyKey=3D"position error", "999999999, 999999999, 99999999= 9, > 999999999, 000000000", "999999999, 999999999, 999999999, 999999999, > 000000000 position error" > > > > > home A, B, C > 0 2 i unknownReplyKey=3D"position error", "-000002760, -000003907, > 000000201, 999999999, 999999999", "-000002760, -000003907, 000000201, > 999999999, 999999999 position error" > 0 2 i unknownReplyKey=3D"position error", "000000377, 000000068, -0000014= 94, > 999999999, 999999999", "000000377, 000000068, -000001494, 999999999, > 999999999 position error" > 0 2 i unknownReplyKey=3D"position error", "000000175, 000000100, -0000006= 25, > 999999999, 999999999", "000000175, 000000100, -000000625, 999999999, > 999999999 position error" > 0 2 i unknownReplyKey=3D"position error", "-000000297, -000000039, > -000000215, 999999999, 999999999", "-000000297, -000000039, -000000215, > 999999999, 999999999 position error" > 0 2 i unknownReplyKey=3D"position error", "000000081, -000000007, > -000000114, 999999999, 999999999", "000000081, -000000007, -000000114, > 999999999, 999999999 position error" > > Now we are at good errors. > > > > 07:24:18 CmdDone: OBSERVER.dmbiz 259 tcc proc enable collimate > > > At AZ~80 ALT~60 deg > FK5 stars consistently arrive at the very lower left corner of the chip. > Offset to the center =3D +100", -110" arc. > We tried these offsets in other positions in the sky, but > when they are far away, the offsets don't bring stars > to the center. > > > Commends > guider on oneExposure > and > guider findstar time=3D5 > start exposures, but then fail and complain about exposure time exceeding > limits, > e.g. > 10:14:59 OBSERVER.dmbiz 486 guider d text=3D"ecamera expose time=3D5.0 st= ack=3D1 > didFail=3DTrue" > 10:14:59 OBSERVER.dmbiz 486 guider w text=3D"Failed to take ecamera expos= ure" > 10:14:59 OBSERVER.dmbiz 486 guider w text=3D"ecamera expose command excee= ded > time limit: 25.0." > which is not true - the exposure time was 5 sec. > > > 10:15Z humidity peaks again. We decided to close. > > 10:24Z encl25m : closed > > We started calibrations, forced LN2 fill, and called it a night. > > > ---- Mirror Numbers ---- > > Note: the mirror numbers cannot be correct below > since we have the engineering camera on. > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4620 -0.0010 > Axial B: -0.0780 -0.0230 > Axial C: -0.2050 -0.0250 > Trans D: 1.4570 0.0060 > Lateral E: 0.4010 0.3315 > Lateral F: 0.5900 0.5345 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.01 37.23 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: 2.9610 0.0400 > Axial B: 2.8460 0.0950 > Axial C: 2.9650 -0.0620 > Trans D: -0.3360 -0.1060 > > GALILS > Commanded: 831500 842850 811100 -11300 -16200 > Actual: 831494 842857 811091 -11300 -16200 > > SETMIR VALUES > SecDesOrient: 657.0 9.62 1.47 18.09 309.04 > SecOrient: 657.1 9.72 1.48 17.97 308.82 > > > > After home-relaxing: > > > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4630 -0.0010 > Axial B: -0.0820 -0.0230 > Axial C: -0.2050 -0.0250 > Trans D: 1.4610 0.0060 > Lateral E: 0.4010 0.3315 > Lateral F: 0.5900 0.5345 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.0 37.22 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: 2.9590 0.0400 > Axial B: 2.8450 0.0950 > Axial C: 2.9660 -0.0620 > Trans D: -0.3430 -0.1060 > > GALILS > Commanded: 831650 843050 811400 -11300 -16250 > Actual: 831620 842933 811324 -11300 -16250 > > SETMIR VALUES > SecDesOrient: 657.0 9.62 1.47 18.09 309.04 > SecOrient: 657.15 9.63 1.56 18.59 309.46 > > > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4630 -0.0010 > Axial B: -0.0820 -0.0230 > Axial C: -0.2050 -0.0250 > Trans D: 1.4610 0.0060 > Lateral E: 0.4010 0.3315 > Lateral F: 0.5900 0.5345 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.0 37.22 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: 2.6790 0.0400 > Axial B: 2.5570 0.0950 > Axial C: 2.6790 -0.0620 > Trans D: -0.3220 -0.1060 > > GALILS > Commanded: 1239351 1250351 1218849 -10400 -15250 > Actual: 1240500 1251398 1219927 -10400 -15250 > > SETMIR VALUES > SecDesOrient: 3857.0 9.62 1.47 18.09 309.04 > SecOrient: 656.85 9.67 1.38 18.47 309.43 > > > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4630 0.4630 > Axial B: -0.0820 -0.0820 > Axial C: -0.2050 -0.2050 > Trans D: 1.4610 1.4610 > Lateral E: 0.4010 0.4010 > Lateral F: 0.5900 0.5900 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.0 37.22 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: 1.7570 2.1320 > Axial B: 1.6300 2.0150 > Axial C: 1.7570 2.1320 > Trans D: -0.3150 -0.3180 > > GALILS > Commanded: 2392866 2403915 2372365 -10400 -15250 > Actual: 2388403 2398588 2366015 -10400 -15250 > > SETMIR VALUES > SecDesOrient: 3857.0 9.62 1.47 18.09 309.04 > SecOrient: 656.85 9.67 1.38 18.47 309.43 > > > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4630 0.4630 > Axial B: -0.0820 -0.0820 > Axial C: -0.2050 -0.2050 > Trans D: 1.4610 1.4610 > Lateral E: 0.4010 0.4010 > Lateral F: 0.5900 0.5900 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.0 37.22 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: -0.2400 2.1320 > Axial B: -0.3520 2.0150 > Axial C: -0.2330 2.1320 > Trans D: -0.2960 -0.3180 > > GALILS > Commanded: 4863100 4874200 4842500 -10400 -15200 > Actual: 4863098 4874197 4842588 -10400 -15200 > > SETMIR VALUES > SecDesOrient: 3857.0 9.62 1.47 18.09 309.04 > SecOrient: 3857.05 9.63 1.46 18.0 308.63 > > > Finally, after saving the Nominals: > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A: 0.4630 0.4630 > Axial B: -0.0820 -0.0820 > Axial C: -0.2050 -0.2050 > Trans D: 1.4610 1.4610 > Lateral E: 0.4010 0.4010 > Lateral F: 0.5900 0.5900 > > GALILS > Commanded: 6150 -50 10150 2000 48050 47300 > Actual: 6150 -50 10150 2000 48050 47300 > > SETMIR VALUES > PrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25 > PrimOrient: 0.0 37.22 19.74 1088.93 -2027.66 > > SECONDARY: > ---------- > > Focus: 0.0000 > Air temp: 0.00 > Altitude: 30.0 > > MIGS TONIGHT NOMINAL > Axial A: -0.2400 -0.2400 > Axial B: -0.3520 -0.3520 > Axial C: -0.2320 -0.2320 > Trans D: -0.2960 -0.2960 > > GALILS > Commanded: 4863000 4874100 4842600 -10400 -15200 > Actual: 4863016 4874102 4842550 -10400 -15200 > > SETMIR VALUES > SecDesOrient: 3857.0 9.62 1.47 18.09 309.04 > SecOrient: 3856.97 9.63 1.45 18.0 308.63 > > > > ---- Telescope Status ---- > > 05:13Z Started ventilation > 06:11Z encl25m : open > 10:24Z encl25m : closed > > Red BOSS camera is detached. > > Status at: 10:32Z > Telescope stowed at: 121.0, 30.0, 0.0 mount > Instrument mounted: eng, camera > Counterweights at: 423/444 > LN2 autofill systems: Connected and turned on > 180L LN2 dewar scales: SP1 127 lbs, 18 psi > > > > > ---- Software Used ---- > > > STUI : 1.7.19 > alerts : 2.3.0 > boss : 6.0.2-alpha.0 > -boss.specMec : 3.0.4 > apo : 3.0.1 > fliswarm : 0.4.0 > jaeger : 1.4.1a0 > kaiju : 1.3.2-alpha.0 > coordio : 1.8.2a0 > fps_calibrati : 2023.07.27+7ea4ef6 > cherno : 0.6.3 > astrometrynet : 0.93 > hal : 0.6.0b5 > hartmann : 2.0.2 > hub : 5.0.1a0 > mcp : 2.1 > -mcp.plc : 35 > -mcp.azFiduci : v1_149 > -mcp.altFiduc : v1_149 > -mcp.rotFiduc : v1_149 > tcc : 1.4.0 > apogee : not availble > apogeecal : not availble > apogeeql : v1_7_0dev > STUIAdditions : 3.1.20 > Boson : 0.3.2 > > --------------Other Versions-------------- > sdss-obstools : 3.9.3 > TPM : 1.2-31-gd7eb > MCP : 2.1-1-ge461 > idlspec2d : v6_1_0 > Kronos : 1.6.2a > roboscheduler : 1.4.0 > > /dev/sdb1 2.0T 291G 1.8T 15% /home > /dev/sdd1 22T 9.1T 12T 44% /data > > > ---- APOGEE Data Summary ---- > > APOGEE data list, mjd=3D60204, all > raw_data: /data/apogee/utr_cdr/60204/apRaw-*.fits > archive: /data/apogee/archive/60204/apR-[a,b,c]-*.apz > quickred: /data/apogee/quickred/60204/apq-*.fits > -------------------------------------------------------------------------= ----- > > mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset > %Flux/FPI Comm > > -------------------------------------------------------------------------= ----- > 60204 1 00:03 46420001 Arc---- 3 A 13.0 ---------- a-b-c - > -12 test > 60204 2 00:14 46420002 Dark 60 A 13.0 ---------- a-b-c - > - > 60204 3 00:16 46420003 QuarFlat 10 A 13.0 ---------- a-b-c - > - > 60204 4 00:19 46420004 Arc-Thar 12 B 13.5 ---------- a-b-c 1.03 > - > 60204 5 00:26 46420005 Arc-Une 40 B 13.5 ---------- a-b-c - > - > 60204 6 00:28 46420006 Arc-Thar 12 A 13.0 ---------- a-b-c 0.45 > - > 60204 7 00:35 46420007 Arc-Une 40 A 13.0 ---------- a-b-c - > - > 60204 8 00:46 46420008 Dark 60 A 13.0 ---------- a-b-c - > - > 60204 9 00:52 46420009 Arc---- 30 A 13.0 ---------- a-b-c - > 86 FPI > 60204 10 10:38 46420010 Dark 60 A 13.0 ---------- a-b-c - > - > 60204 11 10:49 46420011 Dark 60 A 13.0 ---------- a-b-c - > - > ... > -------------------------------------------------------------------------= ----- > > > > > ---- Weather Log ---- > > Wind 1 um DIMM IRSC > Time Temp C Dewp C MPH Dir Dust fwhm mean sigma > > 18:00 14.7 9.1 13.9 221.3 813 > 18:15 16.7 10.1 7.9 241.8 843 > 18:30 15.0 10.0 11.1 233.2 866 > 18:45 15.2 10.3 6.3 243.3 789 > 19:00 17.0 10.8 9.4 235.9 828 > 19:15 15.4 10.3 8.7 227.6 855 > 19:30 15.9 10.9 8.0 239.8 769 > 19:45 14.2 10.5 10.1 271.1 806 > 20:00 14.2 10.2 6.9 222.5 847 > 20:15 14.3 10.2 10.7 225.1 870 > 20:30 15.6 10.7 12.4 260.0 787 > 20:45 14.4 9.8 10.5 216.1 794 > 21:00 14.1 9.9 5.6 263.6 702 > 21:15 16.1 10.5 9.4 229.4 762 > 21:30 16.4 10.3 10.3 264.5 714 > 21:45 18.5 11.0 16.0 260.5 756 > 22:00 15.9 10.0 9.0 256.6 850 > 22:15 15.1 10.1 6.6 254.1 839 > 22:30 15.7 10.1 10.2 265.6 697 > 22:45 18.6 10.3 13.1 271.2 731 > 23:00 17.0 9.9 11.0 246.5 696 > 23:15 16.7 9.8 9.7 260.5 635 > 23:30 16.3 9.9 8.0 259.6 622 > 23:45 15.8 9.7 6.8 261.9 693 > 00:00 16.8 9.8 6.1 263.6 611 > 00:15 14.5 9.9 6.1 278.5 613 > 00:30 14.6 9.7 5.4 296.1 640 > 00:45 12.9 9.9 4.0 297.3 654 > 01:00 12.6 9.9 2.9 42.8 648 > 01:15 11.9 9.9 8.4 65.8 681 > 01:30 11.3 9.9 10.5 65.0 797 > 01:45 10.8 9.8 8.5 61.3 dpDep 387 110.65 > 02:00 10.6 9.7 16.1 73.1 dpDep 380 73.20 > 02:15 10.8 9.5 15.1 61.8 dpDep 376 71.64 > 02:30 11.5 8.3 13.6 73.3 dpDep 358 48.16 > 02:45 11.3 7.8 10.2 81.0 dpDep 344 33.47 > 03:00 11.3 7.4 13.3 75.4 594 348 62.39 > 03:15 11.9 6.6 14.3 77.4 581 348 34.06 > 03:30 11.6 6.7 6.4 89.5 614 348 47.31 > 03:45 12.2 6.8 6.1 88.0 633 348 39.87 > 04:00 12.2 7.2 6.3 89.7 646 351 59.51 > 04:15 12.1 7.1 7.1 87.5 677 356 55.86 > 04:30 12.6 6.7 3.0 119.0 657 346 53.36 > 04:45 12.7 6.6 4.6 142.2 631 345 30.48 > 05:00 12.6 5.9 5.5 174.2 629 344 43.14 > 05:15 12.0 6.4 4.9 163.4 681 307 13.45 > 05:30 12.9 6.2 5.3 181.7 621 344 59.66 > 05:45 12.6 6.1 4.4 187.3 635 340 7.68 > 06:00 12.2 5.9 1.5 193.1 626 340 12.02 > 06:15 12.9 5.8 1.5 158.4 644 342 46.51 > 06:30 12.5 5.9 2.7 163.6 621 345 30.46 > 06:45 12.8 5.9 5.1 189.5 605 344 30.60 > 07:00 12.0 7.3 4.0 195.1 710 342 31.15 > 07:15 11.9 7.7 4.1 188.8 754 341 13.27 > 07:30 11.8 7.5 1.9 191.6 759 340 4.01 > 07:45 11.4 5.9 3.4 97.6 676 342 10.74 > 08:00 11.6 6.3 0.7 172.9 612 348 17.93 > 08:15 11.2 5.6 1.9 111.4 600 345 30.32 > 08:30 11.2 5.4 5.1 95.7 578 344 45.84 > 08:45 11.9 5.9 1.3 145.0 551 340 29.44 > 09:00 12.0 6.9 1.2 200.2 634 340 5.08 > 09:15 11.9 6.2 1.0 172.8 606 340 2.45 > 09:30 12.0 7.2 1.5 204.8 751 340 2.40 > 09:45 11.4 8.3 1.2 211.3 699 340 3.56 > 10:00 11.5 8.2 1.0 207.8 759 340 9.81 > 10:15 10.9 8.9 1.3 224.3 815 340 11.25 > 10:30 10.0 8.8 2.1 199.5 787 340 2.63 > 10:45 10.2 8.6 1.6 209.1 dpDep 326 2.37 > > > ---- Time Tracking ---- > > *=3D*=3D*=3D Observatory: APO > *=3D*=3D*=3D MJD: 60204 > Fill night time in Hours below > *=3D*=3D*=3D Total bright time : 0.2 > *=3D*=3D*=3D Bright time, queued observations : 0 > *=3D*=3D*=3D Bright time, commissioning/engineering: 0 > *=3D*=3D*=3D Bright time lost to weather : 0.2 > *=3D*=3D*=3D Bright time lost to technical issues : 0 > > *=3D*=3D*=3D Total dark time : 9.4 > *=3D*=3D*=3D Dark time, queued observations : 0 > *=3D*=3D*=3D Dark time, commissioning/engineering : 4.2 > *=3D*=3D*=3D Dark time lost to weather : 5.2 > *=3D*=3D*=3D Dark time lost to technical issues : 0 > > > > > ____________________________________________________________ > Logs of Nightly APO Activities > > https://urldefense.com/v3/__https://trac.sdss.org/tracmailman/browser/pri= vate/sloan-25mlog/index.html__;!!K-Hz7m0Vt54!nUIdmYB32O14azznB6LwJqDHH4fuaC= kCyKfOLyZPv2oQjW7rw6odoZuYyM72T2uXmN3g82COsvaySedcHg$ > --00000000000024f209060591b527 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Dmitry,I had a qui= ck look at the longs and not sure what the issue is. It does seem the probl= em is that the guider actor did not listen to the keywords output by the ec= amera actor and did not know the exposure had finished. Assuming everything= was correctly connected to tron, and it seems it was, I'm not very sur= e what the issue is.The e= cam seems to be disconnected. Can somebody connect it so I can test this du= ring the day? I probably won't be available until relatively late tonig= ht.Thanks,Jos=C3= =A9 On 17 Sep 2023 at 03:57:22, dmbiz@apo.nmsu.edu wrote: =20 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0APACHE PO= INT OBSERVATORY SDSS 2.5M =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0OBSERVING LOG =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0Saturday September 16, 2023 =C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0(SJD 60204)---- =C2=A0Observing Team = ----Dmitry BizyaevConner ScoresbyKaike Pan (remote support)= ---- Observing Plan ----Finish instrumental block u= pdate.Run pointing model.Sat 16 Sep 2023 60204 0.05 02:01 02:16= 11:39 18:56 04:21 --- dark ( 9.4 h) plus 0.2 h for 12 deg design ---- Observing Summary ----Part of the night was lost to the clo= uds and radar.Opened late. This night was not successful becaus= e of many failures. Not all issues were fixed. The root of all the = problems happened tonight, we think, were rather dried corpses offive b= ats found on the floor in the upper enclosure and at the entrance door. 1. At the beginning we saw strange structure of Ecam flats - with = a depression at the center. We suspected that the secondary mirror was = out very much. Home/relaxed mirrors and gotgood flats. So this problem = was fixed. Nominal MIGs are saved with "fps" instrument. = 2. Tried to start with fitting the grid data taken yesterday, and got t= he same very strangenumbers (like new rot angle ~ 150 deg, which is ins= ane). We inspected images taken yesterdayfor the grid and found that th= e star was at the edge of the chip; for most of offsets it went away, and g= uider measured position of different stars. The grid data need to be retake= n. 3. We followed the same procedure as a few days ago to start gui= derActor. It starts, takes images, but it is unable to process them and fai= ls. At the same time, "proc-gimg" images are not made. engcamera = can take images normally. We tried many ways to restart, to run from differ= ent users, to load specific cartridge with it (0 or 19), to take darks and = flats every time, but nothing worked. We need Jose's assistance here.4. We find that pointing at bright fk5 stars doesn't bring them t= o the chip. Using very bright stars we figured out that the arc offset +100= ", -110" brings stars more or less to the chip, but to the center= only at Az~80 Alt~60 deg. If a star is in very different location, fk5 sta= rs can come to the chip, but not to the center exactly. To proceed,= we need to review the mirror parameters, tilts and translation numbers, an= d we need working guiderActor. ---- Engineering Iss= ues ----- The Enclosure status is always Closed in the APO weather = status page, even =C2=A0when the enclosure was open. - An atte= mpt to turn on Ne and HgCd lamps is not successful. At the same time, FF la= mps =C2=A0work well. We reported it to John Downey. ---- Software Issues ----guiderActor doesn't work completely: = images are not analyzed. Scriptsbased on guider analysis, including tho= se for grid tests pointing models, etc, do not work. We tried t= he following procedure to turn the guider actor on,but at the end the g= uider doesn't analyze images. =C2=A0As sdss5@sdss5-hub:ml g= uiderActorcd $GUIDERACTOR_DIR/binpython guiderActor_main.pyhub = startNubs guider (issued in STUI)guider loadCartridge---- Obser= ving Log ----Afternoon---------Checked all systems. Those t= hat supposed to work are looking good. cwPositions =3D =C2=A0423 = =C2=A0426 =C2=A0444 =C2=A0443; =C2=A0MCP instr =3D =C2=A019 =C2=A0(moun= ted); =C2=A0----------motorPosition =C2=A0=C2=A0=C2=A0=C2=A0sp1= : =C2=A0=C2=A025000, =C2=A0=C2=A025000, =C2=A0=C2=A024999; =C2=A0------= ----Median spectrographs temperatures: =C2=A0=C2=A0=C2=A0=C2=A0Tsp1= =3D 9.2 =C2=A0=C2=A0=C2=A0=C2=A0Outside air temperature=3D 0.0; =C2=A0= ----------Boss CCD Temp : =C2=A0=C2=A0=C2=A0sp1r0=3D =C2=A0=C2= =A0=C2=A02.0 =C2=A0(-126.6); =C2=A0The camera is disconnected =C2=A0=C2= =A0=C2=A0sp1b2=3D =C2=A0-99.6 =C2=A0(-100.0); =C2=A0 =C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0sp1LN2: 10.0; =C2=A0----------ecamera= Temp=3D 40.0 (-40.0) =C2=A0ecamera simulating =3D False Rel. Focus = =3D =C2=A00.0; =C2=A0objArcOff =3D 0.0, =C2=A00.0; =C2=A0----------= Apogee: =C2=A0vacuum =3D 9.374e-07 ( < 1.1e-06 ) =C2=A0ln2Le= vel =3D 93.153 ( > 85 )----------00:22Z started ventilat= ion.01:43Z humidity jumped up. =C2=A0=C2=A0A thunder front is appro= aching. We stopped ventilation and closed doors. Took Ecam darks02:09Z homed the Ecam stageXQ#STATUS: 1 axis homed-0006530= 00 commanded position-000653000 actual position 00065537 status wor= dOK02:15Z took flats. The 40K median level is achieved with= 45 sec exp time. Inspecting the ecam flat shows that it has signal= depression at the center. This is not a saturation- it scales with the exp= osure time. We then looked at the petals on the telescope and ensured that = all FF lamps are actually on. It was a guess that the FF illumination looks= strange, at least not usual - not it was sharp shadows from spiders and co= ncentric shadows, which was not like this before. We guessed that somet= hing is wrong with the secondary mirror. Attempts to change the focus the r= eflect in the motion of pistons. Restarted the mirror controllers via the s= ystemctl, but it didn't improve the situation. Then we decided to home = M2 to find its good position. Before that we called to John Downey and disc= ussed what we see and asked if works were done this morning. No works, ok t= o improve the focus, not ok to touch MCP. After homing M2 the flat = improved a lot amd started looking like yesterday. We also took mirror = numbers and find them similar to ones from yesterday. 05:13Z the sky is= less cloudy now, and the humidity is better. LN2 fill forced, ventilat= ion started.We fit the grid data taken yesterday and found crazy da= ta - not reasonable values at all. Checked fitting last taken data (from 28= Nov 2021) and got a good fit. The file inspection shows big difference= between 2021 and 2023 - for example in the position of the star at the cen= ter. Decided to re-take the grid data first.06:11Z enclosure openWe were unable to find right stars in the field. Repeating home/relax= inghome E, F0 2 i unknownReplyKey=3D"position error",= "999999999, 999999999, 999999999, 999999999, 000000000, -000000050&qu= ot;, "999999999, =C2=A0999999999, =C2=A0999999999, =C2=A0999999999, = =C2=A0000000000, -000000050 position error"home D0 2 i= unknownReplyKey=3D"position error", "999999999, 999999999, = 999999999, 000000000, 999999999, 999999999", "999999999, =C2=A099= 9999999, =C2=A0999999999, =C2=A0000000000, =C2=A0999999999, =C2=A0999999999= position error"home A, B, C0 2 i unknownReplyKey=3D&q= uot;position error", "000000000, 000000000, 000000000, 999999999,= 999999999, 999999999", "000000000, =C2=A0000000000, =C2=A0000000= 000, =C2=A0999999999, =C2=A0999999999, =C2=A0999999999 position error"= move 0.00,37.12,19.93,1088.85,-2028.25relax:07:05:0= 1 .tcc 6 tcc i Broadcast=3D"relax: cycle 1/4"...07:07:03 = .tcc 15 tcc i Broadcast=3D"relax: cycle 4/4 and homing"07:07:= 53 .tcc 0 tcc : JobStatus=3Drelax,DoneHoming M2home D0 = 2 i unknownReplyKey=3D"position error", "999999999, 99999999= 9, 999999999, 000000050, 999999999", "999999999, =C2=A0999999999,= =C2=A0999999999, =C2=A0000000050, =C2=A0999999999 position error"= home E0 2 i unknownReplyKey=3D"position error", "9999999= 99, 999999999, 999999999, 999999999, 000000000", "999999999, =C2= =A0999999999, =C2=A0999999999, =C2=A0999999999, =C2=A0000000000 position er= ror"home A, B, C0 2 i unknownReplyKey=3D"= position error", "-000002760, -000003907, 000000201, 999999999, 9= 99999999", "-000002760, -000003907, =C2=A0000000201, =C2=A0999999= 999, =C2=A0999999999 position error"0 2 i unknownReplyKey=3D"= position error", "000000377, 000000068, -000001494, 999999999, 99= 9999999", "000000377, =C2=A0000000068, -000001494, =C2=A099999999= 9, =C2=A0999999999 position error"0 2 i unknownReplyKey=3D"po= sition error", "000000175, 000000100, -000000625, 999999999, 9999= 99999", "000000175, =C2=A0000000100, -000000625, =C2=A0999999999,= =C2=A0999999999 position error"0 2 i unknownReplyKey=3D"posi= tion error", "-000000297, -000000039, -000000215, 999999999, 9999= 99999", "-000000297, -000000039, -000000215, =C2=A0999999999, =C2= =A0999999999 position error"0 2 i unknownReplyKey=3D"position= error", "000000081, -000000007, -000000114, 999999999, 999999999= ", "000000081, -000000007, -000000114, =C2=A0999999999, =C2=A0999= 999999 position error"Now we are at good errors. 07:24:18 CmdDone: OBSERVER.dmbiz 259 tcc proc enable collimateAt AZ~80 ALT~60 degFK5 stars consistently arrive at the very lower le= ft corner of the chip.Offset to the center =3D +100", -110" a= rc.We tried these offsets in other positions in the sky, but when t= hey are far away, the offsets don't bring stars to the center. = Commendsguider on oneExposureandguider findstar time=3D= 5start exposures, but then fail and complain about exposure time exceed= ing limits,e.g.10:14:59 OBSERVER.dmbiz 486 guider d text=3D"ec= amera expose time=3D5.0 stack=3D1 didFail=3DTrue"10:14:59 OBSERVER= .dmbiz 486 guider w text=3D"Failed to take ecamera exposure"1= 0:14:59 OBSERVER.dmbiz 486 guider w text=3D"ecamera expose command exc= eeded time limit: 25.0."which is not true - the exposure time was = 5 sec. =C2=A010:15Z humidity peaks again. We decided to close.10:24Z =C2=A0=C2=A0=C2=A0=C2=A0encl25m : closedWe started ca= librations, forced LN2 fill, and called it a night. ---- Mirror= Numbers ----Note: the mirror numbers cannot be correct belowsi= nce we have the engineering camera on. PRIMARY:--------Scal= e: 1.000000MIGS TONIGHT NOMINALAxial A: 0.4620 -0.0010Axi= al B: -0.0780 -0.0230Axial C: -0.2050 -0.0250Trans D: 1.4570 0.00= 60Lateral E: 0.4010 0.3315Lateral F: 0.5900 0.5345GALIL= SCommanded: =C2=A06150 -50 10150 2000 48050 47300Actual: =C2=A0=C2= =A0=C2=A0=C2=A06150 -50 10150 2000 48050 47300SETMIR VALUESPrim= DesOrient: 0.0 37.12 19.93 1088.85 -2028.25PrimOrient: =C2=A0=C2=A0=C2= =A00.01 37.23 19.74 1088.93 -2027.66SECONDARY:----------Focus: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A00.0000Air temp: =C2=A0=C2=A0=C2= =A0=C2=A00.00Altitude: =C2=A0=C2=A030.0MIGS TONIGHT NOMINALAxial A: 2.9610 0.0400Axial B: 2.8460 0.0950Axial C: 2.9650 -= 0.0620Trans D: -0.3360 -0.1060GALILSCommanded: 831500 84285= 0 811100 -11300 -16200Actual: =C2=A0=C2=A0=C2=A0831494 842857 811091 -1= 1300 -16200SETMIR VALUESSecDesOrient: 657.0 9.62 1.47 18.09 309= .04SecOrient: =C2=A0=C2=A0=C2=A0657.1 9.72 1.48 17.97 308.82After home-relaxing:PRIMARY:--------Scale: 1.0= 00000MIGS TONIGHT NOMINALAxial A: 0.4630 -0.0010Axial B: = -0.0820 -0.0230Axial C: -0.2050 -0.0250Trans D: 1.4610 0.0060= Lateral E: 0.4010 0.3315Lateral F: 0.5900 0.5345GALILSC= ommanded: =C2=A06150 -50 10150 2000 48050 47300Actual: =C2=A0=C2=A0=C2= =A0=C2=A06150 -50 10150 2000 48050 47300SETMIR VALUESPrimDesOri= ent: 0.0 37.12 19.93 1088.85 -2028.25PrimOrient: =C2=A0=C2=A0=C2=A00.0 = 37.22 19.74 1088.93 -2027.66SECONDARY:----------Focus: = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A00.0000Air temp: =C2=A0=C2=A0=C2=A0=C2=A00= .00Altitude: =C2=A0=C2=A030.0MIGS TONIGHT NOMINALAxial A: = 2.9590 0.0400Axial B: 2.8450 0.0950Axial C: 2.9660 -0.0620= Trans D: -0.3430 -0.1060GALILSCommanded: 831650 843050 811400 -= 11300 -16250Actual: =C2=A0=C2=A0=C2=A0831620 842933 811324 -11300 -1625= 0SETMIR VALUESSecDesOrient: 657.0 9.62 1.47 18.09 309.04Sec= Orient: =C2=A0=C2=A0=C2=A0657.15 9.63 1.56 18.59 309.46PRIM= ARY:--------Scale: 1.000000MIGS TONIGHT NOMINALAxial A= : 0.4630 -0.0010Axial B: -0.0820 -0.0230Axial C: -0.2050 -0.0250Trans D: 1.4610 0.0060Lateral E: 0.4010 0.3315Lateral F: 0.5= 900 0.5345GALILSCommanded: =C2=A06150 -50 10150 2000 48050 473= 00Actual: =C2=A0=C2=A0=C2=A0=C2=A06150 -50 10150 2000 48050 47300SETMIR VALUESPrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25PrimO= rient: =C2=A0=C2=A0=C2=A00.0 37.22 19.74 1088.93 -2027.66SECONDARY:= ----------Focus: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A00.0000Air te= mp: =C2=A0=C2=A0=C2=A0=C2=A00.00Altitude: =C2=A0=C2=A030.0MIGS = TONIGHT NOMINALAxial A: 2.6790 0.0400Axial B: 2.5570 0.0950Axial C: 2.6790 -0.0620Trans D: -0.3220 -0.1060GALILSComm= anded: 1239351 1250351 1218849 -10400 -15250Actual: =C2=A0=C2=A0=C2=A01= 240500 1251398 1219927 -10400 -15250SETMIR VALUESSecDesOrient: = 3857.0 9.62 1.47 18.09 309.04SecOrient: =C2=A0=C2=A0=C2=A0656.85 9.67 1= .38 18.47 309.43PRIMARY:--------Scale: 1.000000= MIGS TONIGHT NOMINALAxial A: 0.4630 0.4630Axial B: -0.0820 -= 0.0820Axial C: -0.2050 -0.2050Trans D: 1.4610 1.4610Lateral E= : 0.4010 0.4010Lateral F: 0.5900 0.5900GALILSCommanded:= =C2=A06150 -50 10150 2000 48050 47300Actual: =C2=A0=C2=A0=C2=A0=C2=A06= 150 -50 10150 2000 48050 47300SETMIR VALUESPrimDesOrient: 0.0 3= 7.12 19.93 1088.85 -2028.25PrimOrient: =C2=A0=C2=A0=C2=A00.0 37.22 19.7= 4 1088.93 -2027.66SECONDARY:----------Focus: =C2=A0=C2= =A0=C2=A0=C2=A0=C2=A00.0000Air temp: =C2=A0=C2=A0=C2=A0=C2=A00.00Al= titude: =C2=A0=C2=A030.0MIGS TONIGHT NOMINALAxial A: 1.7570 = 2.1320Axial B: 1.6300 2.0150Axial C: 1.7570 2.1320Trans D: = -0.3150 -0.3180GALILSCommanded: 2392866 2403915 2372365 -10400 = -15250Actual: =C2=A0=C2=A0=C2=A02388403 2398588 2366015 -10400 -15250SETMIR VALUESSecDesOrient: 3857.0 9.62 1.47 18.09 309.04SecOr= ient: =C2=A0=C2=A0=C2=A0656.85 9.67 1.38 18.47 309.43PRIMAR= Y:--------Scale: 1.000000MIGS TONIGHT NOMINALAxial A: = 0.4630 0.4630Axial B: -0.0820 -0.0820Axial C: -0.2050 -0.2050= Trans D: 1.4610 1.4610Lateral E: 0.4010 0.4010Lateral F: 0.590= 0 0.5900GALILSCommanded: =C2=A06150 -50 10150 2000 48050 47300= Actual: =C2=A0=C2=A0=C2=A0=C2=A06150 -50 10150 2000 48050 47300= SETMIR VALUESPrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25PrimOri= ent: =C2=A0=C2=A0=C2=A00.0 37.22 19.74 1088.93 -2027.66SECONDARY:----------Focus: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A00.0000Air temp= : =C2=A0=C2=A0=C2=A0=C2=A00.00Altitude: =C2=A0=C2=A030.0MIGS T= ONIGHT NOMINALAxial A: -0.2400 2.1320Axial B: -0.3520 2.0150A= xial C: -0.2330 2.1320Trans D: -0.2960 -0.3180GALILSComman= ded: 4863100 4874200 4842500 -10400 -15200Actual: =C2=A0=C2=A0=C2=A0486= 3098 4874197 4842588 -10400 -15200SETMIR VALUESSecDesOrient: 38= 57.0 9.62 1.47 18.09 309.04SecOrient: =C2=A0=C2=A0=C2=A03857.05 9.63 1.= 46 18.0 308.63Finally, after saving the Nominals:PRIMAR= Y:--------Scale: 1.000000MIGS TONIGHT NOMINALAxial A: = 0.4630 0.4630Axial B: -0.0820 -0.0820Axial C: -0.2050 -0.2050= Trans D: 1.4610 1.4610Lateral E: 0.4010 0.4010Lateral F: 0.590= 0 0.5900GALILSCommanded: =C2=A06150 -50 10150 2000 48050 47300= Actual: =C2=A0=C2=A0=C2=A0=C2=A06150 -50 10150 2000 48050 47300= SETMIR VALUESPrimDesOrient: 0.0 37.12 19.93 1088.85 -2028.25PrimOri= ent: =C2=A0=C2=A0=C2=A00.0 37.22 19.74 1088.93 -2027.66SECONDARY:----------Focus: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A00.0000Air temp= : =C2=A0=C2=A0=C2=A0=C2=A00.00Altitude: =C2=A0=C2=A030.0MIGS T= ONIGHT NOMINALAxial A: -0.2400 -0.2400Axial B: -0.3520 -0.3520A= xial C: -0.2320 -0.2320Trans D: -0.2960 -0.2960GALILSComman= ded: 4863000 4874100 4842600 -10400 -15200Actual: =C2=A0=C2=A0=C2=A0486= 3016 4874102 4842550 -10400 -15200SETMIR VALUESSecDesOrient: 38= 57.0 9.62 1.47 18.09 309.04SecOrient: =C2=A0=C2=A0=C2=A03856.97 9.63 1.= 45 18.0 308.63---- Telescope Status ----05:13Z =C2= =A0=C2=A0=C2=A0=C2=A0Started ventilation06:11Z =C2=A0=C2=A0=C2=A0=C2=A0= encl25m : open10:24Z =C2=A0=C2=A0=C2=A0=C2=A0encl25m : closedRe= d BOSS camera is detached. Status at: 10:32ZTelescope stowed at= : =C2=A0=C2=A0=C2=A0121.0, 30.0, =C2=A0=C2=A00.0 =C2=A0mountInstrument = mounted: =C2=A0=C2=A0=C2=A0=C2=A0eng, camera =C2=A0=C2=A0=C2=A0=C2=A0Co= unterweights at: =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0423/444 =C2=A0=C2=A0=C2=A0LN2 autofill systems: =C2=A0=C2=A0Connected and turned on180L LN2 dew= ar scales: =C2=A0SP1 =C2=A0=C2=A0127 =C2=A0=C2=A0=C2=A0=C2=A0lbs, 18 =C2=A0= =C2=A0=C2=A0psi---- Software Used ----STUI = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.7.19alerts = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 2.3.0boss =C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 6.0.2-alpha.0-boss.specMec : 3= .0.4apo =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 3= .0.1fliswarm =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.4.0jaeger =C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.4.1a0kaiju =C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.3.2-alpha.0coordio =C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0: 1.8.2a0fps_calibrati : 2023.07.27+7ea4ef6cherno = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.6.3astrometrynet : 0.93hal =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.6.0b5= hartmann =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 2.0.2hub =C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 5.0.1a0mcp =C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 2.1-mcp.plc =C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0: 35-mcp.azFiduci : v1_149-mcp.altFiduc : v1_1= 49-mcp.rotFiduc : v1_149tcc =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0: 1.4.0apogee =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: not availbleapogeecal =C2=A0=C2=A0=C2=A0=C2=A0: not availbleapogeeql =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: v1_7_0devSTUIAdditions : 3.1.= 20Boson =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.3.2= --------------Other Versions--------------sdss-obstools =C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0: 3.9.3 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0TPM =C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 1.2-= 31-gd7eb =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0MCP =C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: 2.1-1-ge461 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0idl= spec2d =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: v6_1_0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0Kronos =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0: 1.6.2a =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0roboscheduler =C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0: 1.4.0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0/dev/sdb1 =C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A02.0T =C2=A02= 91G =C2=A01.8T =C2=A015% /home/dev/sdd1 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A022T =C2= =A09.1T =C2=A0=C2=A012T =C2=A044% /data---- APOGEE Data Summary= ----APOGEE data list, =C2=A0=C2=A0mjd=3D60204, =C2=A0allraw_da= ta: =C2=A0/data/apogee/utr_cdr/60204/apRaw-*.fitsarchive: =C2=A0/data/a= pogee/archive/60204/apR-[a,b,c]-*.apzquickred: =C2=A0/data/apogee/quick= red/60204/apq-*.fits---------------------------------------------------= --------------------------- mjd =C2=A0=C2=A0i =C2=A0=C2=A0UT =C2=A0=C2= =A0File/Exp =C2=A0Imtype Nread A/B Dth =C2=A0Design-Cfg =C2=A0Arch Offset %= Flux/FPI Comm --------------------------------------------------------= ----------------------60204 =C2=A0=C2=A01 00:03 =C2=A046420001 =C2=A0Ar= c---- =C2=A0=C2=A03 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0= =C2=A0=C2=A0- =C2=A0-12 =C2=A0test60204 =C2=A0=C2=A02 00:14 =C2=A046420= 002 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A060 =C2=A0A =C2=A013.0 =C2=A0--------= -- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A060204 =C2=A0=C2= =A03 00:16 =C2=A046420003 =C2=A0QuarFlat 10 =C2=A0A =C2=A013.0 =C2=A0------= ---- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A060204 =C2=A0= =C2=A04 00:19 =C2=A046420004 =C2=A0Arc-Thar 12 =C2=A0B =C2=A013.5 =C2=A0---= ------- =C2=A0a-b-c =C2=A01.03 =C2=A0- =C2=A060204 =C2=A0=C2=A05 00:26 = =C2=A046420005 =C2=A0Arc-Une =C2=A040 =C2=A0B =C2=A013.5 =C2=A0---------- = =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A060204 =C2=A0=C2=A06= 00:28 =C2=A046420006 =C2=A0Arc-Thar 12 =C2=A0A =C2=A013.0 =C2=A0----------= =C2=A0a-b-c =C2=A00.45 =C2=A0- =C2=A060204 =C2=A0=C2=A07 00:35 =C2=A04= 6420007 =C2=A0Arc-Une =C2=A040 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-= b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A060204 =C2=A0=C2=A08 00:46 = =C2=A046420008 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2=A060 =C2=A0A =C2=A013.0 =C2= =A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A060204= =C2=A0=C2=A09 00:52 =C2=A046420009 =C2=A0Arc---- =C2=A030 =C2=A0A =C2=A013= .0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- =C2=A0=C2=A086 =C2=A0FP= I60204 =C2=A010 10:38 =C2=A046420010 =C2=A0=C2=A0=C2=A0Dark =C2=A0=C2= =A060 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2=A0=C2=A0=C2=A0- = =C2=A0=C2=A0- =C2=A060204 =C2=A011 10:49 =C2=A046420011 =C2=A0=C2=A0=C2= =A0Dark =C2=A0=C2=A060 =C2=A0A =C2=A013.0 =C2=A0---------- =C2=A0a-b-c =C2= =A0=C2=A0=C2=A0- =C2=A0=C2=A0- =C2=A0...---------------------------= --------------------------------------------------- ---- We= ather Log ---- Wind 1 um DIMM IRSCTime Temp C Dewp C MPH Di= r Dust fwhm mean sigma18:00 14.7 9.1 13.9 221.3 813 18:15 16.= 7 10.1 7.9 241.8 843 18:30 15.0 10.0 11.1 233.2 866 18:45 15.2 = 10.3 6.3 243.3 789 19:00 17.0 10.8 9.4 235.9 828 19:15 15.4 10.= 3 8.7 227.6 855 19:30 15.9 10.9 8.0 239.8 769 19:45 14.2 10.5 1= 0.1 271.1 806 20:00 14.2 10.2 6.9 222.5 847 20:15 14.3 10.2 10.= 7 225.1 870 20:30 15.6 10.7 12.4 260.0 787 20:45 14.4 9.8 10.5 = 216.1 794 21:00 14.1 9.9 5.6 263.6 702 21:15 16.1 10.5 9.4 229.= 4 762 21:30 16.4 10.3 10.3 264.5 714 21:45 18.5 11.0 16.0 260.5= 756 22:00 15.9 10.0 9.0 256.6 850 22:15 15.1 10.1 6.6 254.1 83= 9 22:30 15.7 10.1 10.2 265.6 697 22:45 18.6 10.3 13.1 271.2 731= 23:00 17.0 9.9 11.0 246.5 696 23:15 16.7 9.8 9.7 260.5 635 23:30 16.3 9.9 8.0 259.6 622 23:45 15.8 9.7 6.8 261.9 693 00= :00 16.8 9.8 6.1 263.6 611 00:15 14.5 9.9 6.1 278.5 613 00:30 1= 4.6 9.7 5.4 296.1 640 00:45 12.9 9.9 4.0 297.3 654 01:00 12.6 9= .9 2.9 42.8 648 01:15 11.9 9.9 8.4 65.8 681 01:30 11.3 9.9 10.5= 65.0 797 01:45 10.8 9.8 8.5 61.3 dpDep 387 110.6502:00 10.6 9.7= 16.1 73.1 dpDep 380 73.2002:15 10.8 9.5 15.1 61.8 dpDep 376 71.6402:30 11.5 8.3 13.6 73.3 dpDep 358 48.1602:45 11.3 7.8 10.2 81.0 dpDe= p 344 33.4703:00 11.3 7.4 13.3 75.4 594 348 62.3903:15 11.9 6.6 1= 4.3 77.4 581 348 34.0603:30 11.6 6.7 6.4 89.5 614 348 47.3103:45 = 12.2 6.8 6.1 88.0 633 348 39.8704:00 12.2 7.2 6.3 89.7 646 351 59.5104:15 12.1 7.1 7.1 87.5 677 356 55.8604:30 12.6 6.7 3.0 119.0 657 = 346 53.3604:45 12.7 6.6 4.6 142.2 631 345 30.4805:00 12.6 5.9 5.5 = 174.2 629 344 43.1405:15 12.0 6.4 4.9 163.4 681 307 13.4505:30 12= .9 6.2 5.3 181.7 621 344 59.6605:45 12.6 6.1 4.4 187.3 635 340 7.6806:00 12.2 5.9 1.5 193.1 626 340 12.0206:15 12.9 5.8 1.5 158.4 644 = 342 46.5106:30 12.5 5.9 2.7 163.6 621 345 30.4606:45 12.8 5.9 5.1 = 189.5 605 344 30.6007:00 12.0 7.3 4.0 195.1 710 342 31.1507:15 11= .9 7.7 4.1 188.8 754 341 13.2707:30 11.8 7.5 1.9 191.6 759 340 4.0107:45 11.4 5.9 3.4 97.6 676 342 10.7408:00 11.6 6.3 0.7 172.9 612 3= 48 17.9308:15 11.2 5.6 1.9 111.4 600 345 30.3208:30 11.2 5.4 5.1 9= 5.7 578 344 45.8408:45 11.9 5.9 1.3 145.0 551 340 29.4409:00 12.0= 6.9 1.2 200.2 634 340 5.0809:15 11.9 6.2 1.0 172.8 606 340 2.450= 9:30 12.0 7.2 1.5 204.8 751 340 2.4009:45 11.4 8.3 1.2 211.3 699 340 = 3.5610:00 11.5 8.2 1.0 207.8 759 340 9.8110:15 10.9 8.9 1.3 224.3 = 815 340 11.2510:30 10.0 8.8 2.1 199.5 787 340 2.6310:45 10.2 8.6 = 1.6 209.1 dpDep 326 2.37---- Time Tracking ----*=3D*= =3D*=3D Observatory: APO*=3D*=3D*=3D MJD: 60204 =C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0Fill night time in Hours below*=3D*=3D*=3D Total brig= ht time =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0.2*=3D*=3D*=3D= Bright time, queued observations =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0*=3D= *=3D*=3D Bright time, commissioning/engineering: 0*=3D*=3D*=3D Bright t= ime lost to weather =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0: 0.2*=3D*=3D*=3D Bright time lost to technical issues =C2=A0: 0*=3D*=3D*=3D Total dark time =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0: 9.4*=3D*=3D*=3D Dark time, queued observations =C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 0*=3D*=3D*=3D Dark time, commi= ssioning/engineering =C2=A0: 4.2*=3D*=3D*=3D Dark time lost to weather = =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0: 5= .2*=3D*=3D*=3D Dark time lost to technical issues =C2=A0=C2=A0=C2=A0: 0= _______________________________________________________= _____Logs of Nightly APO Activities https://urldefense.com/v3/__https://trac.sd= ss.org/tracmailman/browser/private/sloan-25mlog/index.html__;!!K-Hz7m0Vt54!= nUIdmYB32O14azznB6LwJqDHH4fuaCkCyKfOLyZPv2oQjW7rw6odoZuYyM72T2uXmN3g82COsva= ySedcHg$ --00000000000024f209060591b527--