Subject: 2.5m obslog 20190820 (SJD 58716)
From: doravetz@apo.nmsu.edu
Date: Wed, 21 Aug 2019 07:00:55 +0000 (UTC)
                       APACHE POINT OBSERVATORY SDSS 2.5M
                                 OBSERVING LOG
                          Tuesday August 20, 2019
                                  (SJD 58716)
----  Observing Team ----
Dan Oravetz
---- Observing Summary ----
Monitored the BOSS fills (and will continue to do so). The most recent secondary
fill completed around 05:00Z. Since there isn't a whole lot to report I'll just
forego the Log body section and put the notes here in the Summary.
Notes
=====
(1) The 180L LN2 pressures are incorrectly reporting 2.68 psi for both sp1 and
sp2 within the TPM. It looks like they have been this way for at least the last
several days. The actual pressures are normal and secondary fills complete
normally. The 180L dewar weights seem to be updating with reasonable values,
however.
(2) The alertsActor was full of stale disabled.alert rules, including 'boss',
'boss.sp1', and 'boss.sp2' reportedly 'Down'. Given the incorrect 180L pressures
in the TPM and the fact that the cameras are cold and auto-filling, I wanted to
have the alerts active to catch any BOSS fill faults, so I restarted
alertsActor. There are a couple dozen 'boss' warnings -- mainly voltage warnings
-- that came back as active following the restart and I disabled the following:
Critical 	boss.SP1B2CCDTempRead
Critical 	tcc.heartbeat
Serious 	mcp.heartbeat
(3) The b1 temperature was reading -77C again tonight. Despite the email
correction to the day log that the b1 temperature was reading correctly, it was
reading -77C all night from the time I arrived on site this evening:
Boss CCD Temp :
    sp1r0= -124.6  (-126.6);
    sp1b2=  -77.0  (-100.0);
    sp2r0= -133.6  (-134.8);
    sp2b2= -100.8  (-100.0);
(4) There were a few instances of some of the boss controllers needing a reload:
sp1cam was not responding at one point, then after a reload sp2cam and sp1cam
both weren't responding, but then after a subsequent reload all six controllers
responded. This was followed by a phaseBoot and execBoot alert, but an iack
resolved those issues.
(5) I tried to focus sp2, but didn't get too far. I took some hartmann exposures
manually and tried to use hartmann 'recompute' to reduce the pair of exposures
and quantify how much to move the r2 and b2 focus rings (the focus doesn't look
too bad at all when looking at the raw images, especially considering we're
coming out of shutdown work), but the command failed because the image headers
don't have the proper FFS information. There are also similar header keywords
that aren't correct, but this is undoubtedly tied to the MCP upgrade work.
---- Telescope Status ----
Status at: 06:42Z
Telescope stowed at:    121.0, 30.0, 0.0 mount
Instrument mounted:     cartridge = 6
Counterweights at:      375
LN2 autofill systems:   Connected and turned on
180L LN2 dewar scales:  SP1 106 lbs,  psi
                        SP2  64 lbs,  psi