From: ank@apo.nmsu.edu
Subject: 2.5mobslog 20010111 (MJD 51921)
Date: Fri, 12 Jan 2001 06:15:47 -0700 (MST)
                      Thursday  Jan  11 2001
                 Apache Point Observatory SDSS 2.5m
                            Observing Log
                             (MJD 51921)
OBSERVING TEAM:
===============
Atsuko Nitta Kleinman (APO)
Scot Kleinman (APO)
Steph Snedden (APO)
VISITORS:
=========
Mike Carr (PU)
Larry Carry (UW)
Craig Drennan (FNAL)
Jim Gunn (PU)
French Leger (FNAL/APO)
Steve Kent (FNAL)
Craig Loomis (APO)
Robert Lupton esq. (PU)
Connie Rockosi (UC)
THE PLAN:
=========
Shake Down --- one of the bigger shake downs of all shake downs. Numbers
of improvements were made that requires testing MCP, IOP/SOP, Watcher,
homing relaxing the mirrors, Spectro Monthly Checkout, Imager Monthly
Checkout (biasGen and biasCheck), pointing model, PRs, and help
Brinkman with the power inventory.
SYNOPSIS FOR NIGHT:
===================
We created new Fiducial tables and checked them in.
TELESCOPE STATUS:
=================
We did not open.
Opened:
Closed:
DIMM:
=====
INTERLOCKS:
===========
none bypassed.
SOFTWARE USED:
==============
IOP/SOP: v3_23_2 and v2_25_0
Watcher: v2_8_11
MCP: v4_4_0
TPM: v2_2_1  and v2_2_0
AstroDa: 14_34
TCC: 2.4.1
tccMon: 1_5
WEATHER SYNOPSIS (see below for hourly data):
=============================================
Partly cloudy and VERY moony. 3.5m reported 0.5"seeing.
GENERAL COMMENTS (see Problems below for details):
==================================================
The imager work was on-going  at the telescope when we arrived.  After
the imager work was completed, Craig L., French and Larry took over to
do checks on the mis-cabling Russell Owen reported.
Meanwhile, once Robert was done (for tonight) with improving MCP, Scot
cut and installed MCP, Watcher, IOP/SOP.  There was some discussion on
whether we need to cut a new TPM or not, but it was settled that we
will not do so and Robert will email Peregrine on the status.
While for the telescope to be ready, we declared tccMon v1_5 current
and TPM v2_2_0 current.
/mcptpm space on COMMISH is full.  We had watcher error telling us
that we had to clear space on HOST /mcptpm. So we copied
the old TPM logs over to COMMISH until COMMISH's /mcptpm was 100% full.
What are we to do now? Are we to delete the old TPM logs on commish?
Shall we compress the old ones?  Either way, we must decide now
on what to do with the TPM logs until we get a super big disk space
for it (which I hope is the plan).
When the telescope was handed over to us, we noticed that the MIGS for
both M1 and M2 were all reading 0.0000. TCC confirmed that it was having
problem talking to M1  but was talking to M2. Steph rolled back to tpm v2_2_0
to see if it has any luck without any success.  Craig L. and Steph went
to the telescope to check on cables which could be causing this.  Craig
found the lots of miscabling  and since it was getting late we decided
to have them fixed tomorrow. Since we have Sir Robert Lupton the Great
on site, we wanted to get started on shaking the MCP before he goes to
bed. We put on a cartridge and balanced the telescope, and did part of
the "preFlight" checkout (we omitted the instrument health check and
the mirror check--- both we knew we have problems), filled the spectro
dewars, and followed the procedure on how to build the fiducial
tables.
When we tried to get the cart out of the shed, Atsuko had great
difficulty opening the shed door. Atsuko asked the World's best
instrumentalists, Jim and Connie, for help (Atsuko was thinking of a
chain saw to cut the door off the shed before they walked by) and
managed to open the door. The lock was very sticky.
Building New Fiducial Tables
-----------------------------
Before data taking started, Robert noticed that sometimes the position
of AZ was showing up in ALT in the mcpMenu! Robert was quite puzzled
but by the time he went to bed he thought he know what is happening.
He sent out a PR on this.
Around 23:45, while Steph was moving in AZ to collect the data for the
fiducial table, MCP hung. Robert rebooted MCP twice (Around 23:49 and
23:50), before MCP was happy again. We forgot to refiducialize after
the reboot took place and we saw the telescope hit the limit at AZ=148
according to mcpMenu, but it was actually at AZ=160 -- the limit. We
continued on with fiducial table taking. There was no other fiducial
misbehavior while taking the fiducial data.
In AZ, fiducial id 7, 19, 24, 31 were missed when going positive
direction only. For ROT, fiducial id 1,2,3,4,5,122 were missed -- no
fiducial readings.  After creating fiducial tables for all three axis,
we checked those tables in. BTW, in the process of checking in, it
asked if I wanted to change log. When I typed "e" for edit, I was told
I cannot edit because it could not find emacs (please see below for the
actual message).  Where is emacs or femacs on HOST?
if I wanted to edit the change log -- when I typed e for edit,
g message unchanged or not specified
a)bort, c)ontinue, e)dit, !)reuse this message unchanged for remaining dirs
Action: (continue) edit
cvs commit: cannot exec /usr/bin/emacs: No such file or directory
cvs commit: warning: editor session failed
mcp 1525:
The new AZ fiducial table had sequential numbering. Closed the PR.
MCP v2_8_11
------------
Laptop stop button is now recognized in mcpMenu. When the button is in,
it will show up as "S" now.
mcp 1723:
We are not sure how we know if the umbilical motion is good or bad so
that we can use the "Umbil" button in the mcpMenu to enable/disable motion.
Robert ?
mcp 1210:
The couple time we did "axis init" the axisDtime was small (-0.1). We
would like to keep an eye on it for few more days before closing the
PR.
mcp 1420:
We looked at the mcpFiducials-51921.dat by eye to look for any
fiducials that were read twice while taking the data for the fiducial
tables.  We did not find any.  We will check it again when we do more
slewing (maybe when we do the pointing model) that is not exercising
one axis at a time in a systematic manner.
mcp 1652:
How shall we test this?   Since we could not tell the exact situation
in which this problem happened, we tried two things. (1) We had a stop
button in, try axis init which failed and then do axis status which
gave us that the axis were in bad status. (2) Steph tried having zero,
one, two or three axis in bad state, do an axis init and then axis
status. The axis status showed BAD status for all axis no matter what
state the axis were in. Even when all the axis were in "good" status,
axis status showed bad status. This is actually opposite of what the PR
said happened. The PR said that the axis status showed good status when
it was actually NOT.  The PR does not tell us what Steve was looking at
and what caused the inhibit etc. making it difficult to come up with a
way to recreate the situation in which the problem occurred, but we now
found the opposite situation where the axis status finds the axis in
bad state even when they are in good state! This PR is reopened with
the new findings of tonight.
TPM
----
After we rolled back in the process of trying to get MIG values
on TPM, we did not restart the new TPM, v2_2_1, which we are
suppose to shake until after were done with creating new fiducial
tables. While switching back to TPM v2_2_1, we noticed that the procedure
page does not tell us that we have to start the archiver by hand in
order for .  the chron job to be active and will restart TPM within
15min. This was added to the procedure and checked in.
IOP/SOP v3_23_3
----------------
This is  the current version. Check to make sure we can talk
to the instruments. Many changes has been made to iop and
we wanted to ensure that IOP/SOP talks to the the instruments.
Both IOP/SOP were able to talk to the imager/spectros.
IOP/SOP v3_25_0
----------------
This is the latest version with lots of changes. We restarted the servers
with v3_25_0 and did normal beginning of the night procedure (initNight and
taking bias for sop) for iop/sop which worked fine.
Spectrograph's communication (to sp2 mechanicals) is not working --
Craig is working on it.  Hopefully it will be fixed by tomorrow so that
we can do the spectro Monthly checkout.
Two biases were taken. When the first bias showed up on the monitor,
it showed saturation -- SoS could not deal with the first bias for sp2
probably due to this reason. This was the first bias in few days so it
definitely needed some flushing of charges. The second bias was good
and SoS showed all numbers in black.
We ran endNight -doTpm successfully.
Watcher v2_8_11
-----------------
Many improvements has been made by Sir Robert.
watcher 1280:
The watcher now tells us  to which instruments it has no connection.
We now see when the server cannot talk to spectros as "No connection to
sp1 sp2" rather than "No connection".  If the imager is busy, then we
will see "No connection to im".
Watcher's "active" and "inactive" button:  Watcher now gives us update
on the many status, e.g. FWHM, LN2temp etc. The button will be at the
right bottom corner of the window which can be "activated" to give
updates. I didn't know ion pump pressure was under Imager-->right_button
click.  If only if we could get the plotting capability on the ion
pump pressure in watcher.....
watcher 1583:
By clicking the ctrl-left_button gives a window "Root Causes of Problems"
which give the lowest level causing the axis to be in the state that is
in. This should be a great help in finding out the cause of the problems
quickly.
watcher 1631:
I have not been able to find any logic long enough that I could not read
with the new scroll bar. So we closed this PR.
DATA ACQUISITION (see IOP/SOP output below):
===========================================
IMAGING:
--------
Run     Type
---     ----
SPECTROSCOPY:
-------------
Exposure     Type
--------     ----
8202         bias --S/N did not come up for sp2.
8203         bias
MIRRORS: Unavailable.
========
PRIMARY:
--------
MIGS                   SHOULD BE
Axial A=                 0.0160
Axial B=                -0.0109
Axial C=                 0.0270
Transverse D=            0.2269
Lateral E=               1.8984
Lateral F=               0.4054
GALILS
Commanded:
Actual:
SETMIR VALUES
primDesOrient:
primOrient:
SECONDARY:
----------
Focus:
Temp:
Altitude:
MIGS
Axial A=
Axial B=
Axial C=
Transverse D=
GALILS
Commanded:
Actual:
SETMIR VALUES
secDesOrient:
secOrient:
FOCUS LOG:
==========
            M1 Piston     M2 Piston            Temp    Wind
Time  Inst   setmir    TCC  setmir   Az  Alt    C    Dir MPH  filt  FWHM "
                       (rel) (abs)
LN2 SCHEDULE:
=============
imager@140.8
spectro@175.6
this is at 6am.
PROBLEMS:
=========
Communications to the mirror and sp2 mechanicals. Craig will take care of
them tomorrow.
WEATHER DATA:
=============
                               Wind
     Time   Temp F Dewp F  MPH   Direction    Dust   DIMM   Sky   Precip.
[pmt]cl = partly, mostly, totally cloudy
DATA LOGS FROM IOP/SOP:
=======================