Subject: 2.5m obslog 20191003 (SJD 58760) From: asimmons@apo.nmsu.edu Date: Fri, 4 Oct 2019 10:05:43 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday October 03, 2019 (SJD 58760) ---- Observing Team ---- Karen Kinemuchi Audrey Oravetz ---- Observing Plan ---- Thu 3 OCT 2019 58760.0 0.30 01:53 11:52 19:40 05:41 ---- MaNGA (10.0 h) ---- Observing Summary ---- Entire night lost due to weather. MaNGA lost 10.0 hours. The absorbent pads were checked periodically through the night. NOTES TO DAY STAFF AND DEVELOPERS: ================================== /home is still at 94%. Someone needs to attend to this. Filesystem Size Used Avail Use% Mounted on /dev/vdd 688G 642G 47G 94% /home /dev/vdc1 11T 6.5T 4.4T 60% /data The 2.5m on the APO weather page is not reporting any weather values. A new untagged version of the MCP is running. We saw some new warning messages from the MCP that we have not seen before scroll by within STUI. The messages are copied in the problem section. We are without water on site. We commandeered some of the 5 gallon tap-water jugs that were not being used in the upper dorm since we ran out within the control building. ---- Observing Log ---- 22:06Z Raining on site. AFTERNOON CHECKOUT: =================== 22:27Z Restarted the alerts actor due to MCP work this afternoon. 22:53Z Started APOGEE evening cals. There's a lot of new error messages related to the MCP. Please look in the Problem in detail for the error messages. They just keep scrolling by. Since there is a low probability of opening tonight, we will let these errors go by unaddressed. 23:11Z Grabbed mirror numbers - ok; accidentally added it twice since the response time was slow to host2. In the second set, a couple of the M1 numbers didn't get recorded. guider/camera prep - done. MaNGA cals: LogFun is not reporting the bias we just took. Is there a bug since the system thinks we are stuck in the "S" dither? 23:24:53 boss exposure 20.0, file=296176, S DoS is reporting both the bias and short dark. DoS is alive. BOSS COLLIMATION: 23:28:16 boss exposure 4.0, file=296177, S 23:29:27 boss exposure 4.0, file=296178, S 23:31:26 sp1.motor.move= 2311, 2310, 2310 23:31:31 sp2.motor.move= 1577, 1578, 1577 23:31:31 Hartmann collimate output on cart #6 sp1: offset: r= 2308 (Out of focus); b= -7.3 (Out of focus) sp2: offset: r= 1578 (Out of focus); b= -4.9 (Out of focus) sp1: pred. move: spAverageMove= 2310 sp2: pred. move: spAverageMove= 1577 sp1: pred. resid: r= -2, b= -0.0, txt= OK, spTemp = 10.2 sp2: pred. resid: r= 1, b= 0.0, txt= OK, spTemp = 14.5 Blue rings were not adjusted. motorPosition sp1: 26929, 26059, 24811; sp2: 27834, 27635, 27469; ---------- Median spectrographs temperatures: Tsp1= 10.2, Tsp2= 14.5; Outside air temperature= 10.1; MaNGA cals: 23:33:05 boss exposure 25.0, file=296179, S 23:36:54 boss exposure 4.0, file=296180, S 23:49Z Delaying ventilation. Raining on site. APOGEE evening cals done and inspected - all ok. NIGHT: ====== 09:47Z - Started cals. Continued to monitor the systems through STUI, but within the dorm room. Started a secondary fill as a precaution. ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000; MIGS TONIGHT NOMINAL Axial A: -5.33 -5.329 Axial B: -5.05 -5.05 Axial C: -5.269 -5.268 Trans D: -0.577 -0.577 Lateral E: 9.3472 9.3472 Lateral F: 14.4526 14.4526 GALILS Commanded: 11200 -1850 6850 29650 21250 21050 Actual: 11200 -1850 6850 29650 21250 21050 SETMIR VALUES PrimDesOrient: 0.0 -11.37 6.87 375.47 621.12 PrimOrient: 0.0 -11.4 6.58 375.38 620.77 SECONDARY: ---------- Focus: 0.0000 Air temp: 12.3 Altitude: 30.4 MIGS TONIGHT NOMINAL Axial A: -6.665 -6.664 Axial B: -0.03 -0.028 Axial C: -6.669 -6.669 Trans D: -0.075 -0.076 GALILS Commanded: 1090050 1128800 1113900 -7250 -6550 Actual: 1058674 1101427 1079518 -7250 -6550 SETMIR VALUES SecDesOrient: 857.0 2.7 12.75 -38.35 156.51 SecOrient: 857.0 2.69 12.78 -38.4 156.73 ---- Telescope Status ---- Status at: 09:51Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge = 6 Counterweights at: 330 LN2 autofill systems: Connected and turned on -180L LN2 dewar scales: SP1 168.6 lbs, 19.6 psi SP2 137.3 lbs, 19.0 psi ---- Software Used ---- Get Versions, 10/03/19, 22:52:08 -- STUI software: STUI : 1.7.8 alerts : trunk apo : trunk boss : v4_0 -boss.specMec : Offline gcamera : v2_2 guider : 3.8.1 hartmann : 1.6.0 hub : Tag: v4.2 mcp : 1.1-14-g00bc|2019-10-03|11:22 -mcp.plc : 34 -mcp.azFiduci : v1_140 -mcp.altFiduc : v1_140 -mcp.rotFiduc : v1_140 platedb : 2.8.0 sop : 3.12.3 tcc : 1.3.1 apogee : not availble apogeecal : not availble apogeeql : v1_6_1 APO-local : trunk -- done -- Home Disk Hogs (GB): muna 132.068 eboss 84.453 manga 72.5344 sdss3 27.1813 apogee 17.8558 logging 13.7152 observer 11.6443 Filesystem Size Used Avail Use% Mounted on /dev/vdd 688G 642G 47G 94% /home /dev/vdc1 11T 6.5T 4.4T 60% /data Setting up: idlspec2d Flavor: Linux64 Version: v5_7_12 Setting up: |elodie Flavor: Linux64 Version: v1_3 Setting up: |spinspect Flavor: Linux64 Version: trunk Setting up: |specflat Flavor: Linux64 Version: v1_20 Setting up: |speclog Flavor: Linux64 Version: trunk Setting up: |platelist Flavor: Linux64 Version: trunk Setting up: |sdss_python_module Flavor: Linux64 Version: v1_6_7 Setting up: |sqlalchemy Flavor: Linux64 Version: 0.9.7 Setting up: |psycopg2 Flavor: Linux64 Version: 2.5.3 Setting up: |idlutils Flavor: Linux64 Version: v5_5_16 Setting up: |idl Flavor: Linux64 Version: 7.1 Setting up: |dust Flavor: Linux64 Version: v0_1 Setting up: |photolog Flavor: Linux64 Version: trunk Setting up: actorcore Flavor: Linux64 Version: v4_1_6 Setting up: |opscore Flavor: Linux64 Version: v2_5 Setting up: |external Flavor: Linux64 Version: v1_2_0 Setting up: |actorkeys Flavor: Linux64 Version: trunk Setting up: |plc Flavor: Linux64 Version: v30_2 Setting up: |sdsstools Flavor: Linux64 Version: v4_33 Setting up: |sdss3tools Flavor: Linux64 Version: v1_7_13 Setting up: |RO Flavor: Linux64 Version: 3.6.9 -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v6_0_12 petunia : git autoscheduler : 1.3.0 sdss_python_module: trunk mangadrp : trunk exported ---- Problems in Detail ---- 23:12:27 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:28 .mcp 0 mcp i semaphoreOwner="TCC:0:0" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:28 .mcp 0 mcp i mcpVersion="1.1-14-g00bc|2019-10-03|11:22" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:28 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:29 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:29 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:29 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:29 .mcp 0 mcp i trace="MGT: bad rot amp; aborting" 23:12:30 .mcp 0 mcp i mcpVersion="1.1-14-g00bc|2019-10-03|11:22" 23:12:30 .mcp 0 mcp i haveSemaphore=false 23:12:30 .mcp 0 mcp i semaphoreOwner="TCC:0:0" 23:12:30 .mcp 0 mcp i trace="MGT: bad rot state ABORT_EVENT: ID_PC_COMMAND" 23:12:30 .mcp 0 mcp i trace="MGT: bad rot amp; aborting"