Date: Wed, 25 Jan 2012 10:21:43 -0500 Subject: Re: [SDSS3-infrastructure 6298] Re: [sdss3-25mlog 476] 2.5m obslog From: David Kirkby --047d7b10c96330fefa04b75bd2d0 Content-Type: text/plain; charset=ISO-8859-1 Thanks Fritz! On Wed, Jan 25, 2012 at 8:42 AM, Fritz Stauffer wrote: > It's restarted and the archive log is working. > > On Jan 25, 2012, at 5:27 AM, David Kirkby wrote: > > It looks like the archiver has not received any keyword data from the hub > since about an hour before this reboot (12 hours ago). I am traveling and > my VPN access is not working so could Fritz or Jon please restart the > archiver for me? I believe that "sudo kill -s SIGINT 19218" should do the > trick, thanks to Jon's auto-restarter. You can check that the archiver has > restarted by checking this status page (which will not be available until > the archiver is running): > > http://sdss-archiver.apo.nmsu.edu/archiver/info > > Look at the "Last table activity" entry (near the top) to verify that the > archiver is receiving keywords from the hub (which is not the case now). > > thanks - David > > On Wed, Jan 25, 2012 at 6:29 AM, wrote: > >> >> 00:15Z - Received an email from Fritz saying that he rebooted hub25m. STUI >> sessions crashed, sos actor failed to respond, mcp could not read a >> certain file: >> 01:12:04 .mcp 0 mcp i trace="Can't create /mcptpm/55951: >> S_nfsLib_NFSERR_NOENT" >> 01:12:04 .mcp 0 mcp i trace="Cannot open mcpCmdLog-55951.dat: >> S_nfsLib_NFSERR_NOENT" >> 01:12:05 .mcp 0 mcp i trace="Can't create /mcptpm/55951: >> S_nfsLib_NFSERR_NOENT" >> 01:12:05 .mcp 0 mcp i trace="Cannot open mcpCmdLog-55951.dat: >> S_nfsLib_NFSERR_NOENT" >> 01:12:05 .mcp 0 mcp i trace="Can't create /mcptpm/55951: >> S_nfsLib_NFSERR_NOENT" >> 01:12:05 .mcp 0 mcp i trace="Cannot open mcpCmdLog-55951.dat: >> S_nfsLib_NFSERR_NOENT" >> We called Jon for help. We rebooted the MCP. We restarted sos through >> stageManager. Craig helped with the rest. >> >> Cloudy, foggy, and snowy all night. We did not open. >> >> >> ---- Telescope Status ---- >> >> 10:48Z - Enclosure is on, doors and louvers are closed, and fans are off. >> >> Status at: 11:29Z >> >> Telescope stowed at: 30,121,00 mount >> Instrument mounted: Cartridge 10 >> Counterweights at: 285 lbs >> LN2 autofill systems: Connected and turned on. >> SP1 LN2 dewar scale: 204 lbs, 19 psi >> SP2 LN2 dewar scale: 103 lbs, 17 psi >> >> >> ---- Software Used ---- >> >> ----STUI software: >> STUI: 1.1.2b1 2011-11-08; >> alerts: v1_2_0; >> apo: v1_7; >> boss: v2_5_4; >> boss.daq: 1.3.2; >> boss.specMech: 3.0.1; >> gcamera: v1_2_7; >> guider: v1_3_17; >> hub: Tag: sdss3_v1_1_8; >> mcp: v6_6_11; >> mcp.plc: 28; >> mcp.azFiducialVersion: v1_100; >> mcp.altFiducialVersion: v1_100; >> mcp.rotFiducialVersion: v1_100; >> platedb: v1_0_5; >> sop: v1_2_12; >> sos: v1_2_0; >> sos.idlspec2d: v5_5_3; >> tcc: 2.14.0; >> apogee: ? >> apogeecal: ? >> apogeeql: v1_4_1 >> >> -----Other software >> sdssProcedure(sdss3): v3_07; >> >> >> ---- Mirror Numbers ---- >> >> >> PRIMARY: >> -------- >> Scale: 1.000000 >> >> MIGS TONIGHT NOMINAL >> Axial A: -0.13 -0.127 >> Axial B: 0.068 0.08 >> Axial C: -0.007 -0.004 >> Trans D: 0.4101 0.40935 >> Lateral E: 10.668 10.6553 >> Lateral F: 12.2809 12.2809 >> >> GALILS >> Commanded: 11300 -650 5500 19150 13500 13050 >> Actual: 11300 -650 5500 19150 13500 13050 >> >> SETMIR VALUES >> PrimDesOrient: 0.00 0.00 0.00 612.35 1325.90 >> PrimOrient: 0.00 0.00 0.00 612.43 1325.18 >> >> SECONDARY: >> ---------- >> >> Focus: 0.00 >> Air temp: -2.1 >> Altitude: 30.0 >> >> MIGS TONIGHT NOMINAL >> Axial A: -8.407 -8.408 >> Axial B: -8.692 -8.705 >> Axial C: -12.147 -12.158 >> Trans D: -10.017 -10.018 >> >> GALILS >> Commanded: 1577450 1611550 1562700 -9050 -6750 >> Actual: 1577451 1611561 1562692 -9050 -6750 >> >> SETMIR VALUES >> SecDesOrient: 1257.00 13.00 8.00 -60.00 174.63 >> SecOrient: 1257.00 13.01 7.99 -60.39 174.68 >> >> >> >> ---- Problems in Detail ---- >> >> High Humidity >> Clouds >> Other weather problem >> >> _______________________________________________ >> Message 476 of sdss3-25mlog - Logs of nightly APO activities. >> sdss3-25mlog@sdss3.org >> https://sdss3.org/mailman/listinfo/sdss3-25mlog >> > > _______________________________________________ > Message 6298 of sdss3-infrastructure - SDSS-III Common APO hardware and > software. > sdss3-infrastructure@sdss3.org > https://sdss3.org/mailman/listinfo/sdss3-infrastructure > > > --047d7b10c96330fefa04b75bd2d0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Fritz!On Wed, Jan 25, 2012 at 8:4= 2 AM, Fritz Stauffer wrote: It's restarted and the archive log = is working.On Jan 25, 2012, at 5:= 27 AM, David Kirkby wrote: It looks like the archiver has not received any keyword d= ata from the hub since about an hour before this reboot (12 hours ago). I a= m traveling and my VPN access is not working so could Fritz or Jon please r= estart the archiver for me? I believe that "sudo kill -s SIGINT 19218&= quot; should do the trick, thanks to Jon's auto-restarter. You can chec= k that the archiver has restarted by checking this status page (which will = not be available until the archiver is running): =A0=A0http://sdss-archiver.apo.nmsu.edu/archiver/info= Look at the "Last table activity" entry= (near the top) to verify that the archiver is receiving keywords from the = hub (which is not the case now). thanks - DavidOn We= d, Jan 25, 2012 at 6:29 AM, wro= te: 00:15Z - Received an email from Fritz saying that he rebooted hub25m. STUI sessions crashed, sos actor failed to respond, mcp could not read a certain= file: 01:12:04 .mcp 0 mcp i trace=3D"Can't create /mcptpm/55951: S_nfsLi= b_NFSERR_NOENT" 01:12:04 .mcp 0 mcp i trace=3D"Cannot open mcpCmdLog-55951.dat: S_nfsL= ib_NFSERR_NOENT" 01:12:05 .mcp 0 mcp i trace=3D"Can't create /mcptpm/55951: S_nfsLi= b_NFSERR_NOENT" 01:12:05 .mcp 0 mcp i trace=3D"Cannot open mcpCmdLog-55951.dat: S_nfsL= ib_NFSERR_NOENT" 01:12:05 .mcp 0 mcp i trace=3D"Can't create /mcptpm/55951: S_nfsLi= b_NFSERR_NOENT" 01:12:05 .mcp 0 mcp i trace=3D"Cannot open mcpCmdLog-55951.dat: S_nfsL= ib_NFSERR_NOENT" We called Jon for help. We rebooted the MCP. We restarted sos through stageManager. Craig helped with the rest. Cloudy, foggy, and snowy all night. We did not open. ---- Telescope Status ---- 10:48Z - Enclosure is on, doors and louvers are closed, and fans are off. Status at: 11:29Z Telescope stowed at: =A0 =A030,121,00 mount Instrument mounted: =A0 =A0 Cartridge 10 Counterweights at: =A0 =A0 =A0285 lbs LN2 autofill systems: =A0 Connected and turned on. SP1 LN2 dewar scale: =A0 =A0204 lbs, 19 psi SP2 LN2 dewar scale: =A0 =A0103 lbs, 17 psi ---- Software Used ---- ----STUI software: STUI: 1.1.2b1 2011-11-08; alerts: v1_2_0; apo: =A0v1_7; boss: =A0v2_5_4; =A0 boss.daq: 1.3.2; =A0 boss.specMech: 3.0.1; gcamera: v1_2_7; guider: v1_3_17; hub: Tag: sdss3_v1_1_8; mcp: =A0v6_6_11; =A0mcp.plc: =A028; =A0mcp.azFiducialVersion: =A0v1_100; =A0mcp.altFiducialVersion: =A0v1_100; =A0mcp.rotFiducialVersion: =A0v1_100; platedb: v1_0_5; sop: v1_2_12; sos: v1_2_0; =A0 sos.idlspec2d: v5_5_3; tcc: 2.14.0; apogee: =A0? apogeecal: =A0? apogeeql: =A0v1_4_1 -----Other software sdssProcedure(sdss3): v3_07; ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS =A0 =A0 =A0 =A0 =A0 =A0TONIGHT NOMINAL Axial A: =A0 =A0 =A0 =A0-0.13 =A0 -0.127 Axial B: =A0 =A0 =A0 =A00.068 =A0 0.08 Axial C: =A0 =A0 =A0 =A0-0.007 =A0-0.004 Trans D: =A0 =A0 =A0 =A00.4101 =A00.40935 Lateral E: =A0 =A0 =A010.668 =A010.6553 Lateral F: =A0 =A0 =A012.2809 12.2809 GALILS Commanded: =A011300 -650 5500 19150 13500 13050 Actual: =A0 =A0 11300 -650 5500 19150 13500 13050 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 612.35 1325.90 PrimOrient: =A0 =A00.00 0.00 0.00 612.43 1325.18 SECONDARY: ---------- Focus: =A0 =A0 =A00.00 Air temp: =A0 -2.1 Altitude: =A0 30.0 MIGS =A0 =A0 =A0 =A0 =A0 =A0TONIGHT NOMINAL Axial A: =A0 =A0 =A0 =A0-8.407 =A0-8.408 Axial B: =A0 =A0 =A0 =A0-8.692 =A0-8.705 Axial C: =A0 =A0 =A0 =A0-12.147 -12.158 Trans D: =A0 =A0 =A0 =A0-10.017 -10.018 GALILS Commanded: 1577450 1611550 1562700 -9050 -6750 Actual: =A0 =A01577451 1611561 1562692 -9050 -6750 SETMIR VALUES SecDesOrient: 1257.00 13.00 8.00 -60.00 174.63 SecOrient: =A0 =A01257.00 13.01 7.99 -60.39 174.68 ---- Problems in Detail ---- High Humidity Clouds Other weather problem _______________________________________________ Message 476 of sdss3-25mlog - Logs of nightly APO activities. sdss3-25mlog@sd= ss3.org https://sdss3.org/mailman/listinfo/sdss3-25mlog _______________________________________________Message 6298 of sdss3-in= frastructure - SDSS-III Common APO hardware and software.sdss3-infrastructure@= sdss3.org https://sdss3.org/mailman/listinfo/sdss3-infrastructure --047d7b10c96330fefa04b75bd2d0--