Subject: 2.5m obslog 20140413 (MJD 56761) From: elenam@apo.nmsu.edu Date: Mon, 14 Apr 2014 10:51:08 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Sunday April 13, 2014 (MJD 56761) ---- Observing Team ---- Moses Marchante Olena (Elena) Malanushenko John P. alerts actor help ---- Observing Plan ---- 13 Apr 2014 56761.0 0.93 02:43 11:24 09:08 17:51 APOGEE 9.3 hours Flexible Night Engineering ---- Observing Summary ---- We observed apogee 4 plates: ct=6, pl=7435, sd=A; 221+84_A, seeing 1.7-1.9 missing: 181; faint: 5,15,22,34,43,287,297 ct=2, pl=7269, sd=A; field M67_A, seeing 1.6-2.9" missing: 157, 163,227; faint: 22 ct=8, pl=7344, sd=A; field 030+75_A, seeing 1.5-2.5" missing: 35,184,187; faint:88 ct=3, pl=7439, sd=A; field K16_075+11_A, seeing 2.5-4.5" missing: no missing fibers faint: 22, 250, 258 During the night, there was high dust, clouds, bad seeing, and nearby radar return. We collected ~30K counts of dust. Could you please check the mirror. We had fail of sp1 camera, reloaded controllers fixed it. Repeated Critical Alerts during afternoon checkout, the alert that Kaike got at the end of last night might have been the real one, after that it was a stuck alert. Called JohnP. for help on restarting alerts actor. Every alerts was exactly the same and followed by this line: 22:49:53 .alerts 0 alerts e alert=boss.heartbeat,critical,"The boss ICC's been dead for at least 781s",enabled,noack,"" 22:49:53 .mcp 0 mcp i cwPositions=451,450,450,451 22:49:55 .boss 14902 boss : 22:49:59 .alerts 0 alerts i alert=boss.heartbeat,ok,"",enabled,noack,"" ---- Observing Log ---- Afternoon: ---------- 22:50Z Started the afternoon checkout. Checked email and changeNotes Checked 180-L dewars weight Cleaned APOGEE gang connector with air. Did 3-read dark Did APOGEE evening cals Checked the images Checked status of rain sensor Recorded the software versions Recorded and checked mirror numbers Did 'platedb showActive' All BOSS/APOGEE carts are ready Tested the actors Check calib lamps Guider/gcamera tests: a) gcamera status (simulate=off; temp=-40) b) guider dark stack=9 time=15 c) guider status d) guider flat Spectro tests and focus a) guider loadCartridge b) boss exposure bias itime=0 c) boss exposure dark itime=20 d) sop hartmann No Boss Tonight: -- Status, 2014-04-14, 00:05:44 Enclosure = closed; cwPositions = 451 450 449 448; MCP instr = 17 (mounted); Guider cart= 17, plate= 7339, side= A (loaded); ---------- motorPosition sp1: 21506, 21622, 21441; sp2: 17235, 16695, 17856; ---------- Median spectrographs temperatures: Tsp1= 8.3, Tsp2= 7.5; Outside air temperature= 11.7; ---------- Boss CCD Temp : sp1r0= -124.6 (-126.6); sp1b2= -99.6 (-100.0); sp2r0= -134.0 (-134.8); sp2b2= -100.8 (-100.0); sp1LN2: 11.0; sp2LN2: 10.0; ---------- e) sop doCalibs f) checked xMid and waveMid values g) declared calibs as test Checked that carts were in bay correctly; All BOSS/Apogee carts are ready Opened doors/louvers; turned on fans Mounted first cart of the night cart 6 hub25m> df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 95G 20G 71G 22% / /dev/sda4 793G 355G 397G 48% /home /dev/sda1 99M 36M 58M 39% /boot tmpfs 5.9G 0 5.9G 0% /dev/shm sdssfiles1-p://data1/data/MARVELS 1.8T 516G 1.3T 29% /MARVELS /dev/drbd1 13T 9.9T 2.7T 79% /data Delayed ventilation due to high dust and wind: 00:18Z ========================= Night: ==================== Wind 37 mph. dust 12K. Wait for weather improvement. 2:03 started ventilation 02:20:40 encl25m : open; --------------------------------------- loadCart: ct=6, pl=7435, sd=A; 221+84_A, seeing 1.7-1.9 FSonGTF 03:05:15 apogee.expose=apRaw-11990012, 47, B, Object 03:13:36 apogee.expose=apRaw-11990013, 47, B, Object 03:22:03 apogee.expose=apRaw-11990014, 47, A, Object 03:30:23 apogee.expose=apRaw-11990015, 47, A, Object 03:38:46 apogee.expose=apRaw-11990016, 47, B, Object 03:47:06 apogee.expose=apRaw-11990017, 47, B, Object 03:55:34 apogee.expose=apRaw-11990018, 47, A, Object missing: fiber= 181, faint: fiber= 5,15,22,34,43,287,297 --------------------------------------- 04:10:30 loadCart: ct=2, pl=7269, sd=A; field M67_A seeing 1.6-2.9" FSonGTf 04:19:06 apogee.expose=apRaw-11990022, 47, A, Object 04:27:29 apogee.expose=apRaw-11990023, 47, B, Object 04:35:49 apogee.expose=apRaw-11990024, 47, B, Object 04:44:17 apogee.expose=apRaw-11990025, 47, A, Object 04:52:37 apogee.expose=apRaw-11990026, 47, A, Object 05:01:00 apogee.expose=apRaw-11990027, 47, B, Object 05:09:22 apogee.expose=apRaw-11990028, 47, B, Object 05:17:48 apogee.expose=apRaw-11990029, 47, A, Object missing fibers (flat/master -------------------------------------------------------------------------------- 01:18 6-7435A 1.000000 0 1256 0 121.0 30.0 10.0 28 245 99.9 01:18 6-7435A 1.000000 0 1256 0 121.0 30.0 10.0 28 245 99.9 02:04 6-7435A 1.000000 0 1256 0 121.0 30.0 8.5 29 246 99.9 02:56 6-7435A 1.000378 -3730 -1624 283 92.7 49.7 8.3 22 257 1.7 apog 03:04 6-7435A 1.000339 -3351 -1305 291 91.7 51.5 8.1 16 263 1.8 apog 03:13 6-7435A 1.000338 -3341 -1302 292 90.6 53.2 8.1 22 253 1.9 apog 03:21 6-7435A 1.000321 -3172 -1166 294 89.4 55.0 8.1 24 270 1.9 apog 03:29 6-7435A 1.000326 -3214 -1193 306 88.2 56.8 8.1 21 271 1.8 apog 03:38 6-7435A 1.000310 -3064 -1063 317 87.0 58.5 7.8 20 262 1.9 apog 03:46 6-7435A 1.000309 -3051 -1050 324 85.7 60.2 7.8 22 264 1.6 apog 03:54 6-7435A 1.000310 -3064 -1054 329 84.2 62.1 7.9 25 267 1.7 apog 04:18 2-7269A 1.000075 -739 906 358 -57.2 56.8 7.8 34 278 2.0 apog 04:26 2-7269A 1.000049 -487 1118 357 -59.7 55.3 7.8 12 258 1.7 apog 04:35 2-7269A 1.000048 -474 1139 362 -62.0 53.8 7.7 22 263 1.6 apog 04:43 2-7269A 1.000063 -621 1026 367 -64.2 52.2 7.7 23 262 1.9 apog 04:52 2-7269A 1.000060 -592 1064 376 -66.3 50.6 7.6 19 263 1.9 apog 05:00 2-7269A 1.000069 -684 997 380 -68.2 49.0 7.6 25 252 2.0 apog 05:08 2-7269A 1.000077 -758 970 409 -70.1 47.4 7.4 18 264 2.8 apog 05:17 2-7269A 1.000085 -834 909 405 -71.8 45.7 6.8 13 300 2.9 apog 07:01 8-7344A 1.000304 -3007 -909 460 44.1 79.9 4.9 13 306 2.0 apog 07:09 8-7344A 1.000315 -3109 -928 529 34.8 81.1 4.8 16 293 1.7 apog 07:18 8-7344A 1.000332 -3277 -1022 574 23.4 81.9 4.8 13 261 1.5 apog 07:26 8-7344A 1.000323 -3185 -946 574 9.8 82.4 4.7 13 281 2.1 apog 07:35 8-7344A 1.000332 -3284 -1012 581 -4.7 82.5 4.3 16 303 2.0 apog 07:43 8-7344A 1.000328 -3239 -965 601 -18.5 82.2 4.2 17 305 2.3 apog 07:51 8-7344A 1.000337 -3328 -1022 615 -30.8 81.4 3.9 24 303 2.1 apog 08:00 8-7344A 1.000343 -3383 -1058 624 -41.0 80.4 3.2 22 308 2.5 apog 08:23 3-7439A 1.000548 -5409 -2628 614 121.6 34.9 2.7 7 354 3.5 apog 08:31 3-7439A 1.000496 -4896 -2239 583 121.1 36.4 2.3 10 5 4.0 apog 08:39 3-7439A 1.000422 -4166 -1670 553 120.6 37.9 1.9 6 27 3.9 apog 08:48 3-7439A 1.000352 -3475 -1055 603 120.2 39.4 2.3 11 0 2.7 apog 08:56 3-7439A 1.000452 -4462 -1875 606 119.8 40.9 2.0 11 358 4.2 apog 09:04 3-7439A 1.000452 -4462 -1880 606 119.5 42.5 1.8 8 328 8.0 apog 09:13 3-7439A 1.000452 -4462 -1886 606 119.1 44.0 1.6 4 277 3.6 apog 09:21 3-7439A 1.000452 -4462 -1891 606 118.8 45.6 1.6 12 43 5.7 apog ---- Weather Log ---- --- Weather --- Time Inst Temp DP Dif Humid Wind Dir Dust,1um IRSC IRSCm -------------------------------------------------------------------------------- 01:18 6-7435A 10.0 -10.8 20.8 21 28 245 12932 11.8 801 99.9 01:18 6-7435A 10.0 -10.8 20.8 21 28 245 12932 11.8 801 99.9 02:04 6-7435A 8.5 -10.9 19.4 23 29 246 3417 11.8 801 99.9 02:56 6-7435A 8.3 -10.8 19.1 24 22 257 4018 13.1 800 1.7 apog 03:04 6-7435A 8.1 -10.8 18.9 24 16 263 3758 8.9 799 1.8 apog 03:13 6-7435A 8.1 -10.4 18.5 25 22 253 3450 9.0 800 1.9 apog 03:21 6-7435A 8.1 -10.3 18.4 25 24 270 3431 10.1 800 1.9 apog 03:29 6-7435A 8.1 -10.1 18.2 26 21 271 3499 8.6 800 1.8 apog 03:38 6-7435A 7.8 -10.3 18.1 26 20 262 3132 11.3 800 1.9 apog 03:46 6-7435A 7.8 -10.1 17.9 26 22 264 2987 12.0 800 1.6 apog 03:54 6-7435A 7.9 -9.9 17.8 27 25 267 3742 9.9 801 1.7 apog 04:18 2-7269A 7.8 -9.3 17.1 28 34 278 3824 10.6 800 2.0 apog 04:26 2-7269A 7.8 -9.2 17.0 28 12 258 3644 9.0 802 1.7 apog 04:35 2-7269A 7.7 -8.6 16.3 30 22 263 3535 9.8 801 1.6 apog 04:43 2-7269A 7.7 -8.6 16.3 30 23 262 4126 18.9 801 1.9 apog 04:52 2-7269A 7.6 -8.6 16.2 30 19 263 4413 11.8 801 1.9 apog 05:00 2-7269A 7.6 -8.4 16.0 31 25 252 4132 16.8 805 2.0 apog 05:08 2-7269A 7.4 -8.1 15.5 32 18 264 4104 415.2 1006 2.8 apog 05:17 2-7269A 6.8 -8.1 14.9 33 13 300 4649 181.0 799 2.9 apog 07:01 8-7344A 4.9 -5.7 10.6 45 13 306 3953 16.6 801 2.0 apog 07:09 8-7344A 4.8 -5.5 10.3 47 16 293 3312 11.7 802 1.7 apog 07:18 8-7344A 4.8 -6.8 11.6 42 13 261 3883 12.6 803 1.5 apog 07:26 8-7344A 4.7 -6.1 10.8 45 13 281 3112 10.3 801 2.1 apog 07:35 8-7344A 4.3 -5.1 9.4 50 16 303 3358 19.0 802 2.0 apog 07:43 8-7344A 4.2 -4.9 9.1 51 17 305 2942 14.7 800 2.3 apog 07:51 8-7344A 3.9 -4.8 8.7 52 24 303 3604 15.9 806 2.1 apog 08:00 8-7344A 3.2 -4.2 7.4 58 22 308 3947 19.0 801 2.5 apog 08:23 3-7439A 2.7 -3.8 6.5 62 7 354 4655 8.9 800 3.5 apog 08:31 3-7439A 2.3 -3.6 5.9 65 10 5 4329 12.2 799 4.0 apog 08:39 3-7439A 1.9 -3.3 5.2 68 6 27 4640 29.4 809 3.9 apog 08:48 3-7439A 2.3 -4.2 6.5 62 11 0 5133 150.5 861 2.7 apog 08:56 3-7439A 2.0 -4.4 6.4 62 11 358 4997 241.9 1023 4.2 apog 09:04 3-7439A 1.8 -4.7 6.5 62 8 328 5048 249.7 895 8.0 apog 09:13 3-7439A 1.6 -4.7 6.3 62 4 277 5544 184.6 881 3.6 apog 09:21 3-7439A 1.6 -5.1 6.7 61 12 43 5303 279.6 926 5.7 apog Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma 18:00 7.3 -10.4 6.2 268.1 1351 18:15 8.1 -10.3 20.9 269.3 1965 18:30 8.5 -11.3 9.1 231.6 1392 18:45 9.4 -10.7 22.5 272.4 1509 19:00 9.0 -11.3 20.4 290.1 1526 19:15 9.8 -10.7 17.0 268.0 1342 19:30 11.3 -10.4 17.1 265.3 1338 19:45 10.5 -11.1 15.7 285.6 1253 20:00 11.0 -10.1 21.7 269.5 1159 20:15 10.6 -11.9 16.6 268.8 1611 20:30 11.2 -11.6 17.6 274.3 1370 20:45 11.1 -11.4 28.3 255.0 1354 21:00 11.0 -11.4 16.0 239.4 1263 21:15 10.9 -11.7 17.4 255.5 1625 21:30 10.1 -12.2 29.3 267.4 2021 21:45 10.7 -12.6 27.4 236.1 1759 22:00 11.2 -12.1 21.3 270.2 2155 22:15 10.9 -12.4 28.9 245.3 2267 22:30 10.8 -12.9 26.3 267.7 2365 22:45 10.7 -13.2 21.0 265.2 2293 23:00 11.4 -12.2 7.1 209.8 4055 23:15 11.5 -12.4 24.5 228.2 4762 23:30 10.9 -13.8 23.3 251.1 4465 23:45 10.5 -13.9 23.4 268.6 3175 00:00 10.3 -14.0 23.4 266.5 4942 00:15 10.9 -13.0 28.2 235.3 3966 00:30 9.9 -13.0 24.5 260.0 5919 00:45 10.0 -12.9 32.9 257.5 9132 01:00 9.8 -13.2 32.0 255.4 14778 01:15 9.3 -13.2 33.3 250.1 7335 01:30 8.9 -13.3 30.6 236.4 10110 01:45 8.4 -13.3 26.7 243.8 6019 02:00 8.2 -13.6 21.4 253.8 4340 02:15 8.1 -13.3 18.9 258.9 3254 02:30 7.9 -12.9 19.1 263.8 2907 02:45 7.8 -13.1 19.2 252.7 3328 799 8.95 03:00 7.7 -12.8 16.9 262.0 3672 799 9.67 03:15 7.7 -12.6 27.4 260.1 3713 800 8.62 03:30 7.6 -12.2 27.6 268.9 3499 800 7.22 03:45 7.5 -11.9 21.9 271.0 2987 800 9.64 04:00 7.5 -11.6 24.0 267.4 3658 801 9.86 04:15 7.6 -11.4 25.1 273.0 4232 801 9.07 04:30 7.2 -11.2 25.8 263.5 3796 801 12.26 04:45 7.2 -10.7 26.1 271.8 3741 801 11.43 05:00 7.1 -10.4 20.5 247.8 4132 804 16.48 05:15 6.5 -9.9 21.2 302.8 4649 818 255.96 05:30 5.8 -9.2 11.7 299.3 8129 801 10.65 05:45 5.6 -8.1 13.9 298.0 7537 801 11.62 06:00 5.7 -7.8 13.6 299.0 4974 802 8.62 06:15 5.2 -7.8 14.6 296.8 5930 801 12.40 06:30 5.5 -7.6 10.0 309.2 4901 802 27.78 06:45 5.2 -7.7 10.7 284.6 3789 802 10.86 07:00 4.6 -7.2 11.0 302.8 3953 802 12.18 07:15 4.4 -6.7 13.6 264.3 3883 802 12.89 07:30 4.1 -7.5 16.0 297.4 3358 801 11.05 07:45 4.0 -6.4 10.1 325.2 2942 801 15.19 08:00 3.4 -5.6 13.2 324.8 3947 801 24.73 08:15 3.2 -5.8 20.1 322.8 4018 801 12.94 08:30 1.8 -4.5 8.1 351.1 4166 800 9.94 08:45 1.8 -4.9 15.4 14.6 4309 905 241.48 09:00 1.4 -5.7 6.4 5.0 4997 927 289.76 09:15 1.2 -5.9 5.5 305.1 5544 902 186.96 09:30 1.1 -6.9 16.2 327.8 5462 857 188.57 09:45 1.0 -7.4 14.7 348.8 5750 1012 224.60 10:00 1.0 -7.4 13.0 313.9 5806 936 242.90 10:15 1.0 -7.9 12.0 354.3 5607 1534 221.61 ---- Telescope Status ---- 2:03 Started ventilation 2:20 encl25m : open 5:46 encl25m : closed 6:53 encl25m : open 9:57 encl25m : closed No interlocks bypassed Status at: Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge =17 Counterweights at: LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 181.8 lbs, 23.3 psi SP2 196.5 lbs, 20.8 psi ---- Software Used ---- Get Versions, 04/13/14, 23:49:14 ----STUI software: STUI: 1.3 2013-09-05 alerts: v1_3_0 apo: v1_10 boss: v2_5_16 boss.daq: 1.3.2 boss.specMech: Offline gcamera: v1_3_7 guider: v1_6_3 hub: Tag: sdss3_v1_2_0 mcp: v6_6_18 mcp.plc: 29 mcp.azFiducialVersion: v1_111 mcp.altFiducialVersion: v1_111 mcp.rotFiducialVersion: v1_111 platedb: v1_1_0 sop: v1_3_2 sos: v1_2_0 sos.idlspec2d: v5_6_9 tcc: 2.14.0 apogee: -not availble- apogeecal: -not availble- apogeeql: v1_5_3 -----Other software sdssProcedure(sdss3): v3_06 APO-local scripts : trunk idlspec2d (sos3) --- v5_6_9 plate-mapper3 ------ NOCVS:v5_0_14a ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 15.013 15.011 Axial B: 16.005 16.003 Axial C: 15.531 15.529 Trans D: -0.002 -0.003 Lateral E: 10.6045 10.6299 Lateral F: 12.2682 12.2809 GALILS Commanded: 11300 -650 5500 21900 13500 13050 Actual: 11300 -650 5500 21900 13500 13050 SETMIR VALUES PrimDesOrient: 0.00 0.00 0.00 612.35 1500.90 PrimOrient: 0.00 0.00 0.00 612.07 1500.38 SECONDARY: ---------- Focus: 0.00 Air temp: 12.1 Altitude: 29.4 MIGS TONIGHT NOMINAL Axial A: -7.061 -7.063 Axial B: -7.035 -7.036 Axial C: -7.078 -7.078 Trans D: 0.026 0.024 GALILS Commanded: 1575950 1583000 1592550 -8800 -3350 Actual: 1575964 1583000 1592556 -8800 -3350 SETMIR VALUES SecDesOrient: 1257.00 -4.10 3.00 -100.00 143.14 SecOrient: 1256.99 -4.08 3.00 -100.04 143.61 ---- Miscellaneous ---- APOGEE data list, mjd=56760 raw_data: /data/apogee/utr_cdr/56760/apRaw-*.fits -------------------------------------------------------------------------------- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm -------------------------------------------------------------------------------- 56760 1 11:52 11980044 Dark 60 A 13.0 17-7339 a-b-c - - 56760 2 12:03 11980045 Dark 60 A 13.0 17-7339 a-b-c - - 56760 3 12:13 11980046 Dark 60 A 13.0 17-7339 a-b-c - - 56760 4 12:24 11980047 QuarFlat 10 A 13.0 17-7339 a-b-c - 78 56760 5 12:26 11980048 QuarFlat 10 A 13.0 17-7339 a-b-c - 78 56760 6 12:28 11980049 QuarFlat 10 A 13.0 17-7339 a-b-c - 78 56760 7 12:30 11980050 Arc-Thar 12 A 13.0 17-7339 a-b-c 1.91 - 56760 8 12:32 11980051 Arc-Une 40 A 13.0 17-7339 a-b-c - - 56760 9 12:39 11980052 Arc-Thar 12 B 13.5 17-7339 a-b-c 2.37 - 56760 10 12:41 11980053 Arc-Une 40 B 13.5 17-7339 a-b-c - - 56760 11 12:49 11980054 Dark 30 A 13.0 17-7339 a-b-c - - 56760 12 12:54 11980055 InteFlat 30 A 13.0 17-7339 a-b-c - 99 56760 13 12:59 11980056 InteFlat 30 A 13.0 17-7339 a-b-c - 99 56760 14 13:05 11980057 InteFlat 30 A 13.0 17-7339 a-b-c - 99 56760 15 13:10 11980058 Dark 30 A 13.0 17-7339 a-b-c - - -------------------------------------------------------------------------------- ---- Problems in Detail ---- 0:22:15 APO.telescope.sop 478 boss w text="Command PING to sp1cam timed out" 10:22:15 APO.telescope.sop 478 boss e text="Error while waiting for flush to complete on sp1cam. " 10:22:15 APO.telescope.sop 478 boss f text="Flush failed, exposure aborted." 10:22:15 CmdDone: APO.telescope.sop 478 boss exposure bias 10:22:15 .boss 29 boss w text="this command has already been finished!!!! (client.v72 29): exposure bias " 10:22:15 .boss 29 boss w text="this command has already been finished!!!! (client.v72 29): exposure bias " 10:22:15 .boss 29 boss f text="exposure aborted" 10:22:15 APO.telescope 618 sop f text="Failed to take bias exposure" 10:22:15 CmdDone: APO.telescope 618 sop doCalibs nBias=20 nDark=1 nFlat=0 nArc=1 darkTime=900.0 flatTime=30.0 guiderFlatTime=0.5 arcTime=4.0