Subject: 2.5m obslog 20220419 (SJD 59689) From: viktorm@apo.nmsu.edu Date: Wed, 20 Apr 2022 11:51:35 +0000 (UTC) APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday April 19, 2022 (SJD 59689) ---- Observing Team ---- Kaike Pan Viktor Malanushenko ---- Observing Plan ---- If clear, queue, then observe one dither field each night. Select from designs 35987 (APOGEE), 35988 (BOSS), 35989 (APOGEE), 35990 (BOSS), until you get one successful complete dither on each. If there are clouds, then just observe from the queue. ---- Observing Summary ---- Cloudy night with strong wind until 07:40Z . We lost due to the weather conditions: 5.6 hours. 08:14:55 101806-46823-4954 1x900s + 2x43 AB -> DONE 08:42:48 101806-46824-4955 2x900s + 4x43 AB -> DONE 09:21:57 101806-46825-4956 1x900s + 2x43 AB -> DONE 09:44:17 101806-46826-4957 1x900s + 2x43 AB -> DONE 10:09:48 104196-55082-4958 1x900s + 2x43 AB -> DONE Notes: ===== we made 'jaeger disable 1340'. -> section "Problems in Detail" ---- Engineering Issues ---- ### Notes: - Integrated Dust Counts: ~ 3300 dust-hrs ---- Observing Log ---- afternoon: ========= BOSS collimation was checked, no adjustment. 3:35:13 Hartmann collimate output sp1: offset: r= -1979 (Out of focus); b= 0.8 (In Focus) sp1: pred. move: spAverageMove= -1118 sp1: pred. resid: r= -861, b= -2.7, txt= OK, spTemp = 8.2 ---------- motorPosition sp1: 1179, 1324, -73; ---------- Median spectrographs temperatures: Tsp1= 8.2 Outside air temperature= 14.7; /data is 90% full. Apogee evening cal is taken, checked. Checked and confirmed all robots are folded. Robot position checked with "jaeger fvc loop --no-apply". 00:14:24 OBSERVER.kpan 95 jaeger i fvc_rms=43.01 00:14:24 OBSERVER.kpan 95 jaeger i fvc_perc_90=64.0 00:14:24 OBSERVER.kpan 95 jaeger i fvc_percent_reached=1.8 SOS is rolled back to the previous version. Clouds and high wind, no evening ventilation. Night: ====== 07:49:27 encl25m : open; 7:53:58 Config Loaded: 101806-46823-4952 07:55:19 apogee.expose=apRaw-41270010, 5, A, DomeFlat 07:57:29 apogee.expose=apRaw-41270011, 5, A, DomeFlat 07:58:48 apogee.expose=apRaw-41270012, 5, A, DomeFlat 08:00:22 Jaeger collision: 1340 08:05:58 Jaeger collision: 1340 08:09:47 Config Loaded: 101806-46823-4953 08:10:29 Jaeger collision: 1340 -- we made: jaeger disable 1340 08:14:55 Config Loaded: 101806-46823-4954 08:16:08 boss exposure 4.0, file=340568 08:16:48 boss exposure 4.0, file=340569 08:17:32 Hartmann collimate output sp1: offset: r= 329 (In Focus); b= -7.3 (Out of focus) sp1: pred. move: spAverageMove= 1321 sp1: pred. resid: r= -992, b= -3.1, txt= OK, spTemp = 7.0 08:27:07 OBSERVER.kpan_2 38 cherno i guide_rms=9,0.746,0.643,0.985 -- RMS is really high. Maybe Jose made any change of units and now instead [mm] we have [mk]? 08:27:36 apogee.expose=apRaw-41270013, 43, A, Object 08:27:42 boss exposure 900.0, file=340572 08:35:17 apogee.expose=apRaw-41270014, 43, B, Object 08:42:48 Config Loaded: 101806-46824-4955 08:49:43 New-field overhead: 0:05:56 08:49:57 apogee.expose=apRaw-41270015, 43, B, Object 08:50:03 boss exposure 900.0, file=340573 08:57:43 apogee.expose=apRaw-41270016, 43, A, Object 09:06:44 apogee.expose=apRaw-41270017, 43, A, Object 09:06:51 boss exposure 900.0, file=340574 09:14:25 apogee.expose=apRaw-41270018, 43, B, Object 09:21:57 Config Loaded: 101806-46825-4956 09:28:43 Same-field overhead: 0:05:47 09:28:57 apogee.expose=apRaw-41270019, 43, B, Object 09:29:03 boss exposure 900.0, file=340575 09:36:43 apogee.expose=apRaw-41270020, 43, A, Object 09:44:17 Config Loaded: 101806-46826-4957 09:53:04 Same-field overhead: 0:07:57 09:53:18 apogee.expose=apRaw-41270021, 43, A, Object 09:53:25 boss exposure 900.0, file=340576 10:00:59 apogee.expose=apRaw-41270022, 43, B, Object 10:09:48 Config Loaded: 104196-55082-4958 10:14:25 Hartmann collimate output sp1: offset: r= -989 (In Focus); b= 4.8 (Out of focus) sp1: pred. move: spAverageMove= -1265 sp1: pred. resid: r= 276, b= 0.9, txt= OK, spTemp = 6.3 10:20:08 New-field overhead: 0:10:34 10:20:22 apogee.expose=apRaw-41270023, 43, B, Object 10:20:29 boss exposure 900.0, file=340581 10:28:07 apogee.expose=apRaw-41270024, 43, A, Object 10:37:35 Config Loaded: 104197-55179-4959 10:48:21 New-field overhead: 0:11:48 10:48:35 apogee.expose=apRaw-41270025, 43, A, Object 10:48:42 boss exposure 900.0, file=340584 10:56:17 apogee.expose=apRaw-41270026, 43, B, Object -------- 11:15:35 apogee.expose=apRaw-41270027, 5, B, DomeFlat 11:17:47 apogee.expose=apRaw-41270028, 5, B, DomeFlat 11:19:28 apogee.expose=apRaw-41270029, 5, B, DomeFlat -------- 11:26:28 encl25m : closed; ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: 0.0060 0.0040 Axial B: 0.0050 0.0030 Axial C: -0.1190 -0.1150 Trans D: -0.0336 -0.0338 Lateral E: 0.3315 0.3315 Lateral F: 0.5345 0.5350 GALILS Commanded: 12500 -1600 5300 47050 -8800 -8400 Actual: 12500 -1600 5300 47050 -8800 -8400 SETMIR VALUES PrimDesOrient: 0.0 -59.5 -9.15 -512.0 1906.3 PrimOrient: 1.07 -59.51 -9.21 -512.13 1906.31 SECONDARY: ---------- Focus: 0.0000 Air temp: 14.83 Altitude: 30.0 MIGS TONIGHT NOMINAL Axial A: -9.6550 -9.6570 Axial B: -9.6650 -9.6710 Axial C: -9.6990 -9.6970 Trans D: 0.1020 0.1140 GALILS Commanded: 4882700 4876700 4905950 0 -3400 Actual: 4859274 4859148 4859299 0 -3400 SETMIR VALUES SecDesOrient: 3857.0 0.0 0.0 0.0 42.22 SecOrient: 3857.02 -0.04 -0.04 -0.03 41.67 ---- Telescope Status ---- 07:29Z Started ventilation Opened at 07:49:27 Closed at 11:26:28 Status at: 11:38:19Z Telescope Position: 121.0, 30.0, 0.0 mount Instrument mounted: FPS Counterweights at: 683.3, 685.5, 703.4, 702.7 LN2 autofill systems: Connected and turned on 180L LN2 dewar scale: SP1 142.0 lbs, 21.8 psi FPS Status ========== CP10 Loop = 6.91 L/min GFA Loop = 1.97 L/min Supply pressure = 41.3 psi Return pressure = 26.8 psi Chiller Status ============== Set temperarature = 9.4 C Flow = 3.6 Gpm ---- Software Used ---- Get Versions, 04/19/22, 23:27:10 -- STUI software: STUI : 1.7.17b1 alerts : 2.2.0 boss : 6.0.1 -boss.specMec : 3.0.4 apo : 3.0.1 fliswarm : 0.2.1-alpha.0 jaeger : 0.14.1-alpha.0 kaiju : 1.2.2-alpha.1 coordio : 1.2.2-alpha.1 fps_calibrati : APO.2021.12.25+b1cf2fd cherno : 0.1.1-alpha.0 hal : 0.1.1-alpha.0 hartmann : 2.0.2 hub : 5.0.1a0 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_148 -mcp.altFiduc : v1_148 -mcp.rotFiduc : v1_148 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : 3.1.13 ---- APOGEE Data Summary ---- APOGEE data list, mjd=59689, all raw_data: /data/apogee/utr_cdr/59689/apRaw-*.fits archive: /data/apogee/archive/59689/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59689/apq-*.fits ------------------------------------------------------------------------------ mjd i UT File/Exp Imtype Nread A/B Dth Design-Cfg Arch Offset %Flux Comm ------------------------------------------------------------------------------ 59689 1 23:24 41270001 Dark 3 A 13.0 ---------- a-b-c - - 59689 2 23:37 41270002 Dark 60 A 13.0 ---------- a-b-c - - 59689 3 23:40 41270003 QuarFlat 10 A 13.0 ---------- a-b-c - 100 59689 4 23:42 41270004 Arc-Thar 12 B 13.5 ---------- a-b-c 1.92 - 59689 5 23:49 41270005 Arc-Une 40 B 13.5 ---------- a-b-c - - 59689 6 23:51 41270006 Arc-Thar 12 A 13.0 ---------- a-b-c 1.52 - 59689 7 23:58 41270007 Arc-Une 40 A 13.0 ---------- a-b-c - - 59689 8 00:09 41270008 Dark 60 A 13.0 ---------- a-b-c - - 59689 9 00:15 41270009 Arc---- 30 A 13.0 ---------- a-b-c - - FPI 59689 10 07:55 41270010 DomeFlat 5 A 13.0 46823-4952 a-b-c - 137 59689 11 07:57 41270011 DomeFlat 5 A 13.0 46823-4952 a-b-c - 137 59689 12 07:59 41270012 DomeFlat 5 A 13.0 46823-4952 a-b-c - 138 59689 13 08:34 41270013 Object 43 A 13.0 46823-4954 a-b-c 1.44 - 59689 14 08:42 41270014 Object 43 B 13.5 46823-4954 a-b-c 1.95 - 59689 15 08:57 41270015 Object 43 B 13.5 46824-4955 a-b-c 1.94 - 59689 16 09:04 41270016 Object 43 A 13.0 46824-4955 a-b-c 1.43 - 59689 17 09:13 41270017 Object 43 A 13.0 46824-4955 a-b-c 1.43 - 59689 18 09:21 41270018 Object 43 B 13.5 46824-4955 a-b-c 1.95 - 59689 19 09:36 41270019 Object 43 B 13.5 46825-4956 a-b-c 1.95 - 59689 20 09:43 41270020 Object 43 A 13.0 46825-4956 a-b-c 1.43 - 59689 21 10:00 41270021 Object 43 A 13.0 46826-4957 a-b-c 1.43 - 59689 22 10:08 41270022 Object 43 B 13.5 46826-4957 a-b-c 1.95 - 59689 23 10:27 41270023 Object 43 B 13.5 55082-4958 a-b-c 1.92 - 59689 24 10:35 41270024 Object 43 A 13.0 55082-4958 a-b-c 1.41 - 59689 25 10:55 41270025 Object 43 A 13.0 55179-4959 a-b-c 1.44 - 59689 26 11:03 41270026 Object 43 B 13.5 55179-4959 a-b-c 1.96 - 59689 27 11:16 41270027 DomeFlat 5 B 13.5 55179-4959 a-b-c - 138 59689 28 11:18 41270028 DomeFlat 5 B 13.5 55179-4959 a-b-c - 137 59689 29 11:19 41270029 DomeFlat 5 B 13.5 55179-4959 a-b-c - 134 cannot read file : /data/apogee/utr_cdr/59689/apRaw-41270030.fits ------------------------------------------------------------------------------ ---- eBOSS Data Summary ---- Reading FITS from /data/spectro//59689 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - n Time Filename design-field cfg flav shu Exp colA colB colC Hrt - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 1 23:29 r1-00340552 ----------- ---- bia Clo 0.0 2297 2441 1042 2 23:29 b1-00340552 ----------- ---- bia Clo 0.0 2297 2441 1042 3 23:31 b1-00340553 -999--999 4949 arc Lef 4.1 2297 2441 1042 HART 4 23:31 r1-00340553 -999--999 4949 arc Lef 4.1 2297 2441 1042 HART 5 23:32 b1-00340554 -999--999 4949 arc Rig 4.1 2297 2441 1042 HART 6 23:32 r1-00340554 -999--999 4949 arc Rig 4.1 2297 2441 1042 HART 7 23:33 r1-00340555 -999--999 4949 arc Lef 4.1 2297 2441 1042 HART 8 23:33 b1-00340555 -999--999 4949 arc Lef 4.1 2297 2441 1042 HART 9 23:34 r1-00340556 -999--999 4949 arc Rig 4.1 2297 2441 1042 HART 10 23:34 b1-00340556 -999--999 4949 arc Rig 4.1 2297 2441 1042 HART 11 23:35 r1-00340557 ----------- ---- bia Clo 0.0 1179 1324 -73 12 23:35 b1-00340557 ----------- ---- bia Clo 0.0 1179 1324 -73 13 03:12 r1-00340558 -999--999 4950 arc Lef 4.1 1179 1324 -73 HART 14 03:12 b1-00340558 -999--999 4950 arc Lef 4.1 1179 1324 -73 HART 15 03:12 r1-00340559 -999--999 4950 arc Rig 4.1 1179 1324 -73 HART 16 03:12 b1-00340559 -999--999 4950 arc Rig 4.1 1179 1324 -73 HART 17 03:15 b1-00340560 -999--999 4950 fla Out 25.1 1523 1669 272 18 03:15 r1-00340560 -999--999 4950 fla Out 25.1 1523 1669 272 19 03:17 b1-00340561 -999--999 4950 arc Out 4.1 1523 1669 272 20 03:17 r1-00340561 -999--999 4950 arc Out 4.1 1523 1669 272 21 04:06 r1-00340562 -999--999 4950 arc Out 4.1 1523 1669 272 22 04:06 b1-00340562 -999--999 4950 arc Out 4.1 1523 1669 272 23 05:14 b1-00340563 ----------- ---- dar Clo 20.0 1523 1669 272 24 05:14 r1-00340563 ----------- ---- dar Clo 20.0 1523 1669 272 25 05:29 r1-00340564 -999--999 4950 arc Out 4.1 1523 1669 272 26 05:29 b1-00340564 -999--999 4950 arc Out 4.1 1523 1669 272 27 05:32 r1-00340565 -999--999 4950 fla Out 25.1 1523 1669 272 28 05:32 b1-00340565 -999--999 4950 fla Out 25.1 1523 1669 272 29 05:38 r1-00340566 4950-17083 4951 arc Out 4.1 1523 1669 272 30 05:38 b1-00340566 4950-17083 4951 arc Out 4.1 1523 1669 272 31 05:40 b1-00340567 4950-17083 4951 fla Out 25.1 1523 1669 272 32 05:40 r1-00340567 4950-17083 4951 fla Out 25.1 1523 1669 272 33 08:16 r1-00340568 46823-101806 4954 arc Lef 4.1 1523 1669 272 HART 34 08:16 b1-00340568 46823-101806 4954 arc Lef 4.1 1523 1669 272 HART 35 08:16 r1-00340569 46823-101806 4954 arc Rig 4.1 1523 1669 272 HART 36 08:16 b1-00340569 46823-101806 4954 arc Rig 4.1 1523 1669 272 HART 37 08:17 r1-00340570 46823-101806 4954 arc Out 4.1 2844 2990 1594 38 08:17 b1-00340570 46823-101806 4954 arc Out 4.1 2844 2990 1594 39 08:19 r1-00340571 46823-101806 4954 fla Out 25.1 2844 2990 1594 40 08:19 b1-00340571 46823-101806 4954 fla Out 25.1 2844 2990 1594 41 08:27 r1-00340572 46823-101806 4954 sci Out 900.1 2844 2990 1594 42 08:27 b1-00340572 46823-101806 4954 sci Out 900.1 2844 2990 1594 43 08:50 r1-00340573 46824-101806 4955 sci Out 900.1 2844 2990 1594 44 08:50 b1-00340573 46824-101806 4955 sci Out 900.1 2844 2990 1594 45 09:06 r1-00340574 46824-101806 4955 sci Out 900.1 2844 2990 1594 46 09:06 b1-00340574 46824-101806 4955 sci Out 900.1 2844 2990 1594 47 09:29 b1-00340575 46825-101806 4956 sci Out 900.1 2844 2990 1594 48 09:29 r1-00340575 46825-101806 4956 sci Out 900.1 2844 2990 1594 49 09:53 r1-00340576 46826-101806 4957 sci Out 900.1 2844 2990 1594 50 09:53 b1-00340576 46826-101806 4957 sci Out 900.1 2844 2990 1594 51 10:12 r1-00340577 55082-104196 4958 arc Lef 4.1 2844 2990 1594 HART 52 10:12 b1-00340577 55082-104196 4958 arc Lef 4.1 2844 2990 1594 HART 53 10:13 r1-00340578 55082-104196 4958 arc Rig 4.1 2844 2990 1594 HART 54 10:13 b1-00340578 55082-104196 4958 arc Rig 4.1 2844 2990 1594 HART 55 10:14 r1-00340579 55082-104196 4958 arc Out 4.1 1579 1728 333 56 10:14 b1-00340579 55082-104196 4958 arc Out 4.1 1579 1728 333 57 10:16 r1-00340580 55082-104196 4958 fla Out 25.1 1579 1728 333 58 10:16 b1-00340580 55082-104196 4958 fla Out 25.1 1579 1728 333 59 10:20 r1-00340581 55082-104196 4958 sci Out 900.1 1579 1728 333 60 10:20 b1-00340581 55082-104196 4958 sci Out 900.1 1579 1728 333 61 10:41 r1-00340582 55179-104197 4959 arc Out 4.1 1579 1728 333 62 10:41 b1-00340582 55179-104197 4959 arc Out 4.1 1579 1728 333 63 10:43 b1-00340583 55179-104197 4959 fla Out 25.1 1579 1728 333 64 10:43 r1-00340583 55179-104197 4959 fla Out 25.1 1579 1728 333 65 10:48 b1-00340584 55179-104197 4959 sci Out 900.1 1579 1728 333 66 10:48 r1-00340584 55179-104197 4959 sci Out 900.1 1579 1728 333 ---- BOSS Spectrographs Collimation ---- Time TSP1 R1 B1 Move1 B1Resid ============================================= 23:35:00 7.7 -1979 0.8 -1118 -2.7 03:13:30 7.5 -659 -4.2 345 -3.1 08:17:20 6.4 329 -7.3 1321 -3.1 10:14:10 5.8 -989 4.8 -1265 0.9 ---- Weather Log ---- Wind 1 um DIMM IRSC Time Temp C Dewp C MPH Dir Dust fwhm mean sigma 18:00 12.9 -0.6 5.8 252.3 4721 18:15 12.6 -1.0 14.6 298.4 4302 18:30 12.2 -2.7 16.4 322.9 3829 18:45 12.5 -3.2 9.7 273.0 3441 19:00 13.1 -4.5 11.3 301.0 2262 19:15 12.4 -4.4 13.5 315.1 2538 19:30 13.1 -3.6 9.4 248.3 3505 19:45 13.0 -4.8 19.7 280.5 3243 20:00 14.5 -4.7 16.5 288.3 3305 20:15 14.4 -5.7 17.1 283.3 2356 20:30 14.2 -6.2 24.8 300.3 1914 20:45 15.1 -7.4 11.1 258.1 1963 21:00 14.8 -6.2 29.2 270.4 2359 21:15 14.2 -7.2 18.9 270.1 1987 21:30 14.6 -6.3 15.3 284.1 2078 21:45 15.1 -6.4 22.3 265.4 2434 22:00 15.0 -5.7 14.2 283.6 2660 22:15 15.3 -6.8 17.9 289.2 2225 22:30 15.3 -6.4 18.1 259.6 2147 22:45 14.6 -7.6 22.8 286.6 1792 23:00 15.0 -7.7 18.5 280.5 1783 23:15 15.0 -7.6 17.9 278.5 1578 23:30 14.6 -8.1 18.3 269.4 1495 23:45 14.6 -8.1 18.7 274.1 1494 00:00 14.5 -8.1 18.8 287.6 1612 00:15 14.4 -8.4 17.6 282.9 1419 00:30 14.2 -9.8 19.1 288.2 1318 00:45 13.7 -11.8 24.5 283.0 2914 01:00 13.5 -11.9 21.0 283.8 1594 01:15 13.4 -11.6 21.2 255.6 1529 01:30 13.4 -11.6 24.0 266.8 1801 01:45 13.2 -11.7 25.3 281.9 2167 02:00 13.1 -11.7 16.9 275.8 1452 02:15 12.9 -11.6 26.8 270.5 1683 02:30 13.1 -11.8 24.9 268.5 1571 202 15.80 02:45 12.7 -11.8 18.7 246.2 1396 181 18.42 03:00 12.8 -12.0 18.1 262.8 1148 91 13.97 03:15 12.7 -11.8 28.1 284.7 1137 93 18.62 03:30 12.4 -11.8 20.9 249.3 1060 93 22.53 03:45 12.5 -11.7 22.4 265.0 1257 146 25.57 04:00 12.3 -11.7 22.4 275.5 1211 231 27.59 04:15 12.2 -11.8 34.9 275.1 1225 160 17.58 04:30 12.4 -12.2 21.5 278.9 1163 116 18.41 04:45 12.6 -12.6 28.9 274.8 1185 129 18.31 05:00 12.5 -12.6 32.8 277.9 1094 193 22.52 05:15 12.4 -12.5 35.5 279.0 1043 162 23.82 05:30 12.2 -12.1 23.0 273.7 1032 203 34.14 05:45 11.8 -12.0 28.8 290.3 1014 95 24.12 06:00 11.6 -12.0 29.7 269.7 982 146 12.65 06:15 11.7 -12.2 29.7 271.0 999 96 21.80 06:30 11.6 -11.9 33.4 269.1 1054 119 19.19 06:45 11.4 -12.1 20.5 261.6 1050 177 26.31 07:00 11.2 -12.1 30.1 270.6 973 163 15.88 07:15 10.9 -12.1 23.2 273.2 904 272 21.97 07:30 10.9 -12.1 23.4 268.3 941 132 5.06 07:45 10.6 -12.4 27.1 282.5 886 181 7.18 08:00 10.6 -12.6 24.5 282.1 809 191 10.31 08:15 10.6 -12.6 26.9 285.7 743 127 5.12 08:30 10.4 -12.8 28.3 274.7 776 88 9.14 08:45 10.5 -12.6 28.8 269.4 1131 88 10.31 09:00 10.3 -12.6 24.0 285.2 983 142 2.34 09:15 10.4 -12.5 16.8 268.5 885 132 1.38 09:30 10.4 -12.7 21.8 292.3 1001 127 3.33 09:45 10.0 -12.9 24.9 275.5 976 161 2.02 10:00 9.9 -12.6 22.1 269.4 929 88 9.43 10:15 9.9 -12.6 25.3 283.6 891 230 12.35 10:30 9.8 -12.6 26.6 280.3 947 166 7.29 10:45 9.8 -12.6 27.4 280.9 934 88 6.95 11:00 9.5 -12.6 26.1 267.7 1114 234 17.16 11:15 9.9 -12.1 29.1 285.6 1062 156 7.22 11:30 10.1 -12.5 36.8 290.6 958 146 13.59 11:45 9.7 -12.2 26.9 277.8 837 147 7.04 ---- Problems in Detail ---- 08:09:47 Config Loaded: 101806-46823-4953 08:10:29 Jaeger collision: 1340 … 08:10:56 CmdStarted: OBSERVER.kpan 139 jaeger unlock 08:11:04 CmdStarted: OBSERVER.kpan 140 jaeger unwind … So we will disabled that robot: 08:12:47 CmdStarted: OBSERVER.kpan 141 jaeger disable 1340 —> now need reload configuration: 08:13:41 CmdStarted: OBSERVER.kpan 142 jaeger configuration load --no-clone 46823 -------- 11:05:24 CmdStarted: OBSERVER.kpan 152 jaeger enable 1340 11:07:51 OBSERVER.kpan_2 61 jaeger f error="Command 'configuration preload' failed because of an uncaught error 'TrajectoryError: Attempt 6: 3 deadlocks remain but the number of retries has been exhausted'. See traceback in the log for more information." 11:07:51 CmdDone: OBSERVER.kpan_2 61 jaeger configuration preload -- we try again: 11:08:31 OBSERVER.kpan_2 62 jaeger i text="Preloading design 40386." 11:10:38 OBSERVER.kpan_2 62 jaeger f error="Command 'configuration preload' failed because of an uncaught error 'TrajectoryError: Attempt 6: 3 deadlocks remain but the number of retries has been exhausted'. See traceback in the log for more information." 11:10:38 CmdDone: OBSERVER.kpan_2 62 jaeger configuration preload - we try disable robot 1340: 11:11:05 CmdStarted: OBSERVER.kpan 153 jaeger disable 1340 11:11:10 OBSERVER.kpan_2 63 jaeger i text="Preloading design 40386." - we try again enble robot 1340: 11:13:39 CmdStarted: OBSERVER.kpan 154 jaeger enable 1340 11:13:52 CmdStarted: OBSERVER.kpan_2 64 jaeger configuration preload 11:16:00 OBSERVER.kpan_2 64 jaeger f error="Command 'configuration preload' failed because of an uncaught error 'TrajectoryError: Attempt 6: 3 deadlocks remain but the number of retries has been exhausted'. See traceback in the log for more information."