Date: Thu, 27 Oct 2005 19:49:41 -0400 (EDT) From: jegunn Subject: Re: 2.5m obslog 20051026 (MJD 53670) Thanks, Kurt. I will sleep better. --jim On Thu, 27 Oct 2005, Kurt Biery wrote: > Jim, > My reading of the code is that it is not possible for the DA to miss a > line and not know it.  If and when a line is missed, the "deadbeef" > pattern is stored in the frame in place of the missing data. > There is lots of screaming in the trace log on the board when this > happens, but not much, if any, external reporting that I recall.  > Kurt > > jegunn wrote: > > Hi, Kurt. > > Interesting, to say the least. I have been meaning to ask you on some > phonecon or other but it keeps slipping what is left of my mind--is > it possible at all for the DA to completely miss a line of data from > one or more CCDs and > > a) not itself be aware of what has happened > > b) if it is aware, not scream? > > This error is particularly insidious, because there is just a 400 > milliarcsecond stripe missing from some ccd image, almost impossible > to see unless it happens to go through some brightish star and even > then hard. Plays havoc with the astrometry, of course, but so do other > things. > > Re the checksums, one *could* think about writing them to a file > a line at a time, which is I think how the DA calculates them. If > there are real hardware errors, this would at least localize them so > one might get a better handle on what is going on. > > thanks > > --jim > > > > > On Thu, 27 Oct 2005, Kurt Biery wrote: > > > > I've looked at the checksum mismatch and the sdssid6 freeze-up... > > > The checksum mismatch errors reported by the VxWorks boards were > basically saying that the value calculated by astroline did not agree > with the value calculated by the assembly task when it was ready to > write the frame to the ICC pool. I have not seen this happen before, > although it is certainly curious that it happened on all 10 boards > (id1-6, ad1-4) at the same time. FrameCatcher complained about all of > these photo frames (frame #19). This is because the astroline value > (not the assemTask value) is stored in the FITS header and that value > didn't match the data that was written to the pool (and later copied to > the Linux disk). The differences between the two checksum values looked > like they could have been due to a single pair of 16-bit data words > (e.g. diff = 0x03FD03FA and diff = 0x042C042D). I'll add a bit more > debugging information to the error message for the next version of > astroda, but otherwise I don't have good ideas on digging out what happened. > > > At the time that sdssid6 stopped sending data to the scrolling display, > there were two messages sent to murmur complaining that the VCI+ readout > had fallen behind. The warning message reported that the code was > trying to recover from the problem, but I suspect that in the end, the > situation became too bad to be recovered. Without being able to poke > around on the board after the problem but before the reboot, it is hard > to say more. > Kurt > > long@sdsshost2.apo.nmsu.edu wrote: > > > > APACHE POINT OBSERVATORY SDSS 2.5M > > OBSERVING LOG > Wednesday October 26, 2005 > > (MJD 53670) > > ---=== OBSERVING TEAM ===--- > > Howard Brewington (swing) > John Barentine (night) > Dan Long (night) > > ---=== OBSERVING PLAN ===--- > > Supernova Science! > > ---=== OBSERVING SUMMARY ===--- > > Tonight we imaged 82 N over the entire SN range (runs 5780, 5781) > and got the last 30 degrees of 82 S (run 5782). Skies were clear > until around 07:00Z, with variable amounts of high cloud afterwards. > There were a few problems which fortunately didn't cost too > much sky time. > > Spectro autofill system refused to accept a force fill by the > usual method of hitting the start button. It did work when > switched individually to manual. French was notified. > > id6 crashed at frame 59 of run 5780, forcing an early end to the > run, and a reboot of the crates. Status details listed in the > problem section. > > Got biases and darks for spectro monthly checkout while imaging. > All looks normal. However, instruments could not be grabbed. > PR 6704 filed. > > ---=== OBSERVING LOG ===--- > > Afternoon: > ------------ > The afternoon checkout went well. The spectro focus was not check since the > reinstalled camera was not cold yet. > During an imager bias, Watcher complained about that the FTP connection was > hung on id4. The error message is located in the problems section. > Yesterday, the SDSS camera bellows pressure was at 48psi, and today it's at > 38psi. > > MJD 53668 data removal was completed. Note that one part of > the removal took an extraordinarily long time. It took nearly > 45 minutes to delete /data/photo/frames/53668. > > Night: > ------------ > > 00:15Z Doors Closed to take bias (run 5779) in darkened enclosure. > > 00:35Z Opening > > Spectro fill would not start with the start button. It would > emit a brief puff when the start switch was held down but > would not start a fill. It did fill when the toggle switches > were set for manual fill, but of course in this state there > is no automatic shutoff when the dewars become full, so the > switches needed to be returned to auto when the dewars were > full. French was around in the evening and is aware of the > situation and will look into it in the morning. > > 01:35Z Run 5780 82 N 112.5 to 121 (120 in dewar 6) > > skippy happy from the start > focus converged by frame 20 lambda 114 > > 2005-10-27 01:48:22Z sdssfiles1 frameCatch TEXTONLY > Invalid frame /data/photo/frames/53670/5780/2/idRR-005780-z2-0019.fit > processed anyway > > this message showed up in the watcher. There was one for > frame 19 in all dewars and all chips. A check of the header > for the frame looked normal, and the frames were the right > size, so we are not sure what the error was. > > 02:08Z id6 stopped scrolling around frame 59 lambda 120 > > We ended the drift with frame 64 lambda 121 > > See problem section for output of "i" from sdssid6 and > sdssid4 (which was still scrolling at the time). > > rebooted crates > > scanStripe took two tries. The first didn't return a prompt > after the slew finished. Maybe it missed the slew end. In > any case we didn't wait for the three minute timeout and got > the prompt back with ctrl-C. The second attempt worked. > > Note there is no run log for 5780. Trying to generate one > results in an error message complaining about not having > all the files needed to create it. > > 02:21Z Run 5781 82 N 119 to -125.5 > > Everything good from the start. > Seeing acceptable at the start, ranging from 1.4 to 1.8 arcseconds > for the first 110 frames. It went up to around 2 arcseconds > between frames 110 and 130 (lambda 133 to 136). > After that seeing settled down to 1.2 to 1.4 arcseconds > Clear skies until about 07:00Z, frame 470, lambda -172. > Ramp start frame 762, lambda -127.7 > Run end frame 778, lamda -125.5 > > 02:38Z Clouds lurking low in the SE (well below 15 degrees). > > 06:55Z Clouds now sweeping in from the north, lambda -172, frame 470. > Right now they are just thin and patchy. > > 07:00Z Coincident with the clouds arrival is an uptick in the seeing. > It is hovering around 1.7 arcseconds starting about frame 475, > lambda -171. > > 08:09Z Moonrise > > 10:05Z Run 5782 82 S -153 to > Skippy and focus loop happy from the start. Still have variable > thin high cloud. Seeing around 1.7 arcseconds. Note that the > elevation is only 33 degrees. We are having to reach pretty > far over to get the end of the other strip when the first one > finishes. Fortunately the spectrographs will be available soon > and in a couple more nights, the moon will be down all night > giving more options once we reach the end of the first SN strip. > Seeing improved steadily to around 1.4 arcseconds by frame 60. > Seeing pops back up to around 1.8 arcseconds at frame 120. > 11:55Z Twilight begins frame 195, lambda -125 (also start of ramp) > 12:06Z End of run, frame 217 > > 12:10Z Closing > > 12:50Z endNight rejoiced. > > > Partial Spectro Monthly Checkout: > --------------------------------- > While doing the supernova imaging, the portion of the > spectro monthly checkout which could be done with no signal > (biases and darks) was completed. All looked normal > > Spectro biases 34300-34324 > > Filename 02% 05% 10% 50% 90% 95% 98% > ------------------- ------ ------ ------ ------ ------ ------ ------ > sdR-b1-00034324.fit -5.7 -4.6 -2.7 2.2 7.5 8.9 10.8 > sdR-b1-00034324.fit -5.7 -4.6 -2.7 2.2 7.5 8.9 10.8 > sdR-b2-00034324.fit -8.7 -7.2 -4.8 0.7 7.3 9.7 11.3 > sdR-b2-00034324.fit -8.7 -7.2 -4.8 0.7 7.3 9.7 11.3 > sdR-r1-00034324.fit -7.5 -5.2 -4.0 1.4 6.4 8.6 10.4 > sdR-r1-00034324.fit -7.5 -5.2 -4.0 1.4 6.4 8.6 10.4 > sdR-r2-00034324.fit -7.6 -6.5 -4.5 0.8 6.5 8.1 9.5 > sdR-r2-00034324.fit -7.6 -6.5 -4.5 0.8 6.5 8.1 9.5 > > Spectro darks 34325-34327 > > Filename 02% 05% 10% 50% 90% 95% 98% > ------------------- ------ ------ ------ ------ ------ ------ ------ > sdR-b1-00034327.fit -3.1 -0.9 0.3 6.8 12.4 14.7 17.0 > sdR-b1-00034327.fit -3.1 -0.9 0.3 6.8 12.4 14.7 17.0 > sdR-b2-00034327.fit -5.0 -2.9 -1.0 5.6 12.9 14.8 17.4 > sdR-b2-00034327.fit -5.0 -2.9 -1.0 5.6 12.9 14.8 17.4 > sdR-r1-00034327.fit -4.9 -2.6 -1.4 4.6 11.2 12.6 15.6 > sdR-r1-00034327.fit -4.9 -2.6 -1.4 4.6 11.2 12.6 15.6 > sdR-r2-00034327.fit -5.2 -3.9 -1.9 4.1 10.1 12.1 14.8 > sdR-r2-00034327.fit -5.2 -3.9 -1.9 4.1 10.1 12.1 14.8 > > Note that grabInst failed saying: > requestListen spectro: Neither 30310 nor 30307 appears to exist > > full traceback in problem section. > > ---=== IMAGING RUN SUMMARY ===--- > > Run Time Stripe Lambda Last Flavor Comments > Start End Begin End Frame > ------------------------------------------------------------------------- > 5778 21:42Z 22:52Z 100 O 69.99 87.55 52 ignore > 5779 00:14Z 00:29Z 100 O 108.24 111.98 39 bias > 5780 01:35Z 02:10Z 82 N 112.38 121.06 72 science id6 crash > 5781 02:19Z 09:59Z 82 N 118.80 -125.83 785 science > 5782 10:04Z 12:05Z 82 S -153.23 -122.81 217 science > > ---=== IMAGING RUN DETAILS ===--- > > ---=== SKIPPY RESULTS ===--- > > Run Frame nFrames stars muErr muRms nuErr nuRms rot az el > --------------------------------------------------------------------------- > 5780 14 4 2 114.200 0.000 13.500 0.000 -0.58426 208 54 > 5781 47 4 133 1.600 0.117 -0.800 0.140 -0.00391 215 52 > 5781 98 4 109 2.500 0.137 -1.100 0.124 -0.00338 215 52 > 5781 151 4 66 3.100 0.108 -1.200 0.117 -0.00315 215 52 > 5781 182 4 52 3.000 0.126 -1.500 0.129 -0.00329 215 52 > 5781 204 4 49 3.000 0.109 -1.600 0.120 -0.00344 215 52 > 5781 252 4 70 3.400 0.148 -1.800 0.139 -0.00310 215 52 > 5781 256 4 57 3.300 0.121 -1.900 0.121 -0.00364 215 52 > 5781 310 4 43 3.700 0.121 -2.100 0.113 -0.00326 215 52 > 5781 361 4 39 4.000 0.142 -2.300 0.134 -0.00412 215 52 > 5781 367 4 55 4.000 0.120 -2.300 0.100 -0.00418 215 52 > 5781 413 4 61 3.700 0.104 -2.500 0.121 -0.00335 215 52 > 5781 444 4 52 3.200 0.125 -2.600 0.120 -0.00321 215 52 > 5781 465 4 50 3.400 0.140 -2.500 0.137 -0.00379 215 52 > 5781 516 4 50 3.600 0.124 -2.700 0.125 -0.00334 215 52 > 5781 570 4 48 3.700 0.185 -2.700 0.124 -0.00277 215 52 > 5781 622 4 47 4.300 0.132 -2.400 0.120 -0.00304 215 52 > 5781 675 4 67 4.200 0.142 -2.800 0.118 -0.00319 215 52 > 5781 727 4 49 4.100 0.164 -2.600 0.134 -0.00309 215 52 > 5782 17 4 44 3.900 0.238 -4.300 0.144 -0.02027 245 33 > 5782 69 4 42 4.300 0.193 -4.600 0.138 -0.01957 245 33 > 5782 120 4 47 4.300 0.217 -5.000 0.271 -0.01977 245 33 > 5782 148 4 56 3.900 0.222 -5.000 0.196 -0.02101 245 33 > 5782 172 4 51 4.100 0.269 -5.300 0.214 -0.02106 245 33 > > ---=== LTMATCH RESULTS ===--- > > Run Field nFields alt az nGood rowMean rowSig colMean colSig rot > ------------------------------------------------------------------------ > 5781 57 1 52 325 61 -0.412 0.174 -0.080 0.312 0.00027 > 5781 57 1 52 325 72 -0.544 0.186 0.255 0.313 -0.00086 > 5781 57 1 52 325 60 -0.431 0.197 0.451 0.308 -0.00152 > 5781 57 1 52 325 57 -0.564 0.171 0.597 0.255 -0.00201 > 5781 57 1 52 325 68 -0.820 0.243 0.643 0.310 -0.00216 > 5781 75 1 52 325 58 -0.170 0.253 -0.288 0.359 0.00097 > 5781 75 1 52 325 60 -0.327 0.263 -0.246 0.355 0.00082 > 5781 75 1 52 325 65 -0.138 0.295 0.078 0.245 -0.00026 > 5781 75 1 52 325 61 -0.490 0.315 0.079 0.342 -0.00027 > 5781 75 1 52 325 47 -0.526 0.348 0.266 0.242 -0.00089 > 5781 110 1 52 325 44 -0.238 0.252 -0.302 0.333 0.00102 > 5781 110 1 52 325 44 -0.352 0.257 -0.081 0.296 0.00027 > 5781 110 1 52 325 46 -0.510 0.225 -0.013 0.369 0.00004 > 5781 110 1 52 325 34 -0.505 0.330 0.376 0.252 -0.00126 > 5781 110 1 52 325 39 -0.484 0.285 0.613 0.223 -0.00206 > 5781 127 1 52 325 39 0.318 0.273 -0.067 0.253 0.00022 > 5781 127 1 52 325 40 0.177 0.242 -0.233 0.226 0.00078 > 5781 127 1 52 325 47 0.110 0.198 -0.081 0.228 0.00027 > 5781 127 1 52 325 39 0.092 0.249 -0.072 0.207 0.00024 > 5781 127 1 52 325 36 -0.037 0.192 0.204 0.234 -0.00069 > 5781 162 1 52 325 28 -0.395 0.222 -0.114 0.489 0.00038 > 5781 162 1 52 325 36 -0.308 0.254 0.059 0.559 -0.00020 > 5781 162 1 52 325 23 -0.429 0.233 -0.039 0.454 0.00013 > 5781 162 1 52 325 31 -0.596 0.340 0.202 0.328 -0.00068 > 5781 162 1 52 325 32 -0.637 0.264 0.348 0.234 -0.00117 > 5781 180 1 52 325 33 -0.255 0.447 -0.667 0.357 0.00224 > 5781 180 1 52 325 33 -0.123 0.453 -0.551 0.461 0.00185 > 5781 180 1 52 325 36 -0.146 0.379 -0.162 0.390 0.00054 > 5781 180 1 52 325 33 -0.325 0.397 0.104 0.445 -0.00035 > 5781 180 1 52 325 30 -0.371 0.245 0.177 0.251 -0.00060 > 5781 215 1 52 325 24 -0.233 0.185 -0.356 0.223 0.00120 > 5781 215 1 52 325 34 -0.157 0.176 -0.126 0.152 0.00042 > 5781 215 1 52 325 29 -0.229 0.253 0.072 0.295 -0.00024 > 5781 215 1 52 325 32 -0.338 0.176 0.318 0.216 -0.00107 > 5781 215 1 52 325 20 -0.476 0.216 0.236 0.162 -0.00080 > 5781 232 1 52 325 28 0.753 0.126 -0.442 0.198 0.00149 > 5781 232 1 52 325 22 0.539 0.156 -0.365 0.346 0.00123 > 5781 232 1 52 325 18 0.524 0.150 0.017 0.245 -0.00006 > 5781 232 1 52 325 32 0.436 0.125 0.133 0.369 -0.00045 > 5781 232 1 52 325 26 0.354 0.148 0.155 0.220 -0.00052 > 5781 267 1 52 325 18 0.186 0.215 -0.182 0.182 0.00061 > 5781 267 1 52 325 22 0.023 0.154 0.024 0.183 -0.00008 > 5781 267 1 52 325 19 0.126 0.156 0.251 0.187 -0.00084 > 5781 267 1 52 325 14 -0.261 0.171 0.046 0.087 -0.00016 > 5781 267 1 52 325 22 -0.284 0.098 0.220 0.192 -0.00074 > 5781 284 1 52 325 25 0.088 0.145 0.034 0.265 -0.00011 > 5781 284 1 52 325 21 -0.076 0.152 0.105 0.272 -0.00035 > 5781 284 1 52 325 23 -0.075 0.185 0.394 0.293 -0.00132 > 5781 284 1 52 325 16 -0.405 0.216 0.512 0.370 -0.00172 > 5781 284 1 52 325 19 -0.587 0.276 0.600 0.302 -0.00202 > 5781 319 1 52 325 25 -0.191 0.211 -0.369 0.166 0.00124 > 5781 319 1 52 325 19 -0.150 0.135 -0.033 0.144 0.00011 > 5781 319 1 52 325 16 -0.066 0.261 0.129 0.252 -0.00043 > 5781 319 1 52 325 21 -0.355 0.139 0.011 0.171 -0.00004 > 5781 319 1 52 325 12 -0.296 0.094 0.235 0.203 -0.00079 > 5781 336 1 52 325 19 0.411 0.114 0.169 0.196 -0.00057 > 5781 336 1 52 325 15 0.324 0.093 0.327 0.207 -0.00110 > 5781 336 1 52 325 14 0.332 0.211 0.364 0.273 -0.00122 > 5781 336 1 52 325 16 0.100 0.113 0.496 0.156 -0.00167 > 5781 336 1 52 325 20 -0.029 0.175 0.361 0.278 -0.00121 > 5781 371 1 52 325 16 0.028 0.291 -0.124 0.163 0.00042 > 5781 371 1 52 325 12 0.061 0.233 0.060 0.134 -0.00020 > 5781 371 1 52 325 15 0.068 0.110 0.182 0.226 -0.00061 > 5781 371 1 52 325 17 0.035 0.126 0.570 0.113 -0.00192 > 5781 371 1 52 325 23 -0.128 0.219 0.623 0.128 -0.00210 > 5781 389 1 52 325 14 0.109 0.391 -0.504 0.135 0.00169 > 5781 389 1 52 325 17 -0.025 0.294 -0.463 0.102 0.00156 > 5781 389 1 52 325 13 -0.047 0.346 -0.351 0.222 0.00118 > 5781 389 1 52 325 16 -0.200 0.352 -0.117 0.286 0.00040 > 5781 389 1 52 325 14 -0.226 0.299 -0.039 0.236 0.00013 > 5781 423 1 52 325 18 0.151 0.247 -0.416 0.191 0.00140 > 5781 423 1 52 325 11 0.085 0.279 -0.200 0.187 0.00067 > 5781 423 1 52 325 18 0.065 0.329 0.067 0.278 -0.00022 > 5781 423 1 52 325 16 0.017 0.189 0.158 0.299 -0.00053 > 5781 423 1 52 325 9 -0.002 0.162 0.383 0.199 -0.00129 > 5781 441 1 52 325 12 -0.060 0.181 -0.251 0.133 0.00084 > 5781 441 1 52 325 14 -0.022 0.172 0.003 0.178 -0.00001 > 5781 441 1 52 325 18 -0.122 0.147 0.072 0.182 -0.00024 > 5781 441 1 52 325 15 -0.137 0.164 0.305 0.161 -0.00102 > 5781 441 1 52 325 24 -0.361 0.134 0.376 0.311 -0.00126 > 5781 476 1 52 325 15 -0.504 0.138 -0.623 0.186 0.00209 > 5781 476 1 52 325 16 -0.506 0.135 -0.336 0.143 0.00113 > 5781 476 1 52 325 14 -0.389 0.382 0.078 0.285 -0.00026 > 5781 476 1 52 325 5 -0.806 0.407 -0.001 0.256 0.00000 > 5781 476 1 52 325 12 -0.661 0.437 0.307 0.185 -0.00103 > 5781 493 1 52 325 13 0.446 0.205 0.321 0.334 -0.00108 > 5781 493 1 52 325 8 0.442 0.240 0.352 0.167 -0.00118 > 5781 493 1 52 325 8 0.099 0.139 0.651 0.220 -0.00219 > 5781 493 1 52 325 11 0.003 0.364 0.603 0.210 -0.00203 > 5781 493 1 52 325 16 -0.322 0.141 0.515 0.196 -0.00173 > 5781 528 1 52 325 15 -0.305 0.285 0.403 0.408 -0.00136 > 5781 528 1 52 325 15 -0.554 0.249 0.598 0.271 -0.00201 > 5781 528 1 52 325 7 -0.299 0.274 1.244 0.259 -0.00418 > 5781 528 1 52 325 7 -0.483 0.371 1.142 0.449 -0.00384 > 5781 528 1 52 325 11 -0.781 0.356 1.356 0.233 -0.00456 > 5781 545 1 52 325 11 -0.145 0.235 -0.686 0.233 0.00231 > 5781 545 1 52 325 10 0.050 0.233 -0.512 0.407 0.00172 > 5781 545 1 52 325 8 0.016 0.115 -0.146 0.330 0.00049 > 5781 545 1 52 325 14 -0.124 0.295 0.217 0.517 -0.00073 > 5781 545 1 52 325 12 -0.528 0.337 0.390 0.262 -0.00131 > 5781 580 1 52 325 10 0.209 0.342 -0.499 0.443 0.00168 > 5781 580 1 52 325 16 0.156 0.345 -0.438 0.333 0.00147 > 5781 580 1 52 325 11 0.408 0.475 -0.163 0.225 0.00055 > 5781 580 1 52 325 6 0.075 0.279 -0.203 0.129 0.00068 > 5781 580 1 52 325 13 -0.194 0.258 -0.058 0.155 0.00019 > 5781 598 1 52 325 14 0.532 0.236 -0.063 0.285 0.00021 > 5781 598 1 52 325 9 0.921 0.158 0.313 0.319 -0.00105 > 5781 598 1 52 325 17 0.667 0.179 0.472 0.202 -0.00159 > 5781 598 1 52 325 9 0.719 0.258 0.611 0.158 -0.00206 > 5781 598 1 52 325 14 0.734 0.299 0.759 0.114 -0.00255 > 5781 633 1 52 325 16 -0.710 0.180 -0.994 0.774 0.00334 > 5781 633 1 52 325 13 -0.806 0.318 -0.594 0.389 0.00200 > 5781 633 1 52 325 15 -0.562 0.243 -0.192 0.298 0.00065 > 5781 633 1 52 325 13 -0.745 0.387 0.038 0.365 -0.00013 > 5781 633 1 52 325 17 -0.521 0.244 0.126 0.377 -0.00042 > 5781 650 1 52 325 12 0.090 0.150 -0.381 0.165 0.00128 > 5781 650 1 52 325 17 -0.075 0.184 -0.239 0.181 0.00080 > 5781 650 1 52 325 12 0.363 0.227 0.419 0.237 -0.00141 > 5781 650 1 52 325 14 -0.103 0.261 0.077 0.177 -0.00026 > 5781 650 1 52 325 14 -0.090 0.292 0.314 0.170 -0.00105 > 5781 685 1 52 325 9 -0.270 0.346 -0.156 0.157 0.00052 > 5781 685 1 52 325 17 -0.205 0.349 0.001 0.228 -0.00000 > 5781 685 1 52 325 10 0.060 0.285 0.481 0.239 -0.00162 > 5781 685 1 52 325 12 0.437 2.687 -0.190 2.729 0.00064 > 5781 685 1 52 325 12 -0.443 0.273 0.612 0.352 -0.00206 > 5781 702 1 52 325 7 0.405 0.349 0.036 0.350 -0.00012 > 5781 702 1 52 325 9 0.136 0.541 -0.021 0.254 0.00007 > 5781 702 1 52 325 13 0.238 0.336 0.237 0.330 -0.00080 > 5781 702 1 52 325 4 0.014 0.489 0.015 0.270 -0.00005 > 5781 702 1 52 325 10 0.019 0.114 0.361 0.189 -0.00121 > 5781 737 1 52 325 15 -0.384 0.199 -0.296 0.159 0.00100 > 5781 737 1 52 325 18 -0.060 0.378 -0.257 0.236 0.00086 > 5781 737 1 52 325 14 -0.453 0.407 -0.270 0.252 0.00091 > 5781 737 1 52 325 9 -0.622 0.220 0.100 0.220 -0.00034 > 5781 737 1 52 325 13 -0.421 0.321 0.592 0.291 -0.00199 > 5781 754 1 52 325 8 0.404 0.574 -0.180 0.148 0.00060 > 5781 754 1 52 325 14 0.366 0.304 0.114 0.176 -0.00038 > 5781 754 1 52 325 13 0.467 0.274 0.294 0.268 -0.00099 > 5781 754 1 52 325 12 0.126 0.544 0.275 0.181 -0.00093 > 5781 754 1 52 325 23 0.111 0.408 0.641 0.261 -0.00215 > 5781 766 1 52 325 25 0.103 0.227 -0.188 0.198 0.00063 > 5781 766 1 52 325 18 0.045 0.275 0.094 0.218 -0.00032 > 5781 766 1 52 325 19 -0.208 0.368 0.024 0.300 -0.00008 > 5781 766 1 52 325 14 -0.266 0.395 0.175 0.306 -0.00059 > 5781 766 1 52 325 16 -0.363 0.303 0.068 0.326 -0.00023 > 5782 32 1 33 295 7 -1.130 0.239 0.823 0.227 -0.00277 > 5782 32 1 33 295 13 -0.673 0.165 0.944 0.241 -0.00317 > 5782 32 1 33 295 11 0.011 0.359 1.688 0.456 -0.00568 > 5782 32 1 33 295 5 0.438 0.305 2.129 0.437 -0.00716 > 5782 32 1 33 295 11 1.090 0.235 2.066 0.450 -0.00695 > > ---=== SPECTROSCOPY DATA SUMMARY ===--- > > Summary Checked (y/n): > QA Procedures Done (y/n): > > UT Exp Time flavor comment (S/N)^2 totals > ========================================== b1 r1 b2 r2 > ----- sequence 34294, plate -9999 ------- > 23:09 34294 0.0 bias > 23:42 34295 0.0 bias > 23:47 34296 0.0 bias > 00:07 34297 0.0 bias > ----- sequence 34298, plate -9999 ------- > 03:03 34298 0.0 bias spectro monthly checkout > 03:06 34299 0.0 bias biases and darks. > 03:09 34300 0.0 bias > 03:12 34301 0.0 bias > 03:15 34302 0.0 bias > 03:17 34303 0.0 bias > 03:19 34304 0.0 bias > 03:21 34305 0.0 bias > 03:27 34306 0.0 bias > 03:33 34307 0.0 bias > 03:36 34308 0.0 bias > 03:42 34309 0.0 bias > 03:44 34310 0.0 bias > 03:49 34311 0.0 bias > 04:05 34312 0.0 bias > 04:08 34313 0.0 bias > 04:11 34314 0.0 bias > 04:14 34315 0.0 bias > 04:17 34316 0.0 bias > 04:22 34317 0.0 bias > 04:30 34318 0.0 bias > 04:33 34319 0.0 bias > 04:35 34320 0.0 bias > 04:39 34321 0.0 bias > 04:41 34322 0.0 bias > 04:44 34323 0.0 bias > 04:46 34324 0.0 bias > 05:05 34325 0.0 dark > 05:25 34326 0.0 dark > 05:49 34327 0.0 dark > ----- sequence 34328, plate -9999 ------- > 06:28 34328 0.0 bias > > ---=== TELESCOPE OFFSETS AND SCALE I ===--- > > Time Instrument Az Alt Rot Scale > pos offset pos offset pos offset > ------------------------------------------------------------------------------ > 04:40Z imager -35.19 0.0000 51.92 0.0000 60.79 0.0000 1.000000 > > ---=== TELESCOPE OFFSETS AND SCALE II ===--- > > ---=== DATA TAPE SUMMARY ===--- > > Goes: JL > Stays: JL > > ---=== FOCUS LOG ===--- > > setmir piston Temp Wind > Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm > ------------------------------------------------------------------------------ > 02:23Z imager 1.00000 0 -217 -127 -35 51.9 6.4 10 29 23-i' 1.64 > 04:05Z imager 1.00000 0 -330 -240 -35 51.9 6.5 7 19 23-i' 1.20 > 05:17Z imager 1.00000 0 -311 -220 -35 51.9 6.6 8 2 23-i' 1.33 > 06:06Z imager 1.00000 0 -318 -228 -35 51.9 6.2 6 20 23-i' 1.23 > 07:09Z imager 1.00000 0 -299 -209 -35 51.9 5.3 1 331 23-i' 1.72 > 08:41Z imager 1.00000 0 -297 -206 -35 51.9 5.4 1 65 23-i' 1.65 > 09:30Z imager 1.00000 0 -293 -203 -35 51.9 4.5 6 2 23-i' 1.49 > 10:20Z imager 1.00000 0 -226 -204 295 33.2 5.4 8 352 23-i' 1.77 > 11:05Z imager 1.00000 0 -245 -224 295 33.2 5.4 8 357 23-i' 1.33 > 12:01Z imager 1.00000 0 -245 -223 295 33.2 5.6 5 0 23-i' 1.92 > > ---=== WEATHER LOG ===--- > > Wind > Time Temp F Dewp F MPH Direction Dust DIMM Sky > 21:31Z 46 32 4 261 (W) -9999 - Partly Cloudy > 22:03Z 49 33 12 270 (W) -9999 - Partly Cloudy > 22:34Z 47 31 6 284 (WNW) -9999 - Partly Cloudy > 23:07Z 45 31 7 323 (NW) -9999 - Mostly Clear > 23:47Z 45 30 12 327 (NNW) -9999 - Clear > 00:17Z 43 31 4 318 (NW) -9999 - Clear > 00:51Z 42 31 4 296 (WNW) -9999 - Clear > 01:22Z 42 31 8 355 (NNW) -9999 - Clear > 01:53Z 43 30 2 22 (NNE) -9999 - Clear > 02:23Z 43 28 10 13 (NNE) -9999 - Clear > 02:55Z 43 24 12 24 (NNE) -9999 - Clear > 03:27Z 43 23 7 2 (N) -9999 - Clear > 03:57Z 43 24 8 5 (N) -9999 - Clear > 04:27Z 43 25 6 49 (NE) -9999 - Clear > 04:58Z 43 25 7 10 (N) -9999 - Clear > 05:28Z 43 25 11 4 (N) -9999 - Clear > 05:59Z 42 26 4 3 (N) -9999 - Clear > 06:29Z 42 27 8 357 (NNW) -9999 - Clear > 07:00Z 42 27 3 1 (N) -9999 - Mostly Clear > 07:30Z 41 29 4 3 (N) -9999 - Mostly Clear > 08:02Z 40 30 6 349 (NNW) -9999 - Mostly Clear > 08:32Z 41 30 0 6 (N) -9999 - Mostly Clear > 09:02Z 41 30 4 14 (NNE) -9999 - Mostly Clear > 09:32Z 40 30 1 18 (NNE) -9999 - Mostly Clear > 10:05Z 41 29 7 351 (NNW) -9999 - Mostly Clear > 10:35Z 42 25 2 357 (NNW) -9999 - Mostly Clear > 11:06Z 41 29 5 343 (NNW) -9999 - Mostly Clear > 11:37Z 42 28 5 8 (N) -9999 - Mostly Clear > 12:10Z 41 26 8 0 (N) -9999 - Mostly Clear > 12:42Z 42 24 5 353 (NNW) -9999 - Mostly Clear > > ---=== TELESCOPE STATUS ===--- > > 23:15Z Door Open, Louvers Open, Fans On. > 00:15Z Doors Closed. > 00:35Z Enclosure Opened. > 12:25Z Enclosure Closed, Louvers Closed, Fans Off. > > Stowed at 30 deg alt, cartridge 5 installed. Spectro auto-fill connected. > Spectro dewar 11:00Z Dewar wt 90 lb > Imager dewar 11:00Z Dewar wt 208 lb > > No interlocks bypassed. > > ---=== SOFTWARE USED ===--- > > IOP/SOP: v4_6_0b > Watcher: v2_30_2 > MCP: v5_26_0 > TPM: tpm_v3_1_0 > AstroDa: v15_6 > TCC: TCC 2.7.2.1 August 6 2004 > sdssProcedures: > SoS: v4_10_7 > hoggPT: v1_6_9 > plate-mapper: v4_3_1 > > ---=== MIRROR NUMBERS ===--- > > PRIMARY: > -------- > Scale: 1.000000 > > MIGS TONIGHT NOMINAL > Axial A -5.8410 -5.8440 > Axial B -5.6840 -5.6770 > Axial C 0.9410 0.9420 > Trans D -9.9860 -9.9940 > Lateral E 10.3759 10.3759 > Lateral F 11.9507 11.9380 > > GALILS > Commanded: 4700. -2450. 3000. -7800. 3300. 3000. > Actual: 4700. -2450. 3000. -7800. 3300. 3000. > > SETMIR VALUES > PriDesOrient: 0.00 -1.68 7.05 385.25 92.02 > PriOrient: 0.00 -1.52 7.02 384.99 93.81 > > SECONDARY: > ---------- > Focus: 0.00 > Air Temp.: 9.2 > Alt.: 29.999425 > > MIGS TONIGHT NOMINAL > Axial A 1.5420 1.5420 > Axial B 1.0490 1.0470 > Axial C 1.1700 1.1650 > Trans D -0.1090 -0.1240 > > GALILS > Commanded: 1593450. 1604795. 1554307. -6800. -5900. > Actual: 1593450. 1603650. 1554300. -6800. -5900. > > SETMIR VALUES > SecDesOrient: 1257.00 15.87 0.00 -50.00 136.76 > SecOrient: 1257.30 16.14 0.30 -49.36 136.56 > > ---=== PROBLEMS IN DETAIL ===--- > > dsc E archTaskErr Archive task error: FTP connection is hung. > (dsc_E_archTaskErr Archive task error: FTP connection is hung. : 2005-10-26 > 21:48:31Z) > > > id6 crash: > ---------- > > > Status of id6 (for which the scrolling display stopped) > > sdssid6> i > > NAME ENTRY TID PRI STATUS PC SP ERRNO DELAY > ---------- ------------ -------- --- ---------- -------- -------- ------- ----- > tExcTask excTask 1dffcd80 0 PEND 210aa4 1dffcc60 3006b 0 > tLogTask logTask 1dffa1e0 0 PEND 210aa4 1dffa0d0 0 0 > tShell shell 1debf760 1 READY 209ca8 1debf320 8800dd 0 > tWdbTask wdbTask 1df25700 3 PEND 20434c 1df255d0 0 0 > tTimerTask timerTask 1df1e760 3 DELAY 2095cc 1df1e670 3d0002 1 > tcpLnkSrv tcpLnkSrv 1d5ffde0 3 PEND 20434c 1d5ffb50 3d0002 0 > dIntern inDataTsk 1c82c820 3 PEND 210aa4 1c82c510 0 0 > ntpd ntpd 1dd6f050 4 PEND+T 20434c 1dd6ecf0 3d0002 78 > tScsiTask scsiMgr 1dff7b90 5 PEND 20434c 1dff7a80 0 0 > dAssem assemTask 1c826a90 6 PEND 210aa4 1c826710 3d0002 0 > ntpTZenv usrTZenv 1dea4e60 8 PEND 20434c 1dea4d90 0 0 > dLine lineTask 1d4df570 8 PEND 210aa4 1d4ca160 3006b 0 > vciWatch1 vciWatchDog 1d4adde0 10 DELAY 2095cc 1d4adc00 0 3 > dArch archTsk 1c748a60 10 PEND+T 210aa4 1c7485d0 3d0004 389 > dSCD scdTask 1d552d60 12 PEND+T 210aa4 1d552b70 3d0004 887821 > dCLI cliTask 1d9ad420 16 PEND 210aa4 1d9ad320 0 0 > dTclShr cliTask 1d9a35c0 16 PEND 210aa4 1d9a34c0 3d0002 0 > tTelnetd telnetd 1df28e40 18 PEND 20434c 1df28cd0 360003 0 > tNetTask netTask 1dfb75c0 50 PEND 20434c 1dfb74d0 3d 0 > dTCClisten tccListen 1d5e7520 52 PEND+T 20434c 1d5e7050 3d0002 5960 > tPortmapd portmapd 1df2b9c0 54 PEND 20434c 1df2b760 3d0002 0 > tTelnetOut_telnetOutTas 1be2a240 55 READY 204198 1be29f10 0 0 > tTelnetIn_1telnetInTask 1be28040 55 PEND 20434c 1be27c40 0 0 > dCtrlSrv clntSvTsk 1d54dd20 60 PEND 20434c 1d54dc00 0 0 > dArchSrv clntSvTsk 1d50a0e0 62 PEND 20434c 1d509fc0 0 0 > dDataSrv clntSvTsk 1d530ed0 64 PEND 20434c 1d530db0 0 0 > tMurRouter mur_route_st 1deb50a0 70 PEND 210aa4 1deb4ac0 20 0 > dAnal frameTask 1c73e9e0 74 PEND 210aa4 1c73e760 22 0 > tTraceDump trcDmpTsk 1dd77df0 150 PEND 210aa4 1dd77c20 0 0 > dIdle idle 1ddac950 200 READY 1dee8668 1ddac8e0 0 0 > value = 0 = 0x0 > sdssid6> > > > > Status of id4 (which was still scrolling) > > sdssid4> task spawned: id = 0x1be30d30, name = t15157 > write filename archive:/data/photo/frames/53670/5780/4/idRR-005780-i4-0065.fit > i > > NAME ENTRY TID PRI STATUS PC SP ERRNO DELAY > ---------- ------------ -------- --- ---------- -------- -------- ------- ----- > tExcTask excTask 1dffcd80 0 PEND 210aa4 1dffcc60 3006b 0 > tLogTask logTask 1dffa1e0 0 PEND 210aa4 1dffa0d0 0 0 > tShell shell 1debf760 1 READY 209ca8 1debf320 8800dd 0 > tWdbTask wdbTask 1df25700 3 PEND 20434c 1df255d0 0 0 > tTimerTask timerTask 1df1e760 3 DELAY 2095cc 1df1e670 3d0002 1 > tcpLnkSrv tcpLnkSrv 1d5ffde0 3 PEND 20434c 1d5ffb50 3d0002 0 > dIntern inDataTsk 1c82c820 3 PEND 210aa4 1c82c510 0 0 > ntpd ntpd 1dd6f050 4 PEND+T 20434c 1dd6ecf0 3d0002 68 > tScsiTask scsiMgr 1dff7b90 5 PEND 20434c 1dff7a80 0 0 > dAssem assemTask 1c826a90 6 PEND 210aa4 1c826710 3d0002 0 > ntpTZenv usrTZenv 1dea4e60 8 PEND 20434c 1dea4d90 0 0 > dLine lineTask 1d4df570 8 PEND 210aa4 1d4ca160 3d0002 0 > vciWatch1 vciWatchDog 1d4adde0 10 DELAY 2095cc 1d4adc00 0 1 > dArch archTsk 1be447a0 10 DELAY 2095cc 1be44340 3d0001 68 > dSCD scdTask 1d552d60 12 PEND+T 210aa4 1d552b70 3d0004 898158 > dCLI cliTask 1d9ad420 16 PEND 210aa4 1d9ad320 0 0 > dTclShr cliTask 1d9a35c0 16 PEND 210aa4 1d9a34c0 3d0002 0 > tTelnetd telnetd 1df28e40 18 PEND 20434c 1df28cd0 360003 0 > tNetTask netTask 1dfb75c0 50 PEND 20434c 1dfb74d0 3d 0 > dTCClisten tccListen 1d5e7520 52 PEND+T 20434c 1d5e7050 3d0002 5915 > tPortmapd portmapd 1df2b9c0 54 PEND 20434c 1df2b760 3d0002 0 > tTelnetOut_telnetOutTas 1be3bc70 55 READY 204198 1be3b940 0 0 > tTelnetIn_1telnetInTask 1de06ce0 55 PEND 20434c 1de068e0 0 0 > dCtrlSrv clntSvTsk 1d54dd20 60 PEND 20434c 1d54dc00 0 0 > dArchSrv clntSvTsk 1d50a0e0 62 PEND 20434c 1d509fc0 0 0 > dDataSrv clntSvTsk 1d530ed0 64 PEND 20434c 1d530db0 0 0 > tMurRouter mur_route_st 1deb50a0 70 PEND 210aa4 1deb4ac0 20 0 > dAnal frameTask 1c75add0 74 PEND 210aa4 1c75ab50 22 0 > tTraceDump trcDmpTsk 1dd77df0 150 PEND 210aa4 1dd77c20 0 0 > dIdle idle 1ddac950 200 READY 1dee8668 1ddac8e0 0 0 > value = 0 = 0x0 > sdssid4> task spawned: id = 0x1be30d30, name = t15158 > write filename archive:/data/photo/frames/53670/5780/4/idRR-005780-u4-0067.fit > task spawned: id = 0x1be30d30, name = t15159 > write filename archive:/data/photo/frames/53670/5780/4/idRR-005780-z4-0069.fit > > > > grabInst Failure: PR 6704 > ------------------ > grabInstruments in sop is failing occasionally complaining that neither port > appears to exist. This type of grabInst failure has happened several times > since the installation of the new DA. I don't recall seeing this complaint > prior to the change to the new DA (at least not very often). The main, > imager, and spectro servers were up and running at the time, and were > successfully completing camchecks etc up until the time that grabInst was run. > Once grabInst was run, the main servers began complaining of ftelnet refused, > as they normally do when a relay server takes over. However, sop returns an > error message saying the relay server failed to start, and will not allow one > to take data with the spectrographs until the instruments are grabbed. The > traceback generated during the failure follows. > > sp1> grabInst -handlers 900 > IOP running as Backup Relay Server > ************************************************** > ====>>>>>>RELAY SERVER FAILED TO START!!!! ************************************************** > requestListen spectro: Neither 30310 nor 30307 appears to exist > ************************************************** > requestListen spectro: Neither 30310 nor 30307 appears to exist > requestListen spectro: Neither 30310 nor 30307 appears to exist > while executing > "error "requestListen $type: Neither $port1 nor $port2 appears to exist"" > invoked from within > "if {[lindex [getPortOwner $port1 "udp"] 0] != 0} {# It exists > set port $port1 > } elseif {[lindex [getPortOwner $port2 "udp"] 0] != 0} {# It exi ..." > invoked from within > "if {$port == ""} { > if $backup { > set port1 [relayPort $type] > set port2 [serverPort] > } else { > set port1 [serverPort] > set port2 [rela ..." > (procedure "requestListen" line 12) > invoked from within > "requestListen -[cameraType] 1" > invoked from within > "if 1 { > requestListen -[cameraType] 1; # tell server we're quitting > }" > invoked from within > "if {$drop || $stop_handlers} { > if 1 { > requestListen -[cameraType] 1; # tell server we're quitting > } > > if [info exists packeteerPort ..." > (procedure "grabInstruments" line 78) > invoked from within > "grabInstruments -drop" > invoked from within > "if {$serverFailedToStart} { > bell > puts "**************************************************" > puts "====>>>>>>RELAY SERVER FAILE ..." > invoked from within > "if {![info exists packeteerPort] && $dt > 0} { > set serverFailedToStart [catch { > startServer -backup -relay [cameraType] -listen 2 > } serverSt ..." > invoked from within > "if {$drop || $stop_handlers} { > if 1 { > requestListen -[cameraType] 1; # tell server we're quitting > } > > if [info exists packeteerPort ..." > (procedure "grabInstruments" line 78) > invoked from within > "grabInstruments -handlers 900 -reconnect" > ("eval" body line 1) > invoked from within > "eval $procname $args" > grabInstruments is scheduled, further errors sent to murmur > sp1> > > > > > > DSS DSS DSS DSS DSS Digital Sky Survey DSS DSS DSS DSS DSS DSS > DSS *** The information posted to SDSS mailing lists is proprietary *** > DSS This is message 2656 in the sdss-25mlog archive, URL > DSS http://www.astro.princeton.edu:81/sdss-25mlog/msg.2656.html > DSS The index is at http://www.astro.princeton.edu:81/sdss-25mlog/INDEX.html > DSS To join/leave the list, go to > DSS http://www.astro.princeton.edu:81/cgi-bin/mailinglists.pl/show_subscription?list=sdss-25mlog > DSS To post a message, mail it to sdss-25mlog@astro.princeton.edu > DSS > DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS > > > > > DSS DSS DSS DSS DSS Digital Sky Survey DSS DSS DSS DSS DSS DSS > DSS *** The information posted to SDSS mailing lists is proprietary *** > DSS This is message 2657 in the sdss-25mlog archive, URL > DSS http://www.astro.princeton.edu:81/sdss-25mlog/msg.2657.html > DSS The index is at http://www.astro.princeton.edu:81/sdss-25mlog/INDEX.html > DSS To join/leave the list, go to > DSS http://www.astro.princeton.edu:81/cgi-bin/mailinglists.pl/show_subscription?list=sdss-25mlog > DSS To post a message, mail it to sdss-25mlog@astro.princeton.edu > DSS > DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS > > > > >