Date: Tue, 20 Feb 2007 16:34:04 -0600 From: John Hendry Subject: Re: MJDs 54148 and later are missing their fields data Greetings, This problem actually began on the previous MJD, 54147 as FNAL only received the 1st of the 2 runs, 6720 (not 6721). But once Fritz/Dan got frameCatcher working, all the back-logged MJDs have been un-stuck and look like they are now on disk on sdssfiles1. I will re-run the GAP processing beginning with MJD 54147 which should fill-in the voids at FNAL. Thanks, John On 02/20/2007 04:21 PM, John Hendry wrote: > Hi Dan, Fritz, > > It looks like the problem has been taken care of as sdssfiles1 > now has these missing fields: > > [sdssdp@sdssfiles1 data]$ ls -ld /data/photo/fields/5414[89]/* > /data/photo/fields/5415?/* > drwxr-xr-- 8 observer dss 4096 Feb 20 13:56 /data/photo/fields/54148/6722 > drwxr-xr-- 8 observer dss 4096 Feb 20 13:51 /data/photo/fields/54149/6723 > drwxr-xr-- 8 observer dss 4096 Feb 20 14:03 /data/photo/fields/54150/6724 > drwxr-xr-- 8 observer dss 4096 Feb 20 14:14 /data/photo/fields/54151/6725 > drwxr-xr-- 8 observer dss 4096 Feb 20 14:18 /data/photo/fields/54152/6726 > [sdssdp@sdssfiles1 data]$ > > > I agree there should be some sort of warning when the frameCatcher wont > restart due to the lock file. > > Thanks, > John > > On 02/20/2007 03:15 PM, Dan Long wrote: >> Hi John, >> >> Somehow the frameCatcher stopped running and did not restart via >> the cron job because the lock file was in place. Thanks to Fritz it >> is up and running again now and converting all the missing runs. >> >> Curiously there was no warning in the watcher on any of those three >> days. Does anyone know if there should have been? >> >> Cheers, >> >> Dan >> >> >>> Greetings, >>> >>> For some reason, there are zero fields files (not even their MJD >>> directories exist) for MJDs beginning with 54148. >>> >>> MJD 54148 >>> >>> The obs log reported problems with power so its understandable >>> to have problems. >>> http://www.astro.princeton.edu:81/sdss-25mlog/msg.3404.html >>> >>> A bias run 6722 38 fields was taken and so indicated >>> by the idDiskSummary-54148.par. >>> >>> However, there is ONLY its frames files on sdssfiles1.apo.nmsu.edu. >>> The MJD directory does not exist for fields: >>> >>> [sdssdp@sdssfiles1 data]$ ls /data/photo/frames/54148 >>> 6722 >>> [sdssdp@sdssfiles1 data]$ ls /data/photo/frames/54148/6722/ >>> 1 2 3 4 5 6 >>> [sdssdp@sdssfiles1 data]$ ls /data/photo/fields/54148/ >>> ls: /data/photo/fields/54148/: No such file or directory >>> [sdssdp@sdssfiles1 data]$ >>> >>> --- >>> >>> Upon looking into MJD 54148, also see there has not been ANY >>> new fields files generated for any of the new MJDs from >>> MJD 54148 and forward. >>> >>> As of right now, MJDs missing fields: 54148, 54149, 54150, 54151. >>> >>> [sdssdp@sdssfiles1 data]$ ls /data/photo/frames >>> 40587 54114 54117 54120 54123 54126 54135 54139 54142 >>> 54145 54148 54151 >>> 53661-bak 54115 54118 54121 54124 54127 54137 54140 54143 >>> 54146 54149 65442 >>> 54113 54116 54119 54122 54125 54134 54138 54141 54144 >>> 54147 54150 >>> [sdssdp@sdssfiles1 data]$ ls /data/photo/fields >>> 40587 54115 54118 54121 54124 54127 54137 54140 54143 54146 >>> 54113 54116 54119 54122 54125 54134 54138 54141 54144 54147 >>> 54114 54117 54120 54123 54126 54135 54139 54142 54145 65442 >>> [sdssdp@sdssfiles1 data]$ >>> >>> For each of these MJDs, their idDiskSummary and idReport files >>> indicate there was one bias run taken and this is reflected >>> in the existence of >>> sdsshost2:/data/photo/frames/$MJD/$RUN/$COL/idRR*.fit >>> >>> The missing photo fields runs include: >>> >>> 54148/6722 fields 0 thru 30 >>> 54149/6723 fields 0 thru 46 >>> 54150/6724 fields 0 thru 37 >>> 54151/6725 fields 0 thru 19 >>> >>> --- >>> John >>> >>> >>> >>> DSS DSS DSS DSS DSS Digital Sky Survey DSS DSS DSS DSS DSS DSS >>> DSS *** The information posted to SDSS mailing lists is proprietary *** >>> DSS This is message 1208 in the sdss-da archive, URL >>> DSS http://www.astro.princeton.edu:81/sdss-da/msg.1208.html >>> DSS The index is at >>> http://www.astro.princeton.edu:81/sdss-da/INDEX.html >>> DSS To join/leave the list, go to >>> DSS >>> http://www.astro.princeton.edu:81/cgi-bin/mailinglists.pl/show_subscription?list=sdss-da >>> >>> DSS To post a message, mail it to sdss-da@astro.princeton.edu >>> DSS >>> DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS >> >> >> DSS DSS DSS DSS DSS Digital Sky Survey DSS DSS DSS DSS DSS DSS >> DSS *** The information posted to SDSS mailing lists is proprietary *** >> DSS This is message 5894 in the sdss-obs archive, URL >> DSS http://www.astro.princeton.edu:81/sdss-obs/msg.5894.html >> DSS The index is at >> http://www.astro.princeton.edu:81/sdss-obs/INDEX.html >> DSS To join/leave the list, go to >> DSS >> http://www.astro.princeton.edu:81/cgi-bin/mailinglists.pl/show_subscription?list=sdss-obs >> >> DSS To post a message, mail it to sdss-obs@astro.princeton.edu >> DSS >> DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS > > DSS DSS DSS DSS DSS Digital Sky Survey DSS DSS DSS DSS DSS DSS > DSS *** The information posted to SDSS mailing lists is proprietary *** > DSS This is message 5895 in the sdss-obs archive, URL > DSS http://www.astro.princeton.edu:81/sdss-obs/msg.5895.html > DSS The index is at http://www.astro.princeton.edu:81/sdss-obs/INDEX.html > DSS To join/leave the list, go to > DSS > http://www.astro.princeton.edu:81/cgi-bin/mailinglists.pl/show_subscription?list=sdss-obs > > DSS To post a message, mail it to sdss-obs@astro.princeton.edu > DSS > DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS DSS