Re: Concurency

"darvon4u" <[email protected]> Mon, 30 Jun 2003 13:40:33 -0000
Newsgroups gmane.network.ubh
Message-ID <[email protected]>
i've combined ubhdb and ubhasm in one script, and run it in a loop 
with a "sleep" period of like 15 minutes, and 3 instances of ubh to 
suck in the actual articles (all at the same time). there are a few 
issues that had to be resolved:
first off, in ubh there's a part that marks all the "processing" 
headers as unread (supposedly to kill dead articles). this is fine as 
long as you run ubhdb and ubh in serial, which is really bad for a 
daemon. what you do, is comment that part out (hey, those dead 
articles will still expire once they go out of scope on the news 
server). if you don't, it can mark back the articles that ubh is 
currently trying to download (so they'll be stepping on each other's 
toes). 
also, cron job is fine if you want to download only a bit of data at 
a time. if you want to continuously be downloading some newsgroups, 
i'd recommend putting the code into "main" proc and just looping it 
continuously (with some sleep period)

-Andrey

--- In [email protected], Guillaume Filion <jfilion@v...> wrote:
> I have a few ideas about concurrency and ubh:
> 1) Is is possible to run ubhdb while ubh is downloading articles 
and 
> not corrupt the database? If so it would be possible to run it as a 
> cron job a couple times a day, isn't it?
> 



------------------------ Yahoo! Groups Sponsor ---------------------~-->
Looking for the latest Free IT White Papers?
Visit SearchNetworking.com to access over 500 white papers.
Get instant access at SearchNetworking.com Today
http://us.click.yahoo.com/99UKOC/OLNGAA/fzPGAA/IHFolB/TM
---------------------------------------------------------------------~->

To unsubscribe from this group, send an email to:
[email protected]

 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/