Re: [xmltv-users] UK Atlas load/usage warning email

On Wed, 2016-05-11 at 15:38 -0500, Robert Eden wrote:
> The way I read the last email from Atlas is a single request can't cover 
> over 24 hours.  Having written a back-end server, I can understand why. 
> (it's a very big "in" close to get details)
> 
> The solution is to update the grabber to break up requests into smaller 
> chunks.....  4 hours, 12hours, etc.  It's not that the grabber is 
> requesting 7 days... it's that the grabber is requesting 7 days *in a 
> single call*

That was my guess/understanding too. FWIW I have changed my cronjob
from:
    tv_grab_uk_atlas --days 14 ... | mythfilldatabase ...
to
     for day in $(seq 0 10); do # One day at a time only, T&Cs, could do 14 days but lets not push things.
         tv_grab_uk_atlas --days 1 --offset $day ... | mythfilldatabase ...
     done

I hope that is sufficient, although there isn't really a way to tell it
seems until I get cut off regardless :-/.

It seems the grabber's --days causes it to grab from 00:00-23:00 of the
day in question, rather than from now-now+24h, so AFAICT there is not a
problem with skew over the loop missing bits, unless it runs over
midnight (my cron.daily runs in the AM so it really shouldn't).

I also considered $(seq 0 12 240) and --hours 12, but I wasn't so sure
it had the above property.

Ian.

------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j