Re: uk_atlas: Minor Issues

On 20 Dec 2013 08:46, <[email protected]> wrote:
>
> On Thu, 19 Dec 2013 18:59:57 +0000, John Bergqvist wrote:
> >
> > Hi Geoff, i've been advised by Nick Morrott to contact you, over some
> > small bugs i've found within the atlas XMLTV grabber (in my case, i'm
> > using it to populate the MythTV EPG via mythfilldatabase).
>
> Hi, Thanks for your feedback.
>
> > I understand that it's still work in progress.
>
> Well it's complete in the sense I have been using it pretty much unchanged for the past 3 months.  The "in progress" parts are enhancements rather than bug fixes, primarily to improve consistency with the other grabbers in the Project, and also to make it easier for people to use with MythTV.
>
>
> > Anyway, here are a few things i've noticed (I'm using Freeview, in the
> > West Region):
> >
> > Firstly, the Travel Channel (cbfK) does't get automatically added to
> > the .xmltv config file that's created, when Freeview is used.
>
> Seems this channel isn't available on the Atlas database. It's not in the list of channels they supply. I suggest you post to their Google group asking for it.

The channel IS available in the atlas database, it's under cbkF in the
channels.conf file for Atlas. However, when the grabber's configure
command (I believe) is run, where it prompts you to pick a platform
and region, then prompts you to choose which channels you'd like to
add, the Travel Channel isn't in that list of channels it asks you to
pick from, for Freeview at least, therefore it doesn't get added to
the .XMLTV file, which mythtv reads from when filling the epg
database.



> > Secondly, a couple of other channels are incorrect. God TV (god.tv)
> > gets added to the .xmltv file by default yet it's no longer part of
> > the Freeview Lineup.
>
> Unlike the uk_rt grabber, this one does not have a manually maintained lists of channels - you get whatever is specified on Atlas.  This way you automatically get any new channels as soon as Atlas add them.  The corollary is if they don't remove one then you still get it in the xml feed.
>
> However, according to the Freeview site, God TV is available on the Freeview platform as a streamed channel (channel 235).

The Official Freeview site is never as up-to-date as third party
websites, use this instead for example:
http://www.a516digital.com/search/label/Freeview%20Updates

According to it's own website, God TV has been replaced by CHRISTIAN,
channel 228, it's an interactive channel though now.


> > Thirdly, Smooth Radio's xml id has been mis-spelt as smmothradio.com
> > instead of smoothradio.com
>
> Thanks! Typo fixed.
>
>
> > None of the programs on the HD channels get flagged up as being in HD
> > from within the guide data
>
> Not sure what you are looking at here.
>
> Atlas don't mark individual programmes as HD or SD and it's not in their data stream.  Nor is it in the source data used by the Radio Times grabber.
>
> I suspect the Radio Times grabber just assumes that anything on an HD channel is broadcast in HD (!)  Which may not be true of course.
>
> I don't think a grabber should be inventing data where none exist, so if it's not in the source data then you don't get it. Your PVR software can then make it's own decision about whether to assume a programme is HD or not.

Well I know Nick, for the Radio Times grabber had to manually mark
content on the HD channels as HD, as he was able to create quick
simulcasts of the 6  BBC HD channels when they launched for example.
By the nature of the channel, everything is broadcast in
high-definition, at 1920x1080 resolution (whether upscaled or not, but
that would still lead to an increase in picture quality even if it was
upscaled). Given as mythtv doesn't have support for "guessing" whether
the channel is in HD based on the name, I feel that this should be
done on the grabber's side, at least where MythTV is concerned (I
can't speak for other software that uses XMLTV i'm afraid. I saw no
issues with how it was implemented on the Radio Times grabber.


>
>
> > The program genres still come through into the mythconverg database as
> > all in lower-case for some reason.
>
> They leave me in mixed case so this must be a MythTV issue (i.e. outside of my control).
>
> For example here's a film from uk_atlas:
>
>   <programme start="20131220154500 +0000" stop="20131220183500 +0000" channel="filmfour.channel4.com">
>     <title lang="en">Tora! Tora! Tora!</title>
>     <desc lang="en">Fact-based Second World War drama recounting the bombing of Pearl Harbour from both the Japanese and American perspectives, reconstructing the events leading up to the devastating attack on the US naval base in 1941. Starring Martin Balsam, So Yamamura, Joseph Cotten, James Whitmore and Jason Robards.</desc>
>     <credits>
>       <director>Richard Fleischer</director>
>       <actor role="Admiral Husband E Kimmel">Martin Balsam</actor>
>       <actor role="Henry L Stimson">Joseph Cotten</actor>
>       <actor role="Admiral Isoroku Yamamoto">So Yamamura</actor>
>       <actor role="Admiral William F Halsey">James Whitmore</actor>
>       <actor role="Gen Walter C Short">Jason Robards</actor>
>       <actor role="Cdr Minoru Genda">Tatsuya Mihashi</actor>
>       <actor role="Lt Col Rufus S Bratton">EG Marshall</actor>
>       <actor role="Admiral Chuichi Nagumo">Eijiro Tono</actor>
>     </credits>
>     <date>1970</date>
>     <category lang="en">Films</category>
>     <category lang="en">War</category>
>     <episode-num system="brand.series.episode">..ch989</episode-num>
>     <rating system="GB">
>       <value>U</value>
>     </rating>
>   </programme>
>
> and here's the same film from uk_rt:
>
>   <programme start="20131220154500 +0000" stop="20131220183500 +0000" channel="filmfour.channel4.com">
>     <title>Tora! Tora! Tora!</title>
>     <desc lang="en">Fact-based Second World War drama recounting the bombing of Pearl Harbour from both the Japanese and American perspectives, reconstructing the events leading up to the devastating attack on the US naval base in 1941. Starring Martin Balsam, So Yamamura, Joseph Cotten, James Whitmore and Jason Robards.</desc>
>     <credits>
>       <director>Richard Fleischer</director>
>       <actor>Martin Balsam</actor>
>       <actor>Joseph Cotten</actor>
>       <actor>So Yamamura</actor>
>       <actor>James Whitmore</actor>
>       <actor>Jason Robards</actor>
>       <actor>Tatsuya Mihashi</actor>
>       <actor>EG Marshall</actor>
>       <actor>Eijiro Tono</actor>
>     </credits>
>     <date>1970</date>
>     <category lang="en">Film</category>
>     <video>
>       <quality>SDTV</quality>
>     </video>
>     <subtitles type="teletext" />
>   </programme>
>
>
> You can see in both cases that the categories are the correct case.
>

Looks like it's a mythtv thing then. It's odd though that the genres
that get added to the EPG via EIT, over the air, have their cases
correct though.


>
>
> > Finally, I get a few programs with this come up, when I run
> > mythfilldatabase at least:
> >
> > "2013-12-19 17:37:02.028086 E  FillData: XMLTV grabber returned error code 1
> > 2013-12-19 17:37:02.110146 W  Invalid programme (Weather), identical
> > start and end times, skipping
> >[...]
>
> Yes that's the way the data are held in Atlas.  They say this is what the Press Association (the original data provider) do when they mean it's a "follow-on" programme.
>
> So they give the news as say 18:00 - 18:30 and the weather as 18:30 - 18:30, i.e. zero duration plus overlapping end times!  I don't know how to sensibly handle these yet (Atlas won't change their data) so at the moment I just pass through what they send.  (Radio Times grabber just drops these zero duration programmes).
>
>
>
> > Anyway, apart from that it's working fine, except I feel the atlas
> > genres are a bit inconsistent, or too specific heh, but I don't know
> > whether that's your problem or not. See the end of this thread:
> > https://groups.google.com/forum/#!topic/atlasapi/7N7zeLO36Ss
>
> Yes I've asked Atlas if they will look at the genres they allocate but I've not had any success with getting them to change them.
>
> You are seeing the problem now because the RT grabber only had one genre per programme and that was a "top-level" genre.  My Atlas grabber can have an unlimited number of genres per programme and you are getting a much finer grained set passed through from the Atlas database.

That's it.
It seems that for some programs (for example, the top genre for both
the Poirot ones was Drama, the 2nd level was Mystery, and the 3rd
level was Detective/Thriller, yet both parts had different levels
passed as the genre) the top level genre gets through, and for other
programs, the lower get passed through instead.

>
> There's a list of the top-level ones on Atlas's site so you could if you wanted simply ignore any of the sub-genres when you import the XML file. (Although you would need to write code to do this yourself when you import into Myth).
>
> If there are specific genres you don't like you can customise your own copy of uk_atlas and "map" them to some other value(s).  The 'tv_grab_uk_atlas.user.map.conf'  file (in your supplement directory) has instructions on how to do this.


I've just noticed a " tv_grab_uk_atlas.pa.genres.conf" which I presume
lists all possible PA genres a show could have. I'll experiment with
building up a map.conf file from that and see how it goes.
>
>
> Thanks again for your feedback,
> Geoff
>
>
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT
> organizations don't have a clear picture of how application performance
> affects their revenue. With AppDynamics, you get 100% visibility into your
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
> _______________________________________________
> xmltv-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/xmltv-users

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk