xmltv/filter/augment augment.conf, NONE, 1.1 augment.rules, NONE, 1.1
Geoff <[email protected]> Sun, 12 Jul 2015 16:46:11 +0000
| Newsgroups | gmane.comp.tv.xmltv.cvs |
|---|---|
| Message-ID | <[email protected]> |
Update of /cvsroot/xmltv/xmltv/filter/augment
In directory sfp-cvs-1.v30.ch3.sourceforge.com:/tmp/cvs-serv3144/augment
Added Files:
augment.conf augment.rules
Log Message:
Augment XMLTV programme listings files via automatic and user-defined rules
--- NEW FILE: augment.conf ---
#
# Sample configuration file for tv_augment
#
# $Id: augment.conf,v 1.1 2015/07/12 16:46:09 bilbo_uk Exp $
#
# This file controls which augmentation rules are applied to the input XMLTV file
#
#
# It also controls what reporting is printed in the program's output log file.
#
# Set an option to 1 to enable it, 0 to disable.
#
# If specified, then this language code will be written to e.g. <credit> elements
language_code = en
# Set the following values to have XMLTV::Augment automatically fetch a file
# from the grabber's repository using XMLTV::Supplement
use_supplement = 0
supplement_grabber_name = tv_grab_uk_rt
supplement_grabber_file = prog_titles_to_process
###############################################################################
#
# RULES
# =====
#
# The option called 'enable_all_options' is a 'super-option' to quickly turn
# on or off ALL automatic and user rules. If this is set then ALL individual
# options are ignored.
#
enable_all_options = 0
# AUTOMATIC RULES
# ===============
#
# The rules are pre-determined and use no user-defined data.
#
# To enable a rule set it 1, to disable set it to 0.
#
# Note: if the 'enable_all_options' is set to 1 then the following lines
# will be ignored (i.e. they will be run as if they were set to 1).
#
# Rule #A1 - Remove "New $title :" from <sub-title>.
remove_duplicated_new_title_in_ep = 1
# Rule #A2 - Remove duplicated programme title *and* episode from <sub-title>.
remove_duplicated_title_and_ep_in_ep = 1
# Rule #A3 - Remove duplicated programme title from <sub-title>.
remove_duplicated_title_in_ep = 1
# Rule #A4 -
update_premiere_repeat_flags_from_desc = 1
# Rule #A5 - Check for potential series, episode and part numbering in the title, episode and description fields.
check_potential_numbering_in_text = 1
# Rule #A5.1 - Extract series/episode numbering found in <title>.
# (requires #A5 enabled)
# may generate false matches so use this only if your data needs it
extract_numbering_from_title = 0
# Rule #A5.2 - Extract series/episode numbering found in <sub-title>.
# (requires #A5 enabled))
# may generate false matches so use this only if your data needs it
extract_numbering_from_episode = 0
# Rule #A5.3 - Extract series/episode numbering found in <desc>.
# (requires #A5 enabled)
extract_numbering_from_desc = 1
# Rule #A6 - If no <sub-title> then make one from "part" numbers.
make_episode_from_part_numbers = 1
# USER RULES
# ==========
#
# These rules use data contained within the 'fixup' rules file to control their action.
#
# You could disable a rule simply by not having any entries in the rules file,
# but this provides a convenient way to switch on/off any particular rule.
#
# The corollary is, to action an particular rule type, you must have some
# relevant rules of the type in the rules file, *and* you must enable the
# option below (or enable the 'all' option above)
#
# Note: if the 'enable_all_options' is set to 1 then the following lines
# will be ignored (i.e. they will be run as if they were set to 1).
#
# Rule #user - Process programme against user-defined fixups
# If you disable this option (by setting to 0) then none of the user rules
# will be actioned (irrespective of whether you have them set to 1 or 0)
#
process_user_rules = 1
# Rule #1 - Remove specified non-title text from <title>.
process_non_title_info = 1
# Rule #2 - Extract sub-title from <title>.
process_mixed_title_subtitle = 1
# Rule #3 - Extract sub-title from <title>.
process_mixed_subtitle_title = 1
# Rule #4 - Reverse <title> and <sub-title>
process_reversed_title_subtitle = 1
# Rule #5 - Replace <title> with supplied text.
process_replacement_titles = 1
# Rule #6 - Replace <category> with supplied text.
process_replacement_genres = 1
# Rule #7 - Replace <sub-title> with supplied text.
process_replacement_episodes = 1
# Rule #8 - Replace specified <title> / <sub-title> with title/episode pair supplied.
process_replacement_titles_episodes = 1
# Rule #9 - Replace <sub-title> with supplied text when the <desc> matches that given.
process_replacement_ep_from_desc = 1
# Rule #10 - Replace specified <title> / <sub-title> with title/episode pair supplied using <desc>.
process_replacement_titles_desc = 1
# Rule #11 - Promote demoted title from <sub-title> to <title>.
process_demoted_titles = 1
# Rule #12 - Replace "Film"/"Films" <category> with supplied text.
process_replacement_film_genres = 1
# Rule #13 - Remove specified text from <sub-title> for a given <title>.
process_subtitle_remove_text = 1
# Rule #14 - Replace specified categories with another value
process_translate_genres = 1
--- NEW FILE: augment.rules ---
#
# Sample "rules" file for use with tv_augment
#
# $Id: augment.rules,v 1.1 2015/07/12 16:46:09 bilbo_uk Exp $
#
#
###############################################################################
#
# This file contains the rules used by XMLTV::Augment.
#
# The objective is to fix errors and inconsistencies in the incoming data from
# a grabber, and to enhance the programme xml where certain data are missing.
#
# For example:
# Some programme entries in the listings data may contain subtitle/episode
# information in the title field, others may contain the programme title
# and subtitle reversed, and yet more may contain 'episode' information that
# should be in the episode-num field.
#
# Rules are divided into a number of 'types' according to what they do.
# Individual types (rule sets) can be switched off in the augmentation config
# file.
#
# Matching is usually (but not exclusively) done by comparing the incoming
# <title> against the title specified in the rule below.
#
# A 'rule' definition consists of the rule 'type' separated rom the rule
# content by a pipe character ('|'). The rule content has a variable (but fixed
# for any given rule type) number of fields separated by tilde characters ('~')
#
# The action taken depends on the rule type:
#
# 1) non_title_info
# The content is text that is to be removed from any programme titles where
# this text occurs at the beginning of the <title> element followed by
# any of : ; or ,
# e.g.
# 1|Action Heroes Season
# "Action Heroes Season: Rambo" --> "Rambo"
#
# 2) mixed_title_subtitle
# The content is the desired title of a programme when the incoming title
# contains both the programme's title *and* episode separated by : ; or -
# ($title:$episode). We reassign the episode information to the <episode>
# element, leaving only the programme title in the <title> element.
# e.g.
# 2|Blackadder II
# "Blackadder II: Potato / " --> "Blackadder II / Potato"
#
# 3) mixed_subtitle_title
# The content is the desired title of a programme when the incoming title
# contains both the programme's episode *and* title separated by : ; or -
# ($episode:$title). We reassign the episode information to the <episode>
# element, leaving only the programme title in the <title> element.
# e.g.
# 3|Storyville
# "Kings of Pastry: Storyville / " --> "Storyville / Kings of Pastry"
#
# 4) reversed_title_subtitle
# The content is the desired title of a programme which is listed as the
# programme's episode (i.e. the title and episode details have been
# reversed). We therefore reverse the <title> and <episode> elements.
# e.g.
# 4|Storyville
# "Kings of Pastry / Storyville" --> "Storyville / Kings of Pastry"
#
# 5) replacement_titles
# The content contains two programme titles, separated by a
# tilde (~). The first title is replaced by the second in the listings
# output.
# This is useful to fix inconsistent naming (e.g. "Law and Order" vs.
# "Law & Order") or inconsistent grammar ("xxxx's" vs. "xxxxs'")
# e.g.
# 5|A Time Team Special~Time Team
# "A Time Team Special / Doncaster" --> "Time Team / Doncaster"
#
# 6) replacement_genres
# The content contains a programme title and a programme category(-ies)
# (genres), separated by tilde (~). Categories can be assigned to
# uncategorised programmes (which can be seen in the stats log).
# (Note that *all* categories are replaced for the title.)
# e.g.
# 6|Antiques Roadshow~Entertainment~Arts~Shopping
# "Antiques Roadshow / " category "Reality" -->
# "Antiques Roadshow / " category "Entertainment" + "Arts" + "Shopping"
#
# 7) replacement_episodes
# The content contains a programme title, an old episode value and a new
# episode value, separated by tildes (~).
# e.g.
# 7|Time Team~Time Team Special: Doncaster~Doncaster
# "Time Team / Time Team Special: Doncaster" --> "Time Team / Doncaster"
#
# 8) replacement_titles_episodes
# The content contains an old programme title, an old episode value, a new
# programme title and a new episode value. The old and new titles MUST be
# given, the episode fields can be left empty but the field itself must be
# present.
# e.g.
# 8|Top Gear USA Special~Detroit~Top Gear~USA Special
# "Top Gear USA Special / Detroit" --> "Top Gear / USA Special"
#
# 8|Top Gear USA Special~~Top Gear~USA Special
# "Top Gear USA Special / " --> "Top Gear / USA Special"
#
# 9) replacement_ep_from_desc
# The content contains a programme title, a new episode value to update,
# and a description (or at least the start of it) to match against. When
# title matches incoming data and the incoming description startswith the
# text given then the episode value will be replaced.
# e.g.
# 9|Heroes of Comedy~The Goons~The series celebrating great British
# comics pays tribute to the Goons.
# "Heroes of Comedy / " desc> = "The series celebrating great British
# comics pays tribute to the Goons."
# --> "Heroes of Comedy / The Goons"
# Should be used with care; e.g.
# "Heroes of Comedy / Spike Milligan" desc> = "The series celebrating
# great British comics pays tribute to the Goons."
# would *also* become
# "Heroes of Comedy / The Goons"
# this may not be what you want!
#
# 10) replacement_titles_desc
# The content contains an old programme title, an old episode value, a new
# programme title, a new episode value and the episode description (or at
# least the start of it) to match against.
# The old and new titles and description MUST be given, the episode fields
# can be left empty but the field itself must be present.
# This is useful to fix episodes where the series is unknown but can be
# pre-determined from the programme's description.
# e.g.
# 10|Which Doctor~~Gunsmoke~Which Doctor~Festus and Doc go fishing, but
# are captured by a family that is feuding with the Haggens.
# "Which Doctor / " desc> = "Festus and Doc go fishing, but are captured
# by a family that is feuding with the Haggens. [...]"
# --> "Gunsmoke / Which Doctor"
#
# 11) demoted_titles
# The content contains a programme 'brand' and a new title to be extracted
# from subtitle field and promoted to programme title, replacing the brand
# title.
# In other words, if title matches, and sub-title starts with text then
# remove the matching text from sub-title and move it into the title.
# Any text after 'separator' (any of .,:;-) in the sub-title is preserved.
# e.g.
# 11|Blackadder~Blackadder II
# "Blackadder / Blackadder II: Potato" --> "Blackadder II / Potato"
#
# 12) replacement_film_genres
# The content contains a film title and a category (genre) or categories,
# separated by a tilde (~).
# If title matches the rule's text and the prog has category "Film" or
# "Films", then use the replacement category(-ies) supplied.
# Use case: some film-related programmes are incorrectly flagged as films
# and should to be re-assigned to a more suitable category.
# (Note ALL categories are replaced, not just "Film")
# e.g.
# 12|The Hobbit Special~Entertainment~Interview
# "The Hobbit Special / " category "Film" + "Drama" -->
# "The Hobbit Special / " category "Entertainment" + "Interview"
#
# 13) subtitle_remove_text
# The content contains a programme title and arbitrary text to
# be removed from the start/end of the programme's subtitle. If the text to
# be removed precedes or follows a "separator" (any of .,:;-), the
# separator is removed also.
# e.g.
# 13|Time Team~A Time Team Special
# "Time Team / Doncaster : A Time Team Special" -->
# "Time Team / Doncaster"
#
# 14) process_replacement_genres
# The content contains a category (genre) value followed by replacement
# category(-ies) separated by a tilde (~).
# Use case: useful if your PVR doesn't understand some of the category
# values in the incoming data; you can translate them to another value.
# e.g.
# 14|Adventure/War~Action Adventure~War
# "The Guns of Navarone" category "Adventure/War" -->
# "The Guns of Navarone" category "Action Adventure" + "War"
#
#
###############################################################################
#
# Some sample rules follow; obviously you should delete these and replace with
# your own!
#
1|Action Heroes Season
1|Western Season
1|Python Night
2|Blackadder II
2|Comic Relief
2|Old Grey Whistle Test
3|Storyville
4|Storyville
4|Timewatch
5|A Time Team Special~Time Team
5|Cheaper By the Dozen~Cheaper by the Dozen
5|Later - with Jools Holland~Later... with Jools Holland
6|Antiques Roadshow~Entertainment~Arts~Shopping
6|Deal or No Deal~Game show
6|Men Behaving Badly~Sitcom
7|Time Team~Time Team Special: Doncaster~Doncaster
8|Top Gear USA Special~Detroit~Top Gear~USA Special
9|Heroes of Comedy~The Goons~The series celebrating great British comics pays tribute to the Goons.
10|Which Doctor~~Gunsmoke~Which Doctor~Festus and Doc go fishing, but are captured by a family that is feuding with the Haggens.
11|Blackadder~Blackadder II
11|Formula One~Live Formula One
11|Man on Earth~Man on Earth with Tony Robinson
12|The Hobbit Special~Entertainment~Interview
12|Hell on Wheels~Drama
13|Time Team~A Time Team Special
13|World's Busiest~World's Busiest
14|Adventure/War~Action Adventure~War
14|Soccer~Football
14|NFL~American Football
#
# (the sample rules shown here are in sorted order but that is not necessary
# in your live file)
###############################################################################
------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/