A reference Web dataset for learning to rank using click-through data
Alvaro R Pereira Jr <alvaro-qr4C/[email protected]> Wed, 21 May 2008 08:20:47 -0300 (BRT)
| Newsgroups | gmane.comp.information-retrieval.webir |
|---|---|
| Message-ID | <[email protected]> |
--vFlx24DNzjqelflhBKfI2fbiTbQUfLADYoCosH-
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Title: A reference Web dataset for learning to rank using click-through data --
help with relevance assessment
Learning to rank is a very important research field in Web search where machine
learning techniques are employed to improve the ranking of results returned by
search systems. One of the best ways of learning to rank is by observing users
behaviors, which requires usage data. The lack of a publicly available dataset
containing click-through data makes researches in this topic (when using
click-through data) limited to industrial research groups.
TodoCL is a horizontal search engine which covers the Chilean Web, running
since April 2000. As a contribution for science, the company will make
available for research a series of data for the most intensive period of use of
the search engine. The dataset includes:
- Documents: two Web pages collections, crawled in August 2003 and
January 2004, respectively. Most of the Web pages are in Spanish.
- Structure: internal in-links and out-links.
- Usage data: query requests and click-through data for a span of 12
months, from August 2003 to July 2004.
- Relevance data for results of a sample of the real queries.
For composing the relevance data we have prepared a relevance assessment
experiment. We are looking for people to help with the relevance assessment
task, which consists on judging whether Web pages are relevant for an
associated query.
More information about the relevance assessment may be found here:
http://grupoweb.upf.es/~cmiddlet/todocl_assessment/
Our prevision is to make the data available on demand by August 2008. Probably
there will be a fee to fund the management of the dataset, but we will offer
the dataset for free to all the assessors who collaborate in the relevance
experiment.
Please, enter the relevance assessment page referred above to register for a
set of queries to assess. Your contribution is very important. Note that you
need to understand Spanish. In case you do not understand and want to
collaborate and have the dataset for free, tell a friend to participate by
forwarding this message, and let us know who is the person later.
Thank you in advance for any help.
Ricardo Baeza-Yates, Christian Middleton and Alvaro Pereira.
Web Research Group - grupoweb.upf.es
Universitat Pompeu Fabra, Barcelona, Spain
More information about the Chilean dataset:
The collections and query logs are provided by the Chilean search engine
TodoCL. For composing the collections, the complete list of the Chilean Web
primary domains were used to start the crawling, guaranteeing that a set of
pages under every Chilean domain (.cl) was crawled once the crawls were pruned
by depth. Domains outside the Chilean primary domain were only crawled if their
IP address was from a Chilean IP provider. This data set has already been
successfully used for research [2, 1, 3, 8, 5, 7, 6, 4].
Two document collections will be provided. The 2003 collection was crawled in
August 2003, and has 3.11 million documents, whereas the 2004 collection was
crawled in January 2004, containing 3.13 million documents. Among other
attributes, the collections have the text of the documents, their titles and
URLs, their link structure, and duplication information. The HTML of the pages
does not exist. We will provide an API to access all the data.
The query log span is 12 months, from August 2003 to July 2004. It contains
query requests and click-through data, with identification of sessions, time
stamp and (anonymous) host names for every entry. In order to guarantee
privacy, we will exclude queries performed only a few times. The query log has
approximately 10 million query requests and 1.7 million clicks.
We intend to provide an automatic translation for the Web pages into English,
which may be useful when the users do not understand Spanish, as well as a
human translation of the queries used in the relevance assessment.
[1] R. Baeza-Yates, A. Pereira, and N. Ziviani. Understanding content reuse on
the web: Static and dynamic analyses. In Advances in Web Mining and Web Usage
Analysis, O. Nasraoui, M. Spiliopoulou, J. Srivastava, B. Mobasher, and B.
Masand, editors, volume 4811 of LNCS/LNAI, pages 227--246. Springer, 2007.
[2] R. Baeza-Yates, A. Pereira, and N. Ziviani. Genealogical trees on the Web:
a search engine user perspective. In 17th International World Wide Web
Conference, pages 367--376, Beijing, China, April 2008.
[3] R. Baeza-Yates and B. Poblete. Dynamics of the chilean web structure.
Computer Networks, 50(10):1464--1473, 2006.
[4] Ricardo Baeza-Yates, Felipe Saint-Jean, and Carlos Castillo. Web structure,
age and page quality. In Proceedings of String Processing and Information
Retrieval Conference (SPIRE), pages 117--130, Lisbon, Portugal, 2002. Springer
LNCS.
[5] Ricardo A. Baeza-Yates, Liliana Calderon-Benavides, and Cristina N.
Gonzalez-Caro. The intention behind web queries. In Proceedings of String
Processing and Information Retrieval Conference (SPIRE), pages 98--109,
Glasgow, UK, 2006.
[6] Ricardo A. Baeza-Yates, Carlos A. Hurtado, and Marcelo Mendoza. Query
clustering for boosting web page ranking. In Second International Atlantic Web
Intelligence Conference, pages 164--175, Cancun, Mexico, 2004.
[7] Georges Dupret and Marcelo Mendoza. Recommending better queries from
click-through data. In Proceedings of String Processing and Information
Retrieval Conference (SPIRE), pages 41--44, Buenos Aires, Argentina, 2005.
[8] Georges Dupret and Marcelo Mendoza. Automatic query recommendation using
click-through data. In Professional Practice in Artificial Intelligence, pages
303--312, Santiago, Chile, 2006.
--vFlx24DNzjqelflhBKfI2fbiTbQUfLADYoCosH-
Content-Type: text/html; charset=US-ASCII
Content-Transfer-Encoding: 7bit
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
</head>
<body style="background-color: #ffffff;">
<!--~-|**|PrettyHtmlStartT|**|-~-->
<div id="ygrp-mlmsg" style="width:655px; position:relative;">
<div id="ygrp-msg" style="width: 470px; margin:0; padding:0 25px 0 0; float:left; z-index:1;">
<!--~-|**|PrettyHtmlEndT|**|-~-->
<div id="ygrp-text">
<p>Title: A reference Web dataset for learning to rank using click-through data -- <br>
help with relevance assessment<br>
<br>
Learning to rank is a very important research field in Web search where machine <br>
learning techniques are employed to improve the ranking of results returned by <br>
search systems. One of the best ways of learning to rank is by observing users <br>
behaviors, which requires usage data. The lack of a publicly available dataset <br>
containing click-through data makes researches in this topic (when using <br>
click-through data) limited to industrial research groups.<br>
<br>
TodoCL is a horizontal search engine which covers the Chilean Web, running <br>
since April 2000. As a contribution for science, the company will make <br>
available for research a series of data for the most intensive period of use of <br>
the search engine. The dataset includes:<br>
<br>
- Documents: two Web pages collections, crawled in August 2003 and<br>
January 2004, respectively. Most of the Web pages are in Spanish.<br>
<br>
- Structure: internal in-links and out-links.<br>
<br>
- Usage data: query requests and click-through data for a span of 12<br>
months, from August 2003 to July 2004.<br>
<br>
- Relevance data for results of a sample of the real queries.<br>
<br>
For composing the relevance data we have prepared a relevance assessment <br>
experiment. We are looking for people to help with the relevance assessment <br>
task, which consists on judging whether Web pages are relevant for an <br>
associated query.<br>
<br>
More information about the relevance assessment may be found here:<br>
<br>
<a href="http://grupoweb.upf.es/~cmiddlet/todocl_assessment/">http://grupoweb.<wbr>upf.es/~cmiddlet<wbr>/todocl_assessme<wbr>nt/</a><br>
<br>
Our prevision is to make the data available on demand by August 2008. Probably <br>
there will be a fee to fund the management of the dataset, but we will offer <br>
the dataset for free to all the assessors who collaborate in the relevance <br>
experiment.<br>
<br>
Please, enter the relevance assessment page referred above to register for a <br>
set of queries to assess. Your contribution is very important. Note that you <br>
need to understand Spanish. In case you do not understand and want to <br>
collaborate and have the dataset for free, tell a friend to participate by <br>
forwarding this message, and let us know who is the person later.<br>
<br>
Thank you in advance for any help.<br>
<br>
Ricardo Baeza-Yates, Christian Middleton and Alvaro Pereira.<br>
Web Research Group - grupoweb.upf.<wbr>es<br>
Universitat Pompeu Fabra, Barcelona, Spain<br>
<br>
More information about the Chilean dataset:<br>
<br>
The collections and query logs are provided by the Chilean search engine <br>
TodoCL. For composing the collections, the complete list of the Chilean Web <br>
primary domains were used to start the crawling, guaranteeing that a set of <br>
pages under every Chilean domain (.cl) was crawled once the crawls were pruned <br>
by depth. Domains outside the Chilean primary domain were only crawled if their <br>
IP address was from a Chilean IP provider. This data set has already been <br>
successfully used for research [2, 1, 3, 8, 5, 7, 6, 4].<br>
<br>
Two document collections will be provided. The 2003 collection was crawled in <br>
August 2003, and has 3.11 million documents, whereas the 2004 collection was <br>
crawled in January 2004, containing 3.13 million documents. Among other <br>
attributes, the collections have the text of the documents, their titles and <br>
URLs, their link structure, and duplication information. The HTML of the pages <br>
does not exist. We will provide an API to access all the data.<br>
<br>
The query log span is 12 months, from August 2003 to July 2004. It contains <br>
query requests and click-through data, with identification of sessions, time <br>
stamp and (anonymous) host names for every entry. In order to guarantee <br>
privacy, we will exclude queries performed only a few times. The query log has <br>
approximately 10 million query requests and 1.7 million clicks.<br>
<br>
We intend to provide an automatic translation for the Web pages into English, <br>
which may be useful when the users do not understand Spanish, as well as a <br>
human translation of the queries used in the relevance assessment.<br>
<br>
[1] R. Baeza-Yates, A. Pereira, and N. Ziviani. Understanding content reuse on <br>
the web: Static and dynamic analyses. In Advances in Web Mining and Web Usage <br>
Analysis, O. Nasraoui, M. Spiliopoulou, J. Srivastava, B. Mobasher, and B. <br>
Masand, editors, volume 4811 of LNCS/LNAI, pages 227--246. Springer, 2007.<br>
<br>
[2] R. Baeza-Yates, A. Pereira, and N. Ziviani. Genealogical trees on the Web: <br>
a search engine user perspective. In 17th International World Wide Web <br>
Conference, pages 367--376, Beijing, China, April 2008.<br>
<br>
[3] R. Baeza-Yates and B. Poblete. Dynamics of the chilean web structure. <br>
Computer Networks, 50(10):1464-<wbr>-1473, 2006.<br>
<br>
[4] Ricardo Baeza-Yates, Felipe Saint-Jean, and Carlos Castillo. Web structure, <br>
age and page quality. In Proceedings of String Processing and Information <br>
Retrieval Conference (SPIRE), pages 117--130, Lisbon, Portugal, 2002. Springer <br>
LNCS.<br>
<br>
[5] Ricardo A. Baeza-Yates, Liliana Calderon-Benavides, and Cristina N. <br>
Gonzalez-Caro. The intention behind web queries. In Proceedings of String <br>
Processing and Information Retrieval Conference (SPIRE), pages 98--109, <br>
Glasgow, UK, 2006.<br>
<br>
[6] Ricardo A. Baeza-Yates, Carlos A. Hurtado, and Marcelo Mendoza. Query <br>
clustering for boosting web page ranking. In Second International Atlantic Web <br>
Intelligence Conference, pages 164--175, Cancun, Mexico, 2004.<br>
<br>
[7] Georges Dupret and Marcelo Mendoza. Recommending better queries from <br>
click-through data. In Proceedings of String Processing and Information <br>
Retrieval Conference (SPIRE), pages 41--44, Buenos Aires, Argentina, 2005.<br>
<br>
[8] Georges Dupret and Marcelo Mendoza. Automatic query recommendation using <br>
click-through data. In Professional Practice in Artificial Intelligence, pages <br>
303--312, Santiago, Chile, 2006.<br>
<br>
</p>
</div>
<!--~-|**|PrettyHtmlStart|**|-~-->
<span width="1" style="color: white;">__._,_.___</span>
<!-- Start the section with Message In topic -->
<div id="ygrp-actbar">
<span class="left">
<a href="http://groups.yahoo.com/group/webir/message/2515;_ylc=X3oDMTM0cjdtMnRiBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BG1zZ0lkAzI1MTUEc2VjA2Z0cgRzbGsDdnRwYwRzdGltZQMxMjExMzczNDAyBHRwY0lkAzI1MTU-">
Messages in this topic </a> (<span class="bld">1</span>)
</span>
<a href="http://groups.yahoo.com/group/webir/post;_ylc=X3oDMTJwcXF0bDhvBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BG1zZ0lkAzI1MTUEc2VjA2Z0cgRzbGsDcnBseQRzdGltZQMxMjExMzczNDAy?act=reply&messageNum=2515">
<span class="bld">
Reply </span> (via web post)
</a> |
<a href="http://groups.yahoo.com/group/webir/post;_ylc=X3oDMTJla3YyOWE3BF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTIxMTM3MzQwMg--" class="bld">
Start a new topic </a>
</div>
<!------- Start Nav Bar ------>
<!-- |**|begin egp html banner|**| -->
<div id="ygrp-vitnav">
<a href="http://groups.yahoo.com/group/webir/messages;_ylc=X3oDMTJlaDJ0YjVrBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwNmdHIEc2xrA21zZ3MEc3RpbWUDMTIxMTM3MzQwMg--">Messages</a>
</div>
<!-- |**|end egp html banner|**| -->
<div id="ygrp-grft">
</div>
<!-- yahoo logo -->
<!-- |**|begin egp html banner|**| -->
<div id="ygrp-ft">
<a href="http://groups.yahoo.com/;_ylc=X3oDMTJkcDBuZDhlBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwNmdHIEc2xrA2dmcARzdGltZQMxMjExMzczNDAy">
<img src="http://us.i1.yimg.com/us.yimg.com/i/yg/img/logo/ma_grp_160.gif" height="15" width="106" border="0" alt="Yahoo! Groups"></a> <br>
<a href="http://groups.yahoo.com/group/webir/join;_ylc=X3oDMTJmN2Nrc2t2BF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwNmdHIEc2xrA3N0bmdzBHN0aW1lAzEyMTEzNzM0MDI-">Change settings via the Web</a> (Yahoo! ID required) <br>
Change settings via email: <a href="mailto:[email protected]?subject=Email Delivery: Digest">Switch delivery to Daily Digest</a> | <a href = "mailto:[email protected]?subject=Change Delivery Format: Traditional">Switch format to Traditional</a> <br>
<a href="http://groups.yahoo.com/group/webir;_ylc=X3oDMTJkYzFuajBtBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwNmdHIEc2xrA2hwZgRzdGltZQMxMjExMzczNDAy">
Visit Your Group
</a> |
<a href="http://docs.yahoo.com/info/terms/">
Yahoo! Groups Terms of Use </a> |
<a href="mailto:[email protected]?subject=">
Unsubscribe </a>
</div> <!-- |**|end egp html banner|**| -->
</div> <!-- ygrp-msg -->
<!-- Sponsor -->
<!-- |**|begin egp html banner|**| -->
<div id="ygrp-sponsor" style="width:160px; float:right; clear:none; margin:0 0 25px 0; background:white;">
<!-- Network content -->
<!-- Start Recommendations -->
<div id="ygrp-reco">
</div>
<!-- End Recommendations -->
<!-- Start vitality -->
<div id="ygrp-vital">
<div id="vithd">Recent Activity</div>
<ul style="list-style-type:none; padding: 0; margin: 2px 0;">
<li style="clear: both;">
<div class="ct" style="float: right;"><span style="display:none"> </span>2</div>
<div class="cat"><a href="http://groups.yahoo.com/group/webir/members;_ylc=X3oDMTJmaXY2NXUxBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwN2dGwEc2xrA3ZtYnJzBHN0aW1lAzEyMTEzNzM0MDI-">New Members</a></div>
</li>
</ul>
<a href="http://groups.yahoo.com/group/webir;_ylc=X3oDMTJlazA1YXVzBF9TAzk3MzU5NzE0BGdycElkAzEyMzQ1ODUEZ3Jwc3BJZAMxNzA1MDgzMjA2BHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTIxMTM3MzQwMg--">
Visit Your Group </a>
</div>
<!-- Network content -->
<div id="nc">
<div class="ad">
<div id="hd1">Y! Groups blog</div>
<p><a href="http://us.ard.yahoo.com/SIG=13o6ujfv8/M=493064.12016258.12582637.8674578/D=groups/S=1705083206:NC/Y=YAHOO/EXP=1211380602/L=/B=hhDHAELaX94-/J=1211373402677238/A=5191955/R=0/SIG=112mhte3e/*http://www.ygroupsblog.com/blog/">the best source</a></p>
<p>for the latest</p>
<p>scoop on Groups.</p> </div>
<div class="ad">
<div id="hd1">Give Things.</div>
<p><a href="http://us.ard.yahoo.com/SIG=13ovd6vg7/M=493064.12016272.12948931.8674578/D=groups/S=1705083206:NC/Y=YAHOO/EXP=1211380602/L=/B=hxDHAELaX94-/J=1211373402677238/A=5327831/R=0/SIG=1129o14gc/*http://green.yahoo.com/earth-day">Get Things.</a></p>
<p>It's free and it's</p>
<p>good for the planet.</p> </div>
<div class="ad">
<div id="hd1">Discover Tips</div>
<p><a href="http://us.ard.yahoo.com/SIG=13ot3cg2i/M=493064.12662709.12980595.8674578/D=groups/S=1705083206:NC/Y=YAHOO/EXP=1211380602/L=/B=iBDHAELaX94-/J=1211373402677238/A=5349283/R=0/SIG=11ks6tatn/*http://advision.webevents.yahoo.com/HealthyLiving/">on healthy living</a></p>
<p>and healthy eating</p>
<p>on Yahoo! Groups.</p> </div>
</div>
</div> <!-- |**|end egp html banner|**| -->
<div style="clear:both; color: #FFF; font-size:1px;">.</div>
</div> <img src="http://geo.yahoo.com/serv?s=97359714/grpId=1234585/grpspId=1705083206/msgId=2515/stime=1211373402/nc1=5191955/nc2=5327831/nc3=5349283" width="1" height="1"> <br>
<span style="color: white;">__,_._,___</span>
<!--~-|**|PrettyHtmlEnd|**|-~-->
</body>
<!--~-|**|PrettyHtmlStart|**|-~-->
<head>
<style type="text/css">
<!--
#ygrp-mkp{
border: 1px solid #d8d8d8;
font-family: Arial;
margin: 14px 0px;
padding: 0px 14px;
}
#ygrp-mkp hr{
border: 1px solid #d8d8d8;
}
#ygrp-mkp #hd{
color: #628c2a;
font-size: 85%;
font-weight: bold;
line-height: 122%;
margin: 10px 0px;
}
#ygrp-mkp #ads{
margin-bottom: 10px;
}
#ygrp-mkp .ad{
padding: 0 0;
}
#ygrp-mkp .ad a{
color: #0000ff;
text-decoration: none;
}
-->
</style>
</head>
<head>
<style type="text/css">
<!--
#ygrp-sponsor #ygrp-lc{
font-family: Arial;
}
#ygrp-sponsor #ygrp-lc #hd{
margin: 10px 0px;
font-weight: bold;
font-size: 78%;
line-height: 122%;
}
#ygrp-sponsor #ygrp-lc .ad{
margin-bottom: 10px;
padding: 0 0;
}
-->
</style>
</head>
<head>
<style type="text/css">
<!--
#ygrp-mlmsg {font-size:13px; font-family: arial,helvetica,clean,sans-serif;*font-size:small;*font:x-small;}
#ygrp-mlmsg table {font-size:inherit;font:100%;}
#ygrp-mlmsg select, input, textarea {font:99% arial,helvetica,clean,sans-serif;}
#ygrp-mlmsg pre, code {font:115% monospace;*font-size:100%;}
#ygrp-mlmsg * {line-height:1.22em;}
#ygrp-text{
font-family: Georgia;
}
#ygrp-text p{
margin: 0 0 1em 0;
}
#ygrp-tpmsgs{
font-family: Arial;
clear: both;
}
#ygrp-vitnav{
padding-top: 10px;
font-family: Verdana;
font-size: 77%;
margin: 0;
}
#ygrp-vitnav a{
padding: 0 1px;
}
#ygrp-actbar{
clear: both;
margin: 25px 0;
white-space:nowrap;
color: #666;
text-align: right;
}
#ygrp-actbar .left{
float: left;
white-space:nowrap;
}
.bld{font-weight:bold;}
#ygrp-grft{
font-family: Verdana;
font-size: 77%;
padding: 15px 0;
}
#ygrp-ft{
font-family: verdana;
font-size: 77%;
border-top: 1px solid #666;
padding: 5px 0;
}
#ygrp-mlmsg #logo{
padding-bottom: 10px;
}
#ygrp-reco {
margin-bottom: 20px;
padding: 0px;
}
#ygrp-reco #reco-head {
font-weight: bold;
color: #ff7900;
}
#reco-grpname{
font-weight: bold;
margin-top: 10px;
}
#reco-category{
font-size: 77%;
}
#reco-desc{
font-size: 77%;
}
#ygrp-vital{
background-color: #e0ecee;
margin-bottom: 20px;
padding: 2px 0 8px 8px;
}
#ygrp-vital #vithd{
font-size: 77%;
font-family: Verdana;
font-weight: bold;
color: #333;
text-transform: uppercase;
}
#ygrp-vital ul{
padding: 0;
margin: 2px 0;
}
#ygrp-vital ul li{
list-style-type: none;
clear: both;
border: 1px solid #e0ecee;
}
#ygrp-vital ul li .ct{
font-weight: bold;
color: #ff7900;
float: right;
width: 2em;
text-align:right;
padding-right: .5em;
}
#ygrp-vital ul li .cat{
font-weight: bold;
}
#ygrp-vital a{
text-decoration: none;
}
#ygrp-vital a:hover{
text-decoration: underline;
}
#ygrp-sponsor #hd{
color: #999;
font-size: 77%;
}
#ygrp-sponsor #ov{
padding: 6px 13px;
background-color: #e0ecee;
margin-bottom: 20px;
}
#ygrp-sponsor #ov ul{
padding: 0 0 0 8px;
margin: 0;
}
#ygrp-sponsor #ov li{
list-style-type: square;
padding: 6px 0;
font-size: 77%;
}
#ygrp-sponsor #ov li a{
text-decoration: none;
font-size: 130%;
}
#ygrp-sponsor #nc{
background-color: #eee;
margin-bottom: 20px;
padding: 0 8px;
}
#ygrp-sponsor .ad{
padding: 8px 0;
}
#ygrp-sponsor .ad #hd1{
font-family: Arial;
font-weight: bold;
color: #628c2a;
font-size: 100%;
line-height: 122%;
}
#ygrp-sponsor .ad a{
text-decoration: none;
}
#ygrp-sponsor .ad a:hover{
text-decoration: underline;
}
#ygrp-sponsor .ad p{
margin: 0;
}
o{font-size: 0; }
.MsoNormal{
margin: 0 0 0 0;
}
#ygrp-text tt{
font-size: 120%;
}
blockquote{margin: 0 0 0 4px;}
.replbq{margin:4}
-->
</style>
</head>
<!--~-|**|PrettyHtmlEnd|**|-~-->
</html><!--End group email -->
--vFlx24DNzjqelflhBKfI2fbiTbQUfLADYoCosH---