CFP CLEF 2025 - Madrid - Deadlines 6 and 13 May 2025

--000000000000d1f2b206322d614a
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

*CLEF 2025 Conference and Labs of the Evaluation Forum*
*9-12 September 2025, Madrid, Spain*

CLEF 2025 is the 16th CLEF conference continuing the popular CLEF
campaigns which have run since 2000 contributing to the systematic
evaluation of information access systems, primarily through
experimentation on shared tasks.

The CLEF Conference addresses all aspects of Information Access in any
modality and language. The CLEF conference consists of presentation of
research papers and a series of workshops presenting the results of
lab-based comparative evaluation benchmarks.

*Good To Know*
-------------
The CLEF 2025 Conference welcomes papers in the Information Access
domain that describe rigorous
hypothesis testing regardless of whether the results are positive or
negative. Each submission is reviewed in two stages, see more details
here: https://clef2025.clef-initiative.eu

*Important Dates (AoE)*
-----------------------
6 May 2025: Abstract submission of Long, Short, Best of 2024 Labs Papers
13 May 2025: Full paper submission deadline (Long, Short, Best of 2024 Labs=
)
10 June 2025: Notification of acceptance (Long, Short, Best of Labs)
23 June 2025: Camera-ready version due
9-12 September 2025: Conference

*Format*
-------
Authors are invited to electronically submit original papers, which have
not been published and are not under consideration elsewhere, using the
LNCS proceedings format.

Two categories of papers will be accepted:

   - Long papers: 12 pages plus references
   - Short papers: 6 pages plus references


*Topics*
---------
Relevant topics for the CLEF 2025 Conference include but are not limited to=
:

   - Information access in any language or modality: information
retrieval, image
   retrieval, question answering, search interfaces and design,
infrastructures,
   etc.
   - Analytics for information retrieval: theoretical and practical results=
 in
   the analytics field that are specifically targeted for information acces=
s
   data analysis, data enrichment, etc.
   - Reproducibility and replicability issues: analyses of past
results/run deep
   analysis both statistically and fine grain based.
   - Language diversity: work on low-resource languages.
   - Models leveraging collaborative and social data and their evaluation.
   - User studies either based on lab studies or crowdsourcing.
   - Evaluation initiatives: conclusions, lessons learned, impact and
projection
   of any evaluation initiative after completing their cycle.
   - Evaluation: methodologies, metrics, statistical and analytical
tools, component
   based, user groups and use cases, ground-truth creation, impact of
   multilingual/multicultural/multimodal differences, etc.
   - Technology transfer: economic impact/sustainability of information acc=
ess
   approaches, deployment and exploitation of systems, use cases, etc.
   - Interactive and Conversational Information Retrieval evaluation:
the interactive/conversational
   evaluation of information retrieval systems using user-centered methods,
   evaluation of novel search interfaces, novel interactive/conversational
   evaluation methods, simulation of interaction/conversation, etc.
   - Specific application domains: information access and its
evaluation in application
   domains such as cultural heritage, digital libraries, social media,
   health information, legal documents, patents, news, books, and in the
   form of text, audio and/or image data.
   - New data collection: presentation of new data collections with potenti=
al
   high impact on future research, specific collections from companies or
   labs, multilingual collections.


More details at https://clef2025.clef-initiative.eu

----------



*Dr Alba Garc=C3=ADa Seco de Herrera*

*Distinguished researcher*

Escuela T=C3=A9cnica Superior de Ingenier=C3=ADa Inform=C3=A1tica

########################################################################

To unsubscribe from the IR list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=3DIR&A=3D1

This message was issued to members of www.jiscmail.ac.uk/IR, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/

--000000000000d1f2b206322d614a
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_quote gmail_quote_container"><div dir=
=3D"ltr" class=3D"gmail_attr"><br></div><div dir=3D"ltr"><b><font size=3D"4=
"><span style=3D"color:rgb(33,33,33);font-family:Arial">CLEF 2025 Conferenc=
e and Labs of the Evaluation Forum</span></font></b><div><b><font size=3D"4=
"><span style=3D"color:rgb(33,33,33);font-family:Arial">9-12 September<span=
>=C2=A0</span></span><span style=3D"color:rgb(33,33,33);font-family:Arial">=
2025, Madrid, Spain</span></font></b><br style=3D"color:rgb(33,33,33);font-=
family:Arial;font-size:14.6667px"><br style=3D"color:rgb(33,33,33);font-fam=
ily:Arial;font-size:14.6667px"><span style=3D"color:rgb(33,33,33);font-fami=
ly:Arial">CLEF 2025 is the 16th CLEF conference continuing the popular CLEF=
<span>=C2=A0</span></span><br style=3D"color:rgb(33,33,33);font-family:Aria=
l"><span style=3D"color:rgb(33,33,33);font-family:Arial">campaigns which ha=
ve run since 2000 contributing to the systematic<span>=C2=A0</span></span><=
br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb=
(33,33,33);font-family:Arial">evaluation of information access systems, pri=
marily through<span>=C2=A0</span></span><br style=3D"color:rgb(33,33,33);fo=
nt-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">expe=
rimentation on shared tasks.</span><br style=3D"color:rgb(33,33,33);font-fa=
mily:Arial"><br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=
=3D"color:rgb(33,33,33);font-family:Arial">The CLEF Conference addresses al=
l aspects of Information Access in any<span>=C2=A0</span></span><br style=
=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb(33,33,3=
3);font-family:Arial">modality and language. The CLEF conference consists o=
f presentation of<span>=C2=A0</span></span><br style=3D"color:rgb(33,33,33)=
;font-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">r=
esearch papers and a series of workshops presenting the results of<span>=C2=
=A0</span></span><br style=3D"color:rgb(33,33,33);font-family:Arial"><span =
style=3D"color:rgb(33,33,33);font-family:Arial">lab-based comparative evalu=
ation benchmarks.</span><br style=3D"color:rgb(33,33,33);font-family:Arial"=
><br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:r=
gb(33,33,33);font-family:Arial"><b>Good To Know</b></span><br style=3D"colo=
r:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-=
family:Arial">-------------</span><br style=3D"color:rgb(33,33,33);font-fam=
ily:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">The CLEF 2=
025 Conference welcomes papers in the Information Access<span>=C2=A0</span>=
</span><br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"c=
olor:rgb(33,33,33);font-family:Arial">domain that describe rigorous</span><=
br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb=
(33,33,33);font-family:Arial">hypothesis testing regardless of whether the =
results are positive or<span>=C2=A0</span></span><br style=3D"color:rgb(33,=
33,33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Ar=
ial">negative. Each submission is reviewed in two stages, see more details<=
span>=C2=A0</span></span><br style=3D"color:rgb(33,33,33);font-family:Arial=
"><span style=3D"color:rgb(33,33,33);font-family:Arial">here:<span>=C2=A0</=
span></span><a href=3D"https://clef2025.clef-initiative.eu" title=3D"https:=
//clef2025.clef-initiative.eu" style=3D"color:rgb(0,120,215);font-family:Ar=
ial" target=3D"_blank">https://clef2025.clef-initiative.eu</a><br style=3D"=
color:rgb(33,33,33);font-family:Arial"><br style=3D"color:rgb(33,33,33);fon=
t-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial"><b>Im=
portant Dates (AoE)</b></span><br style=3D"color:rgb(33,33,33);font-family:=
Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">--------------=
---------</span><br style=3D"color:rgb(33,33,33);font-family:Arial"><span s=
tyle=3D"color:rgb(33,33,33);font-family:Arial">6 May 2025: Abstract submiss=
ion of Long, Short, Best of 2024 Labs Papers</span><br style=3D"color:rgb(3=
3,33,33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:=
Arial">13 May 2025: Full paper submission deadline (Long, Short, Best of 20=
24 Labs)</span><br style=3D"color:rgb(33,33,33);font-family:Arial"><span st=
yle=3D"color:rgb(33,33,33);font-family:Arial">10 June 2025: Notification of=
 acceptance (Long, Short, Best of Labs)</span><br style=3D"color:rgb(33,33,=
33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial=
">23 June 2025: Camera-ready version due</span><br style=3D"color:rgb(33,33=
,33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Aria=
l">9-12 September 2025: Conference</span><br style=3D"color:rgb(33,33,33);f=
ont-family:Arial"><br style=3D"color:rgb(33,33,33);font-family:Arial"><span=
 style=3D"color:rgb(33,33,33);font-family:Arial"><b>Format</b></span><br st=
yle=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb(33,3=
3,33);font-family:Arial">-------</span><br style=3D"color:rgb(33,33,33);fon=
t-family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">Autho=
rs are invited to electronically submit original papers, which have<span>=
=C2=A0</span></span><br style=3D"color:rgb(33,33,33);font-family:Arial"><sp=
an style=3D"color:rgb(33,33,33);font-family:Arial">not been published and a=
re not under consideration elsewhere, using the<span>=C2=A0</span></span><b=
r style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb(=
33,33,33);font-family:Arial">LNCS proceedings format.</span><br style=3D"co=
lor:rgb(33,33,33);font-family:Arial"><br style=3D"color:rgb(33,33,33);font-=
family:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial">Two cat=
egories of papers will be accepted:</span><br style=3D"color:rgb(33,33,33);=
font-family:Arial"><ul><li><span style=3D"color:rgb(33,33,33);font-family:A=
rial">Long papers: 12 pages plus references</span></li><li>Short papers: 6 =
pages plus references</li></ul><br style=3D"color:rgb(33,33,33);font-family=
:Arial"><span style=3D"color:rgb(33,33,33);font-family:Arial"><b>Topics</b>=
</span><br style=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"c=
olor:rgb(33,33,33);font-family:Arial">---------</span><br style=3D"color:rg=
b(33,33,33);font-family:Arial"><span style=3D"color:rgb(33,33,33);font-fami=
ly:Arial">Relevant topics for the CLEF 2025 Conference include but are not =
limited to:</span><br style=3D"color:rgb(33,33,33);font-family:Arial"><ul><=
li><span style=3D"color:rgb(33,33,33);font-family:Arial">Information access=
 in any language or modality: information retrieval,<span>=C2=A0</span></sp=
an>image retrieval, question answering, search interfaces and design,<span =
style=3D"color:rgb(33,33,33);font-family:Arial">=C2=A0</span>infrastructure=
s, etc.</li><li><span style=3D"color:rgb(33,33,33);font-family:Arial">Analy=
tics for information retrieval: theoretical and practical results=C2=A0</sp=
an>in the analytics field that are specifically targeted for information<sp=
an style=3D"color:rgb(33,33,33);font-family:Arial">=C2=A0</span>access data=
 analysis, data enrichment, etc.</li><li><span style=3D"color:rgb(33,33,33)=
;font-family:Arial">Reproducibility and replicability issues: analyses of p=
ast results/run<span>=C2=A0</span></span>deep analysis both statistically a=
nd fine grain based.</li><li><span style=3D"color:rgb(33,33,33);font-family=
:Arial">Language diversity: work on low-resource languages.</span></li><li>=
<span style=3D"color:rgb(33,33,33);font-family:Arial">Models leveraging col=
laborative and social data and their evaluation.</span></li><li><span style=
=3D"color:rgb(33,33,33);font-family:Arial">User studies either based on lab=
 studies or crowdsourcing.</span></li><li><span style=3D"color:rgb(33,33,33=
);font-family:Arial">Evaluation initiatives: conclusions, lessons learned, =
impact and<span>=C2=A0</span></span>projection of any evaluation initiative=
 after completing their cycle.</li><li><span style=3D"color:rgb(33,33,33);f=
ont-family:Arial">Evaluation: methodologies, metrics, statistical and analy=
tical tools,<span>=C2=A0</span></span>component based, user groups and use =
cases, ground-truth creation,<span style=3D"color:rgb(33,33,33);font-family=
:Arial">=C2=A0</span>impact of multilingual/multicultural/multimodal differ=
ences, etc.</li><li><span style=3D"color:rgb(33,33,33);font-family:Arial">T=
echnology transfer: economic impact/sustainability of information<span>=C2=
=A0</span></span>access approaches, deployment and exploitation of systems,=
 use cases, etc.</li><li><span style=3D"color:rgb(33,33,33);font-family:Ari=
al">Interactive and Conversational Information Retrieval evaluation: the<sp=
an>=C2=A0</span></span>interactive/conversational evaluation of information=
 retrieval systems<span style=3D"color:rgb(33,33,33);font-family:Arial">=C2=
=A0</span>using user-centered methods, evaluation of novel search interface=
s,<span style=3D"color:rgb(33,33,33);font-family:Arial">=C2=A0</span>novel =
interactive/conversational evaluation methods, simulation of<span style=3D"=
color:rgb(33,33,33);font-family:Arial">=C2=A0</span>interaction/conversatio=
n, etc.</li><li><span style=3D"color:rgb(33,33,33);font-family:Arial">Speci=
fic application domains: information access and its evaluation in=C2=A0</sp=
an>application domains such as cultural heritage, digital libraries, social=
<span style=3D"color:rgb(33,33,33);font-family:Arial">=C2=A0</span>media, h=
ealth information, legal documents, patents, news, books, and in<span style=
=3D"color:rgb(33,33,33);font-family:Arial">=C2=A0</span>the form of text, a=
udio and/or image data.</li><li><span style=3D"color:rgb(33,33,33);font-fam=
ily:Arial">New data collection: presentation of new data collections with<s=
pan>=C2=A0</span></span>potential high impact on future research, specific =
collections from<span style=3D"color:rgb(33,33,33);font-family:Arial">=C2=
=A0</span>companies or labs, multilingual collections.</li></ul><br style=
=3D"color:rgb(33,33,33);font-family:Arial"><span style=3D"color:rgb(33,33,3=
3);font-family:Arial">More details at<span>=C2=A0</span></span><a href=3D"h=
ttps://clef2025.clef-initiative.eu" title=3D"https://clef2025.clef-initiati=
ve.eu" style=3D"color:rgb(0,120,215);font-family:Arial" target=3D"_blank">h=
ttps://clef2025.clef-initiative.eu</a></div><div><br></div><div><span style=
=3D"color:rgb(33,33,33);font-family:Arial;font-size:14.6667px">----------</=
span></div><div><p class=3D"MsoNormal" style=3D"margin:0cm;font-family:Apto=
s,sans-serif"><span lang=3D"ES" style=3D"font-family:Arial,sans-serif">=C2=
=A0</span></p>

<p class=3D"MsoNormal" style=3D"margin:0cm 0cm 8pt;line-height:115%;font-fa=
mily:Aptos,sans-serif"><b><span style=3D"line-height:115%;font-family:&quot=
;Arial Black&quot;,sans-serif;color:rgb(0,83,63)">Dr Alba Garc=C3=ADa Seco =
de Herrera</span></b></p>

<p class=3D"MsoNormal" style=3D"margin:0cm 0cm 8pt;line-height:115%;font-fa=
mily:Aptos,sans-serif"><b><i><span style=3D"line-height:115%;font-family:Ar=
ial,sans-serif;color:black">Distinguished researcher</span></i></b></p>

<p class=3D"MsoNormal" style=3D"margin:0cm 0cm 8pt;line-height:115%;font-fa=
mily:Aptos,sans-serif"><span style=3D"line-height:115%;font-family:Arial,sa=
ns-serif;color:black">Escuela T=C3=A9cnica Superior de Ingenier=C3=ADa
Inform=C3=A1tica</span></p><span style=3D"font-size:12pt;font-family:Aptos,=
sans-serif">
<br>
</span></div></div>
</div></div>
<br>
<hr>
<p align=3D"center">To unsubscribe from the IR list, click the following link:<br>
<a href=3D"https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=3DIR&A=3D1" target=3D"_blank">https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=3DIR&A=3D1</a>
</p>

--000000000000d1f2b206322d614a--