Re: Introducing WISE: Semantic search for Common s (we’d love your feedback)

Vasanth Gopa via Wikimedia-l <[email protected]> Tue, 5 May 2026 10:27:09 +0200
Newsgroups gmane.org.wikimedia.foundation,gmane.science.linguistics.wikipedia.technical,gmane.org.wikimedia.india,gmane.org.wikimedia.wikidata,gmane.org.wikimedia.commons
Message-ID <CA+GrJMuYema0fFUkk8y_HdUtMaSAyDGBx6t3WJfcwn0KZJx-1w@mail.gmail.com>
--===============6504053300368958955==
Content-Type: multipart/alternative; boundary="000000000000594f0906510dd2a4"

--000000000000594f0906510dd2a4
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hello everyone,

Following up on the WISE <https://wise.wmcloud.org/> tool's announcement,
we wanted to briefly explain why we are seeking community interest and
support.

At the moment, WISE indexes only =E2=80=9CMedia of the Day=E2=80=9D (~5,000=
 videos).
Expanding this to cover the full Wikimedia Commons collection (millions of
images) requires significant computational resources, especially
large-scale GPU processing, along with storage and ongoing maintenance.

Before moving in that direction, we want to understand:

   - Is this tool useful for the community?
   - Should we invest effort and resources to scale it further?
   - Are there any concerns we should address first?

If you find WISE useful or promising, you can support or share feedback
here:
https://commons.wikimedia.org/wiki/Commons:Wise#Community_interest_and_supp=
ort

You can:

   - Add your support or comments on the page
   - Share use cases or ideas
   - Raise any concerns or suggestions

Your input will help guide whether and how we expand WISE further. Thanks
again for your time and feedback.

Wise Tool: https://wise.wmcloud.org/

Regards,
Gopa Vasanth

On Sun, May 3, 2026 at 2:09=E2=80=AFAM Vasanth Gopa <gopavasanth1999@gmail.=
com>
wrote:

> Hello everyone,
>
> We would love to get your feedback on a tool we have been working on:
> https://wise.wmcloud.org/
>
> This is a search tool for images and videos on wikimedia. Currently is
> searching only on media of the day (approximately 5000 videos). It search=
es
> only the visual content of the file (not on metadata, filename, or
> structured data). It also does face detection and recognition.
>
> Please give it a go. Here's some examples:
>
> *Semantic example queries:*
> "man at a train station"
> "=E0=A4=8F=E0=A4=95 =E0=A4=B5=E0=A5=8D=E0=A4=AF=E0=A4=95=E0=A5=8D=E0=A4=
=A4=E0=A4=BF =E0=A4=B0=E0=A5=87=E0=A4=B2=E0=A4=B5=E0=A5=87 =E0=A4=B8=E0=A5=
=8D=E0=A4=9F=E0=A5=87=E0=A4=B6=E0=A4=A8 =E0=A4=AA=E0=A4=B0" (Hindi)
> "horse in an airplane"
> "=E0=B0=B5=E0=B0=BF=E0=B0=AE=E0=B0=BE=E0=B0=A8=E0=B0=82=E0=B0=B2=E0=B1=8B=
 =E0=B0=97=E0=B1=81=E0=B0=B0=E0=B1=8D=E0=B0=B0=E0=B0=82" (Telugu)
> "man with a flower"
> "pirate with a pistol"
>
> *Face search (select "Faces"):*
>
> Click the green "Image" button and paste an image URL
>
> Example inputs:
> * https://upload.wikimedia.org/wikipedia/commons/0/00/Charlie_Chaplin.jpg
> *
> https://upload.wikimedia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.j=
pg
>
> [warning: some videos are ogv videos and your brownser may not play them,
> so watch them on Commons, i.e., after clicking the search result, scroll
> down to the media metadata table, and follow the link to commons]
>
> *Key features include:*
>
> * Semantic search using natural language to find relevant images on
> Commons from the visual content only (not the structured data or
> description, only the image itself)
> * Face search: upload or paste a face image, and the tool will try to
> identify and locate that person across images and videos, including
> timestamps where they appear
> * Audio search: search within audio files to find relevant segments
> * Multilingual search: supports queries in multiple languages
>
> We are actively improving the tool and would really appreciate any
> feedback, suggestions, or ideas from the community. Here's some more
> immediate future plans:
>
> * Search on all wikimedia images (instead of only videos / media of the
> day)
> * Show similar images when uploading an image to suggest filenames,
> categories, and other relevant metadata
>
> More technical details and a place to share feedback at
> https://commons.wikimedia.org/wiki/Commons:Wise
> * Phabricator: https://phabricator.wikimedia.org/T424092
> * Announcement on Village pump:
> https://commons.wikimedia.org/wiki/Commons:Village_pump#Introducing_WISE%=
3A_Semantic_search_for_Commons_%28we%E2%80%99d_love_your_feedback%29
> Regards,
>
> Gopa Vasanth <https://gopavasanth.github.io/>
> Twitter <https://twitter.com/gopavasanth1999> | LinkedIn
> <https://www.linkedin.com/in/gopa-vasanth/> | GitHub
> <https://github.com/gopavasanth> | Gerrit
> <https://gerrit.wikimedia.org/r/#/q/gopavasanth>
>
> =E2=80=9CYesterday is not ours to recover, but tomorrow is ours to win or=
 lose.=E2=80=9D
>
>

--=20
Regards,

Gopa Vasanth <https://gopavasanth.github.io/>
Twitter <https://twitter.com/gopavasanth1999> | LinkedIn
<https://www.linkedin.com/in/gopa-vasanth/> | GitHub
<https://github.com/gopavasanth> | Gerrit
<https://gerrit.wikimedia.org/r/#/q/gopavasanth>

=E2=80=9CYesterday is not ours to recover, but tomorrow is ours to win or l=
ose.=E2=80=9D

--000000000000594f0906510dd2a4
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><p>Hello everyone,</p><p=
>Following up on the <a href=3D"https://wise.wmcloud.org/" target=3D"_blank=
">WISE</a> tool&#39;s announcement, we wanted to briefly explain why we are=
 seeking community interest and support.</p><p>At the moment, WISE indexes =
only =E2=80=9CMedia of the Day=E2=80=9D (~5,000 videos). Expanding this to =
cover the full Wikimedia Commons collection (millions of images) requires s=
ignificant computational resources, especially large-scale GPU processing, =
along with storage and ongoing maintenance.</p><p>Before moving in that dir=
ection, we want to understand:<br></p><ul><li>Is this tool useful for the c=
ommunity?</li><li>Should we invest effort and resources to scale it further=
?</li><li>Are there any concerns we should address first?</li></ul><p></p><=
p>If you find WISE useful or promising, you can support or share feedback h=
ere:<br><a href=3D"https://commons.wikimedia.org/wiki/Commons:Wise#Communit=
y_interest_and_support">https://commons.wikimedia.org/wiki/Commons:Wise#Com=
munity_interest_and_support</a></p><p>You can:</p><ul><li>Add your support =
or comments on the page</li><li>Share use cases or ideas</li><li>Raise any =
concerns or suggestions</li></ul><p>Your input will help guide whether and =
how we expand WISE further. Thanks again for your time and feedback.</p><p>=
Wise Tool:=C2=A0<a href=3D"https://wise.wmcloud.org/" target=3D"_blank">htt=
ps://wise.wmcloud.org/</a></p><p>Regards,<br>Gopa Vasanth</p></div><br><div=
 class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Sun, May 3,=
 2026 at 2:09=E2=80=AFAM Vasanth Gopa &lt;<a href=3D"mailto:gopavasanth1999=
@gmail.com" target=3D"_blank">[email protected]</a>&gt; wrote:<br><=
/div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo=
rder-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><di=
v><div><p>Hello everyone,<br><br>We would love to get your feedback on a to=
ol we have been working on:=C2=A0<a href=3D"https://wise.wmcloud.org/" targ=
et=3D"_blank">https://wise.wmcloud.org/</a><br>=C2=A0 =C2=A0<br>This is a s=
earch tool for images and videos on wikimedia. Currently is searching only =
on media of the day (approximately 5000 videos). It searches only the visua=
l content of the file (not on metadata, filename, or structured data). It a=
lso does face detection and recognition.<br><br>Please give it a go. Here&#=
39;s some examples:=C2=A0<br><br><b>Semantic example queries:</b><br></p>&q=
uot;man at a train station&quot;<br>&quot;=E0=A4=8F=E0=A4=95 =E0=A4=B5=E0=
=A5=8D=E0=A4=AF=E0=A4=95=E0=A5=8D=E0=A4=A4=E0=A4=BF =E0=A4=B0=E0=A5=87=E0=
=A4=B2=E0=A4=B5=E0=A5=87 =E0=A4=B8=E0=A5=8D=E0=A4=9F=E0=A5=87=E0=A4=B6=E0=
=A4=A8 =E0=A4=AA=E0=A4=B0&quot; (Hindi)<br>&quot;horse in an airplane&quot;=
<br>&quot;=E0=B0=B5=E0=B0=BF=E0=B0=AE=E0=B0=BE=E0=B0=A8=E0=B0=82=E0=B0=B2=
=E0=B1=8B =E0=B0=97=E0=B1=81=E0=B0=B0=E0=B1=8D=E0=B0=B0=E0=B0=82&quot; (Tel=
ugu)<br>&quot;man with a flower&quot;<br>&quot;pirate with a pistol&quot;<b=
r><p><b>Face search (select &quot;Faces&quot;):</b><br><br>Click the green =
&quot;Image&quot; button and paste an image URL</p><p>Example inputs:<br>*=
=C2=A0<a href=3D"https://upload.wikimedia.org/wikipedia/commons/0/00/Charli=
e_Chaplin.jpg" target=3D"_blank">https://upload.wikimedia.org/wikipedia/com=
mons/0/00/Charlie_Chaplin.jpg</a><br>*=C2=A0<a href=3D"https://upload.wikim=
edia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.jpg" target=3D"_blank">=
https://upload.wikimedia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.jpg=
</a></p><p>[warning: some videos are ogv videos and your brownser may not p=
lay them, so watch them on Commons, i.e., after clicking the search result,=
 scroll down to the media metadata table, and follow the link to commons]</=
p><p><b>Key features include:</b><br><br>* Semantic search using natural la=
nguage to find relevant images on Commons from the visual content only (not=
 the structured data or description, only the image itself)<br>* Face searc=
h: upload or paste a face image, and the tool will try to identify and loca=
te that person across images and videos, including timestamps where they ap=
pear<br>* Audio search: search within audio files to find relevant segments=
<br>* Multilingual search: supports queries in multiple languages<br><br>We=
 are actively improving the tool and would really appreciate any feedback, =
suggestions, or ideas from the community. Here&#39;s some more immediate fu=
ture plans:<br><br>* Search on all wikimedia images (instead of only videos=
 / media of the day)<br>* Show similar images when uploading an image to su=
ggest filenames, categories, and other relevant metadata<span style=3D"box-=
sizing:border-box;margin:0px;padding:3px 0px 4px;background-color:rgb(227,2=
55,199);color:rgb(72,83,101)"><br></span><span style=3D"box-sizing:border-b=
ox;margin:0px;padding:3px 0px 4px;background-color:rgb(227,255,199);color:r=
gb(72,83,101)"></span></p><p>More technical details and a place to share fe=
edback at=C2=A0<a href=3D"https://commons.wikimedia.org/wiki/Commons:Wise" =
target=3D"_blank">https://commons.wikimedia.org/wiki/Commons:Wise</a><br>* =
Phabricator:=C2=A0<a href=3D"https://phabricator.wikimedia.org/T424092" tar=
get=3D"_blank">https://phabricator.wikimedia.org/T424092</a><br>* Announcem=
ent on Village pump:=C2=A0<a href=3D"https://commons.wikimedia.org/wiki/Com=
mons:Village_pump#Introducing_WISE%3A_Semantic_search_for_Commons_%28we%E2%=
80%99d_love_your_feedback%29" target=3D"_blank">https://commons.wikimedia.o=
rg/wiki/Commons:Village_pump#Introducing_WISE%3A_Semantic_search_for_Common=
s_%28we%E2%80%99d_love_your_feedback%29</a></p></div></div><div dir=3D"ltr"=
 class=3D"gmail_signature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div=
 dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"l=
tr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><di=
v dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=
=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr=
"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div =
dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><b><span style=3D"background-=
color:rgb(0,0,0)"></span></b>Regards,<br><br><a href=3D"https://gopavasanth=
.github.io/" target=3D"_blank">Gopa Vasanth</a></div><div><span style=3D"fo=
nt-size:12.8px"><a href=3D"https://twitter.com/gopavasanth1999" target=3D"_=
blank">Twitter</a> |=C2=A0</span><span style=3D"font-size:12.8px"><a href=
=3D"https://www.linkedin.com/in/gopa-vasanth/" target=3D"_blank">LinkedIn</=
a> |</span><a href=3D"https://github.com/gopavasanth" target=3D"_blank"> Gi=
tHub</a>=C2=A0| <a href=3D"https://gerrit.wikimedia.org/r/#/q/gopavasanth" =
target=3D"_blank">Gerrit</a>=C2=A0<br><br></div><div style=3D"text-align:le=
ft"><blockquote style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb=
(204,204,204);padding-left:1ex"><div><span style=3D"font-family:monospace,m=
onospace">=E2=80=9C<font size=3D"2">Yesterday is not ours to recover, but t=
omorrow is ours to win or lose.=E2=80=9D</font></span><b><br></b></div></bl=
ockquote></div></div></div></div></div></div></div></div></div></div></div>=
</div></div></div></div></div></div></div></div></div></div></div></div></d=
iv></div></div></div></div></div></div></div></div></div>
</blockquote></div><div><br clear=3D"all"></div><div><br></div><span class=
=3D"gmail_signature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_s=
ignature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div=
><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div dir=3D"l=
tr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><di=
v dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=
=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr=
"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div =
dir=3D"ltr"><div dir=3D"ltr"><b><span style=3D"background-color:rgb(0,0,0)"=
></span></b>Regards,<br><br><a href=3D"https://gopavasanth.github.io/" targ=
et=3D"_blank">Gopa Vasanth</a></div><div><span style=3D"font-size:12.8px"><=
a href=3D"https://twitter.com/gopavasanth1999" target=3D"_blank">Twitter</a=
> |=C2=A0</span><span style=3D"font-size:12.8px"><a href=3D"https://www.lin=
kedin.com/in/gopa-vasanth/" target=3D"_blank">LinkedIn</a> |</span><a href=
=3D"https://github.com/gopavasanth" target=3D"_blank"> GitHub</a>=C2=A0| <a=
 href=3D"https://gerrit.wikimedia.org/r/#/q/gopavasanth" target=3D"_blank">=
Gerrit</a>=C2=A0<br><br></div><div style=3D"text-align:left"><blockquote st=
yle=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padd=
ing-left:1ex"><div><span style=3D"font-family:monospace,monospace">=E2=80=
=9C<font size=3D"2">Yesterday is not ours to recover, but tomorrow is ours =
to win or lose.=E2=80=9D</font></span><b><br></b></div></blockquote></div><=
/div></div></div></div></div></div></div></div></div></div></div></div></di=
v></div></div></div></div></div></div></div></div></div></div></div></div><=
/div></div></div></div></div></div></div>
</div>

--000000000000594f0906510dd2a4--

--===============6504053300368958955==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Wikimedia-l mailing list -- [email protected], guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l
Public archives at https://lists.wikimedia.org/hyperkitty/list/[email protected]/message/JU2ESMYHUTORSDUQMDHECE373HUA3BNC/
To unsubscribe send an email to wikimedia-l-leave-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org
--===============6504053300368958955==--