Re: Introducing WISE: Semantic search for Common s (we’d love your feedback)
Vasanth Gopa via Wikimedia-l <[email protected]> Tue, 5 May 2026 10:27:09 +0200
| Newsgroups | gmane.org.wikimedia.foundation,gmane.science.linguistics.wikipedia.technical,gmane.org.wikimedia.india,gmane.org.wikimedia.wikidata,gmane.org.wikimedia.commons |
|---|---|
| Message-ID | <CA+GrJMuYema0fFUkk8y_HdUtMaSAyDGBx6t3WJfcwn0KZJx-1w@mail.gmail.com> |
--===============6504053300368958955== Content-Type: multipart/alternative; boundary="000000000000594f0906510dd2a4" --000000000000594f0906510dd2a4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello everyone, Following up on the WISE <https://wise.wmcloud.org/> tool's announcement, we wanted to briefly explain why we are seeking community interest and support. At the moment, WISE indexes only =E2=80=9CMedia of the Day=E2=80=9D (~5,000= videos). Expanding this to cover the full Wikimedia Commons collection (millions of images) requires significant computational resources, especially large-scale GPU processing, along with storage and ongoing maintenance. Before moving in that direction, we want to understand: - Is this tool useful for the community? - Should we invest effort and resources to scale it further? - Are there any concerns we should address first? If you find WISE useful or promising, you can support or share feedback here: https://commons.wikimedia.org/wiki/Commons:Wise#Community_interest_and_supp= ort You can: - Add your support or comments on the page - Share use cases or ideas - Raise any concerns or suggestions Your input will help guide whether and how we expand WISE further. Thanks again for your time and feedback. Wise Tool: https://wise.wmcloud.org/ Regards, Gopa Vasanth On Sun, May 3, 2026 at 2:09=E2=80=AFAM Vasanth Gopa <gopavasanth1999@gmail.= com> wrote: > Hello everyone, > > We would love to get your feedback on a tool we have been working on: > https://wise.wmcloud.org/ > > This is a search tool for images and videos on wikimedia. Currently is > searching only on media of the day (approximately 5000 videos). It search= es > only the visual content of the file (not on metadata, filename, or > structured data). It also does face detection and recognition. > > Please give it a go. Here's some examples: > > *Semantic example queries:* > "man at a train station" > "=E0=A4=8F=E0=A4=95 =E0=A4=B5=E0=A5=8D=E0=A4=AF=E0=A4=95=E0=A5=8D=E0=A4= =A4=E0=A4=BF =E0=A4=B0=E0=A5=87=E0=A4=B2=E0=A4=B5=E0=A5=87 =E0=A4=B8=E0=A5= =8D=E0=A4=9F=E0=A5=87=E0=A4=B6=E0=A4=A8 =E0=A4=AA=E0=A4=B0" (Hindi) > "horse in an airplane" > "=E0=B0=B5=E0=B0=BF=E0=B0=AE=E0=B0=BE=E0=B0=A8=E0=B0=82=E0=B0=B2=E0=B1=8B= =E0=B0=97=E0=B1=81=E0=B0=B0=E0=B1=8D=E0=B0=B0=E0=B0=82" (Telugu) > "man with a flower" > "pirate with a pistol" > > *Face search (select "Faces"):* > > Click the green "Image" button and paste an image URL > > Example inputs: > * https://upload.wikimedia.org/wikipedia/commons/0/00/Charlie_Chaplin.jpg > * > https://upload.wikimedia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.j= pg > > [warning: some videos are ogv videos and your brownser may not play them, > so watch them on Commons, i.e., after clicking the search result, scroll > down to the media metadata table, and follow the link to commons] > > *Key features include:* > > * Semantic search using natural language to find relevant images on > Commons from the visual content only (not the structured data or > description, only the image itself) > * Face search: upload or paste a face image, and the tool will try to > identify and locate that person across images and videos, including > timestamps where they appear > * Audio search: search within audio files to find relevant segments > * Multilingual search: supports queries in multiple languages > > We are actively improving the tool and would really appreciate any > feedback, suggestions, or ideas from the community. Here's some more > immediate future plans: > > * Search on all wikimedia images (instead of only videos / media of the > day) > * Show similar images when uploading an image to suggest filenames, > categories, and other relevant metadata > > More technical details and a place to share feedback at > https://commons.wikimedia.org/wiki/Commons:Wise > * Phabricator: https://phabricator.wikimedia.org/T424092 > * Announcement on Village pump: > https://commons.wikimedia.org/wiki/Commons:Village_pump#Introducing_WISE%= 3A_Semantic_search_for_Commons_%28we%E2%80%99d_love_your_feedback%29 > Regards, > > Gopa Vasanth <https://gopavasanth.github.io/> > Twitter <https://twitter.com/gopavasanth1999> | LinkedIn > <https://www.linkedin.com/in/gopa-vasanth/> | GitHub > <https://github.com/gopavasanth> | Gerrit > <https://gerrit.wikimedia.org/r/#/q/gopavasanth> > > =E2=80=9CYesterday is not ours to recover, but tomorrow is ours to win or= lose.=E2=80=9D > > --=20 Regards, Gopa Vasanth <https://gopavasanth.github.io/> Twitter <https://twitter.com/gopavasanth1999> | LinkedIn <https://www.linkedin.com/in/gopa-vasanth/> | GitHub <https://github.com/gopavasanth> | Gerrit <https://gerrit.wikimedia.org/r/#/q/gopavasanth> =E2=80=9CYesterday is not ours to recover, but tomorrow is ours to win or l= ose.=E2=80=9D --000000000000594f0906510dd2a4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><p>Hello everyone,</p><p= >Following up on the <a href=3D"https://wise.wmcloud.org/" target=3D"_blank= ">WISE</a> tool's announcement, we wanted to briefly explain why we are= seeking community interest and support.</p><p>At the moment, WISE indexes = only =E2=80=9CMedia of the Day=E2=80=9D (~5,000 videos). Expanding this to = cover the full Wikimedia Commons collection (millions of images) requires s= ignificant computational resources, especially large-scale GPU processing, = along with storage and ongoing maintenance.</p><p>Before moving in that dir= ection, we want to understand:<br></p><ul><li>Is this tool useful for the c= ommunity?</li><li>Should we invest effort and resources to scale it further= ?</li><li>Are there any concerns we should address first?</li></ul><p></p><= p>If you find WISE useful or promising, you can support or share feedback h= ere:<br><a href=3D"https://commons.wikimedia.org/wiki/Commons:Wise#Communit= y_interest_and_support">https://commons.wikimedia.org/wiki/Commons:Wise#Com= munity_interest_and_support</a></p><p>You can:</p><ul><li>Add your support = or comments on the page</li><li>Share use cases or ideas</li><li>Raise any = concerns or suggestions</li></ul><p>Your input will help guide whether and = how we expand WISE further. Thanks again for your time and feedback.</p><p>= Wise Tool:=C2=A0<a href=3D"https://wise.wmcloud.org/" target=3D"_blank">htt= ps://wise.wmcloud.org/</a></p><p>Regards,<br>Gopa Vasanth</p></div><br><div= class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Sun, May 3,= 2026 at 2:09=E2=80=AFAM Vasanth Gopa <<a href=3D"mailto:gopavasanth1999= @gmail.com" target=3D"_blank">[email protected]</a>> wrote:<br><= /div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo= rder-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><di= v><div><p>Hello everyone,<br><br>We would love to get your feedback on a to= ol we have been working on:=C2=A0<a href=3D"https://wise.wmcloud.org/" targ= et=3D"_blank">https://wise.wmcloud.org/</a><br>=C2=A0 =C2=A0<br>This is a s= earch tool for images and videos on wikimedia. Currently is searching only = on media of the day (approximately 5000 videos). It searches only the visua= l content of the file (not on metadata, filename, or structured data). It a= lso does face detection and recognition.<br><br>Please give it a go. Here&#= 39;s some examples:=C2=A0<br><br><b>Semantic example queries:</b><br></p>&q= uot;man at a train station"<br>"=E0=A4=8F=E0=A4=95 =E0=A4=B5=E0= =A5=8D=E0=A4=AF=E0=A4=95=E0=A5=8D=E0=A4=A4=E0=A4=BF =E0=A4=B0=E0=A5=87=E0= =A4=B2=E0=A4=B5=E0=A5=87 =E0=A4=B8=E0=A5=8D=E0=A4=9F=E0=A5=87=E0=A4=B6=E0= =A4=A8 =E0=A4=AA=E0=A4=B0" (Hindi)<br>"horse in an airplane"= <br>"=E0=B0=B5=E0=B0=BF=E0=B0=AE=E0=B0=BE=E0=B0=A8=E0=B0=82=E0=B0=B2= =E0=B1=8B =E0=B0=97=E0=B1=81=E0=B0=B0=E0=B1=8D=E0=B0=B0=E0=B0=82" (Tel= ugu)<br>"man with a flower"<br>"pirate with a pistol"<b= r><p><b>Face search (select "Faces"):</b><br><br>Click the green = "Image" button and paste an image URL</p><p>Example inputs:<br>*= =C2=A0<a href=3D"https://upload.wikimedia.org/wikipedia/commons/0/00/Charli= e_Chaplin.jpg" target=3D"_blank">https://upload.wikimedia.org/wikipedia/com= mons/0/00/Charlie_Chaplin.jpg</a><br>*=C2=A0<a href=3D"https://upload.wikim= edia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.jpg" target=3D"_blank">= https://upload.wikimedia.org/wikipedia/commons/0/0d/Neil_Armstrong_pose.jpg= </a></p><p>[warning: some videos are ogv videos and your brownser may not p= lay them, so watch them on Commons, i.e., after clicking the search result,= scroll down to the media metadata table, and follow the link to commons]</= p><p><b>Key features include:</b><br><br>* Semantic search using natural la= nguage to find relevant images on Commons from the visual content only (not= the structured data or description, only the image itself)<br>* Face searc= h: upload or paste a face image, and the tool will try to identify and loca= te that person across images and videos, including timestamps where they ap= pear<br>* Audio search: search within audio files to find relevant segments= <br>* Multilingual search: supports queries in multiple languages<br><br>We= are actively improving the tool and would really appreciate any feedback, = suggestions, or ideas from the community. Here's some more immediate fu= ture plans:<br><br>* Search on all wikimedia images (instead of only videos= / media of the day)<br>* Show similar images when uploading an image to su= ggest filenames, categories, and other relevant metadata<span style=3D"box-= sizing:border-box;margin:0px;padding:3px 0px 4px;background-color:rgb(227,2= 55,199);color:rgb(72,83,101)"><br></span><span style=3D"box-sizing:border-b= ox;margin:0px;padding:3px 0px 4px;background-color:rgb(227,255,199);color:r= gb(72,83,101)"></span></p><p>More technical details and a place to share fe= edback at=C2=A0<a href=3D"https://commons.wikimedia.org/wiki/Commons:Wise" = target=3D"_blank">https://commons.wikimedia.org/wiki/Commons:Wise</a><br>* = Phabricator:=C2=A0<a href=3D"https://phabricator.wikimedia.org/T424092" tar= get=3D"_blank">https://phabricator.wikimedia.org/T424092</a><br>* Announcem= ent on Village pump:=C2=A0<a href=3D"https://commons.wikimedia.org/wiki/Com= mons:Village_pump#Introducing_WISE%3A_Semantic_search_for_Commons_%28we%E2%= 80%99d_love_your_feedback%29" target=3D"_blank">https://commons.wikimedia.o= rg/wiki/Commons:Village_pump#Introducing_WISE%3A_Semantic_search_for_Common= s_%28we%E2%80%99d_love_your_feedback%29</a></p></div></div><div dir=3D"ltr"= class=3D"gmail_signature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div= dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"l= tr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><di= v dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir= =3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr= "><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div = dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><b><span style=3D"background-= color:rgb(0,0,0)"></span></b>Regards,<br><br><a href=3D"https://gopavasanth= .github.io/" target=3D"_blank">Gopa Vasanth</a></div><div><span style=3D"fo= nt-size:12.8px"><a href=3D"https://twitter.com/gopavasanth1999" target=3D"_= blank">Twitter</a> |=C2=A0</span><span style=3D"font-size:12.8px"><a href= =3D"https://www.linkedin.com/in/gopa-vasanth/" target=3D"_blank">LinkedIn</= a> |</span><a href=3D"https://github.com/gopavasanth" target=3D"_blank"> Gi= tHub</a>=C2=A0| <a href=3D"https://gerrit.wikimedia.org/r/#/q/gopavasanth" = target=3D"_blank">Gerrit</a>=C2=A0<br><br></div><div style=3D"text-align:le= ft"><blockquote style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb= (204,204,204);padding-left:1ex"><div><span style=3D"font-family:monospace,m= onospace">=E2=80=9C<font size=3D"2">Yesterday is not ours to recover, but t= omorrow is ours to win or lose.=E2=80=9D</font></span><b><br></b></div></bl= ockquote></div></div></div></div></div></div></div></div></div></div></div>= </div></div></div></div></div></div></div></div></div></div></div></div></d= iv></div></div></div></div></div></div></div></div></div> </blockquote></div><div><br clear=3D"all"></div><div><br></div><span class= =3D"gmail_signature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_s= ignature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div= ><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div dir=3D"l= tr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><di= v dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir= =3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr= "><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div = dir=3D"ltr"><div dir=3D"ltr"><b><span style=3D"background-color:rgb(0,0,0)"= ></span></b>Regards,<br><br><a href=3D"https://gopavasanth.github.io/" targ= et=3D"_blank">Gopa Vasanth</a></div><div><span style=3D"font-size:12.8px"><= a href=3D"https://twitter.com/gopavasanth1999" target=3D"_blank">Twitter</a= > |=C2=A0</span><span style=3D"font-size:12.8px"><a href=3D"https://www.lin= kedin.com/in/gopa-vasanth/" target=3D"_blank">LinkedIn</a> |</span><a href= =3D"https://github.com/gopavasanth" target=3D"_blank"> GitHub</a>=C2=A0| <a= href=3D"https://gerrit.wikimedia.org/r/#/q/gopavasanth" target=3D"_blank">= Gerrit</a>=C2=A0<br><br></div><div style=3D"text-align:left"><blockquote st= yle=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padd= ing-left:1ex"><div><span style=3D"font-family:monospace,monospace">=E2=80= =9C<font size=3D"2">Yesterday is not ours to recover, but tomorrow is ours = to win or lose.=E2=80=9D</font></span><b><br></b></div></blockquote></div><= /div></div></div></div></div></div></div></div></div></div></div></div></di= v></div></div></div></div></div></div></div></div></div></div></div></div><= /div></div></div></div></div></div></div> </div> --000000000000594f0906510dd2a4-- --===============6504053300368958955== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Wikimedia-l mailing list -- [email protected], guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/[email protected]/message/JU2ESMYHUTORSDUQMDHECE373HUA3BNC/ To unsubscribe send an email to wikimedia-l-leave-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org --===============6504053300368958955==--