Re: Data Import Policy

--===============1914624128==
Content-Type: multipart/alternative; boundary=001a11c23f6a2631800515cf1558

--001a11c23f6a2631800515cf1558
Content-Type: text/plain; charset=UTF-8

On 11 May 2015 at 11:24, Andre Wiethoff <[email protected]>
wrote:

> Hello everybody,
>
> its again me, with some other weird ideas ;-)
> I would like to ask whether an automatic metadata collection/crawling
> for insertion in the Musicbrainz DB is fine, which will be created by
> web data mining?
>
> Basically I would like to work on these two automatic data
> crawlings/data minings:
>
> 1) Add links for more artists to the AMG, Amazon and BBC web pages
> (which will be automatically be matched by crawling the appropriate web
> pages - of course very conservatively).


I think the community appreciate *very* conservative bots. You might want
to check out https://musicbrainz.org/doc/Bots
https://musicbrainz.org/doc/Code_of_Conduct/Bots and
https://github.com/murdos/musicbrainz-bot

Also interesting would be links
> to the "Musixmatch" lyrics website ( https://www.musixmatch.com ). It
> seems legit, so can it be added to the lyrics site whitelist?
>

You should put in a ticket for this https://musicbrainz.org/doc/Proposals -
Lyric sites used to be different from all other relationships (they may
still be), needing approval from ruaok


> 2) Adding a new kind of relation (which also would need to be approved
> first), I would call it "similar to". Basically I would mainly
> automatically add similarities between two artists, but of course also
> other similarities would be possible (song similarity, etc.). As this
> kind of data is highly subjective, it might be a thought whether only
> data by automatic web/database data mining would be accepted as input
> (and no manual input of users)... This kind of data is available on AMG,
> Amazon and BBC, which could be automatically be crawled (and only two
> artist IDs would be added to the database as similar). Of course lateron
> similarity could also be calculated by an algorithm using some
> scrobbling data.
>

This sounds dodgy to me - I'd at least want to know what the basis of their
claim of similarity was. Also, be particularly careful what you do with AMG
data! But you could always discuss the general idea on the forums. That's
probably a better place to get wider views of the community. You could also
try the style list, where new relationships used to be discussed.


>
> <snip>
>
> I wonder why there are not more BBC artist links, as these links are
> just http://www.bbc.co.uk/music/artists/<musicbrainz artist id>. It
> should be pretty easy to add them...
>

Sounds like a good plan. I guess no-one's got around to it or thought the
beeb might do it themselves

--001a11c23f6a2631800515cf1558
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><br><div class=3D"gmail_extra"><br><div class=3D"gmail_quo=
te">On 11 May 2015 at 11:24, Andre Wiethoff <span dir=3D"ltr">&lt;<a href=
=3D"mailto:[email protected]" target=3D"_blank">brainworks@exact=
audiocopy.de</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" sty=
le=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);paddi=
ng-left:1ex">Hello everybody,<br>
<br>
its again me, with some other weird ideas ;-)<br>
I would like to ask whether an automatic metadata collection/crawling<br>
for insertion in the Musicbrainz DB is fine, which will be created by<br>
web data mining?<br>
<br>
Basically I would like to work on these two automatic data<br>
crawlings/data minings:<br>
<br>
1) Add links for more artists to the AMG, Amazon and BBC web pages<br>
(which will be automatically be matched by crawling the appropriate web<br>
pages - of course very conservatively).</blockquote><div><br></div><div>I t=
hink the community appreciate *very* conservative bots. You might want to c=
heck out <a href=3D"https://musicbrainz.org/doc/Bots">https://musicbrainz.o=
rg/doc/Bots</a> <a href=3D"https://musicbrainz.org/doc/Code_of_Conduct/Bots=
">https://musicbrainz.org/doc/Code_of_Conduct/Bots</a> and <a href=3D"https=
://github.com/murdos/musicbrainz-bot">https://github.com/murdos/musicbrainz=
-bot</a>=C2=A0 <br><br></div><blockquote class=3D"gmail_quote" style=3D"mar=
gin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1=
ex"> Also interesting would be links<br>
to the &quot;Musixmatch&quot; lyrics website ( <a href=3D"https://www.musix=
match.com" target=3D"_blank">https://www.musixmatch.com</a> ). It<br>
seems legit, so can it be added to the lyrics site whitelist?<br></blockquo=
te><div><br></div><div>You should put in a ticket for this <a href=3D"https=
://musicbrainz.org/doc/Proposals">https://musicbrainz.org/doc/Proposals</a>=
 - Lyric sites used to be different from all other relationships (they may =
still be), needing approval from ruaok<br>=C2=A0 <br></div><blockquote clas=
s=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid r=
gb(204,204,204);padding-left:1ex"><div>
2) Adding a new kind of relation (which also would need to be approved<br>
first), I would call it &quot;similar to&quot;. Basically I would mainly<br=
>
automatically add similarities between two artists, but of course also<br>
other similarities would be possible (song similarity, etc.). As this<br>
kind of data is highly subjective, it might be a thought whether only<br>
data by automatic web/database data mining would be accepted as input<br>
(and no manual input of users)... This kind of data is available on AMG,<br=
>
Amazon and BBC, which could be automatically be crawled (and only two<br>
artist IDs would be added to the database as similar). Of course lateron<br=
>
similarity could also be calculated by an algorithm using some<br>
scrobbling data.<br></div></blockquote><div><br></div><div>This sounds dodg=
y to me - I&#39;d at least want to know what the basis of their claim of si=
milarity was. Also, be particularly careful what you do with AMG data! But =
you could always discuss the general idea on the forums. That&#39;s probabl=
y a better place to get wider views of the community. You could also try th=
e style list, where new relationships used to be discussed.<br>=C2=A0<br></=
div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bor=
der-left:1px solid rgb(204,204,204);padding-left:1ex"><div>
<br></div>
&lt;snip&gt;<br><div>
<br>
I wonder why there are not more BBC artist links, as these links are<br>
just <a href=3D"http://www.bbc.co.uk/music/artists/" target=3D"_blank">http=
://www.bbc.co.uk/music/artists/</a>&lt;musicbrainz artist id&gt;. It<br>
should be pretty easy to add them...<br></div></blockquote><div><br></div><=
div>Sounds like a good plan. I guess no-one&#39;s got around to it or thoug=
ht the beeb might do it themselves<br></div></div></div></div>

--001a11c23f6a2631800515cf1558--


--===============1914624128==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
MusicBrainz-devel mailing list
[email protected]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel
--===============1914624128==--