Re: Data Import Policy

Ian McEwen <[email protected]> Mon, 11 May 2015 07:32:30 -0700
Newsgroups gmane.comp.audio.musicbrainz.devel
Message-ID <[email protected]>
--===============0609709792==
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="m51xatjYGsM+13rf"
Content-Disposition: inline


--m51xatjYGsM+13rf
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

On Mon, May 11, 2015 at 03:20:40PM +0100, Tom Crocker wrote:
> On 11 May 2015 at 11:24, Andre Wiethoff <[email protected]>
> wrote:
>
> > Hello everybody,
> >
> > its again me, with some other weird ideas ;-)
> > I would like to ask whether an automatic metadata collection/crawling
> > for insertion in the Musicbrainz DB is fine, which will be created by
> > web data mining?
> >
> > Basically I would like to work on these two automatic data
> > crawlings/data minings:
> >
> > 1) Add links for more artists to the AMG, Amazon and BBC web pages
> > (which will be automatically be matched by crawling the appropriate web
> > pages - of course very conservatively).
>
>
> I think the community appreciate *very* conservative bots. You might want
> to check out https://musicbrainz.org/doc/Bots
> https://musicbrainz.org/doc/Code_of_Conduct/Bots and
> https://github.com/murdos/musicbrainz-bot
>
> Also interesting would be links
> > to the "Musixmatch" lyrics website ( https://www.musixmatch.com ). It
> > seems legit, so can it be added to the lyrics site whitelist?
> >
>
> You should put in a ticket for this https://musicbrainz.org/doc/Proposals -
> Lyric sites used to be different from all other relationships (they may
> still be), needing approval from ruaok
>
>
> > 2) Adding a new kind of relation (which also would need to be approved
> > first), I would call it "similar to". Basically I would mainly
> > automatically add similarities between two artists, but of course also
> > other similarities would be possible (song similarity, etc.). As this
> > kind of data is highly subjective, it might be a thought whether only
> > data by automatic web/database data mining would be accepted as input
> > (and no manual input of users)... This kind of data is available on AMG,
> > Amazon and BBC, which could be automatically be crawled (and only two
> > artist IDs would be added to the database as similar). Of course lateron
> > similarity could also be calculated by an algorithm using some
> > scrobbling data.
> >
>
> This sounds dodgy to me - I'd at least want to know what the basis of their
> claim of similarity was. Also, be particularly careful what you do with AMG
> data! But you could always discuss the general idea on the forums. That's
> probably a better place to get wider views of the community. You could also
> try the style list, where new relationships used to be discussed.
>

I agree; this is far too vague to be used properly, if there even is a
clear definition of using such a thing properly.

>
> >
> > <snip>
> >
> > I wonder why there are not more BBC artist links, as these links are
> > just http://www.bbc.co.uk/music/artists/<musicbrainz artist id>. It
> > should be pretty easy to add them...
> >
>
> Sounds like a good plan. I guess no-one's got around to it or thought the
> beeb might do it themselves

BBC Music links aren't to be added unless they have substantial content
that isn't just from MusicBrainz, because obviously if you want a BBC
Music link you can just construct them, so it's really only useful if
there's something there more than on MB.

See
https://musicbrainz.org/relationship/d028a975-000c-4525-9333-d3c8425e4b54

So it's not simple to add them automatically, and this fact also
explains the limited numbers to some degree.

> _______________________________________________
> MusicBrainz-devel mailing list
> [email protected]
> http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel


--m51xatjYGsM+13rf
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEABECAAYFAlVQvXsACgkQq+0avXExp2+/LQCcDc7ihAQj5pHPq5BBbrry+VSb
0pQAoKxPlv6msUk8u3IytlDQcj+yMIMg
=PQay
-----END PGP SIGNATURE-----

--m51xatjYGsM+13rf--


--===============0609709792==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
MusicBrainz-devel mailing list
[email protected]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel
--===============0609709792==--