Re: Data Import Policy

On 11/05/2015 11:24, Andre Wiethoff wrote:
> Hello everybody,
>
> its again me, with some other weird ideas ;-)
> I would like to ask whether an automatic metadata collection/crawling
> for insertion in the Musicbrainz DB is fine, which will be created by
> web data mining?
>
> Basically I would like to work on these two automatic data
> crawlings/data minings:
>
> 1) Add links for more artists to the AMG, Amazon and BBC web pages
> (which will be automatically be matched by crawling the appropriate web
> pages - of course very conservatively). Also interesting would be links
> to the "Musixmatch" lyrics website ( https://www.musixmatch.com ). It
> seems legit, so can it be added to the lyrics site whitelist?
>
>
>
> PS: Here a small evaluation of the URLs stored in the system for some
> link targets:
>
> URLs total: 2117159
>      Discogs total: 567330
>         Discogs Release: 212163
>         Discogs Artist: 200194
>         Discogs Master: 126747
>         Discogs label: 26405
>
Andre

I have a particular interest in improving the links between Musicbrainz 
(artist, releases and labels) with Discogs. I took the approach it is 
very difficult to correctly link 100% of the time but it is quite easy 
to find potential links that are right at least 95% of the time so my 
solution was generate potential links and make them available so others 
can submit them if they are interested. This takes an artist centric 
approach and concentrates on finding links for releases and making it 
easier to import releases from discogs as well for any artist.

I do plan to create reports showing potential artist and labels as well.

This is all available at http://albunack.net and might be of interest to 
you.

Whilst adding a link doesn't modify existing data, it would be more 
useful if additional data from the linked entity was also added but of 
course you have to be even sure it is correct. For example if two 
releases are matched on various metadata criteria but the MusicBrainz 
release did not have a barcode entered and the Discogs one does then it 
makes sense to add the Discogs barcode at the same as linking it. It is 
possible to do this using the seed release mechanism, what is not 
possible is to edit existing data, i.e you can add a barcode but not 
modify an existing barcode.

Paul/ijabz