Re: [Abcde-users] running multiple abcde/cdparanoia in parallel - performance issues

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--===============1069854606==
Content-Type: multipart/signed; micalg=pgp-sha512;
 protocol="application/pgp-signature";
 boundary="5FOMKN2IuBU2ntGJ4UMQ6gTn16dbNHoP7"

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--5FOMKN2IuBU2ntGJ4UMQ6gTn16dbNHoP7
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable



On 27/05/2015 13:29, Johannes Gernemann wrote:
> that's an impressive hardware setup you got there :-)

Thanks. Hoping to make the user experience a bit smoother that what it
is right now.

> concerning the speed - what do you expect? As you are saying, you are
> using quite an "old PC". 1x CD speed is 150KB/s. Whatever your drives
> are capable of, they'll be sharing the total bandwidth of the busses. S=
o
> does the harddisk. And you have to add read-from-CD time to write-to-HD=
D
> time. And then everything has to go through the CPU for encoding.
> Theoretically you can rip as many in parallel as you want. Practically
> things will be happening more or less sequentially.

The HDD doesn't seem to be taking too much pressure, I don't hear it
crunching away too much.

iotop doesn't show too much activity.

I'm also looking for tips on the tools I could use to measure the speed
and quality of the drives. Am taking a look at hdparm right now and
"cdparanoia --analyse".

My aim would also be to "filter" out the drives that don't  rip well in
favor of others.

Am thinking that if there is no benefit from running them in parallel I
might as well find a way of getting the to run sequentially. I want to
have a web frontend that provides information on progress and am looking
at http://blog.miguelgrinberg.com/post/using-celery-with-flask and
thinking of running the jobs through celery and viewing the progress
with flask (am more at ease with python than other programming languages)=
=2E

> So how long does it actually take you to rip and encode (what format ar=
e
> you encoding?) let's say 4 CD's in parallel?

Am encoding to FLAC (which shouldn't be too CPU intensive right?).

Right now, am having trouble getting through parallel RIPs, they seem to
always fail. At some point I remember most drives popping out
successfully after a couple of hours.

Anyway thanks Johannes for keeping the thread going.

Arthur

>=20
> Johannes
>=20
> Am 25.05.2015 um 12:51 schrieb Arthur Lutz:
>> Hi,
>>
>> I've built a CD ripping machine from a bunch of old CDROMs and DVDRoms=
 I
>> had lying around and an old PC. So far I have 7 drives installed (the
>> 8th is the hard drive). Here's a photo on my blog :
>> http://arthur.lutz.im/blog/wp-content/uploads/2015/02/IMG_7576-e142289=
6399582-532x800.jpg
>>
>> (blog posts in french at the bottom of my email)
>>
>> The idea is to be able to RIP a large number of CDs with minimal user
>> input. udev detects new cds, launches abcde, then the cds are ejected
>> when ripping is done.
>>
>> I find that the speed at which the drives are being read by cdparanoia=

>> is pretty slow and am wondering if you had any tips or experience
>> similar to this.
>>
>> On the hardware side, I have two IDE on the mother board on which ther=
e
>> are 3 drives (and the HDD), and a PCI-IDE card on which there are two
>> IDE slots with 4 drives on it.
>>
>> On the software side, am running debian jessie with kernel
>> 3.16.0-4-686-pae, abcde 2.6-2 and cdparanoia 3.10.2+debian-11
>>
>> A look at the speed of transfer on the .wav files in /tmp/abcde* in
>> speedometer http://i.imgur.com/8DPNzXa.png
>>
>> Should I be running the rips in sequence ? how many could I put in
>> parallel ?
>>
>> Thanks for any advise.
>>
>> Arthur
>>
>> Blog posts in french :
>> http://arthur.lutz.im/blog/2013/03/diy-ripstation-part-1/
>> http://arthur.lutz.im/blog/2013/06/ripstation-diy-part-2/
>> http://arthur.lutz.im/blog/2015/02/ripstation-part-3-un-peu-de-logicie=
l/
>>
>>
>>
>> _______________________________________________
>> Abcde-users mailing list
>> [email protected]
>> http://lists.einval.com/cgi-bin/mailman/listinfo/abcde-users
>>
>=20
> _______________________________________________
> Abcde-users mailing list
> [email protected]
> http://lists.einval.com/cgi-bin/mailman/listinfo/abcde-users


--5FOMKN2IuBU2ntGJ4UMQ6gTn16dbNHoP7
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQIcBAEBCgAGBQJVa3ZYAAoJELB9duUjqo168iAP/ApR5p/6hQK6QAC93kG13IDY
BDgu8L2IFw4Sb/d8Kfm+9jJfsABw5pVO8Y7MnrySEGNMH8mIhuk/2/Pc5Cwzi8b2
IQDOMvAjb2nTCslIieRcanAk5MDzYUQ3yUmay4Pc8Er03gSjT6sjr9Q5fNhFrB06
Eg/AHaqyCzb+4XRg+o/dORMEgUAMXNHK6v1iI8Z5h9zcMHxDIfMk/WuAW+OOuvj9
inFkJKpSxTRVhFBMcxmVAyQ8cM3KNAOGPWveMl029Xx202avoDA0cgfwS/oGQBmg
ml4W9sBmSfogTkDFHmzwx0taZdpQFc+5BkyCn4b60IQ7pFAaoj2s2PBp1iNwO92C
Hm4az/5Z0lgTM6RsYWsk7ajZLzwCLkEcR2ezPiYkU+hU1zEuOEhKHnOOqwLcJw4/
flcJn41A7IYcECA3ebpdxj+lzf6aU+7zQPGexwtt6a5rJ2k3swPBKJLkknzdSzVr
mH3WsZLQnksoG/aSwOKFuW+rWEBUevVB12SUDUqIJW5TbBx2lwqlN9KACuV8r66y
Gyi2YGzjFz+U+BzrCGa0NM2YidH+ZYa4wBhlWJFI9kwc8AM+AicL0+LqBbezapFZ
paZPT3Z0dHFjsq41LmBhOWWNWNYY/OI2m4qz8tZtXozQI+cY3GHcvKa8/kWSF1zb
s1TernsuFIZ/lUfmZBYI
=Cnd/
-----END PGP SIGNATURE-----

--5FOMKN2IuBU2ntGJ4UMQ6gTn16dbNHoP7--

--===============1069854606==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Paranoia mailing list
[email protected]
http://lists.xiph.org/mailman/listinfo/paranoia

--===============1069854606==--