Re: Future directions: Scalability, partial recoverability & Windows

Denis Corbin <[email protected]> Wed, 10 Feb 2010 13:12:10 +0100
Newsgroups gmane.comp.sysutils.backup.dar.general
Message-ID <[email protected]>
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thomas Jacob a écrit :
> On Tue, 2010-02-09 at 13:51 +0100, Denis Corbin wrote:
> 
[...]
> 
> But there other applications. Imagine a standard file server which
> contains 10 million small files, most of which are never really looked
> at (read email). Not a good setup but cheap, and the customer likes
> it that way ;) Now the amount of memory in the system is more
> than sufficient to provide appropriate caching for the "hot set"
> of data currently being accessed. And the system has a certain
> base load, if lots of swap space would be required, that
> system will basically become unusable. BTW, in these
> kinds of scenarios the system never really can be backed up
> in times of no load, so DAR being a good citizen with respect
> to the other processes running is important also. 

Yes, you're right. However, you can still have dar running with a nice
lowest priority (the highest number), which would not lead the system to
slowly swap the less used pages, which should not perturb the active
process on the system.

> 
> So the only solution at moment is to increase the amount of
> memory in the system just do backups properly. 

At the moment, yes.

[...]

> Great so the filenames are actually available in the slices as well?

Yes, the filenames only (and associated inode information), the full
path is still based on the sequential order of files (in depth walk of a
directory tree).

> 

[...]

> 
> Yeah, the problem in a nutshell, lot's of work to port, and almost
> no users on that platform ;)

Well, you guessed right. :)

> 

[...]

> 
> Hehe, of course. Keep up the good work. Eagerly looking forward to
> the 2.4.X release.
> 
> 

The planning is for me to complete the implementation and testing of the
remaining major features for the end of march, then start the
pre-release phase. During this phase I will review the documentation and
if possible produce a systematic testing tool for dar (this is just an
idea for now I have nothing more precise in mind so far).

Maybe, then before the end of the year, the 2.4.0 would be released. Why
so long ? Because I prefer spending more time in testing with no a
little pressure that fixing bugs in emergency with a lot of pressure.

Kind regards,
Denis.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFLcqKapC5CI8gYGlIRAjcWAJ4laSoVYn6uSnMnzF5EidLfGGVSJgCgjbQR
axwFPu3WDkkC+p0iZMMNnGw=
=bbOD
-----END PGP SIGNATURE-----

------------------------------------------------------------------------------
SOLARIS 10 is the OS for Data Centers - provides features such as DTrace,
Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
http://p.sf.net/sfu/solaris-dev2dev