libDAR skips files above 3 KB - Please help
Satheesh Kumar <satheesh_sskzm-/[email protected]> Tue, 22 Apr 2008 22:56:05 -0700 (PDT)
| Newsgroups | gmane.comp.sysutils.backup.dar.libdar |
|---|---|
| Message-ID | <[email protected]> |
--===============1965806462==
Content-Type: multipart/alternative; boundary="0-2036151236-1208930165=:6757"
Content-Transfer-Encoding: 7bit
--0-2036151236-1208930165=:6757
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Hi All,
I am new to libDAR and trying to get it work from a pthread routine on =
ppc-64 platform running AIX 5.3 (32 bit kernel mode) - compiled from sour=
ce using gcc and statically linked. Specific routine that I've used is "c=
reate_archive_noexcept". It backs up files less than about 3200 bytes onl=
y and fails for anything bigger. Using GDB, I found that Erange-exception=
thrown for failed files at "fichier::inherited_read" due to a failed ::r=
ead. If I invoke libdar function from my main thread, all files are getti=
ng backed up. Problem happens only when libdar invoked from a child threa=
d. The directory that I am trying to backup is just about 200 MB and 2000=
+ files. I've provided 1 GB swap space and following are my process ulimi=
ts. I had tried to set all those values as unlimited but with no effect. =
Is it required to increase thread stack size by calling pthread_attr_sets=
tacksize() ? If so, how do I guestimate that value ?
=20
bash-3.2# ulimit -a
core file size (blocks, -c) 1048575
data seg size (kbytes, -d) 131072
file size (blocks, -f) unlimited
max memory size (kbytes, -m) 32768
open files (-n) 2000
pipe size (512 bytes, -p) 64
stack size (kbytes, -s) 32768
cpu time (seconds, -t) unlimited
max user processes (-u) 262144
virtual memory (kbytes, -v) unlimited
=20
I also attempted to dynamically link libdar when the same exception got=
thrown for files above ~3200 bytes. Even though exception is being caugh=
t by "filtre_sauvegarde", it was crashing with the following stack trace =
-=20
=20
Program received signal SIGILL, Illegal instruction.
0x00000000 in ?? ()
(gdb) bt
#0 0x00000000 in ?? ()
#1 0xd1fecd4c in libdar::user_interaction::warning (
this=3D0x200dd8d4, message=3D@0x200f8688)
at user_interaction.cpp:113
#2 0xd20c5e98 in libdar::filtre_sauvegarde (
dialog=3D@0x200dd8d4, filtre=3D@0x200dd90c,
subtree=3D@0x200dd91c, stockage=3D0x200fd3c8,
cat=3D@0x201e75a8, ref=3D@0x201e74f8,
fs_racine=3D@0xf0a7c328, info_details=3Dtrue,
st=3D@0xf0b81ab4, make_empty_dir=3Dfalse,
ea_mask=3D@0x200f9124, compr_mask=3D@0x200dd92c,
min_compr_size=3D@0x200f9110, nodump=3Dfalse,
hourshift=3D@0x200f910c, alter_atime=3Dfalse,
same_fs=3Dfalse, what_to_check=3Dcf_all,
snapshot=3Dfalse, cache_directory_tagging=3Dfalse,
display_skipped=3Dfalse, fixed_date=3D@0x200f9108)
at filtre.cpp:592
=20
Any help would be greatly appreciated.
=20
Thanks,
Satheesh=20
=20
---------------------------------
Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try i=
t now.
--0-2036151236-1208930165=:6757
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
<DIV>Hi All,</DIV> <DIV>I am new to libDAR and trying to get it work fro=
m a pthread routine on ppc-64 platform running AIX 5.3 (32 bit kerne=
l mode) - compiled from source using gcc and statically linked. Specific =
routine that I've used is "create_archive_noexcept". It backs up files le=
ss than about 3200 bytes only and fails for anything bigger. Using GDB, I=
found that Erange-exception thrown for failed files at "f=
ichier::inherited_read" due to a failed ::read. If I invoke libdar f=
unction from my main thread, all files are getting backed up. Problem hap=
pens only when libdar invoked from a child thread. The directory tha=
t I am trying to backup is just about 200 MB and 2000+ files. I've provid=
ed 1 GB swap space and following are my process ulimits. I had tried to s=
et all those values as unlimited but with no effect. Is it required to in=
crease thread stack size by calling pthread_attr_setstacksize() ? If so, =
how do I guestimate that value ?</DIV>=20
<DIV> </DIV> <DIV>bash-3.2# ulimit -a<BR>core file size  =
; (blocks, -c) 1048575<BR>data =
seg size (kby=
tes, -d) 131072<BR>file size &nb=
sp; (blocks, -f) unlimited<BR>max mem=
ory size (kbytes, -m) 327=
68<BR>open files &nb=
sp; (-n=
) 2000<BR>pipe size =
(512 bytes, -p) 64<BR>stack size &nbs=
p; (kbytes, -s) 32768<BR>=
cpu time  =
; (seconds, -t) unlimited<BR>max user
processes &nb=
sp; (-u) 262144<BR>virtual memory &nbs=
p; (kbytes, -v) unlimited</DIV> <DIV> </DIV=
> <DIV>I also attempted to dynamically link libdar when the same excepti=
on got thrown for files above ~3200 bytes. Even though exception is being=
caught by "filtre_sauvegarde", it was crashing with the f=
ollowing stack trace - </DIV> <DIV> </DIV> <DIV>Program received s=
ignal SIGILL, Illegal instruction.<BR>0x00000000 in ?? ()<BR>(gdb) bt<BR>=
#0 0x00000000 in ?? ()<BR>#1 0xd1fecd4c in libdar::user_inter=
action::warning (<BR> this=3D0x200dd8d4, <A href=3D"htt=
p://us.f825.mail.yahoo.com/ym/Compose?To=3Dmessage=3D@0x200f8688" target=3D=
_blank rel=3Dnofollow ymailto=3D"mailto:message=3D@0x200f8688"><SPAN clas=
s=3Dyshortcuts id=3Dlw_1208930081_0><FONT color=3D#003399>message=3D@0x20=
0f8688</FONT></SPAN></A>)<BR> at
user_interaction.cpp:113<BR>#2 0xd20c5e98 in libdar::filtre_sauveg=
arde (<BR> <A href=3D"http://us.f825.mail.yahoo.com/ym/=
Compose?To=3Ddialog=3D@0x200dd8d4" target=3D_blank rel=3Dnofollow ymailto=
=3D"mailto:dialog=3D@0x200dd8d4"><SPAN class=3Dyshortcuts id=3Dlw_1208930=
081_1 style=3D"BACKGROUND: none transparent scroll repeat 0% 0%"><FONT co=
lor=3D#003399>dialog=3D@0x200dd8d4</FONT></SPAN></A>, <A href=3D"http://u=
s.f825.mail.yahoo.com/ym/Compose?To=3Dfiltre=3D@0x200dd90c" target=3D_bla=
nk rel=3Dnofollow ymailto=3D"mailto:filtre=3D@0x200dd90c"><SPAN class=3Dy=
shortcuts id=3Dlw_1208930081_2><FONT color=3D#003399>filtre=3D@0x200dd90c=
</FONT></SPAN></A>,<BR> <A href=3D"http://us.f825.mail.=
yahoo.com/ym/Compose?To=3Dsubtree=3D@0x200dd91c" target=3D_blank rel=3Dno=
follow ymailto=3D"mailto:subtree=3D@0x200dd91c"><SPAN class=3Dyshortcuts =
id=3Dlw_1208930081_3><FONT color=3D#003399>subtree=3D@0x200dd91c</FONT></=
SPAN></A>, stockage=3D0x200fd3c8,<BR> <A
href=3D"http://us.f825.mail.yahoo.com/ym/Compose?To=3Dcat=3D@0x201e75a8"=
target=3D_blank rel=3Dnofollow ymailto=3D"mailto:cat=3D@0x201e75a8"><SPA=
N class=3Dyshortcuts id=3Dlw_1208930081_4><FONT color=3D#003399>cat=3D@0x=
201e75a8</FONT></SPAN></A>, <A href=3D"http://us.f825.mail.yahoo.com/ym/C=
ompose?To=3Dref=3D@0x201e74f8" target=3D_blank rel=3Dnofollow ymailto=3D"=
mailto:ref=3D@0x201e74f8"><SPAN class=3Dyshortcuts id=3Dlw_1208930081_5><=
FONT color=3D#003399>ref=3D@0x201e74f8</FONT></SPAN></A>,<BR> =
<A href=3D"http://us.f825.mail.yahoo.com/ym/Compose?To=3Dfs_racine=
=3D@0xf0a7c328" target=3D_blank rel=3Dnofollow ymailto=3D"mailto:fs_racin=
e=3D@0xf0a7c328"><SPAN class=3Dyshortcuts id=3Dlw_1208930081_6><FONT colo=
r=3D#003399>fs_racine=3D@0xf0a7c328</FONT></SPAN></A>, info_details=3Dtru=
e,<BR> <A href=3D"http://us.f825.mail.yahoo.com/ym/Comp=
ose?To=3Dst=3D@0xf0b81ab4" target=3D_blank rel=3Dnofollow ymailto=3D"mail=
to:st=3D@0xf0b81ab4"><SPAN class=3Dyshortcuts id=3Dlw_1208930081_7><FONT =
color=3D#003399>st=3D@0xf0b81ab4</FONT></SPAN></A>,
make_empty_dir=3Dfalse,<BR> <A href=3D"http://us.f825.=
mail.yahoo.com/ym/Compose?To=3Dea_mask=3D@0x200f9124" target=3D_blank rel=
=3Dnofollow ymailto=3D"mailto:ea_mask=3D@0x200f9124"><SPAN class=3Dyshort=
cuts id=3Dlw_1208930081_8><FONT color=3D#003399>ea_mask=3D@0x200f9124</FO=
NT></SPAN></A>, <A href=3D"http://us.f825.mail.yahoo.com/ym/Compose?To=3D=
compr_mask=3D@0x200dd92c" target=3D_blank rel=3Dnofollow ymailto=3D"mailt=
o:compr_mask=3D@0x200dd92c"><SPAN class=3Dyshortcuts id=3Dlw_1208930081_9=
><FONT color=3D#003399>compr_mask=3D@0x200dd92c</FONT></SPAN></A>,<BR>&nb=
sp; <A href=3D"http://us.f825.mail.yahoo.com/ym/Compose?To=3D=
min_compr_size=3D@0x200f9110" target=3D_blank rel=3Dnofollow ymailto=3D"m=
ailto:min_compr_size=3D@0x200f9110"><SPAN class=3Dyshortcuts id=3Dlw_1208=
930081_10><FONT color=3D#003399>min_compr_size=3D@0x200f9110</FONT></SPAN=
></A>, nodump=3Dfalse,<BR> <A href=3D"http://us.f825.ma=
il.yahoo.com/ym/Compose?To=3Dhourshift=3D@0x200f910c" target=3D_blank rel=
=3Dnofollow
ymailto=3D"mailto:hourshift=3D@0x200f910c"><SPAN class=3Dyshortcuts id=3D=
lw_1208930081_11><FONT color=3D#003399>hourshift=3D@0x200f910c</FONT></SP=
AN></A>, alter_atime=3Dfalse,<BR> same_fs=3Dfalse, what=
_to_check=3Dcf_all,<BR> snapshot=3Dfalse, cache_directo=
ry_tagging=3Dfalse,<BR> display_skipped=3Dfalse, <A hre=
f=3D"http://us.f825.mail.yahoo.com/ym/Compose?To=3Dfixed_date=3D@0x200f91=
08" target=3D_blank rel=3Dnofollow ymailto=3D"mailto:fixed_date=3D@0x200f=
9108"><SPAN class=3Dyshortcuts id=3Dlw_1208930081_12><FONT color=3D#00339=
9>fixed_date=3D@0x200f9108</FONT></SPAN></A>)<BR> at fi=
ltre.cpp:592</DIV> <DIV> </DIV> <DIV>Any help would be greatl=
y appreciated.</DIV> <DIV> </DIV> <DIV>Thanks,</DIV> <DIV>Sathees=
h </DIV><p> 
<hr size=3D1>Be a better friend, newshound, and=20
know-it-all with Yahoo! Mobile. <a href=3D"http://us.rd.yahoo.com/evt=3D5=
1733/*http://mobile.yahoo.com/;_ylt=3DAhu06i62sR8HDtDypao8Wcj9tAcJ "> Try=
it now.</a>
--0-2036151236-1208930165=:6757--
--===============1965806462==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference
Don't miss this year's exciting event. There's still time to save $100.
Use priority code J8TL2D2.
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
--===============1965806462==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Dar-libdar_api mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dar-libdar_api
--===============1965806462==--