Re: Corrupt checkout, but 'svn status' and 'svn diff' refuse to admit it?

EML <[email protected]> Thu, 10 Jul 2025 18:51:07 +0100
Newsgroups gmane.comp.version-control.subversion.user
Message-ID <[email protected]>
This is a multi-part message in MIME format.
--------------t3S0om4T8gj2mfNngq8mimWi
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit


On 10/07/2025 16:37, Johan Corveleyn wrote:
> On Wed, Jul 9, 2025 at 9:53 PM EML<[email protected]> wrote:
>> (1) I have a 2+ GB repo which I committed to today, to reach rev 357
>> (2) I then attempted to use a SQL database in the checkout, which turned out to be corrupt. When importing in MariaDB, it complained about a null char in the database
>> (3) The database was last committed at r335. I know it hasn't changed since r335, and 'svn log' shows r335 as the last commit, two months ago. I have imported the database on several occasions since then, without problems, when building a VM
>> (4) I then checked out the entire project at r335 to find out if the database has changed. If I do a standard diff of the database in r357 and r335 they are different. They are the same size, but the r357 version contains binary non-printing data, which is why MariaDB doesn't like it
>> (5) After the r357 checkin today, I modified one text file. I deleted this, and did an 'svn update' at the top level, to get a clean r357
>> (6) In the current checkout, 'svn status' shows no modifications. If I run 'svn diff -r335 my-database.sql' this reports no differences. So, svn thinks the new and old databases are identical, but the plain diff clearly shows they are different
>> (7) I then did a new complete checkout of the entire project at r357. The database in this new checkout is correct - it's identical to the r335 version
>> (8) The repo looks good - 'svnadmin dump' doesn't complain, anyway
>> (9) db/fs-type says fsfs
>> (10) Both the checkout and the repo are on the same machine, using WebDAV, version 1.14.1 (r1886195), Ubuntu 22.04
>> (11) There are some changes in the .svn directory between the "current" r357 and the just-checked-out r357
>> (12) This is a WordPress database. 'file' reports it as UTF-8 text, and 'wc -L' reports a maximum line length of 693319 characters. It doesn't have an svn:mime-type property.
>>
>> Conclusion: it's possible that a checkout can be corrupted in a way that bypasses detection by svn itself. Is this a reasonable conclusion, or have I missed something? Is there a maximum line length limit for a "text" file?
> [ Moved dev@ to bcc so it is dropped on further replies, and added
> users@ to cc. This is at first a question for the users list. ]
>
> If I understand correctly you have one broken working copy in which
> the contents of my-database.sql became corrupted somehow (containing
> binary data, while it should be UTF-8 text and a valid database). In
> the SVN repository that same file is still correct, and a new checkout
> at r357 confirms that.
>
> In general, the file in your $broken_workingcopy might have been
> changed out-of-band, by some other tool, a virus, a disk failure, ...
> but the main question is: why doesn't your $broken_workingcopy detect
> that it's modified?
>
> Is that a correct rephrasing of your question?

Yes, that's right. I can live with a broken working copy, but only if 
Subversion can tell me that it's broken.

Thanks. I've clarified some of the formatting above to make it obvious 
that it was a list.

--------------t3S0om4T8gj2mfNngq8mimWi
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 10/07/2025 16:37, Johan Corveleyn
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAB84uBUfbhpA3CNF6uvm-5ET699E0-ALZHgvYfGaoEfame=hhw@mail.gmail.com">
      <pre wrap="" class="moz-quote-pre">On Wed, Jul 9, 2025 at 9:53 PM EML <a class="moz-txt-link-rfc2396E" href="mailto:[email protected]">&lt;[email protected]&gt;</a> wrote:
</pre>
      <blockquote type="cite">
        <pre wrap="" class="moz-quote-pre">
(1) I have a 2+ GB repo which I committed to today, to reach rev 357
(2) I then attempted to use a SQL database in the checkout, which turned out to be corrupt. When importing in MariaDB, it complained about a null char in the database
(3) The database was last committed at r335. I know it hasn't changed since r335, and 'svn log' shows r335 as the last commit, two months ago. I have imported the database on several occasions since then, without problems, when building a VM
(4) I then checked out the entire project at r335 to find out if the database has changed. If I do a standard diff of the database in r357 and r335 they are different. They are the same size, but the r357 version contains binary non-printing data, which is why MariaDB doesn't like it
(5) After the r357 checkin today, I modified one text file. I deleted this, and did an 'svn update' at the top level, to get a clean r357
(6) In the current checkout, 'svn status' shows no modifications. If I run 'svn diff -r335 my-database.sql' this reports no differences. So, svn thinks the new and old databases are identical, but the plain diff clearly shows they are different
(7) I then did a new complete checkout of the entire project at r357. The database in this new checkout is correct - it's identical to the r335 version
(8) The repo looks good - 'svnadmin dump' doesn't complain, anyway
(9) db/fs-type says fsfs
(10) Both the checkout and the repo are on the same machine, using WebDAV, version 1.14.1 (r1886195), Ubuntu 22.04
(11) There are some changes in the .svn directory between the "current" r357 and the just-checked-out r357
(12) This is a WordPress database. 'file' reports it as UTF-8 text, and 'wc -L' reports a maximum line length of 693319 characters. It doesn't have an svn:mime-type property.

Conclusion: it's possible that a checkout can be corrupted in a way that bypasses detection by svn itself. Is this a reasonable conclusion, or have I missed something? Is there a maximum line length limit for a "text" file?
</pre>
      </blockquote>
      <pre wrap="" class="moz-quote-pre">
[ Moved dev@ to bcc so it is dropped on further replies, and added
users@ to cc. This is at first a question for the users list. ]

If I understand correctly you have one broken working copy in which
the contents of my-database.sql became corrupted somehow (containing
binary data, while it should be UTF-8 text and a valid database). In
the SVN repository that same file is still correct, and a new checkout
at r357 confirms that.

In general, the file in your $broken_workingcopy might have been
changed out-of-band, by some other tool, a virus, a disk failure, ...
but the main question is: why doesn't your $broken_workingcopy detect
that it's modified?

Is that a correct rephrasing of your question?</pre>
    </blockquote>
    <p>Yes, that's right. I can live with a broken working copy, but
      only if Subversion can tell me that it's broken.</p>
    <p>Thanks. I've clarified some of the formatting above to make it
      obvious that it was a list.</p>
  </body>
</html>

--------------t3S0om4T8gj2mfNngq8mimWi--