RE: 10.0.1FP4 on IBM i getting RRV bucket is corrupt.
Rob Berendt <[email protected]> Wed, 23 Oct 2019 11:52:57 +0000
| Newsgroups | gmane.comp.systems.as400.domino |
|---|---|
| Message-ID | <BY5PR11MB4274F9BCA3F0173E953DD527A46B0@BY5PR11MB4274.namprd11.prod.outlook.com> |
I probably left off a couple of steps
13 - Repeat steps 1-12 with some additional debugging turned on.
14 - Repeat step 13 2-3 times, each time adding additional debugging.
15 - After several months HCL comes up with hotfix
16 - Wait a year or so until they figure out how to distribute the hotfix to IBM i.
Rob Berendt
--
IBM Certified System Administrator - IBM i 6.1
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com
-----Original Message-----
From: Domino400 <domino400-bounces-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org> On Behalf Of Rob Berendt
Sent: Wednesday, October 23, 2019 7:44 AM
To: Lotus Domino on the IBM i (AS/400 and iSeries) <[email protected]>
Subject: RE: 10.0.1FP4 on IBM i getting RRV bucket is corrupt.
<hcl>
Upon further collaboration with our extended team and checking logs, we found nothing on the logs provided to have the upgrade done cause the issue. Error might had appear from the cache of the SmartUpg.nsf but this is just a probability since we have a limited information based from the facts provided. Reproducing the issue with some debugging enabled might help us determine the cause of issue.
</hcl>
<robreply>
So, how would I go about and get this debugging? Would the steps involve:
1 - Restoring from backup to back when we were still on 10.0.1 and not 10.0.1FP4
2 - Run fixup/compact/updall to ensure that the databases are not corrupted.
3 - Fire off some sort of debug capability which will run all the time during the DLTLICPGM of 10.0.1 and the RSTLICPGM of 10.0.1FP4
4 - Before starting the servers, after the upgrade to 10.0.1FP4, modify the notes.ini to add some special level of debugging?
5 - Start the servers.
6 - Run fixup/compact/updall to see if the databases are corrupted
7 - Run a DESIGN
8 - Run fixup/compact/updall to see if the databases are corrupted
9 - Restart the servers, as recommended after the first DESIGN after an upgrade
10 - After the server restart, run fixup/compact/updall to see if the databases are corrupted
11 - Turn the data over to HCL so we can then get weekly updates that the engineers are looking at the data.
12 - Have step 11 continue on for months.
Is the process you envision?
</robreply>
Rob Berendt
--
IBM Certified System Administrator - IBM i 6.1
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com
-----Original Message-----
From: Domino400 <domino400-bounces-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org> On Behalf Of Rob Berendt
Sent: Monday, October 21, 2019 4:41 PM
To: Lotus Domino on the IBM i (AS/400 and iSeries) <[email protected]>
Subject: RE: 10.0.1FP4 on IBM i getting RRV bucket is corrupt.
So far it has affected two servers on this list
WRKDOMSVR
Domino Domino
Server Subsystem Library Release
GDDATA3 GDDATA3 QDOM100001 10.0.1
GDSHELP3 GDSHELP3 QDOM100001 10.0.1
GDSSALES3 GDSSALES3 QDOM100001 10.0.1
LDAP03 LDAP03 QDOM100001 10.0.1
NOTES03 NOTES03 QDOM100001 10.0.1
QUALITY3 QUALITY3 QDOM100001 10.0.1
Note: FP's are not shown in the "Release" column
Rob Berendt
--
IBM Certified System Administrator - IBM i 6.1
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com
-----Original Message-----
From: Domino400 <domino400-bounces-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org> On Behalf Of Chris Whisonant
Sent: Monday, October 21, 2019 2:55 PM
To: Lotus Domino on the IBM i (AS/400 and iSeries) <[email protected]>
Subject: Re: 10.0.1FP4 on IBM i getting RRV bucket is corrupt.
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
This is quite odd... It almost sounds like there may have been a bad
download or file extraction. Or even application of the hot fix onto the
lpar.
Although it's quite possible that it's just a bad kit from HCL, have you
tried a reinstall?
On Mon, Oct 21, 2019, 8:56 AM Rob Berendt <[email protected]> wrote:
> 7 lpars of IBM i running Domino. All lpars are at IBM i 7.4 with similar
> PTF's.
> 6 of those 7 lpars are at 10.0.1FP4. The other one is still at 10.0.1.
> One of the 10.0.1FP4 lpars supports six partitioned Domino servers. Two
> of these six had messages immediately after the upgrade.
> RRV bucket is corrupt.
> Offline maintenance is a waste of time. Need to delete and replicate from
> another server.
> Opened case. Waiting until resolution before upgrading last lpar from
> 10.0.1 to 10.0.1FP4.
>
> Upgraded from 10.0.1 on IBM i 7.4 to 10.0.1FP4. A couple of Domino
> servers are getting the following messages:
> GDDATA3:
> Unable to replicate GDDATA/DEKKO HR\LeaderEffSurvey.nsf: RRV bucket is
> corrupt.
> Unable to replicate Intern Projects.nsf: RRV bucket is corrupt.
>
> Details:
>
> GDDATA3: Time of upgrade
> 10/16/2019 09:45:12 IBM Domino (r) Server started, running Release
> 10.0.1FP4
> First RRV message:
> 10/16/2019 09:50:03 Unable to replicate HR/LeaderEffSurvey.nsf: RRV
> bucket is corrupt.
> 10/16/2019 09:50:03 Unable to replicate Intern Projects.nsf: RRV bucket
> is corrupt.
> Corrective actions:
> 10/17/2019 11:29:34 Database HR/LeaderEffSurvey.nsf deleted by Rob
> Berendt/DEKKO
> Created LeaderEffSurvey from replica
> Tried offline maintenance on the other:
> 10/18/2019 07:21:26 Server shutdown complete
> 10/18/2019 07:22:24 Database Fixup: Started: -F -J
> ...
> 10/18/2019 07:41:57 Performing consistency check on Intern
> Projects.nsf...
> 10/18/2019 07:41:57 Completed consistency check on Intern Projects.nsf
> 10/18/2019 07:41:57 Recovery Manager: Assigning new DBIID for
> /GDDATA3/NOTES/DATA/Intern Projects.nsf (need new backup for media
> recovery).
> 10/18/2019 07:41:57 Database Fixup: Unable to fixup database Intern
> Projects.nsf: RRV bucket is corrupt.
> ...
> 10/18/2019 07:43:29 Database Fixup: Shutdown
> ...
> 10/18/2019 10:57:30 Performing consistency check on Intern
> Projects.nsf...
> 10/18/2019 10:57:30 Completed consistency check on Intern Projects.nsf
> 10/18/2019 10:57:30 Recovery Manager: Assigning new DBIID for
> /GDDATA3/NOTES/DATA/Intern Projects.nsf (need new backup for media
> recovery).
> 10/18/2019 10:57:30 Error opening Intern Projects.nsf: RRV bucket is
> corrupt.
> 10/18/2019 10:57:30 Error compacting Intern Projects.nsf, -c -D -i: RRV
> bucket is corrupt.
> ...
> 10/18/2019 14:07:59 Index update process started: -R
> ...
> 10/18/2019 16:13:52 Performing consistency check on Intern
> Projects.nsf...
> 10/18/2019 16:13:52 Completed consistency check on Intern Projects.nsf
> 10/18/2019 16:13:52 Recovery Manager: Assigning new DBIID for
> /GDDATA3/NOTES/DATA/Intern Projects.nsf (need new backup for media
> recovery).
> ...
> 10/18/2019 16:14:02 Index update process shutdown
> ...
> 10/18/2019 16:58:09 IBM Domino (r) Server started, running Release
> 10.0.1FP4
> ...
> 10/18/2019 16:59:26 Performing consistency check on Intern
> Projects.nsf...
> 10/18/2019 16:59:26 Completed consistency check on Intern Projects.nsf
> 10/18/2019 16:59:26 Recovery Manager: Assigning new DBIID for
> /GDDATA3/NOTES/DATA/Intern Projects.nsf (need new backup for media
> recovery).
> 10/18/2019 16:59:26 Error checking database Intern Projects.nsf: RRV
> bucket is corrupt.
> ...
>
> NOTES03: Time of upgrade
> 10/16/2019 09:45:15 IBM Domino (r) Server started, running Release
> 10.0.1FP4
> First RRV message:
> 10/16/2019 09:48:31 Unable to replicate NOTES01/DEKKO SmartUpg.nsf: RRV
> bucket is corrupt.
> Corrective actions:
> 10/17/2019 11:24:19 Database SmartUpg.nsf deleted by Rob Berendt/DEKKO
> 10/17/2019 11:25:43 Database SmartUpg.nsf created by NOTES02/DEKKO
>
>
>
> Rob Berendt
> --
> IBM Certified System Administrator - IBM i 6.1
> Group Dekko
> Dept 1600
> Mail to: 2505 Dekko Drive
> Garrett, IN 46738
> Ship to: Dock 108
> 6928N 400E
> Kendallville, IN 46755
> http://www.dekko.com
>
> --
> This is the Lotus Domino on the IBM i (AS/400 and iSeries) (Domino400)
> mailing list
> To post a message email: [email protected]
> To subscribe, unsubscribe, or change list options,
> visit: https://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org
> Before posting, please take a moment to review the archives
> at https://archive.midrange.com/domino400.
>
--
This is the Lotus Domino on the IBM i (AS/400 and iSeries) (Domino400) mailing list
To post a message email: [email protected]
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org
Before posting, please take a moment to review the archives
at https://archive.midrange.com/domino400.
--
This is the Lotus Domino on the IBM i (AS/400 and iSeries) (Domino400) mailing list
To post a message email: [email protected]
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org
Before posting, please take a moment to review the archives
at https://archive.midrange.com/domino400.
--
This is the Lotus Domino on the IBM i (AS/400 and iSeries) (Domino400) mailing list
To post a message email: [email protected]
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org
Before posting, please take a moment to review the archives
at https://archive.midrange.com/domino400.
--
This is the Lotus Domino on the IBM i (AS/400 and iSeries) (Domino400) mailing list
To post a message email: [email protected]
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request-+hD5IHI5Xscn3HwCXmMcX9BPR1lH4CV8@public.gmane.org
Before posting, please take a moment to review the archives
at https://archive.midrange.com/domino400.