Re: Upcoping Gerrit Maintenance - Monday, 6 Oct 2 025, 12:00–13:00 UTC

We ran into another issue with the process which has been identified
<https://wikimedia.slack.com/archives/C01R06P8D1B/p1760015457631469?thread_ts=1759734023.979729&cid=C01R06P8D1B>
and will be remediated soon, All the changes have now been reverted and
we'll try again next week.

Le mar. 7 oct. 2025, 11:19, Arnaud Bran <[email protected]> a écrit :

> Hello,
>
> As mentioned, we ran into issues with the cookbook due to a typo, which
> has been fixed
> <https://gerrit.wikimedia.org/r/c/operations/cookbooks/+/1193860>.
> We plan to try again on Thursday, 12:00 UTC.
>
> The item has been added to the deployment calendar:
> https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20251009T1200
>
> Thank you for your patience.
>
>
>
> On Mon, Oct 6, 2025 at 2:47 PM Lukasz Sobanski <[email protected]>
> wrote:
>
>> We ran into issues with the cookbook / cumin before Gerrit instances were
>> switched over. All the changes have now been reverted and we'll try again
>> after investigating.
>>
>> On Mon, Oct 6, 2025 at 1:53 PM Arnaud Bran <[email protected]> wrote:
>>
>>> Hello,
>>>
>>> small reminder: we'll start in a few minutes
>>>
>>> Thank you for your understanding
>>>
>>> On Mon, Sep 29, 2025 at 3:48 PM Arnaud Bran <[email protected]> wrote:
>>>
>>>> Hello,
>>>>
>>>> We will perform maintenance on Gerrit on *Monday, October 6*, from *12:00
>>>> to 13:00 UTC*.
>>>> During this window, we expect a *~20 minutes* write outage while we
>>>> switch over Gerrit's service from the current primary (gerrit1003) to the
>>>> spare host (gerrit2003).
>>>> Since last time, we've added a few guardrails:
>>>>
>>>>    -
>>>>
>>>>    Local emergency backup on each instance.
>>>>    -
>>>>
>>>>    All instances will be *read-only during the switchover *to protect
>>>>    data integrity.
>>>>    -
>>>>
>>>>    Pre- and post-switch checks to verify everything is in the expected
>>>>    state.
>>>>
>>>> As before, we’ll perform the switchover *live with Release Engineering*
>>>> .
>>>>
>>>> This operation will allow us to unblock a few things:
>>>>
>>>>    -
>>>>
>>>>    System daemon user: *gerrit2 → gerrit (*T338470
>>>>    <https://phabricator.wikimedia.org/T338470>)
>>>>    -
>>>>
>>>>    *OS upgrade* (T392464 <https://phabricator.wikimedia.org/T392464>,
>>>>    T384595 <https://phabricator.wikimedia.org/T384595>)*, Java* (
>>>>    T392465 <https://phabricator.wikimedia.org/T392465>) version
>>>>    update and *Gerrit *(T379714
>>>>    <https://phabricator.wikimedia.org/T379714>, T392448
>>>>    <https://phabricator.wikimedia.org/T392448>) version update
>>>>
>>>> *Expected impact*
>>>>
>>>>    -
>>>>
>>>>    A ~20 minutes *read-only* window; reads (browsing, cloning,
>>>>    reviewing) should remain fine.  Pushes, votes, comments, etc. will be
>>>>    blocked during that period
>>>>    -
>>>>
>>>>    We’ll post start/end updates during the window.
>>>>
>>>> *Links*
>>>>
>>>>    -
>>>>
>>>>    Documentation:
>>>>    https://wikitech.wikimedia.org/wiki/Gerrit/Operations#Switch_over
>>>>    -
>>>>
>>>>    Phabricator: https://phabricator.wikimedia.org/T387833
>>>>    -
>>>>
>>>>    Deployment Calendar:
>>>>    https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20251006T1200
>>>>
>>>>
>>>> Thank you for your understanding.
>>>>
>>>> --
>>>> *Arnaud Bran* (he/him)
>>>> Senior Site Reliability Engineer
>>>> Wikimedia Foundation <https://wikimediafoundation.org/>
>>>>
>>> _______________________________________________
>>> Wikitech-l mailing list -- [email protected]
>>> To unsubscribe send an email to [email protected]
>>>
>>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>>
>>
>>
>> --
>> Lukasz
>> _______________________________________________
>> Wikitech-l mailing list -- [email protected]
>> To unsubscribe send an email to [email protected]
>>
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>
>

_______________________________________________
Wikitech-l mailing list -- [email protected]
To unsubscribe send an email to [email protected]
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/