Re: XBACKUP and backupd not backing up public folders (3.0.8)

Hi Deborah,

Does the same problem occur if you use sync_client (on the master server, as the cyrus user) to replicate the shared mailbox to the backup server (rather than using XBACKUP over IMAP)?  Something like "sync_client -n rsync  -m [email protected]" I think?  What about if you use "sync_client -n rsync -u [email protected]" instead (i.e. with -u treating the shared mailbox as a USER rather than as a -m MAILBOX)?

On the backup server, what does the "ctl_backups verify -vvv -m polyfoam.com.au!support" command say about the shared mailbox?  There might be personally-identifying information in this output, I can't remember -- please check/censor carefully before pasting into email.

> I'm seeing what looks like a segfault in the backup server logs.  Don't
> know if this is significant.

It's almost certainly significant.  Are you able to enable core dumps and get a backtrace from it?  That'll probably be the fastest path toward a solution.  Let me know if you need help with this :)

Cheers,

ellie

On Wed, Oct 9, 2019, at 1:46 PM, Deborah Pickett wrote:
> Hi everyone,
> 
> I'm deploying Cyrus 3.0.8 (Debian buster 3.0.8-6) at $dayjob to replace
> an Exchange server.  That part is going well, but I'm hitting a hurdle
> pulling backups of public folders (shared mailboxes, calendars and
> address books, anything outside the user/ hierarchy) using XBACKUP and
> backupd.
> 
> Steps to reproduce:
> 
> 1. On master server (mail-3175-1), run imtest and authenticate as admin.
> 2. Issue XBACKUP to backup normal user.  This succeeds.
> 3. Issue XBACKUP to backup public shared mailbox.  This produces error
> BAD PROTOCOL.
> 
> Expected behaviour is that the backup server backs up this mailbox with
> an OK response.
> 
> I'm seeing what looks like a segfault in the backup server logs.  Don't
> know if this is significant.
> 
> Help?
> 
> Main server (mail-3175-1): Debian buster, cyrus 3.0.8-6
> Backup server (rsync): Debian buster, cyrus 3.0.8-6
> 
> --- imtest session ---
> 
> mail-3175-1$ /usr/lib/cyrus/bin/imtest -a cyrus
> WARNING: no hostname supplied, assuming localhost
> 
> S: * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN
> SASL-IR] mail-3175-1 Cyrus IMAP 3.0.8-Debian-3.0.8-6 server ready
> Please enter your password:
> C: A01 AUTHENTICATE PLAIN ***DELETED***
> S: A01 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxten
> QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT
> CHILDREN MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SEARCH=FUZZY SORT
> SORT=MODSEQ SORT=DISPLAY SORT=UID THREAD=ORDEREDSUBJECT
> THREAD=REFERENCES THREAD=REFS ANNOTATEMORE ANNOTATE-EXPERIMENT-1
> METADATA LIST-EXTENDED LIST-STATUS LIST-MYRIGHTS LIST-METADATA WITHIN
> QRESYNC SCAN XLIST XMOVE MOVE SPECIAL-USE CREATE-SPECIAL-USE DIGEST=SHA1
> X-REPLICATION URLAUTH URLAUTH=BINARY LOGINDISABLED COMPRESS=DEFLATE
> X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STORAGE
> X-QUOTA=X-NUM-FOLDERS IDLE] Success (no protection)
> SESSIONID=<cyrus-***DELETED***>
> Authenticated.
> Security strength factor: 0
> AAA XBACKUP user/[email protected] rsync
> * OK USER [email protected]
> AAA OK Completed
> BBB XBACKUP [email protected] rsync
> * NO MAILBOX polyfoam.com.au!support (Bad protocol)
> BBB NO Bad protocol
> 
> --- log on master ---
> 
> Oct  9 13:31:37 mail-3175-1 cyrus/imap[189353]: login: localhost [::1]
> cyrus PLAIN User logged in
> SESSIONID=<cyrus-189353-1570588288-1-17156687401313158221>
> Oct  9 13:31:55 mail-3175-1 cyrus/imap[189353]: XBACKUP: connecting to
> server 'rsync.polyfoam.com.au' for channel 'rsync'
> Oct  9 13:32:01 mail-3175-1 cyrus/imap[189353]: XBACKUP: replicating
> user [email protected]
> Oct  9 13:32:15 mail-3175-1 cyrus/imap[189353]: XBACKUP: connecting to
> server 'rsync.polyfoam.com.au' for channel 'rsync'
> Oct  9 13:32:21 mail-3175-1 cyrus/imap[189353]: XBACKUP: replicating
> mailbox polyfoam.com.au!support
> Oct  9 13:32:21 mail-3175-1 cyrus/imap[189353]: IOERROR: zero length
> response to MAILBOXES (end of file reached)
> Oct  9 13:32:21 mail-3175-1 cyrus/imap[189353]: IOERROR: zero length
> response to RESTART (end of file reached)
> Oct  9 13:32:22 mail-3175-1 cyrus/imap[189353]: USAGE cyrus user:
> 0.059546 sys: 0.024519
> 
> --- log on backup server ---
> 
> ***successful backup of user debbiep not shown***
> Oct  9 13:32:15 rsync cyrus/backupd[21340]: telling master 2
> Oct  9 13:32:15 rsync cyrus/backupd[21340]: accepted connection
> Oct  9 13:32:15 rsync cyrus/backupd[21340]: telling master 3
> Oct  9 13:32:15 rsync cyrus/master[16697]: service backupd/ipv4 pid
> 21340 in READY state: now unavailable and in BUSY state
> Oct  9 13:32:15 rsync cyrus/master[16697]: service backupd/ipv4 now has
> 0 ready workers
> Oct  9 13:32:15 rsync cyrus/master[16697]: service backupd/ipv4 pid
> 21340 in BUSY state: now serving connection
> Oct  9 13:32:15 rsync cyrus/master[16697]: service backupd/ipv4 now has
> 0 ready workers
> Oct  9 13:32:21 rsync cyrus/backupd[21340]: login:
> mail-3175-1.polyfoam.com.au [10.3.244.125] rsync-mail-3175-1 DIGEST-MD5
> User logged in
> Oct  9 13:32:21 rsync cyrus/master[16697]: process type:SERVICE
> name:backupd path:/usr/lib/cyrus/bin/backupd age:25.007s pid:21340
> signaled to death by signal 11 (Segmentation fault)
> Oct  9 13:32:21 rsync cyrus/master[16697]: service backupd/ipv4 pid
> 21340 in BUSY state: terminated abnormally
> Oct  9 13:32:21 rsync cyrus/master[16697]: service backupd/ipv4 now has
> 0 ready workers
> 
> ---master config---
> 
> admins: cyrus
> allowanonymouslogin: no
> allowplaintext: yes
> altnamespace: yes
> autocreate_inbox_folders: Junk|Trash|Archive|Drafts|Important|Sent
> autocreate_post: yes
> autocreate_quota: 0
> autocreate_subscribe_folders: Junk|Trash|Archive|Drafts|Sent
> calendarprefix: #calendars
> configdirectory: /var/lib/cyrus
> defaultdomain: ad.polyfoam.com.au
> defaultpartition: default
> hashimapspool: true
> httpmodules: caldav carddav
> idlesocket: /run/cyrus/socket/idle
> lmtp_downcase_rcpt: yes
> lmtpsocket: /run/cyrus/socket/lmtp
> loginrealms:  ad.polyfoam.com.au polyfoam.com.au flexifoam.com.au
> mboxname_lockpath: /run/cyrus/lock
> newsspool: /var/spool/news
> notifysocket: /run/cyrus/socket/notify
> partition-default: /var/spool/cyrus/mail
> partition-news: /var/spool/cyrus/news
> popminpoll: 1
> proc_path: /run/cyrus/proc
> rsync_sync_authname: rsync-mail-3175-1@rsync
> rsync_sync_host: rsync.polyfoam.com.au
> rsync_sync_password: ***DELETED***
> rsync_sync_port: csync
> sasl_auto_transition: no
> sasl_auxprop_plugin: sasldb
> sasl_mech_list: PLAIN
> sasl_pwcheck_method: auxprop saslauthd
> sievedir: /var/spool/sieve
> sieveusehomedir: false
> syslog_prefix: cyrus
> tls_client_ca_dir: /etc/ssl/certs
> tls_server_cert: /etc/cert/mail-3175-1.polyfoam.com.au.crt
> tls_server_key: /etc/cert/mail-3175-1.polyfoam.com.au.key
> tls_session_timeout: 1440
> umask: 077
> unixhierarchysep: yes
> virtdomains: on
> xbackup_enabled: yes
> xlist-Archive: Archive
> xlist-Drafts: Drafts
> xlist-Important: Important
> xlist-Junk: Junk
> xlist-Sent: Drafts
> xlist-Trash: Trash
> 
> ---backup config---
> 
> admins: rsync-mail-3175-1
> allowanonymouslogin: no
> altnamespace: yes
> backup_compact_maxsize: 0
> backup_compact_minsize: 0
> backup_compact_work_threshold: 1
> backup_db: twoskip
> backuppartition-name: /home/mail-3175-1/cyrus-backup/partitions/default
> backup_retention_days: 7
> configdirectory: /var/lib/cyrus
> debug: 1
> defaultdomain: rsync
> mboxname_lockpath: /run/cyrus/lock
> proc_path: /run/cyrus/proc
> sasl_auxprop_plugin: sasldb
> sasl_mech_list: DIGEST-MD5
> sasl_pwcheck_method: auxprop
> syslog_prefix: cyrus
> unixhierarchysep: yes
> virtdomains: on
> 
> ----
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus