OK, I think I solved it.
Apparently, cyrus wasn't the only thing that failed. Basically everything that used those certificates failed.
I don't really understand what's going on, but apparently Openssl has been updated, and those certificates were older versions that are now discarded by openssl somehow?
I ended up creating new certificates and they work, everything seems to work with them, not just cyrus.
------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/T095c648989aa4da2-M687091e35944af9f9b2de843
Delivery options: https://cyrus.topicbox.com/groups/info/subscription
lmpx.com only provides a reader for public news (NNTP) servers. It is not
affiliated with the servers or forums shown here and is not responsible for
the content of articles, which is written by their respective authors.