[PATCH net-next v14 11/15] quic: add crypto key derivation and installation
Xin Long <[email protected]> Wed, 15 Jul 2026 16:27:14 -0400
| Newsgroups | dev.linux.lists.quic,dev.linux.lists.kernel-tls-handshake,org.kernel.vger.linux-cifs,org.kernel.vger.netdev |
|---|---|
| Message-ID | <7efe73a228a8f1fae5eec84772423a4aa62d70ca.1784147238.git.lucien.xin@gmail.com> |
This patch introduces 'quic_crypto', a component responsible for QUIC encryption key derivation and installation across the various key levels: Initial, Handshake, 0-RTT (Early), and 1-RTT (Application). It provides helpers to derive and install initial secrets, set traffic secrets and install the corresponding keys, and perform key updates to enable forward secrecy. Additionally, it implements stateless reset token generation, used to support connection reset without state. - quic_crypto_initial_keys_install(): Derive and install initial keys. - quic_crypto_set_cipher(): Allocate all transforms based on the cipher type provided. - quic_crypto_set_secret(): Set the traffic secret and install derived keys. - quic_crypto_key_update(): Rekey and install new keys to the !phase side. - quic_crypto_derive_secret(): Generate token for stateless reset or master key for session resumption. These mechanisms are essential for establishing and maintaining secure communication throughout the QUIC connection lifecycle. Signed-off-by: Pengtao He <[email protected]> Signed-off-by: Moritz Buhl <[email protected]> Signed-off-by: Xin Long <[email protected]> --- v3: - Remove lock from quic_net, since Initial packet decryption for ALPN will be handled serially in a workqueue when ALPN demux is enabled. v4: - Use local cipher pointer in quic_crypto_set_secret() to avoid a warning from Smatch. v5: - Change the timestamp variables from u32 to u64, which provides sufficient precision for timestamps in microsecond. v8: - Remove the redundant err initialization in quic_net_init(), since err is now assigned from quic_crypto_set_cipher(). v10: - Fix header protection key passed to pr_debug(). - Fix typo: "For example,to ..." -> "For example, to ..." in comment. - Remove redundant initialization of err in quic_crypto_set_cipher(). v11: - Note for AI reviews: later patches guarantee all tfms (including secret_tfm) are set before any quic_crypto function uses them. - Set maximum line length to 80 characters. - Merge quic_crypto_rx/tx_keys_derive_and_install() to quic_crypto_keys_derive_and_install() with an extra parameter to reduce code duplication (noted by AI review). - Change flag parameter type to u32 in quic_crypto_set_secret() and quic_crypto_set_cipher(). v12: - Remove the unused hash parameter from quic_crypto_hkdf_expand() and update all callers. - Use put_unaligned_be16() instead of open-coding the conversion in quic_crypto_hkdf_expand(). - Pass the key phase to quic_crypto_keys_derive_and_install() and update its callers; do not modify crypto->key_pending when invoking it from quic_crypto_key_update(). - Update comments for tx_secret and rx_secret in struct quic_crypto. - Add async_pending to struct quic_crypto to indicate when no async crypto operations are pending, enabling key updates in a later patch. - Add quic_sock_destruct() to free crypto resources at the last moment. - Remove quic_crypto_get_secret(), as userspace is no longer allowed to access secret information. - Remove the flag parameter from quic_crypto_set_secret() and quic_crypto_set_cipher(); all AEAD TFMs are now allocated in async mode, and crypto_wait will be used for synchronous mode later. - Remove tag_tfm from struct quic_crypto; use tx/rx_tfm[1] in initial listen socket crypto for token validation instead. - Implement hkdf_expand() and hkdf_extract() locally, as they are no longer available in the latest kernel crypto API. - Add key_derived in quic_crypto to prevent repeated key updates on spoofed packets, and check and update it in quic_crypto_key_update(). v13: - Remove pr_debug() from keys_derive_and_install() as it exposes raw QUIC key material. - Add comment documenting deferred crypto free in quic_sock_destruct(). v14: - Constify the cipher member in struct quic_crypto and ciphers[]. - Move desc->tfm = tfm after crypto_shash_setkey() in quic_crypto_hkdf_expand(). - Remove QUIC_RANDOM_DATA_LEN, quic_random_data, and quic_crypto_init(), as quic_random_data is replaced by the per-socket initial crypto->tx_secret[1] (noted by Sashiko AI review). - Introduce quic_crypto_set_token_secret() to initialize crypto->tx_secret[1]. - Rename quic_crypto_generate_key() to quic_crypto_derive_secret(), replace quic_random_data with crypto->tx_secret[1], and remove quic_crypto_generate_stateless_reset_token() and quic_crypto_generate_session_ticket_key(). --- net/quic/Makefile | 2 +- net/quic/crypto.c | 567 ++++++++++++++++++++++++++++++++++++++++++++ net/quic/crypto.h | 74 ++++++ net/quic/protocol.c | 11 +- net/quic/protocol.h | 2 + net/quic/socket.c | 12 + net/quic/socket.h | 7 + 7 files changed, 673 insertions(+), 2 deletions(-) create mode 100644 net/quic/crypto.c create mode 100644 net/quic/crypto.h diff --git a/net/quic/Makefile b/net/quic/Makefile index 9d8e18297911..58bb18f7926d 100644 --- a/net/quic/Makefile +++ b/net/quic/Makefile @@ -6,4 +6,4 @@ obj-$(CONFIG_IP_QUIC) += quic.o quic-y := common.o family.o protocol.o socket.o stream.o connid.o path.o \ - cong.o pnspace.o + cong.o pnspace.o crypto.o diff --git a/net/quic/crypto.c b/net/quic/crypto.c new file mode 100644 index 000000000000..910557b68052 --- /dev/null +++ b/net/quic/crypto.c @@ -0,0 +1,567 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* QUIC kernel implementation + * (C) Copyright Red Hat Corp. 2023 + * + * This file is part of the QUIC kernel implementation + * + * Initialization/cleanup for QUIC protocol support. + * + * Written or modified by: + * Xin Long <[email protected]> + */ + +#include <crypto/skcipher.h> +#include <linux/skbuff.h> +#include <crypto/aead.h> +#include <crypto/hash.h> +#include <linux/quic.h> +#include <net/tls.h> + +#include "common.h" +#include "crypto.h" + +/* HKDF-Extract. */ +static int quic_crypto_hkdf_extract(struct crypto_shash *tfm, + struct quic_data *srt, + struct quic_data *hash, + struct quic_data *key) +{ + int err; + + err = crypto_shash_setkey(tfm, srt->data, srt->len); + if (err) + return err; + + return crypto_shash_tfm_digest(tfm, hash->data, hash->len, key->data); +} + +#define QUIC_MAX_INFO_LEN 256 + +/* HKDF-Expand-Label. */ +static int quic_crypto_hkdf_expand(struct crypto_shash *tfm, + struct quic_data *srt, + struct quic_data *label, + struct quic_data *key) +{ + u8 info[QUIC_MAX_INFO_LEN], *p = info, tmp[QUIC_SECRET_LEN]; + unsigned int i, infolen, hashlen = srt->len; + SHASH_DESC_ON_STACK(desc, tfm); + u8 LABEL[] = "tls13 ", cnt = 1; + const u8 *prev = NULL; + int err; + + /* rfc8446#section-7.1: + * + * HKDF-Expand-Label(Secret, Label, Context, Length) = + * HKDF-Expand(Secret, HkdfLabel, Length) + * + * Where HkdfLabel is specified as: + * + * struct { + * uint16 length = Length; + * opaque label<7..255> = "tls13 " + Label; + * opaque context<0..255> = Context; + * } HkdfLabel; + */ + put_unaligned_be16(key->len, p); + p += 2; + *p++ = (u8)(sizeof(LABEL) - 1 + label->len); + p = quic_put_data(p, LABEL, sizeof(LABEL) - 1); + p = quic_put_data(p, label->data, label->len); + *p++ = 0; + infolen = (unsigned int)(p - info); + + err = crypto_shash_setkey(tfm, srt->data, srt->len); + if (err) + return err; + desc->tfm = tfm; + + for (i = 0; i < key->len; i += hashlen) { + err = crypto_shash_init(desc); + if (err) + goto out; + + if (prev) { + err = crypto_shash_update(desc, prev, hashlen); + if (err) + goto out; + } + + err = crypto_shash_update(desc, info, infolen); + if (err) + goto out; + + BUILD_BUG_ON(sizeof(cnt) != 1); + if (key->len - i < hashlen) { + err = crypto_shash_finup(desc, &cnt, 1, tmp); + if (err) + goto out; + memcpy(&key->data[i], tmp, key->len - i); + memzero_explicit(tmp, sizeof(tmp)); + } else { + err = crypto_shash_finup(desc, &cnt, 1, &key->data[i]); + if (err) + goto out; + } + cnt++; + prev = &key->data[i]; + } +out: + shash_desc_zero(desc); + memzero_explicit(tmp, sizeof(tmp)); + return err; +} + +#define KEY_LABEL_V1 "quic key" +#define IV_LABEL_V1 "quic iv" +#define HP_KEY_LABEL_V1 "quic hp" + +#define KU_LABEL_V1 "quic ku" + +/* rfc9369#section-3.3.2: + * + * The labels used in rfc9001 to derive packet protection keys, header + * protection keys, Retry Integrity Tag keys, and key updates change from "quic + * key" to "quicv2 key", from "quic iv" to "quicv2 iv", from "quic hp" to + * "quicv2 hp", and from "quic ku" to "quicv2 ku". + */ +#define KEY_LABEL_V2 "quicv2 key" +#define IV_LABEL_V2 "quicv2 iv" +#define HP_KEY_LABEL_V2 "quicv2 hp" + +#define KU_LABEL_V2 "quicv2 ku" + +/* Packet Protection Keys. */ +static int quic_crypto_keys_derive(struct crypto_shash *tfm, + struct quic_data *s, struct quic_data *k, + struct quic_data *i, struct quic_data *hp_k, + u32 version) +{ + struct quic_data hp_k_l = {HP_KEY_LABEL_V1, strlen(HP_KEY_LABEL_V1)}; + struct quic_data k_l = {KEY_LABEL_V1, strlen(KEY_LABEL_V1)}; + struct quic_data i_l = {IV_LABEL_V1, strlen(IV_LABEL_V1)}; + int err; + + /* rfc9001#section-5.1: + * + * The current encryption level secret and the label "quic key" are + * input to the KDF to produce the AEAD key; the label "quic iv" is + * used to derive the Initialization Vector (IV). The header protection + * key uses the "quic hp" label. Using these labels provides key + * separation between QUIC and TLS. + */ + if (version == QUIC_VERSION_V2) { + quic_data(&hp_k_l, HP_KEY_LABEL_V2, strlen(HP_KEY_LABEL_V2)); + quic_data(&k_l, KEY_LABEL_V2, strlen(KEY_LABEL_V2)); + quic_data(&i_l, IV_LABEL_V2, strlen(IV_LABEL_V2)); + } + + err = quic_crypto_hkdf_expand(tfm, s, &k_l, k); + if (err) + return err; + err = quic_crypto_hkdf_expand(tfm, s, &i_l, i); + if (err) + return err; + /* Don't change hp key for key update. */ + if (!hp_k) + return 0; + + return quic_crypto_hkdf_expand(tfm, s, &hp_k_l, hp_k); +} + +/* Derive and install reception (RX) or transmission (TX) packet protection + * keys for the current key phase. This installs AEAD protection key, IV, and + * optionally header protection key. + */ +static int quic_crypto_keys_derive_and_install(struct quic_crypto *crypto, + bool rx, u8 phase) +{ + struct quic_data srt = {}, k, iv, hp_k = {}, *hp = NULL; + u8 key[QUIC_KEY_LEN], hp_key[QUIC_KEY_LEN] = {}; + u32 keylen, ivlen = QUIC_IV_LEN; + struct crypto_skcipher *hp_tfm; + struct crypto_aead *tfm; + int err; + + keylen = crypto->cipher->keylen; + quic_data(&k, key, keylen); + + if (rx) { + quic_data(&srt, crypto->rx_secret[phase], + crypto->cipher->secretlen); + quic_data(&iv, crypto->rx_iv[phase], ivlen); + tfm = crypto->rx_tfm[phase]; + hp_tfm = crypto->rx_hp_tfm; + } else { + quic_data(&srt, crypto->tx_secret[phase], + crypto->cipher->secretlen); + quic_data(&iv, crypto->tx_iv[phase], ivlen); + tfm = crypto->tx_tfm[phase]; + hp_tfm = crypto->tx_hp_tfm; + } + + /* Only derive header protection key when not in key update. */ + if (crypto->key_phase == phase) + hp = quic_data(&hp_k, hp_key, keylen); + err = quic_crypto_keys_derive(crypto->secret_tfm, &srt, &k, &iv, hp, + crypto->version); + if (err) + goto out; + err = crypto_aead_setauthsize(tfm, QUIC_TAG_LEN); + if (err) + goto out; + err = crypto_aead_setkey(tfm, key, keylen); + if (err) + goto out; + if (hp) { + err = crypto_skcipher_setkey(hp_tfm, hp_key, keylen); + if (err) + goto out; + } +out: + memzero_explicit(key, sizeof(key)); + memzero_explicit(hp_key, sizeof(hp_key)); + return err; +} + +#define QUIC_CIPHER_MIN TLS_CIPHER_AES_GCM_128 +#define QUIC_CIPHER_MAX TLS_CIPHER_CHACHA20_POLY1305 + +#define TLS_CIPHER_AES_GCM_128_SECRET_SIZE 32 +#define TLS_CIPHER_AES_GCM_256_SECRET_SIZE 48 +#define TLS_CIPHER_AES_CCM_128_SECRET_SIZE 32 +#define TLS_CIPHER_CHACHA20_POLY1305_SECRET_SIZE 32 + +#define CIPHER_DESC(type, aead_n, skc_n, sha_n)[type - QUIC_CIPHER_MIN] = { \ + .secretlen = type ## _SECRET_SIZE, \ + .keylen = type ## _KEY_SIZE, \ + .aead = aead_n, \ + .skc = skc_n, \ + .shash = sha_n, \ +} + +static const struct quic_cipher +ciphers[QUIC_CIPHER_MAX + 1 - QUIC_CIPHER_MIN] = { + CIPHER_DESC(TLS_CIPHER_AES_GCM_128, + "gcm(aes)", "ecb(aes)", "hmac(sha256)"), + CIPHER_DESC(TLS_CIPHER_AES_GCM_256, + "gcm(aes)", "ecb(aes)", "hmac(sha384)"), + CIPHER_DESC(TLS_CIPHER_AES_CCM_128, + "ccm(aes)", "ecb(aes)", "hmac(sha256)"), + CIPHER_DESC(TLS_CIPHER_CHACHA20_POLY1305, + "rfc7539(chacha20,poly1305)", "chacha20", "hmac(sha256)"), +}; + +int quic_crypto_set_cipher(struct quic_crypto *crypto, u32 type) +{ + const struct quic_cipher *cipher; + void *tfm; + int err; + + if (type < QUIC_CIPHER_MIN || type > QUIC_CIPHER_MAX) + return -EINVAL; + + cipher = &ciphers[type - QUIC_CIPHER_MIN]; + tfm = crypto_alloc_shash(cipher->shash, 0, 0); + if (IS_ERR(tfm)) + return PTR_ERR(tfm); + crypto->secret_tfm = tfm; + + /* Allocate AEAD and HP transform for each RX key phase. */ + tfm = crypto_alloc_aead(cipher->aead, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->rx_tfm[0] = tfm; + tfm = crypto_alloc_aead(cipher->aead, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->rx_tfm[1] = tfm; + tfm = crypto_alloc_sync_skcipher(cipher->skc, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->rx_hp_tfm = tfm; + + /* Allocate AEAD and HP transform for each TX key phase. */ + tfm = crypto_alloc_aead(cipher->aead, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->tx_tfm[0] = tfm; + tfm = crypto_alloc_aead(cipher->aead, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->tx_tfm[1] = tfm; + tfm = crypto_alloc_sync_skcipher(cipher->skc, 0, 0); + if (IS_ERR(tfm)) { + err = PTR_ERR(tfm); + goto err; + } + crypto->tx_hp_tfm = tfm; + + crypto->cipher = cipher; + crypto->cipher_type = type; + return 0; +err: + quic_crypto_free(crypto); + return err; +} + +int quic_crypto_set_secret(struct quic_crypto *crypto, + struct quic_crypto_secret *srt, u32 version) +{ + const struct quic_cipher *cipher; + u8 phase = crypto->key_phase; + int err; + + /* If no cipher has been initialized yet, set it up. */ + if (!crypto->cipher) { + err = quic_crypto_set_cipher(crypto, srt->type); + if (err) + return err; + } + cipher = crypto->cipher; + + /* Handle RX path setup. */ + if (!srt->send) { + crypto->version = version; + memcpy(crypto->rx_secret[phase], srt->secret, + cipher->secretlen); + err = quic_crypto_keys_derive_and_install(crypto, true, phase); + if (err) + return err; + crypto->recv_ready = 1; + return 0; + } + + /* Handle TX path setup. */ + crypto->version = version; + memcpy(crypto->tx_secret[phase], srt->secret, cipher->secretlen); + err = quic_crypto_keys_derive_and_install(crypto, false, phase); + if (err) + return err; + crypto->send_ready = 1; + return 0; +} + +/* Save token secret in Initial TX secret (phase 1) for token generation. */ +int quic_crypto_set_token_secret(struct quic_crypto *crypto) +{ + /* Reuse TX AEAD (phase 1) in Initial crypto. */ + u8 key[TLS_CIPHER_AES_GCM_128_KEY_SIZE], *srt = crypto->tx_secret[1]; + struct crypto_aead *tfm = crypto->tx_tfm[1]; + struct quic_data s = {}, k, i; + int err; + + if (!memchr_inv(srt, 0, TLS_CIPHER_AES_GCM_128_SECRET_SIZE)) + get_random_bytes(srt, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + + quic_data(&s, srt, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + quic_data(&k, key, TLS_CIPHER_AES_GCM_128_KEY_SIZE); + quic_data(&i, crypto->tx_iv[1], QUIC_IV_LEN); + err = quic_crypto_keys_derive(crypto->secret_tfm, &s, &k, &i, NULL, + QUIC_VERSION_V1); + if (err) + goto out; + err = crypto_aead_setauthsize(tfm, QUIC_TAG_LEN); + if (err) + goto out; + err = crypto_aead_setkey(tfm, key, TLS_CIPHER_AES_GCM_128_KEY_SIZE); +out: + memzero_explicit(key, sizeof(key)); + return err; +} + +/* Initiating a Key Update. */ +int quic_crypto_key_update(struct quic_crypto *crypto) +{ + struct quic_data l = {KU_LABEL_V1, strlen(KU_LABEL_V1)}; + u8 phase = crypto->key_phase; + struct quic_data k, srt; + u32 secret_len; + int err; + + if (crypto->key_pending || !crypto->recv_ready) + return -EINVAL; + if (crypto->key_derived) + return 0; + + /* rfc9001#section-6.1: + * + * Endpoints maintain separate read and write secrets for packet + * protection. An endpoint initiates a key update by updating its + * packet protection write secret and using that to protect new + * packets. The endpoint creates a new write secret from the existing + * write secret. This uses the KDF function provided by TLS with a + * label of "quic ku". The corresponding key and IV are created from + * that secret. The header protection key is not updated. + * + * For example, to update write keys with TLS 1.3, HKDF-Expand-Label is + * used as: + * secret_<n+1> = HKDF-Expand-Label(secret_<n>, "quic ku", + * "", Hash.length) + */ + secret_len = crypto->cipher->secretlen; + if (crypto->version == QUIC_VERSION_V2) + quic_data(&l, KU_LABEL_V2, strlen(KU_LABEL_V2)); + + quic_data(&srt, crypto->tx_secret[phase], secret_len); + quic_data(&k, crypto->tx_secret[!phase], secret_len); + err = quic_crypto_hkdf_expand(crypto->secret_tfm, &srt, &l, &k); + if (err) + return err; + err = quic_crypto_keys_derive_and_install(crypto, false, !phase); + if (err) + return err; + + quic_data(&srt, crypto->rx_secret[phase], secret_len); + quic_data(&k, crypto->rx_secret[!phase], secret_len); + err = quic_crypto_hkdf_expand(crypto->secret_tfm, &srt, &l, &k); + if (err) + return err; + err = quic_crypto_keys_derive_and_install(crypto, true, !phase); + if (err) + return err; + + crypto->key_derived = 1; + return 0; +} + +void quic_crypto_free(struct quic_crypto *crypto) +{ + if (crypto->rx_tfm[0]) + crypto_free_aead(crypto->rx_tfm[0]); + if (crypto->rx_tfm[1]) + crypto_free_aead(crypto->rx_tfm[1]); + if (crypto->tx_tfm[0]) + crypto_free_aead(crypto->tx_tfm[0]); + if (crypto->tx_tfm[1]) + crypto_free_aead(crypto->tx_tfm[1]); + if (crypto->secret_tfm) + crypto_free_shash(crypto->secret_tfm); + if (crypto->rx_hp_tfm) + crypto_free_skcipher(crypto->rx_hp_tfm); + if (crypto->tx_hp_tfm) + crypto_free_skcipher(crypto->tx_hp_tfm); + + memzero_explicit(crypto, offsetof(struct quic_crypto, send_offset)); +} + +#define QUIC_INITIAL_SALT_V1 \ + "\x38\x76\x2c\xf7\xf5\x59\x34\xb3\x4d\x17" \ + "\x9a\xe6\xa4\xc8\x0c\xad\xcc\xbb\x7f\x0a" + +#define QUIC_INITIAL_SALT_V2 \ + "\x0d\xed\xe3\xde\xf7\x00\xa6\xdb\x81\x93" \ + "\x81\xbe\x6e\x26\x9d\xcb\xf9\xbd\x2e\xd9" + +#define QUIC_INITIAL_SALT_LEN 20 + +/* Initial Secrets. */ +int quic_crypto_initial_keys_install(struct quic_crypto *crypto, + struct quic_conn_id *conn_id, + u32 version, bool is_serv) +{ + u8 secret[TLS_CIPHER_AES_GCM_128_SECRET_SIZE]; + struct quic_data salt, s, k, l, dcid; + struct quic_crypto_secret srt = {}; + char *tl, *rl, *sal; + int err; + + /* rfc9001#section-5.2: + * + * The secret used by clients to construct Initial packets uses the PRK + * and the label "client in" as input to the HKDF-Expand-Label function + * from TLS [TLS13] to produce a 32-byte secret. Packets constructed by + * the server use the same process with the label "server in". The hash + * function for HKDF when deriving initial secrets and keys is SHA-256 + * [SHA]. + * + * This process in pseudocode is: + * + * initial_salt = 0x38762cf7f55934b34d179ae6a4c80cadccbb7f0a + * initial_secret = HKDF-Extract(initial_salt, + * client_dst_connection_id) + * + * client_initial_secret = HKDF-Expand-Label(initial_secret, + * "client in", "", + * Hash.length) + * server_initial_secret = HKDF-Expand-Label(initial_secret, + * "server in", "", + * Hash.length) + */ + if (is_serv) { + rl = "client in"; + tl = "server in"; + } else { + tl = "client in"; + rl = "server in"; + } + sal = QUIC_INITIAL_SALT_V1; + if (version == QUIC_VERSION_V2) + sal = QUIC_INITIAL_SALT_V2; + quic_data(&salt, sal, QUIC_INITIAL_SALT_LEN); + quic_data(&dcid, conn_id->data, conn_id->len); + quic_data(&s, secret, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + err = quic_crypto_hkdf_extract(crypto->secret_tfm, &salt, &dcid, &s); + if (err) + goto out; + + quic_data(&l, tl, strlen(tl)); + quic_data(&k, srt.secret, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + srt.type = TLS_CIPHER_AES_GCM_128; + srt.send = 1; + err = quic_crypto_hkdf_expand(crypto->secret_tfm, &s, &l, &k); + if (err) + goto out; + err = quic_crypto_set_secret(crypto, &srt, version); + if (err) + goto out; + + quic_data(&l, rl, strlen(rl)); + quic_data(&k, srt.secret, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + srt.type = TLS_CIPHER_AES_GCM_128; + srt.send = 0; + err = quic_crypto_hkdf_expand(crypto->secret_tfm, &s, &l, &k); + if (err) + goto out; + err = quic_crypto_set_secret(crypto, &srt, version); +out: + memzero_explicit(secret, sizeof(secret)); + memzero_explicit(&srt, sizeof(srt)); + return err; +} + +/* Derive a secret using HKDF-Extract and HKDF-Expand with the given label. + * Used to generate a stateless reset token or session resumption master key. + */ +int quic_crypto_derive_secret(struct quic_crypto *crypto, void *data, u32 len, + char *label, u8 *srt, u32 srt_len) +{ + struct crypto_shash *tfm = crypto->secret_tfm; + u8 secret[TLS_CIPHER_AES_GCM_128_SECRET_SIZE]; + struct quic_data salt, s, l, k; + int err; + + quic_data(&salt, data, len); + quic_data(&k, crypto->tx_secret[1], TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + quic_data(&s, secret, TLS_CIPHER_AES_GCM_128_SECRET_SIZE); + err = quic_crypto_hkdf_extract(tfm, &salt, &k, &s); + if (err) + goto out; + + quic_data(&l, label, strlen(label)); + quic_data(&k, srt, srt_len); + err = quic_crypto_hkdf_expand(tfm, &s, &l, &k); +out: + memzero_explicit(secret, sizeof(secret)); + return err; +} diff --git a/net/quic/crypto.h b/net/quic/crypto.h new file mode 100644 index 000000000000..6d61044fccd3 --- /dev/null +++ b/net/quic/crypto.h @@ -0,0 +1,74 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +/* QUIC kernel implementation + * (C) Copyright Red Hat Corp. 2023 + * + * This file is part of the QUIC kernel implementation + * + * Written or modified by: + * Xin Long <[email protected]> + */ + +#define QUIC_TAG_LEN 16 +#define QUIC_IV_LEN 12 +#define QUIC_KEY_LEN 32 +#define QUIC_SECRET_LEN 48 + +#define QUIC_TOKEN_FLAG_REGULAR 0 +#define QUIC_TOKEN_FLAG_RETRY 1 +#define QUIC_TOKEN_TIMEOUT_RETRY 3000000 +#define QUIC_TOKEN_TIMEOUT_REGULAR 600000000 + +struct quic_cipher { + u32 secretlen; /* Length of the traffic secret */ + u32 keylen; /* Length of the AEAD key */ + + char *shash; /* Name of hash algorithm used for key derivation */ + char *aead; /* Name of AEAD algorithm used for payload en/decryption */ + char *skc; /* Name of cipher algorithm used for header protection */ +}; + +struct quic_crypto { + struct crypto_skcipher *tx_hp_tfm; /* TX header protection tfm */ + struct crypto_skcipher *rx_hp_tfm; /* RX header protection tfm */ + struct crypto_shash *secret_tfm; /* Key derivation (HKDF) tfm */ + struct crypto_aead *tx_tfm[2]; /* AEAD tfm for TX (key phase 0 and 1) */ + struct crypto_aead *rx_tfm[2]; /* AEAD tfm for RX (key phase 0 and 1) */ + + const struct quic_cipher *cipher; /* Cipher info (selected cipher) */ + u32 cipher_type; /* Cipher suite (e.g., AES_GCM_128, etc.) */ + + u8 tx_secret[2][QUIC_SECRET_LEN]; /* TX secret (key phase 0 and 1) */ + u8 rx_secret[2][QUIC_SECRET_LEN]; /* RX secret (key phase 0 and 1) */ + u8 tx_iv[2][QUIC_IV_LEN]; /* IVs for TX (key phase 0 and 1) */ + u8 rx_iv[2][QUIC_IV_LEN]; /* IVs for RX (key phase 0 and 1) */ + atomic_t async_pending[2]; /* Async pending count (key phase 0 and 1) */ + + /* Timestamp 1st packet sent after key update */ + u64 key_update_send_time; + u64 key_update_time; /* Timestamp old keys retained after key update */ + u32 version; /* QUIC version in use */ + + u8 ticket_ready:1; /* True if a session ticket is ready to read */ + u8 key_pending:1; /* A key update is in progress */ + u8 key_derived:1; /* Key derived for the key update */ + u8 send_ready:1; /* TX encryption context is initialized */ + u8 recv_ready:1; /* RX decryption context is initialized */ + u8 key_phase:1; /* Current key phase being used (0 or 1) */ + + u64 send_offset; /* Number of handshake bytes sent by user */ + u64 recv_offset; /* Number of handshake bytes read by user */ +}; + +int quic_crypto_set_secret(struct quic_crypto *crypto, + struct quic_crypto_secret *srt, u32 version); +int quic_crypto_set_cipher(struct quic_crypto *crypto, u32 type); +int quic_crypto_key_update(struct quic_crypto *crypto); + +int quic_crypto_derive_secret(struct quic_crypto *crypto, void *data, u32 len, + char *label, u8 *srt, u32 srt_len); +int quic_crypto_initial_keys_install(struct quic_crypto *crypto, + struct quic_conn_id *conn_id, + u32 version, bool is_serv); +int quic_crypto_set_token_secret(struct quic_crypto *crypto); + +void quic_crypto_free(struct quic_crypto *crypto); diff --git a/net/quic/protocol.c b/net/quic/protocol.c index fceb4d5723a3..83267a785ae7 100644 --- a/net/quic/protocol.c +++ b/net/quic/protocol.c @@ -232,15 +232,23 @@ static void quic_protosw_exit(void) static int __net_init quic_net_init(struct net *net) { struct quic_net *qn = quic_net(net); - int err = 0; + int err; qn->stat = alloc_percpu(struct quic_mib); if (!qn->stat) return -ENOMEM; + err = quic_crypto_set_cipher(&qn->crypto, TLS_CIPHER_AES_GCM_128); + if (err) { + free_percpu(qn->stat); + qn->stat = NULL; + return err; + } + #if IS_ENABLED(CONFIG_PROC_FS) err = quic_net_proc_init(net); if (err) { + quic_crypto_free(&qn->crypto); free_percpu(qn->stat); qn->stat = NULL; } @@ -255,6 +263,7 @@ static void __net_exit quic_net_exit(struct net *net) #if IS_ENABLED(CONFIG_PROC_FS) quic_net_proc_exit(net); #endif + quic_crypto_free(&qn->crypto); free_percpu(qn->stat); qn->stat = NULL; } diff --git a/net/quic/protocol.h b/net/quic/protocol.h index fbd0fe39eccc..b8584e72ff14 100644 --- a/net/quic/protocol.h +++ b/net/quic/protocol.h @@ -49,6 +49,8 @@ struct quic_net { #if IS_ENABLED(CONFIG_PROC_FS) struct proc_dir_entry *proc_net; /* procfs entry for QUIC stats */ #endif + /* Context for decrypting Initial packets for ALPN */ + struct quic_crypto crypto; }; struct quic_net *quic_net(struct net *net); diff --git a/net/quic/socket.c b/net/quic/socket.c index 1dfa4791242e..66d810dbaac9 100644 --- a/net/quic/socket.c +++ b/net/quic/socket.c @@ -40,10 +40,22 @@ static void quic_write_space(struct sock *sk) rcu_read_unlock(); } +static void quic_sock_destruct(struct sock *sk) +{ + u8 i; + + /* Deferred crypto free for async encryption/decryption. */ + for (i = 0; i < QUIC_CRYPTO_MAX; i++) + quic_crypto_free(quic_crypto(sk, i)); + + quic_sk_destruct(sk); +} + static int quic_init_sock(struct sock *sk) { u8 i; + sk->sk_destruct = quic_sock_destruct; sk->sk_write_space = quic_write_space; sock_set_flag(sk, SOCK_USE_WRITE_QUEUE); diff --git a/net/quic/socket.h b/net/quic/socket.h index 68c7b22d1e88..d7811391cc8b 100644 --- a/net/quic/socket.h +++ b/net/quic/socket.h @@ -16,6 +16,7 @@ #include "family.h" #include "stream.h" #include "connid.h" +#include "crypto.h" #include "path.h" #include "cong.h" @@ -45,6 +46,7 @@ struct quic_sock { struct quic_path_group paths; struct quic_cong cong; struct quic_pnspace space[QUIC_PNSPACE_MAX]; + struct quic_crypto crypto[QUIC_CRYPTO_MAX]; }; struct quic6_sock { @@ -112,6 +114,11 @@ static inline struct quic_pnspace *quic_pnspace(const struct sock *sk, u8 level) return &quic_sk(sk)->space[level % QUIC_CRYPTO_EARLY]; } +static inline struct quic_crypto *quic_crypto(const struct sock *sk, u8 level) +{ + return &quic_sk(sk)->crypto[level]; +} + static inline bool quic_is_establishing(struct sock *sk) { return sk->sk_state == QUIC_SS_ESTABLISHING; -- 2.47.1