Re: Open vs proprietary LLMs

Charles Plessy wrote:
>Thank Lucas for the suggestion to use bubblewrap. The list of command-line
>arguments is a bit intimidating, but I will try to try it.

You can also use containers with podman or docker. It does good filesystem isolation (have to bind-mount everything from the outside explicitly) and does some sandboxing by default. Then just use the no-new-privileges option to disable suid binaries inside the container. That leaves kernel exploits, but that is something less likely to happen by accident.

I found containers already very helpful before to not have different projects mess with each other.

> Also a basline policy could
>help, including regarding key management.

I think the best recommendation is to store them on hardware tokens, no matter which sort of token exactly. Either TPM-based (probably cheaper as most x86 computers likely have one these days) or USB tokens. One can store keys for both OpenPGP and SSH on them. That at least prevents getting credentials copied easily.

Ansgar