Re: [LSF/MM/BPF TOPIC] BoF VM live migration over C XL memory
Dragan Stancevic <[email protected]> Fri, 7 Apr 2023 20:33:16 -0500
| Newsgroups | dev.linux.lists.nil-migration,org.kernel.vger.linux-cxl,org.kvack.linux-mm |
|---|---|
| Message-ID | <[email protected]> |
Hi David- On 4/7/23 18:17, David Rientjes wrote: > On Fri, 7 Apr 2023, James Houghton wrote: > >> On Fri, Apr 7, 2023 at 5:05 PM Dragan Stancevic <[email protected]> wrote: >>> >>> Hi folks- >>> >>> if it's not too late for the schedule... >>> >>> I am starting to tackle VM live migration and hypervisor clustering over >>> switched CXL memory[1][2], intended for cloud virtualization types of loads. >>> >>> I'd be interested in doing a small BoF session with some slides and get >>> into a discussion/brainstorming with other people that deal with VM/LM >>> cloud loads. Among other things to discuss would be page migrations over >>> switched CXL memory, shared in-memory ABI to allow VM hand-off between >>> hypervisors, etc... >>> >>> A few of us discussed some of this under the ZONE_XMEM thread, but I >>> figured it might be better to start a separate thread. >>> >>> If there is interested, thank you. >> >> Hi Dragan, >> >> Thanks for bringing up this topic. I'd be very interested to be part >> of this BoF, as I'm also interested in using CXL.mem as a live >> migration mechanism. >> > > Thanks for cc'ing me, this would be very interesting to talk about. Count > me in! > >>> [1]. High-level overview available at http://nil-migration.org/ >>> [2]. Based on CXL spec 3.0 >>> > > Dragan: I'm curious about the reference to CXL spec 3.0 here, is there > something specific about 3.0 that this work depends on or should we be > good-to-go with 2.0 as well? (Are you referring to 3.0 for security > extensions?) I'm referencing 3.0 with regards to switched/shared memory as defined in Compute Express Link Specification r3.0, v1.0 8/1/22, Page 51, figure 1-4, black color scheme circle(3) and bars. It may be possible to do it with 2.0 but as far as I understand[1] the 2.0 spec it might be a lot more involved/clunky. I think new 3.0 features make it easier [1]. I would love to read 2.0 spec, but I don't have access to 2.0 spec(only 3.0). But that is my understanding from speaking with some CXL folks at last years plumbers when I floated this idea with them. -- Peace can only come as a natural consequence of universal enlightenment -Dr. Nikola Tesla