[SPDK] Re: a distributed storage system base on SPDK

Hi, Peng Yu

It's a very interesting project.
For your planning CSI, you may reference https://github.com/spdk/spdk-csi created by Yibo. Maybe it can help you reduce some workload.

There is also one distributed NVMf innovation "Add Adaptive Distributed NVMe-oF Namespaces" https://review.spdk.io/gerrit/c/spdk/spdk/+/4325  by Peterson inside SPDK gerrit, I'm sure you will be interested at it. Seems Peteson also has a presentation about it at SDC20.


 --Thanks
From Xiaodong

-----Original Message-----
From: Yibo Cai <yibo.cai(a)arm.com> 
Sent: Thursday, September 24, 2020 3:25 PM
To: Storage Performance Development Kit <spdk(a)lists.01.org>; peng yu <yupeng0921(a)gmail.com>
Subject: [SPDK] Re: a distributed storage system base on SPDK

Hello Peng Yu,

Regarding SPDK CSI plugin for K8s, we have created SPDK-CSI project [1], looks similar to your requirement.
FWIW, I just gave a talk about this project at SDC20 [2]. Hope it helps.

[1] https://github.com/spdk/spdk-csi
[2] https://youtu.be/9I2b1z016Ns

Yibo

On 9/24/20 3:06 PM, peng yu wrote:
> hello, sorry if this is not the correct place to send such an email. 
> I'm writing a distributed storage system, which uses SPDK as the data 
> plane. My purpose is using it as a persistent volume for k8s or a 
> backend driver for openstack cinder. It is a personal open source 
> project. I hope to find someone who is interested in it too.
> 
> My idea is creating a virtual disk array, using SPDK as the disk 
> array's controller and disk. The SPDK on the disk exports the physical 
> disk to the controller. The SPDK on the controller aggregates multiple 
> disks to a single volume and exports to a host. We could set raid 
> level or encryption on the controller.
> 
> Now I have a workable version, and my next step is writing a CSI 
> plugin for it, let it work on k8s. Hope to hear some feedback about 
> it.
> 
> Here is the home page of the project:
> https://virtual-disk-array.readthedocs.io/en/latest/Introduction.html
> 
> Best regards.
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org To unsubscribe send an email to 
> spdk-leave(a)lists.01.org
> 
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org