[lustre-discuss] Openstack Manila + Lustre?

[Andrew Elwell]

Hi All,

Is there anyone on list exporting Lustre filesystems to (private)
cloud services - possibly via Manila?
I can see https://www.openstack.org/assets/science/CrossroadofCloudandHPC-Print.pdf
and Simon's talk from LUG2016
(https://nci.org.au/wp-content/uploads/2016/07/LUG-2016-sjjfowler-hpc-data-in-the-cloud.pdf)
which seems to be pretty much what I'm after.

Does anyone else have updated notes / success / horror stories they'd
be willing to share?

Many thanks


Andrew
(no prizes for guessing who's been asked to look at integrating our
HPC storage with cloud...)

[Matt Rásó-Barnett]

Hi Andrew,

Have you seen these previous LUG presentations by a couple of sites
using a number of newer Lustre features and LNET routing to provide
multi-tenant, private Lustre sub-directory mounts into Openstack
environments:

Wellcome Sanger Institute:
https://www.eofs.eu/_media/events/lad17/15_dave_holland_secure_lustre_on_openstack.pdf

DDN:
http://cdn.opensfs.org/wp-content/uploads/2018/04/Buisson-Multitenancy_v1.0.pdf

ETH Zurich:
https://www.eofs.eu/_media/events/lad18/10_diego_moreno_ethz_simplified_mt_for_personalized_health.pdf

It's not quite the same approach as what you linked to, and don't touch
on the Manila aspect, but the aims I think are broadly similar.

It would be really interesting if Manila could be wrangled into spinning
up and down the necessary VLANs and virtual LNET routers on-demand in
some manner to make this approach at multi-tenancy more self-service.

This concept is something we are interested in following in Cambridge
but we haven't started work on trying this yet - so like you I'd be very
interested in any more stories of places trying this.

Cheers,
Matt

Post by Andrew Elwell
Hi All,
Is there anyone on list exporting Lustre filesystems to (private)
cloud services - possibly via Manila?
I can see https://www.openstack.org/assets/science/CrossroadofCloudandHPC-Print.pdf
and Simon's talk from LUG2016
(https://nci.org.au/wp-content/uploads/2016/07/LUG-2016-sjjfowler-hpc-data-in-the-cloud.pdf)
which seems to be pretty much what I'm after.
Does anyone else have updated notes / success / horror stories they'd
be willing to share?
Many thanks
Andrew
(no prizes for guessing who's been asked to look at integrating our
HPC storage with cloud...)
_______________________________________________
lustre-discuss mailing list
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org