HPDD HSM Agent and Data Movers for Lustre
Lemur is new, open source implementation of HSM tools for the Lustre Filesystem based on this
design. This project
is developed by the Intel High Performance Data Division, one of the main
contributors to the Lustre Filesystem. We welcome community involvement and
contributions. If you would like to raise an issue or file a bug, please use the
LMR project on our community Jira
server instead of Github issues.
Build
We use Docker for building packages, so as long as you have Docker running,
make rpm
will take care of everything needed to create a clean build
environment and build a set of Lemur RPMs. The results will be stored in
./output/RPMS
.
For development and testing, it is generally more convenient to use a Linux host
(or virtual machine) with Lustre installed. We recommend RHEL or CentOS 7.x,
Lustre 2.7 or above, and at least Go 1.6.
Testing Quickstart
The unit tests are run with make test
and do not require a Lustre environment
to be configured.
The user acceptance test (UAT) automates basic testing with the agent and
datamovers. The harness does not manage Lustre filesystems -- you will need to
create one and mount a client somewhere, and ensue the Coordinator is enabled on
the MDT. The harness must run as root, because the agent must also run as root in
order to fiddle with secure xattrs and do other root-y stuff.
make rpm
- Copy built RPMs to Lustre client host and install them
sudo /usr/libexec/lemur-testing/lemur-uat-runner
Set uat/README.md for more details on running and confgiuring the user acceptance tests.