lemur

module
v0.0.0-...-4655df8 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 27, 2019 License: MIT

README

GoDoc

HPDD HSM Agent and Data Movers for Lustre

Lemur is new, open source implementation of HSM tools for the Lustre Filesystem based on this design. This project is developed by the Intel High Performance Data Division, one of the main contributors to the Lustre Filesystem. We welcome community involvement and contributions. If you would like to raise an issue or file a bug, please use the LMR project on our community Jira server instead of Github issues.

Build

We use Docker for building packages, so as long as you have Docker running, make rpm will take care of everything needed to create a clean build environment and build a set of Lemur RPMs. The results will be stored in ./output/RPMS.

For development and testing, it is generally more convenient to use a Linux host (or virtual machine) with Lustre installed. We recommend RHEL or CentOS 7.x, Lustre 2.7 or above, and at least Go 1.6.

Testing Quickstart

The unit tests are run with make test and do not require a Lustre environment to be configured.

The user acceptance test (UAT) automates basic testing with the agent and datamovers. The harness does not manage Lustre filesystems -- you will need to create one and mount a client somewhere, and ensue the Coordinator is enabled on the MDT. The harness must run as root, because the agent must also run as root in order to fiddle with secure xattrs and do other root-y stuff.

  1. make rpm
  2. Copy built RPMs to Lustre client host and install them
  3. sudo /usr/libexec/lemur-testing/lemur-uat-runner

Set uat/README.md for more details on running and confgiuring the user acceptance tests.

Directories

Path Synopsis
cmd
lhsmd/agent
Package agent implements a Parallel Data Mover to copy or migrate data between various storage systems.
Package agent implements a Parallel Data Mover to copy or migrate data between various storage systems.
internal
Package pdm is a generated protocol buffer package.
Package pdm is a generated protocol buffer package.
pkg
uat

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL