Documentation ¶
Index ¶
- func CreateVendorTree(basedir string, l Lock, sm SourceManager, sv bool) error
- func IsAny(c Constraint) bool
- type Constraint
- type LocalImportsError
- type Lock
- type LockedProject
- type Manifest
- type Package
- type PackageOrErr
- type PackageTree
- type PairedVersion
- type ProjectAnalyzer
- type ProjectConstraint
- type ProjectIdentifier
- type ProjectRoot
- type Revision
- type SimpleLock
- type SimpleManifest
- type Solution
- type SolveParameters
- type Solver
- type SourceManager
- type SourceMgr
- func (sm *SourceMgr) ExportProject(n ProjectRoot, v Version, to string) error
- func (sm *SourceMgr) GetProjectInfo(n ProjectRoot, v Version) (Manifest, Lock, error)
- func (sm *SourceMgr) ListPackages(n ProjectRoot, v Version) (PackageTree, error)
- func (sm *SourceMgr) ListVersions(n ProjectRoot) ([]Version, error)
- func (sm *SourceMgr) Release()
- func (sm *SourceMgr) RepoExists(n ProjectRoot) (bool, error)
- func (sm *SourceMgr) RevisionPresentIn(n ProjectRoot, r Revision) (bool, error)
- type UnpairedVersion
- type Version
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CreateVendorTree ¶ added in v0.2.0
func CreateVendorTree(basedir string, l Lock, sm SourceManager, sv bool) error
CreateVendorTree takes a basedir and a Lock, and exports all the projects listed in the lock to the appropriate target location within the basedir.
It requires a SourceManager to do the work, and takes a flag indicating whether or not to strip vendor directories contained in the exported dependencies.
func IsAny ¶ added in v0.2.0
func IsAny(c Constraint) bool
IsAny indicates if the provided constraint is the wildcard "Any" constraint.
Types ¶
type Constraint ¶
type Constraint interface { fmt.Stringer // Matches indicates if the provided Version is allowed by the Constraint. Matches(Version) bool // MatchesAny indicates if the intersection of the Constraint with the // provided Constraint would yield a Constraint that could allow *any* // Version. MatchesAny(Constraint) bool // Intersect computes the intersection of the Constraint with the provided // Constraint. Intersect(Constraint) Constraint // contains filtered or unexported methods }
A Constraint provides structured limitations on the versions that are admissible for a given project.
As with Version, it has a private method because the gps's internal implementation of the problem is complete, and the system relies on type magic to operate.
func NewSemverConstraint ¶ added in v0.4.0
func NewSemverConstraint(body string) (Constraint, error)
NewSemverConstraint attempts to construct a semver Constraint object from the input string.
If the input string cannot be made into a valid semver Constraint, an error is returned.
type LocalImportsError ¶ added in v0.7.0
LocalImportsError indicates that a package contains at least one relative import that will prevent it from compiling.
TODO(sdboyer) add a Files property once we're doing our own per-file parsing
func (*LocalImportsError) Error ¶ added in v0.7.0
func (e *LocalImportsError) Error() string
type Lock ¶
type Lock interface { // The hash of inputs to gps that resulted in this lock data InputHash() []byte // Projects returns the list of LockedProjects contained in the lock data. Projects() []LockedProject }
Lock represents data from a lock file (or however the implementing tool chooses to store it) at a particular version that is relevant to the satisfiability solving process.
In general, the information produced by gps on finding a successful solution is all that would be necessary to constitute a lock file, though tools can include whatever other information they want in their storage.
type LockedProject ¶ added in v0.2.0
type LockedProject struct {
// contains filtered or unexported fields
}
LockedProject is a single project entry from a lock file. It expresses the project's name, one or both of version and underlying revision, the network URI for accessing it, the path at which it should be placed within a vendor directory, and the packages that are used in it.
func NewLockedProject ¶ added in v0.2.0
func NewLockedProject(n ProjectRoot, v Version, url string, pkgs []string) LockedProject
NewLockedProject creates a new LockedProject struct with a given name, version, and upstream repository URL.
Note that passing a nil version will cause a panic. This is a correctness measure to ensure that the solver is never exposed to a version-less lock entry. Such a case would be meaningless - the solver would have no choice but to simply dismiss that project. By creating a hard failure case via panic instead, we are trying to avoid inflicting the resulting pain on the user by instead forcing a decision on the Analyzer implementation.
func (LockedProject) Ident ¶ added in v0.2.0
func (lp LockedProject) Ident() ProjectIdentifier
Ident returns the identifier describing the project. This includes both the local name (the root name by which the project is referenced in import paths) and the network name, where the upstream source lives.
func (LockedProject) Version ¶ added in v0.2.0
func (lp LockedProject) Version() Version
Version assembles together whatever version and/or revision data is available into a single Version.
type Manifest ¶ added in v0.1.0
type Manifest interface { // Returns a list of project constraints that will be universally to // the depgraph. DependencyConstraints() []ProjectConstraint // Returns a list of constraints applicable to test imports. Note that this // will only be consulted for root manifests. TestDependencyConstraints() []ProjectConstraint }
Manifest represents manifest-type data for a project at a particular version. That means dependency constraints, both for normal dependencies and for tests. The constraints expressed in a manifest determine the set of versions that are acceptable to try for a given project.
Expressing a constraint in a manifest does not guarantee that a particular dependency will be present. It only guarantees that if packages in the project specified by the dependency are discovered through static analysis of the (transitive) import graph, then they will conform to the constraint.
This does entail that manifests can express constraints on projects they do not themselves import. This is by design, but its implications are complex. See the gps docs for more information: https://github.com/sdboyer/gps/wiki
type Package ¶ added in v0.4.0
type Package struct {
ImportPath, CommentPath string
Name string
Imports []string
TestImports []string
}
Package represents a Go package. It contains a subset of the information go/build.Package does.
type PackageOrErr ¶ added in v0.4.0
PackageOrErr stores the results of attempting to parse a single directory for Go source code.
type PackageTree ¶ added in v0.4.0
type PackageTree struct { ImportRoot string Packages map[string]PackageOrErr }
A PackageTree represents the results of recursively parsing a tree of packages, starting at the ImportRoot. The results of parsing the files in the directory identified by each import path - a Package or an error - are stored in the Packages map, keyed by that import path.
func (PackageTree) ExternalReach ¶ added in v0.4.0
ExternalReach looks through a PackageTree and computes the list of external packages (not logical children of PackageTree.ImportRoot) that are transitively imported by the internal packages in the tree.
main indicates whether (true) or not (false) to include main packages in the analysis. main packages should generally be excluded when analyzing the non-root dependency, as they inherently can't be imported.
tests indicates whether (true) or not (false) to include imports from test files in packages when computing the reach map.
ignore is a map of import paths that, if encountered, should be excluded from analysis. This exclusion applies to both internal and external packages. If an external import path is ignored, it is simply omitted from the results.
If an internal path is ignored, then it is excluded from all transitive dependency chains and does not appear as a key in the final map. That is, if you ignore A/foo, then the external package list for all internal packages that import A/foo will not include external packages that are only reachable through A/foo.
Visually, this means that, given a PackageTree with root A and packages at A, A/foo, and A/bar, and the following import chain:
A -> A/foo -> A/bar -> B/baz
If you ignore A/foo, then the returned map would be:
map[string][]string{ "A": []string{}, "A/bar": []string{"B/baz"}, }
It is safe to pass a nil map if there are no packages to ignore.
func (PackageTree) ListExternalImports ¶ added in v0.4.0
func (t PackageTree) ListExternalImports(main, tests bool, ignore map[string]bool) ([]string, error)
ListExternalImports computes a sorted, deduplicated list of all the external packages that are reachable through imports from all valid packages in the PackageTree.
main and tests determine whether main packages and test imports should be included in the calculation. "External" is defined as anything not prefixed, after path cleaning, by the PackageTree.ImportRoot. This includes stdlib.
If an internal path is ignored, all of the external packages that it uniquely imports are omitted. Note, however, that no internal transitivity checks are made here - every non-ignored package in the tree is considered independently. That means, given a PackageTree with root A and packages at A, A/foo, and A/bar, and the following import chain:
A -> A/foo -> A/bar -> B/baz
If you ignore A or A/foo, A/bar will still be visited, and B/baz will be returned, because this method visits ALL packages in the tree, not only those reachable from the root (or any other) packages. If your use case requires interrogating external imports with respect to only specific package entry points, you need ExternalReach() instead.
It is safe to pass a nil map if there are no packages to ignore.
If an internal package has an error (that is, PackageOrErr is Err), it is excluded from consideration. Internal packages that transitively import the error package are also excluded. So, if:
-> B/foo / A \ -> A/bar -> B/baz
And A/bar has some error in it, then both A and A/bar will be eliminated from consideration; neither B/foo nor B/baz will be in the results. If A/bar, with its errors, is ignored, however, then A will remain, and B/foo will be in the results.
type PairedVersion ¶ added in v0.1.0
type PairedVersion interface { Version // Underlying returns the immutable Revision that identifies this Version. Underlying() Revision // contains filtered or unexported methods }
PairedVersion represents a normal Version, but paired with its corresponding, underlying Revision.
type ProjectAnalyzer ¶ added in v0.1.0
type ProjectAnalyzer interface {
GetInfo(string, ProjectRoot) (Manifest, Lock, error)
}
A ProjectAnalyzer is responsible for analyzing a path for Manifest and Lock information. Tools relying on gps must implement one.
type ProjectConstraint ¶ added in v0.8.0
type ProjectConstraint struct { Ident ProjectIdentifier Constraint Constraint }
A ProjectConstraint combines a ProjectIdentifier with a Constraint. It indicates that, if packages contained in the ProjectIdentifier enter the depgraph, they must do so at a version that is allowed by the Constraint.
type ProjectIdentifier ¶
type ProjectIdentifier struct { ProjectRoot ProjectRoot NetworkName string }
A ProjectIdentifier is, more or less, the name of a dependency. It is related to, but differs in two keys ways from, an import path.
First, ProjectIdentifiers do not identify a single package. Rather, they encompasses the whole tree of packages that exist at or below their ProjectRoot. In gps' current design, this ProjectRoot must correspond to the root of a repository, though this may not always be the case.
Second, ProjectIdentifiers can optionally carry a NetworkName, which identifies where the underlying source code can be located on the network. These can be either a full URL, including protocol, or plain import paths. So, these are all valid data for NetworkName:
github.com/sdboyer/gps github.com/fork/gps git@github.com:sdboyer/gps https://github.com/sdboyer/gps
With plain import paths, network addresses are derived purely through an algorithm. By having an explicit network name, it becomes possible to, for example, transparently substitute a fork for an original upstream repository.
Note that gps makes no guarantees about the actual import paths contained in a repository aligning with ImportRoot. If tools, or their users, specify an alternate NetworkName that contains a repository with incompatible internal import paths, gps will fail. (gps does no import rewriting.)
Also note that if different projects' manifests report a different NetworkName for a given ImportRoot, it is a solve failure. Everyone has to agree on where a given import path should be sourced from.
If NetworkName is not explicitly set, gps will derive the network address from the ImportRoot using a similar algorithm to that of the official go tooling.
type ProjectRoot ¶ added in v0.8.0
type ProjectRoot string
ProjectRoot is the topmost import path in a tree of other import paths - the root of the tree. In gps' current design, ProjectRoots have to correspond to a repository root (mostly), but their real purpose is to identify the root import path of a "project", logically encompassing all child packages.
Projects are a crucial unit of operation in gps. Constraints are declared by a project's manifest, and apply to all packages in a ProjectRoot's tree. Solving itself mostly proceeds on a project-by-project basis.
Aliasing string types is usually a bit of an anti-pattern. We do it here as a means of clarifying API intent. This is important because Go's package management domain has lots of different path-ish strings floating around:
actual directories: /home/sdboyer/go/src/github.com/sdboyer/gps/example URLs: https://github.com/sdboyer/gps import paths: github.com/sdboyer/gps/example portions of import paths that refer to a package: example portions that could not possibly refer to anything sane: github.com/sdboyer portions that correspond to a repository root: github.com/sdboyer/gps
While not a panacea, defining ProjectRoot at least allows us to clearly identify when one of these path-ish strings is *supposed* to have certain semantics.
type Revision ¶ added in v0.1.0
type Revision string
A Revision represents an immutable versioning identifier.
func (Revision) Intersect ¶ added in v0.1.0
func (r Revision) Intersect(c Constraint) Constraint
func (Revision) Matches ¶ added in v0.1.0
Matches is the Revision acting as a constraint; it checks to see if the provided version is the same Revision as itself.
func (Revision) MatchesAny ¶ added in v0.1.0
func (r Revision) MatchesAny(c Constraint) bool
MatchesAny is the Revision acting as a constraint; it checks to see if the provided version is the same Revision as itself.
type SimpleLock ¶ added in v0.2.0
type SimpleLock []LockedProject
SimpleLock is a helper for tools to easily describe lock data when they know that no hash, or other complex information, is available.
func (SimpleLock) InputHash ¶ added in v0.2.0
func (SimpleLock) InputHash() []byte
InputHash always returns an empty string for SimpleLock. This makes it useless as a stable lock to be written to disk, but still useful for some ephemeral purposes.
func (SimpleLock) Projects ¶ added in v0.2.0
func (l SimpleLock) Projects() []LockedProject
Projects returns the entire contents of the SimpleLock.
type SimpleManifest ¶ added in v0.2.0
type SimpleManifest struct { Deps []ProjectConstraint TestDeps []ProjectConstraint }
SimpleManifest is a helper for tools to enumerate manifest data. It's generally intended for ephemeral manifests, such as those Analyzers create on the fly for projects with no manifest metadata, or metadata through a foreign tool's idioms.
func (SimpleManifest) DependencyConstraints ¶ added in v0.6.0
func (m SimpleManifest) DependencyConstraints() []ProjectConstraint
GetDependencies returns the project's dependencies.
func (SimpleManifest) TestDependencyConstraints ¶ added in v0.6.0
func (m SimpleManifest) TestDependencyConstraints() []ProjectConstraint
GetDependencies returns the project's test dependencies.
type Solution ¶ added in v0.7.0
A Solution is returned by a solver run. It is mostly just a Lock, with some additional methods that report information about the solve run.
type SolveParameters ¶ added in v0.8.0
type SolveParameters struct { // The path to the root of the project on which the solver should operate. // This should point to the directory that should contain the vendor/ // directory. // // In general, it is wise for this to be under an active GOPATH, though it // is not (currently) required. // // A real path to a readable directory is required. RootDir string // The import path at the base of all import paths covered by the project. // For example, the appropriate value for gps itself here is: // // github.com/sdboyer/gps // // In most cases, this should match the latter portion of RootDir. However, // that is not (currently) required. // // A non-empty string is required. ImportRoot ProjectRoot // The root manifest. This contains all the dependencies, constraints, and // other controls available to the root project. // // May be nil, but for most cases, that would be unwise. Manifest Manifest // The root lock. Optional. Generally, this lock is the output of a previous // solve run. // // If provided, the solver will attempt to preserve the versions specified // in the lock, unless ToChange or ChangeAll settings indicate otherwise. Lock Lock // A list of packages (import paths) to ignore. These can be in the root // project, or from elsewhere. Ignoring a package means that both it and its // imports will be disregarded by all relevant solver operations. Ignore []string // ToChange is a list of project names that should be changed - that is, any // versions specified for those projects in the root lock file should be // ignored. // // Passing ChangeAll has subtly different behavior from enumerating all // projects into ToChange. In general, ToChange should *only* be used if the // user expressly requested an upgrade for a specific project. ToChange []ProjectRoot // ChangeAll indicates that all projects should be changed - that is, any // versions specified in the root lock file should be ignored. ChangeAll bool // Downgrade indicates whether the solver will attempt to upgrade (false) or // downgrade (true) projects that are not locked, or are marked for change. // // Upgrading is, by far, the most typical case. The field is named // 'Downgrade' so that the bool's zero value corresponds to that most // typical case. Downgrade bool // Trace controls whether the solver will generate informative trace output // as it moves through the solving process. Trace bool // TraceLogger is the logger to use for generating trace output. If Trace is // true but no logger is provided, solving will result in an error. TraceLogger *log.Logger }
SolveParameters hold all arguments to a solver run.
Only RootDir and ImportRoot are absolutely required. A nil Manifest is allowed, though it usually makes little sense.
Of these properties, only Manifest and Ignore are (directly) incorporated in memoization hashing.
type Solver ¶
A Solver is the main workhorse of gps: given a set of project inputs, it performs a constraint solving analysis to develop a complete Result that can be used as a lock file, and to populate a vendor directory.
func Prepare ¶ added in v0.5.0
func Prepare(params SolveParameters, sm SourceManager) (Solver, error)
Prepare readies a Solver for use.
This function reads and validates the provided SolveParameters. If a problem with the inputs is detected, an error is returned. Otherwise, a Solver is returned, ready to hash and check inputs or perform a solving run.
type SourceManager ¶
type SourceManager interface { // RepoExists checks if a repository exists, either upstream or in the // SourceManager's central repository cache. RepoExists(ProjectRoot) (bool, error) // ListVersions retrieves a list of the available versions for a given // repository name. ListVersions(ProjectRoot) ([]Version, error) // RevisionPresentIn indicates whether the provided Version is present in // the given repository. RevisionPresentIn(ProjectRoot, Revision) (bool, error) // ListPackages retrieves a tree of the Go packages at or below the provided // import path, at the provided version. ListPackages(ProjectRoot, Version) (PackageTree, error) // GetProjectInfo returns manifest and lock information for the provided // import path. gps currently requires that projects be rooted at their // repository root, which means that this ProjectRoot must also be a // repository root. GetProjectInfo(ProjectRoot, Version) (Manifest, Lock, error) // ExportProject writes out the tree of the provided import path, at the // provided version, to the provided directory. ExportProject(ProjectRoot, Version, string) error // Release lets go of any locks held by the SourceManager. Release() }
A SourceManager is responsible for retrieving, managing, and interrogating source repositories. Its primary purpose is to serve the needs of a Solver, but it is handy for other purposes, as well.
gps's built-in SourceManager, accessible via NewSourceManager(), is intended to be generic and sufficient for any purpose. It provides some additional semantics around the methods defined here.
type SourceMgr ¶ added in v0.8.0
type SourceMgr struct {
// contains filtered or unexported fields
}
SourceMgr is the default SourceManager for gps.
There's no (planned) reason why it would need to be reimplemented by other tools; control via dependency injection is intended to be sufficient.
func NewSourceManager ¶ added in v0.1.0
func NewSourceManager(an ProjectAnalyzer, cachedir string, force bool) (*SourceMgr, error)
NewSourceManager produces an instance of gps's built-in SourceManager. It takes a cache directory (where local instances of upstream repositories are stored), a vendor directory for the project currently being worked on, and a force flag indicating whether to overwrite the global cache lock file (if present).
The returned SourceManager aggressively caches information wherever possible. It is recommended that, if tools need to do preliminary, work involving upstream repository analysis prior to invoking a solve run, that they create this SourceManager as early as possible and use it to their ends. That way, the solver can benefit from any caches that may have already been warmed.
gps's SourceManager is intended to be threadsafe (if it's not, please file a bug!). It should certainly be safe to reuse from one solving run to the next; however, the fact that it takes a basedir as an argument makes it much less useful for simultaneous use by separate solvers operating on different root projects. This architecture may change in the future.
func (*SourceMgr) ExportProject ¶ added in v0.8.0
func (sm *SourceMgr) ExportProject(n ProjectRoot, v Version, to string) error
ExportProject writes out the tree of the provided import path, at the provided version, to the provided directory.
func (*SourceMgr) GetProjectInfo ¶ added in v0.8.0
GetProjectInfo returns manifest and lock information for the provided import path. gps currently requires that projects be rooted at their repository root, which means that this ProjectRoot must also be a repository root.
The work of producing the manifest and lock information is delegated to the injected ProjectAnalyzer.
func (*SourceMgr) ListPackages ¶ added in v0.8.0
func (sm *SourceMgr) ListPackages(n ProjectRoot, v Version) (PackageTree, error)
ListPackages retrieves a tree of the Go packages at or below the provided import path, at the provided version.
func (*SourceMgr) ListVersions ¶ added in v0.8.0
func (sm *SourceMgr) ListVersions(n ProjectRoot) ([]Version, error)
ListVersions retrieves a list of the available versions for a given repository name.
The list is not sorted; while it may be returned in the order that the underlying VCS reports version information, no guarantee is made. It is expected that the caller either not care about order, or sort the result themselves.
This list is always retrieved from upstream; if upstream is not accessible (network outage, access issues, or the resource actually went away), an error will be returned.
func (*SourceMgr) Release ¶ added in v0.8.0
func (sm *SourceMgr) Release()
Release lets go of any locks held by the SourceManager.
func (*SourceMgr) RepoExists ¶ added in v0.8.0
func (sm *SourceMgr) RepoExists(n ProjectRoot) (bool, error)
RepoExists checks if a repository exists, either upstream or in the cache, for the provided ProjectRoot.
func (*SourceMgr) RevisionPresentIn ¶ added in v0.8.0
func (sm *SourceMgr) RevisionPresentIn(n ProjectRoot, r Revision) (bool, error)
RevisionPresentIn indicates whether the provided Revision is present in the given repository.
type UnpairedVersion ¶ added in v0.1.0
type UnpairedVersion interface { Version // Is takes the underlying Revision that this UnpairedVersion corresponds // to and unites them into a PairedVersion. Is(Revision) PairedVersion // contains filtered or unexported methods }
UnpairedVersion represents a normal Version, with a method for creating a VersionPair by indicating the version's corresponding, underlying Revision.
func NewBranch ¶ added in v0.2.0
func NewBranch(body string) UnpairedVersion
NewBranch creates a new Version to represent a floating version (in general, a branch).
func NewVersion ¶ added in v0.1.0
func NewVersion(body string) UnpairedVersion
NewVersion creates a Semver-typed Version if the provided version string is valid semver, and a plain/non-semver version if not.
type Version ¶
type Version interface { Constraint // Indicates the type of version - Revision, Branch, Version, or Semver Type() string }
Version represents one of the different types of versions used by gps.
Version composes Constraint, because all versions can be used as a constraint (where they allow one, and only one, version - themselves), but constraints are not necessarily discrete versions.
Version is an interface, but it contains private methods, which restricts it to gps's own internal implementations. We do this for the confluence of two reasons: the implementation of Versions is complete (there is no case in which we'd need other types), and the implementation relies on type magic under the hood, which would be unsafe to do if other dynamic types could be hiding behind the interface.