service

Documentation

Index

• func FindDuplicates(directories []string, excludedFiles map[string]struct{}, ...) (duplicates *entity.DigestToFiles, duplicateTotalCount int64, savingsSize int64, ...)
• func GetDigest(path string) (entity.FileDigest, error)

Functions

func FindDuplicates

func FindDuplicates(directories []string, excludedFiles map[string]struct{}, fileSizeThreshold int64, parallelism int) (
	duplicates *entity.DigestToFiles, duplicateTotalCount int64, savingsSize int64,
	allFiles entity.FilePathToMeta, err error,
)

FindDuplicates finds duplicate files in a given set of directories and matching criteria

func GetDigest

func GetDigest(path string) (entity.FileDigest, error)

GetDigest generates entity.FileDigest of the file provided, in an extremely fast manner without compromising the quality of file's uniqueness.

When this function was called on approximately 172k files (mix of photos, videos, audio files, PDFs etc.), the uniqueness identified by this matched uniqueness identified by SHA-256 for *all* files