info

Documentation

Overview

Package info provides utilities for summarizing the contents of a kzip.

Index

• func KzipInfo(f kzip.File, fileSize int64, scanOpts ...kzip.ScanOption) (*apb.KzipInfo, error)
• func KzipInfoTotalCount(infos []*apb.KzipInfo) apb.KzipInfo_CorpusInfo
• func MergeKzipInfo(infos []*apb.KzipInfo) *apb.KzipInfo

Functions

func KzipInfo

func KzipInfo(f kzip.File, fileSize int64, scanOpts ...kzip.ScanOption) (*apb.KzipInfo, error)

KzipInfo scans the kzip in f and counts contained files and units, giving a breakdown by corpus and language. It also records the size (in bytes) of the kzip specified by fileSize in the returned KzipInfo.

func KzipInfoTotalCount

func KzipInfoTotalCount(infos []*apb.KzipInfo) apb.KzipInfo_CorpusInfo

KzipInfoTotalCount returns the total CompilationUnits counts for infos split apart by language.

func MergeKzipInfo

func MergeKzipInfo(infos []*apb.KzipInfo) *apb.KzipInfo

MergeKzipInfo combines the counts from multiple KzipInfos.