hub3

Documentation

Index

• type BulkAction
  • func (action BulkAction) CreateRDFBulkRequest(response *BulkActionResponse, g *r.Graph)
  • func (action *BulkAction) ESSave(response *BulkActionResponse, v1StylingIndexing bool) error
  • func (action BulkAction) Execute(ctx context.Context, response *BulkActionResponse) error
  • func (action BulkAction) RDFSave(response *BulkActionResponse) []error
• type BulkActionResponse
  • func ReadActions(ctx context.Context, r io.Reader, p *elastic.BulkProcessor, ...) (BulkActionResponse, error)
  • func (r *BulkActionResponse) RDFBulkInsert() []error

Types

type BulkAction

type BulkAction struct {
	HubID         string `json:"hubId"`
	OrgID         string `json:"orgID"`
	Spec          string `json:"dataset"`
	LocalID       string `json:"localID"`
	NamedGraphURI string `json:"graphUri"`
	RecordType    string `json:"type"`
	Action        string `json:"action"`
	ContentHash   string `json:"contentHash"`
	Graph         string `json:"graph"`
	RDF           string `json:"rdf"`
	GraphMimeType string `json:"graphMimeType"`
	SubjectType   string `json:"subjectType"`
	// contains filtered or unexported fields
}

BulkAction is used to unmarshal the information from the BulkAPI

func (BulkAction) CreateRDFBulkRequest

func (action BulkAction) CreateRDFBulkRequest(response *BulkActionResponse, g *r.Graph)

CreateRDFBulkRequest gathers all the triples from an BulkAction to be inserted in bulk.

func (*BulkAction) ESSave

func (action *BulkAction) ESSave(response *BulkActionResponse, v1StylingIndexing bool) error

ESSave the RDF Record to ElasticSearch

func (BulkAction) Execute

func (action BulkAction) Execute(ctx context.Context, response *BulkActionResponse) error

Execute performs the various BulkActions

func (BulkAction) RDFSave

func (action BulkAction) RDFSave(response *BulkActionResponse) []error

RDFSave save the RDFrecord to the TripleStore. This saves each action individually. You should use RDFBulkInsert instead.

type BulkActionResponse

type BulkActionResponse struct {
	Spec               string                   `json:"spec"`
	SpecRevision       int                      `json:"specRevision"`       // version of the records stored
	TotalReceived      int                      `json:"totalReceived"`      // originally json was total_received
	ContentHashMatches int                      `json:"contentHashMatches"` // originally json was content_hash_matches
	RecordsStored      int                      `json:"recordsStored"`      // originally json was records_stored
	JSONErrors         int                      `json:"jsonErrors"`
	TriplesStored      int                      `json:"triplesStored"`
	SparqlUpdates      []fragments.SparqlUpdate `json:"sparqlUpdates"` // store all the triples here for bulk insert
}

BulkActionResponse is the datastructure where we keep the BulkAction statistics

func ReadActions

func ReadActions(ctx context.Context, r io.Reader, p *elastic.BulkProcessor, wp *workerpool.WorkerPool) (BulkActionResponse, error)

ReadActions reads BulkActions from an io.Reader line by line.

func (*BulkActionResponse) RDFBulkInsert

func (r *BulkActionResponse) RDFBulkInsert() []error

RDFBulkInsert inserts all triples from the bulkRequest in one SPARQL update statement