api

package
v0.58.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Nov 13, 2023 License: Apache-2.0 Imports: 20 Imported by: 0

README

REST API v1

/v1/formats

Format object:

{
    "name": "name of the format"
}

Create format

POST /v1/formats

curl -i -XPOST -H "content-type: application/json" -d '{"name": "pdf"}' "http://localhost:8080/v1/formats"

Retrieve format

GET /v1/formats/{name}

curl -i -XGET "http://localhost:8080/v1/formats/pdf"

Delete format

DELETE /v1/formats/{name}

curl -i -XDELETE "http://localhost:8080/v1/formats/pdf"

List formats

GET /v1/formats

curl -i -XGET "http://localhost:8080/v1/formats"

/v1/indexes

Index create request object:

{
    "id": "the index ID",
    "format": "pdf",
    "tags": ["userABC", "salesTeam"],
    "document": "a base64 encoded document, used for create new index only",
    "records": [{"id": "abcd", "segment": "hello world", "vector": [1, 2]}]
}

An index record object:

{
    "id": "a base64 encoded vector",
    "segment": "this is searchable piece of the text",
    "vector": [1, "abc", 3]
}

Create index

POST /v1/indexes

An index may be created via providing the whole data in the content-type: application/json body:

curl -i -XPOST -H "content-type: application/json" -d '{"id": "1234", "format": "pdf", "tags":{"k1":"v1"}, "records": [{"id":"r1", "segment": "my text", "vector": [1, 2]}]}' "http://localhost:8080/v1/indexes"

or 'multipart/form-data' is also supported:

curl -i -X POST -H "content-type: multipart/form-data" -F"file=@/tmp/test.txt" -F "meta={\"id\": \"test.txt\", \"tags\":{\"k1\":\"v1\"}, \"format\": \"txt\"};type=application/json" "http://localhost:8080/v1/indexes"

Update index

PUT /v1/indexes/{id}

curl -i -XPUT -H "content-type: application/json" -d '{"tags":{"k1":"v1"}}' "http://localhost:8080/v1/indexes/1234"

Retrieve index

GET /v1/indexes/{id}

curl -i -XGET "http://localhost:8080/v1/indexes/1234"

Delete index

DELETE /v1/indexes/{id}

curl -i -XDELETE "http://localhost:8080/v1/indexes/1234"

Query indexes

GET /v1/indexes

Query parameters:

  • format = {format name}
  • tag = {url encoded json map}
  • created-after = {date in "2006-01-02T15:04:05-07:00" format}
  • created-before = {date in "2006-01-02T15:04:05-07:00" format}
  • start-index-id = {starting index id, see the result object nextPageId field}
  • limit= {items per page}
curl -i -XGET "http://localhost:8080/v1/indexes?format=pdf&tags=%7B%22k1%22%3A%22v1%22%7D&created-after=2006-01-02T15:04:05-07:00&created-before=2024-01-02T15:04:05-07:00&start-index-id="123"&limit=1"

Query result object:

{
    "indexes":[],
    "nextIndexId":"",
    "total":1
}

Update index records

PATCH /v1/indexes/{id}/records

Index records update request object:

{
    "upsertRecords": [{"id": "record id", "segment": "this is searcheable piece of the text", "vector": [1, "abc", 3]}],
    "deleteRecords": [{"id": "record id"}]
}

curl -i -XPATCH -H "content-type: application/json" -d '{"upsertRecords": [{"id": "000145f6", "segment": "this is searcheable piece of the text", "vector": [1, "abc", 3]}], "deleteRecords": [{"id": "0001044f"}]}' "http://localhost:8080/v1/indexes/test.txt/records"

Update result object:

{
    "upserted": 1,
    "deleted": 1
}

Query index records

GET /v1/indexes/{id}/records

Query parameters:

  • start-record-id = {starting record id, see the result object nextRecordId}
  • limit = {items per page}
curl -i -XGET "http://localhost:8080/v1/indexes/test.txt/records?start-record-id=eyJpbmRleF9pZCI6InRlc3QudHh0IiwicmVjb3JkX2lkIjoiMDAwMDAwMDIifQ==&limit=1"

Query result object:

{
    "records": [{"id":"","segment":"","vector":{}}],
    "nextRecordId": "",
    "total": 1
}

Search request object:

{
    "text": "a list of words that should be found",
    "tags": "a json map of `{key:val}` tags to filter by",
    "indexIDs": "a list of index IDs to filter by",
    "distinct": "if true, the result will contain only one record(first) per index",
    "orderByScore": "if true, the results are ordered by the result relevancy score",
    "pageId": "starting page id, see the result object `nextPageId` field",
    "offset": "specifies how many records to skip before beginning to return records",
    "limit": "items per page"
}

Search records

POST /v1/search

# query to iterate through all the results
curl -i -XPOST -H "content-type: application/json" -d '{"text": "shakespeare", "tags":{"k1":"v1"}, "indexIDs":["test.txt"], "pageId":"eyJpbmRleF9pZCI6InRlc3QudHh0IiwicmVjb3JkX2lkIjoiMDAwMGJhODUifQ=="}' "http://localhost:8080/v1/search"

# query to check the most relevant results
curl -i -XPOST -H "content-type: application/json" -d '{"text": "shakespeare", "orderByScore":true, "distinct":true, "offset":25, "limit":100}' "http://localhost:8080/v1/search"

Search result object:

{
    "records": [{"indexId":"","indexRecord":{"id":"","segment":"","vector":{}}, "matchedKeywords": [], "score":2}],
    "nextPageId": "",
    "total": 1
}

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func BindAppJson added in v0.6.0 

func BindAppJson(c *gin.Context, inf interface{}) error

BindAppJson turns the request body to inf, but for "application/json" contents only

func ComposeURI added in v0.6.0 

func ComposeURI(r *http.Request, id string) string

ComposeURI helper function which composes URI, adding ID to the request path

func ResolveHost added in v0.6.0 

func ResolveHost(r *http.Request) (host string)

ResolveHost returns host part of r

func ResolveScheme added in v0.6.0 

func ResolveScheme(r *http.Request) string

ResolveScheme resolves initial request type by r

Types

type ErrorMsg added in v0.18.0 

type ErrorMsg struct {
	Error string `json:"error"`
}

type Rest added in v0.50.0 

type Rest struct {
	// contains filtered or unexported fields
}

func NewRest added in v0.50.0 

func NewRest(svc *Service) *Rest

func (*Rest) CreateFormat added in v0.50.0 

func (r *Rest) CreateFormat(c *gin.Context)

func (*Rest) CreateIndex added in v0.50.0 

func (r *Rest) CreateIndex(c *gin.Context)

func (*Rest) DeleteFormat added in v0.50.0 

func (r *Rest) DeleteFormat(c *gin.Context, formatId similapi.FormatId)

func (*Rest) DeleteIndex added in v0.50.0 

func (r *Rest) DeleteIndex(c *gin.Context, indexId similapi.IndexId)

func (*Rest) GetFormat added in v0.50.0 

func (r *Rest) GetFormat(c *gin.Context, formatId similapi.FormatId)

func (*Rest) GetFormats added in v0.50.0 

func (r *Rest) GetFormats(c *gin.Context)

func (*Rest) GetIndex added in v0.50.0 

func (r *Rest) GetIndex(c *gin.Context, indexId similapi.IndexId)

func (*Rest) GetIndexRecords added in v0.50.0 

func (r *Rest) GetIndexRecords(c *gin.Context, indexId similapi.IndexId, params similapi.GetIndexRecordsParams)

func (*Rest) GetIndexes added in v0.50.0 

func (r *Rest) GetIndexes(c *gin.Context, params similapi.GetIndexesParams)

func (*Rest) PatchIndexRecords added in v0.50.0 

func (r *Rest) PatchIndexRecords(c *gin.Context, indexId similapi.IndexId)

func (*Rest) Ping added in v0.50.0 

func (r *Rest) Ping(c *gin.Context)

func (*Rest) PutIndex added in v0.50.0 

func (r *Rest) PutIndex(c *gin.Context, indexId similapi.IndexId)

func (*Rest) RegisterEPs added in v0.50.0 

func (r *Rest) RegisterEPs(g *gin.Engine) error

func (*Rest) Search added in v0.50.0 

func (r *Rest) Search(c *gin.Context)

type Service 

type Service struct {
	PProvider parser.Provider `inject:""`
	Db        persistence.Db  `inject:""`
	// contains filtered or unexported fields
}

Service implements the gRPC API endpoints

func NewService 

func NewService() *Service

func (*Service) FormatServiceServer added in v0.6.0 

func (s *Service) FormatServiceServer() format.ServiceServer

func (*Service) IndexServiceServer added in v0.6.0 

func (s *Service) IndexServiceServer() index.ServiceServer

IndexServiceServer returns index.ServiceServer

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.