parallel-inference-generator

command module

v0.0.0-...-ca4676f Latest Latest Go to latest Published: Jul 30, 2024 License: MIT Imports: 9 Imported by: 0

README ¶

parallel-inference-generator

Parallel Inference Generator feeds prompts to your hosted llm endpoints and outputs an excel sheet with the required metrics from the endpoint. It is assumed that the hosted endpoint uses tgi.

Documentation ¶

There is no documentation for this package.

Source Files ¶

View all Source files

main.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL