config

Documentation

Index

• Variables
• func NewClassSettings(cfg moduletools.ClassConfig) *classSettings

Variables

var (
	DefaultBaseURL                     = "https://inference.friendli.ai"
	DefaultFriendliModel               = "meta-llama-3.1-70b-instruct"
	DefaultFriendliTemperature float64 = 0
	DefaultFriendliMaxTokens           = 2048
)

note it might not like this -- might want int values for e.g. MaxTokens

Functions

func NewClassSettings

func NewClassSettings(cfg moduletools.ClassConfig) *classSettings