chat_with_worker

command
v0.2.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 24, 2024 License: Apache-2.0 Imports: 5 Imported by: 0

README

Chat with Worker

An example to chat with worker baichuan2-7b.

We utilize fastchat to provide OpenAI-Compatible RESTFul APIs.

Before using this example,please make sure you have deployed this baichuan2-7b worker

Usage

  1. Update the baseurl in main.go based on how you deploy arcadia

At this example, we deploy arcadia

  • namespace: arcadia
  • with ingress: arcadia-fastchat.172.22.96.167.nip.io

Then we get a final base url http://arcadia-fastchat.172.22.96.167.nip.io/v1

  1. Run this chat & embedding example
go run main.go

Documentation

The Go Gopher

There is no documentation for this package.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL