command
Version:
v0.2.1
Opens a new window with list of versions in this module.
Published: Mar 24, 2024
License: Apache-2.0
Opens a new window with license information.
Imports: 5
Opens a new window with list of imports.
Imported by: 0
Opens a new window with list of known importers.
README
¶
Chat with Worker
An example to chat with worker baichuan2-7b.
We utilize fastchat to provide OpenAI-Compatible RESTFul APIs.
Before using this example,please make sure you have deployed this baichuan2-7b worker
Usage
- Update the baseurl in main.go based on how you deploy arcadia
At this example, we deploy arcadia
- namespace: arcadia
- with ingress: arcadia-fastchat.172.22.96.167.nip.io
Then we get a final base url http://arcadia-fastchat.172.22.96.167.nip.io/v1
- Run this chat & embedding example
go run main.go
Documentation
¶
There is no documentation for this package.
Source Files
¶
Click to show internal directories.
Click to hide internal directories.