chat_with_worker

README

Chat with Worker

An example to chat with worker baichuan2-7b.

We utilize fastchat to provide OpenAI-Compatible RESTFul APIs.

Before using this example,please make sure you have deployed this baichuan2-7b worker

Usage

1. Update the baseurl in main.go based on how you deploy arcadia

At this example, we deploy arcadia

• namespace: arcadia
• with ingress: arcadia-fastchat.172.22.96.167.nip.io

Then we get a final base url http://arcadia-fastchat.172.22.96.167.nip.io/v1

1. Run this chat & embedding example

go run main.go