Can't get Anyscale to call functions
Unanswered
Blue Mockingbird posted this in #help-forum
Blue MockingbirdOP
For some reason, I can't make Mixtral 8x7B from Anyscale to be able to call functions using the default
---
using
functions parameter in the OpenAI client using the Vercel AI sdk:const response = await openai.chat.completions.create({
model: "mistralai/Mixtral-8x7B-Instruct-v0.1",
stream: true,
messages: [systemMessage, ...messages],
functions: functions,
})---
using
experimental_onFunctionCall: const stream = OpenAIStream(response, {
experimental_onFunctionCall: async (
{ name, arguments: args },
createFunctionCallMessages,
) => {