Skip to main content

System Prompt

Mux is interested in supporting a variety of models at different levels of performance. To that end, we’re built on the Vercel AI SDK which does most of the heavy lifting in creating a unified API for all models. Even with consistent support at the protocol layer, we have found that different models react very differently to the same set of tools and instructions. So, we strive to minimize the system prompt and let users figure out the prompting trade-offs. Here’s a snippet from src/node/services/systemMessage.ts which is our shared system prompt (minus tools).