What is a simple chat?

Simple chat template is an LLM-powered application for interactive conversations.

Key features of the simple chat workflow

• Provide answers based on history context.
• Workflow can be easily customised for specific use cases.

Who can benefit from the simple chat template?

• Generate high-quality content for blogs, articles, and marketing materials to support creative teams.
• Automate customer support to provide 24/7 assistance and improve service efficiency.
• Improve personalized learning experiences in education.

How does the simple chat operate?

• The predefined LLM prompt accepts both history and current query
• Generates response on query taking into account previous context.

Customizing the simple chat template for your needs

• Easy to setup streaming for better user experience.
• Switch between alternative model providers (like OpenAI, Anthropic, IBM, etc) or use custom fine-tuned models for more tailored, case-specific responses.
• Seamless integration with various DBs and APIs.
• Update prompts to ensure the tone and style remain accurate and aligned with specific needs.
• Setup tool calling to ensure data is strictly formatted.

Performance metrics and monitoring

• Monitor the latency, tone and correctness of responses, using both custom and prebuilt metrics.
• Monitor number of tokens and cost of inference.

How to use simple chat template

1. Press the “Use Template” button
2. Press the “Test” button
3. In the “history” field type in the context of the conversation. In the “request” field provide current request to the model.
4. Press “Run”