AI Chat Overview

AI Chat is the core feature of ToolChat - it allows your members to have conversations with AI agents trained on your methodology.

How It Works

Member asks question → AI processes with your context → Personalized response

The AI combines:

1. Base intelligence - GPT-4, Claude, or other LLMs
2. System prompt - Your agent's personality and instructions
3. Knowledge base - Your uploaded documents and content
4. Conversation history - Context from the current conversation

Key Concepts

Agents

Agents are AI personalities you create. Each agent has:

• A name and avatar
• A system prompt (personality/instructions)
• Access to your knowledge base

You can create multiple agents for different purposes:

• General coaching agent
• Workout planning specialist
• Nutrition advisor
• Mindset coach

Conversations

Each chat between a member and an agent is a conversation:

• Conversations persist across sessions
• Members can have multiple conversations
• Conversation history provides context

Messages

Individual messages within a conversation:

• Can include text
• Can include images and screenshots
• Can include PDFs (text extracted and sent as context)
• Can include audio files (automatically transcribed)
• Support drag-and-drop file upload
• Are stored for context

For Members

Members access AI Chat through:

1. Tools in the sidebar
2. Select an agent
3. Start chatting

Features available to members:

• Start new conversations
• Continue previous conversations
• View conversation history
• Send images/attachments

For Owners

Your role is to:

1. Create agents with appropriate personalities
2. Upload knowledge so the AI can reference your content
3. Monitor usage through the Admin Dashboard
4. Refine prompts based on member feedback

AI Models

ToolChat supports multiple AI models:

Model	Best For	Speed	Cost
GPT-4o	Best reasoning, coding	Fast	Medium
GPT-4o-mini	Quick responses, cost-effective	Very Fast	Lower
Claude 4.6 Sonnet	Latest model, excellent all-round	Fast	Medium
Claude 3.5 Sonnet	Detailed analysis, long content	Fast	Medium
Claude 3 Haiku	Quick responses	Very Fast	Lower
Grok	General purpose	Fast	Medium

Model selection can be configured per agent.

Usage & Costs

How Costs Work

AI usage is measured in tokens:

• Tokens are roughly 4 characters
• Both input and output count
• More complex responses = more tokens

Your Costs

As an owner, you're responsible for AI costs:

• Costs are deducted from your ToolChat balance
• Monitor usage in Admin → Billing
• Set up alerts for high usage

Guest Rate Limits

For Virtual Coach shared agents, you can set per-guest rate limits through the Tiers configuration:

• Daily messages per guest — Limit how many messages each guest can send per day
• Monthly messages per guest — Limit total messages per month

See Creating Tiers for configuration details.

Best Practices

For Better AI Responses

1. Detailed system prompts - Give clear instructions
2. Rich knowledge base - More context = better answers
3. Specific agents - Specialized agents outperform generalists
4. Regular refinement - Update based on feedback

For Member Experience

1. Clear agent purposes - Help members choose the right agent
2. Conversation starters - Suggest first questions
3. Set expectations - Explain what the AI can/cannot do
4. Encourage specificity - Teach members to ask good questions

Common Questions

Q: Can the AI remember previous conversations? A: Yes, within the same conversation. Each new conversation starts fresh.

Q: Can members upload images? A: Yes, for supported models (like GPT-4 Vision).

Q: Is the conversation data private? A: Yes, conversations are private to the member and stored securely.

Q: Can I see member conversations? A: Currently, conversations are private. Admin viewing features are planned.

Next Steps

• Creating AI Agents - Build your custom agents
• Knowledge Base - Train your AI with your content