AI Chat Overview
AI Chat is the core feature of ToolChat - it allows your members to have conversations with AI agents trained on your methodology.
How It Works
Member asks question → AI processes with your context → Personalized responseThe AI combines:
- Base intelligence - GPT-4, Claude, or other LLMs
- System prompt - Your agent's personality and instructions
- Knowledge base - Your uploaded documents and content
- Conversation history - Context from the current conversation
Key Concepts
Agents
Agents are AI personalities you create. Each agent has:
- A name and avatar
- A system prompt (personality/instructions)
- Access to your knowledge base
You can create multiple agents for different purposes:
- General coaching agent
- Workout planning specialist
- Nutrition advisor
- Mindset coach
Conversations
Each chat between a member and an agent is a conversation:
- Conversations persist across sessions
- Members can have multiple conversations
- Conversation history provides context
Messages
Individual messages within a conversation:
- Can include text
- Can include images/attachments
- Are stored for context
For Members
Members access AI Chat through:
- Tools in the sidebar
- Select an agent
- Start chatting
Features available to members:
- Start new conversations
- Continue previous conversations
- View conversation history
- Send images/attachments
For Owners
Your role is to:
- Create agents with appropriate personalities
- Upload knowledge so the AI can reference your content
- Monitor usage through the Admin Dashboard
- Refine prompts based on member feedback
AI Models
ToolChat supports multiple AI models:
| Model | Best For | Speed | Cost |
|---|---|---|---|
| GPT-4 | Complex reasoning, nuanced responses | Medium | Higher |
| GPT-4 Turbo | Fast, capable responses | Fast | Medium |
| Claude 3 | Long-form content, analysis | Medium | Medium |
| Claude 3 Haiku | Quick responses | Very Fast | Lower |
Model selection can be configured per agent.
Usage & Costs
How Costs Work
AI usage is measured in tokens:
- Tokens are roughly 4 characters
- Both input and output count
- More complex responses = more tokens
Your Costs
As an owner, you're responsible for AI costs:
- Costs are deducted from your ToolChat balance
- Monitor usage in Admin → Billing
- Set up alerts for high usage
Member Limits (Coming Soon)
Future feature: Set per-member or per-tier limits on:
- Messages per day/month
- Tokens per conversation
- Total monthly usage
Best Practices
For Better AI Responses
- Detailed system prompts - Give clear instructions
- Rich knowledge base - More context = better answers
- Specific agents - Specialized agents outperform generalists
- Regular refinement - Update based on feedback
For Member Experience
- Clear agent purposes - Help members choose the right agent
- Conversation starters - Suggest first questions
- Set expectations - Explain what the AI can/cannot do
- Encourage specificity - Teach members to ask good questions
Common Questions
Q: Can the AI remember previous conversations? A: Yes, within the same conversation. Each new conversation starts fresh.
Q: Can members upload images? A: Yes, for supported models (like GPT-4 Vision).
Q: Is the conversation data private? A: Yes, conversations are private to the member and stored securely.
Q: Can I see member conversations? A: Currently, conversations are private. Admin viewing features are planned.
Next Steps
- Creating AI Agents - Build your custom agents
- Knowledge Base - Train your AI with your content