Context Awareness #7

New issue

Closed

opened 2025-05-11 13:51:30 -04:00 by milo · 1 comment

milo commented

2025-05-11 13:51:30 -04:00

Owner

🧠 Context Awareness – Feature Scope

🔬 What This Isn't (Yet)

❌ Not long-term memory across sessions

(That will be handled by User Awareness) #8
❌ Not vector-embedded retrieval like OpenWebUI's knowledge bases

(That comes later with embeddings + vector DB support)
❌ Not model fine-tuning

(We’re just feeding smart context via prompt engineering)

✅ Scope for `Context Awareness v1`

Capture X previous messages in the channel before Delta is mentioned
Format those messages into a readable text block

Inject context above user prompt like:

[Recent Conversation]
- Miguel: what's the plan today?
- Aria: nothing productive, probably
- Miguel: maybe Delta can help

Filter out:
- Messages from other bots
- Empty lines or emojis-only
~~~[ ] Respect token budget (~~1000 tokens max)~~~~ Moved to its own issue #35
Optional: toggle via settings.yml or future admin command

🔁 Upgrade Path for Future Versions

Feature	Upgrade
Persistent long-term memory	Save context to DB and fetch per user or thread
Vector-based retrieval	Use embeddings + vector store (e.g. ChromaDB)
Knowledge base integration	Add OpenWebUI-style document linking
Context-based personality shift	Adjust tone/style based on chat theme
Summarized thread memory	Store previous thread summary for reuse in future chats
Context summarization	Compress long histories into a short-form preamble

## 🧠 Context Awareness – Feature Scope ### 🔬 What This _Isn't_ (Yet) - ❌ Not long-term memory across sessions > (That will be handled by `User Awareness`) #8 - ❌ Not vector-embedded retrieval like OpenWebUI's knowledge bases > (That comes later with embeddings + vector DB support) - ❌ Not model fine-tuning > (We’re just feeding smart context via prompt engineering) --- ### ✅ Scope for `Context Awareness v1` - [x] Capture X previous messages in the channel before Delta is mentioned - [x] Format those messages into a readable text block - [x] Inject context above user prompt like: ``` [Recent Conversation] - Miguel: what's the plan today? - Aria: nothing productive, probably - Miguel: maybe Delta can help ``` - [x] Filter out: - Messages from other bots - Empty lines or emojis-only - ~~[ ] Respect token budget (~1000 tokens max)~~ Moved to its own issue #35 - [x] Optional: toggle via `settings.yml` or future admin command --- ### 🔁 Upgrade Path for Future Versions | Feature | Upgrade | |-------------------------------|---------| | Persistent long-term memory | Save context to DB and fetch per user or thread | | Vector-based retrieval | Use embeddings + vector store (e.g. ChromaDB) | | Knowledge base integration | Add OpenWebUI-style document linking | | Context-based personality shift | Adjust tone/style based on chat theme | | Summarized thread memory | Store previous thread summary for reuse in future chats | | Context summarization | Compress long histories into a short-form preamble |