milo/AI-Discord-Bot
1
0
Fork 0
Code Issues 24 Pull requests Projects 2 Releases 1 Packages Wiki Activity Actions

Multi model support #27

New issue
Open
opened 2025-05-11 21:00:02 -04:00 by milo · 1 comment
milo commented 2025-05-11 21:00:02 -04:00
Owner
Copy link

🧠 Multi-Model Support

Current Behavior:
The bot is hardcoded to use Llama3 as its default model.

Feature Goal:
Support any model available through Ollama, allowing users to choose models that suit their system, preferences, or performance needs.

Why It Matters:

  • 🔄 Flexibility: Not all users will want or be able to use Llama3.
  • ⚙️ Future Features: Enables dynamic model switching based on:
    • Persona
    • Context
    • Hardware limits or availability
  • 🛠️ Power Users: Advanced users may wish to load fine-tuned models or experiment with different behaviors.
### 🧠 Multi-Model Support **Current Behavior:** The bot is hardcoded to use `Llama3` as its default model. **Feature Goal:** Support **any** model available through **[Ollama](https://ollama.com)**, allowing users to choose models that suit their system, preferences, or performance needs. **Why It Matters:** - 🔄 **Flexibility**: Not all users will want or be able to use Llama3. - ⚙️ **Future Features**: Enables dynamic model switching based on: - Persona - Context - Hardware limits or availability - 🛠️ **Power Users**: Advanced users may wish to load fine-tuned models or experiment with different behaviors.
milo added this to the Alpha Build Ready milestone 2025-05-11 21:00:02 -04:00
milo added the
High Priority
💡feature
 labels 2025-05-11 21:00:02 -04:00
milo self-assigned this 2025-05-11 21:00:02 -04:00
milo added this to the Polishing Phase project 2025-05-11 21:00:02 -04:00
milo commented 2025-05-13 23:43:42 -04:00
Author
Owner
Copy link

Not Working

Cannot reliably load and unload Ollama Models. Only way to change models as of now is to ether wait for Ollama to naturaly unload them after 5 min or so or restart Ollama and the bot to reload the new model.

### Not Working Cannot reliably load and unload Ollama Models. Only way to change models as of now is to ether wait for Ollama to naturaly unload them after 5 min or so or restart Ollama and the bot to reload the new model.
milo added the
bug
 label 2025-05-13 23:43:55 -04:00
milo modified the milestone from Alpha Build Ready to Beta Build 2025-05-14 00:10:52 -04:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
0.1
Labels
Clear labels   
High Priority

Critical Feature or Improvement that should be prioritised

  
Low Priority

None Critical Feature, safe to pushed back

  
Upgrade Path

Issue/Feature has room for growth or improvement listed

  
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

  
💡feature

New functionality

No labels
High Priority
Low Priority
Upgrade Path
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
💡feature
Milestone
Clear milestone
No items
No milestone
Beta Build
Projects
Clear projects
No items
No project
Polishing Phase
Assignees
Clear assignees
No assignees
milo
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: milo/AI-Discord-Bot#27
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?