Respect token budget (~1000 tokens max) #35

Open
opened 2025-05-14 20:24:25 -04:00 by milo · 0 comments
Owner
  • Have context.py fit as many tokens as possible in each injection. this allows for the widest possible context length.
    • Moved from #7
- Have context.py fit as many tokens as possible in each injection. this allows for the widest possible context length. - Moved from #7
milo added the
enhancement
label 2025-05-14 20:24:43 -04:00
milo added this to the Beta Build milestone 2025-05-14 20:24:49 -04:00
milo self-assigned this 2025-05-14 20:24:55 -04:00
milo added reference main 2025-05-14 20:25:01 -04:00
Sign in to join this conversation.
No description provided.