Manual context limits.
We should have a slider that goes from like 100 words to whatever the max is and by default it should stay at max. This slider would allow selective context and token costs for generations. The main advantage obviously would be better control over how much each generation costs but it would also be good for when the ai is constantly incorporating context that is irrelevant from far back in the document when just want help with a specific scene or such.
Log in to comment and vote
No comments yet
Be the first to share your thoughts.