This .NET chatbot library designed for on-device use introduces advanced multi-turn conversational AI that maintains context while ensuring quick response times and complete privacy. With lightweight models, it eliminates the need for cloud connectivity.
You can customize the responses using techniques like RandomSampling or MirostatSampling, and manage token usage with LogitBias and RepetitionPenalty to achieve diverse and non-repetitive responses.
Moreover, it features event-driven hooks that allow you to implement personalized logic before or after each message, as well as facilitating human-in-the-loop evaluations when necessary.