StableVicuna Reviews

StableVicuna Description

StableVicuna represents the inaugural large-scale open-source chatbot developed through reinforced learning from human feedback (RLHF). It is an advanced version of the Vicuna v0 13b model, which has undergone further instruction fine-tuning and RLHF training. To attain the impressive capabilities of StableVicuna, we use Vicuna as the foundational model and adhere to the established three-stage RLHF framework proposed by Steinnon et al. and Ouyang et al. Specifically, we perform additional training on the base Vicuna model with supervised fine-tuning (SFT), utilizing a blend of three distinct datasets. The first is the OpenAssistant Conversations Dataset (OASST1), which consists of 161,443 human-generated messages across 66,497 conversation trees in 35 languages. The second dataset is GPT4All Prompt Generations, encompassing 437,605 prompts paired with responses created by GPT-3.5 Turbo. Lastly, the Alpaca dataset features 52,000 instructions and demonstrations that were produced using OpenAI's text-davinci-003 model. This collective approach to training enhances the chatbot's ability to engage effectively in diverse conversational contexts.