Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
This repository showcases an implementation of model parallel autoregressive transformers utilizing GPUs, leveraging the capabilities of the DeepSpeed library. It serves as a record of EleutherAI's framework designed for training extensive language models on GPU architecture. Currently, it builds upon NVIDIA's Megatron Language Model, enhanced with advanced techniques from DeepSpeed alongside innovative optimizations. Our goal is to create a centralized hub for aggregating methodologies related to the training of large-scale autoregressive language models, thereby fostering accelerated research and development in the field of large-scale training. We believe that by providing these resources, we can significantly contribute to the progress of language model research.
Description
PygmalionAI is a vibrant community focused on the development of open-source initiatives utilizing EleutherAI's GPT-J 6B and Meta's LLaMA models. Essentially, Pygmalion specializes in crafting AI tailored for engaging conversations and roleplaying. The actively maintained Pygmalion AI model currently features the 7B variant, derived from Meta AI's LLaMA model. Requiring a mere 18GB (or even less) of VRAM, Pygmalion demonstrates superior chat functionality compared to significantly larger language models, all while utilizing relatively limited resources. Our meticulously assembled dataset, rich in high-quality roleplaying content, guarantees that your AI companion will be the perfect partner for roleplaying scenarios. Both the model weights and the training code are entirely open-source, allowing you the freedom to modify and redistribute them for any purpose you desire. Generally, language models, such as Pygmalion, operate on GPUs, as they require swift memory access and substantial processing power to generate coherent text efficiently. As a result, users can expect a smooth and responsive interaction experience when employing Pygmalion's capabilities.
API Access
Has API
No
API Access
Has API
No
Integrations
Forefront
No
ZBrain
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
EleutherAI
Founded
2020
Website
github.com/EleutherAI/gpt-neox
Vendor Details
Company Name
PygmalionAI
Website
pygmalion.chat/
Product Features
Product Features
Chatbot
Call to Action
No
Context and Coherence
No
Human Takeover
No
Inline Media / Videos
No
Machine Learning
No
Natural Language Processing
No
Payment Integration
No
Prediction
No
Ready-made Templates
No
Reporting / Analytics
No
Sentiment Analysis
No
Social Media Integration
No
Conversational AI
Code-free Development
No
Contextual Guidance
No
For Developers
No
Intent Recognition
No
Multi-Languages
No
Omni-Channel
No
On-Screen Chats
No
Pre-configured Bot
No
Reusable Components
No
Sentiment Analysis
No
Speech Recognition
No
Speech Synthesis
No
Virtual Assistant
No