Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Pre-trained language models have made significant strides, achieving top-tier performance across multiple Natural Language Processing (NLP) applications. The impressive capabilities of GPT-3 highlight how increasing the scale of these models can unlock their vast potential. Recently, a comprehensive framework known as ERNIE 3.0 was introduced to pre-train large-scale models enriched with knowledge, culminating in a model boasting 10 billion parameters. This iteration of ERNIE 3.0 has surpassed the performance of existing leading models in a variety of NLP tasks. To further assess the effects of scaling, we have developed an even larger model called ERNIE 3.0 Titan, which consists of up to 260 billion parameters and is built on the PaddlePaddle platform. Additionally, we have implemented a self-supervised adversarial loss alongside a controllable language modeling loss, enabling ERNIE 3.0 Titan to produce texts that are both reliable and modifiable, thus pushing the boundaries of what these models can achieve. This approach not only enhances the model's capabilities but also opens new avenues for research in text generation and control.
Description
The MAI-1 Preview marks the debut of Microsoft AI's fully in-house developed foundation model, utilizing a mixture-of-experts architecture for streamlined performance. This model has undergone extensive training on around 15,000 NVIDIA H100 GPUs, equipping it to adeptly follow user instructions and produce relevant text responses for common inquiries, thus illustrating a prototype for future Copilot functionalities. Currently accessible for public testing on LMArena, MAI-1 Preview provides an initial look at the platform's direction, with plans to introduce select text-driven applications in Copilot over the next few weeks aimed at collecting user insights and enhancing its capabilities. Microsoft emphasizes its commitment to integrating its proprietary models, collaborations with partners, and advancements from the open-source sector to dynamically enhance user experiences through millions of distinct interactions every day. This innovative approach illustrates Microsoft's dedication to continuously evolving its AI offerings.
API Access
Has API
API Access
Has API
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Baidu
Founded
2000
Country
China
Website
research.baidu.com/Public/uploads/61c4362c79ee8.pdf
Vendor Details
Company Name
Microsoft
Founded
1975
Country
United States
Website
microsoft.ai/news/two-new-in-house-models/