Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
We are thrilled to present DBRX, a versatile open LLM developed by Databricks. This innovative model achieves unprecedented performance on a variety of standard benchmarks, setting a new benchmark for existing open LLMs. Additionally, it equips both the open-source community and enterprises crafting their own LLMs with features that were once exclusive to proprietary model APIs; our evaluations indicate that it outperforms GPT-3.5 and competes effectively with Gemini 1.0 Pro. Notably, it excels as a code model, outperforming specialized counterparts like CodeLLaMA-70B in programming tasks, while also demonstrating its prowess as a general-purpose LLM. The remarkable quality of DBRX is complemented by significant enhancements in both training and inference efficiency. Thanks to its advanced fine-grained mixture-of-experts (MoE) architecture, DBRX elevates the efficiency of open models to new heights. In terms of inference speed, it can be twice as fast as LLaMA2-70B, and its total and active parameter counts are approximately 40% of those in Grok-1, showcasing its compact design without compromising capability. This combination of speed and size makes DBRX a game-changer in the landscape of open AI models.
Description
Hy4 flash is a high-speed generative AI model designed to deliver advanced reasoning and multimodal understanding at a lower computational cost than larger frontier models. Developed as part of Tencent's HY4 family, the model combines hybrid attention, LatentMoE, and Engram architectural technologies to improve inference efficiency. Its architecture contains 224 billion parameters but activates approximately 12 billion parameters during processing, reducing the resources required for generating responses. A one-million-token context window enables users to analyze extensive documents, technical materials, software repositories, and other information-intensive inputs. Hy4 flash supports applications such as deep research, document processing, spreadsheet analysis, PowerPoint creation, frontend development, and visual information interpretation. Its agentic capabilities allow AI assistants to interact with tools, perform computer-based activities, and complete multistep productivity workflows. Tencent uses reinforcement learning and inference optimization techniques to shorten generated outputs and achieve decoding speeds above 150 tokens per second. The model is accessible through Tencent Cloud TokenHub, WorkBuddy, Yuanbao, WeCom, QQ, ima, and other supported Tencent services. By combining multimodal reasoning, efficient architecture, and flexible application integration, Hy4 flash provides developers and enterprises with a cost-effective foundation for AI-powered productivity and automation.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Cogent DataHub
Yes
Double
Yes
GPT-3.5
Yes
GPT-4
Yes
OpenRouter
No
Rayven
Yes
Tencent Cloud
No
Tencent Hy
No
Visplore
Yes
ZenML
Yes
Integrations
Cogent DataHub
No
Double
No
GPT-3.5
No
GPT-4
No
OpenRouter
Yes
Rayven
No
Tencent Cloud
Yes
Tencent Hy
Yes
Visplore
No
ZenML
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0.070 per 1M tokens (input)
$0.070 per 1M tokens (input)
$0.281 per 1M tokens (output)
$0.281 per 1M tokens (output)
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Databricks
Country
United States
Website
www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Vendor Details
Company Name
Tencent
Founded
1998
Country
China
Website
hy.tencent.ai/research/hy4-flash