LTM-2-mini Description

LTM-2-mini operates with a context of 100 million tokens, which is comparable to around 10 million lines of code or roughly 750 novels. This model employs a sequence-dimension algorithm that is approximately 1000 times more cost-effective per decoded token than the attention mechanism used in Llama 3.1 405B when handling a 100 million token context window. Furthermore, the disparity in memory usage is significantly greater; utilizing Llama 3.1 405B with a 100 million token context necessitates 638 H100 GPUs per user solely for maintaining a single 100 million token key-value cache. Conversely, LTM-2-mini requires only a minuscule portion of a single H100's high-bandwidth memory for the same context, demonstrating its efficiency. This substantial difference makes LTM-2-mini an appealing option for applications needing extensive context processing without the hefty resource demands.

Integrations

No Integrations at this time

Reviews

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Company Details

Company:
Magic AI
Year Founded:
2022
Headquarters:
United States
Website:
magic.dev/

Media

LTM-2-mini Screenshot 1
Recommended Products
Top Corporate LMS for Training | Best Learning Management Software Icon
Top Corporate LMS for Training | Best Learning Management Software

Deliver and Track Online Training and Stay Compliant - with Axis LMS!

Axis LMS enables you to deliver online and virtual learning and training through a scalable, easy-to-use LMS that is designed to enhance your training, automate your workflows, engage your learners and keep you compliant.
Learn More

Product Details

Platforms
Web-Based

LTM-2-mini Features and Options

LTM-2-mini Lists

LTM-2-mini User Reviews

Write a Review
  • Previous
  • Next