Liquid AI Integrations

The LEAP Edge AI Platform presents a comprehensive on-device AI toolchain that allows developers to create edge AI applications, encompassing everything from model selection to inference directly on the device. This platform features a best-model search engine designed to identify the most suitable model based on specific tasks and device limitations, and it offers a collection of pre-trained model bundles that can be easily downloaded. Additionally, it provides fine-tuning resources, including GPU-optimized scripts, enabling customization of models like LFM2 for targeted applications. With support for vision-enabled functionalities across various platforms such as iOS, Android, and laptops, it also includes function-calling capabilities, allowing AI models to engage with external systems through structured outputs. For seamless deployment, LEAP offers an Edge SDK that empowers developers to load and query models locally, mimicking cloud API functionality while remaining completely offline, along with a model bundling service that facilitates the packaging of any compatible model or checkpoint into an optimized bundle for edge deployment. This comprehensive suite of tools ensures that developers have everything they need to build and deploy sophisticated AI applications efficiently and effectively.

Apollo is a streamlined mobile application that facilitates completely on-device, cloud-independent AI interactions, allowing users to interact with sophisticated language and vision models in a secure, private manner with minimal delays. It features a collection of compact foundation models sourced from the company's LEAP platform, enabling users to compose messages, send emails, converse with a personal AI assistant, create digital characters, or utilize image-to-text functions, all while maintaining offline capabilities and ensuring no data is transmitted beyond the device. Optimized for immediate responsiveness and offline functionality, Apollo guarantees that all inference occurs locally, eliminating the need for API calls, external servers, or logging of user data. This application acts as both a personal AI exploration tool and a development environment for those utilizing LEAP models, allowing users to effectively assess a model's performance on their specific mobile devices prior to more widespread implementation. Additionally, Apollo's design emphasizes user autonomy, ensuring a seamless experience free from external interruptions or privacy concerns.

SF Compute serves as a marketplace platform providing on-demand access to extensive GPU clusters, enabling users to rent high-performance computing resources by the hour without the need for long-term commitments or hefty upfront investments. Users have the flexibility to select either virtual machine nodes or Kubernetes clusters equipped with InfiniBand for rapid data transfer, allowing them to determine the number of GPUs, desired duration, and start time according to their specific requirements. The platform offers adaptable "buy blocks" of computing power; for instance, clients can request a set of 256 NVIDIA H100 GPUs for a three-day period at a predetermined hourly price, or they can adjust their resource allocation depending on their budgetary constraints. When it comes to Kubernetes clusters, deployment is incredibly swift, taking approximately half a second, while virtual machines require around five minutes to become operational. Furthermore, SF Compute includes substantial storage options, featuring over 1.5 TB of NVMe and upwards of 1 TB of RAM, and notably, there are no fees for data transfers in or out, meaning users incur no costs for data movement. The underlying architecture of SF Compute effectively conceals the physical infrastructure, leveraging a real-time spot market and a dynamic scheduling system to optimize resource allocation. This setup not only enhances usability but also maximizes efficiency for users looking to scale their computing needs.

The LFM-40B strikes an innovative equilibrium between the dimensions of the model and the caliber of its outputs. Utilizing 12 billion activated parameters, it delivers performance that rivals that of larger models. Furthermore, its mixture of experts (MoE) architecture enhances throughput efficiency, making it suitable for deployment on budget-friendly hardware. This combination of features allows for impressive results without necessitating excessive resources.