Fish Audio Integrations

VoiSpark is an innovative online platform for AI voice generation that converts text into lifelike speech in over 30 languages and dialects, featuring more than 100 voice templates that include various ages, accents, and personas. The platform allows for real-time streaming and utilizes a combination of open-source models like Nari Labs Dia alongside premium engines such as ElevenLabs, all accessible through an easy-to-navigate web interface or REST API. Users have the ability to customize voice features using intuitive sliders, while the context-aware generation adjusts pacing and tone to fit any given script. To enhance user experience, instant 30-second previews are available, allowing users to sample voices without any commitment, and the platform supports multiple input formats, including typing, PDF uploads, and Google Docs integration, with output options available in MP3 or WAV for effortless editing. Moreover, advanced functionalities like voice cloning from brief samples, the ability to toggle between "professional" and "expressive" voice models for varying levels of clarity and creativity, and batch generation cater to diverse needs such as podcasts, e-learning materials, audiobooks, video dubbing, social media snippets, and voices for game characters. The versatility of VoiSpark makes it an ideal choice for anyone looking to enhance their audio content with high-quality voice generation.

Vision Agents is a versatile open-source Python framework designed for developing low-latency voice and video AI agents utilizing any model. This framework empowers developers to integrate large language models, speech recognition, and vision models from over 25 different providers, enabling the creation of real-time agents for applications such as telehealth, voice assistance, live coaching, video analysis, interactive avatars, security surveillance, sports commentary, and a variety of other multimodal uses. Its architecture is tailored to facilitate the development of agents capable of listening, speaking, seeing, processing media, accessing tools, and providing instant responses, all while operating on Stream's expansive global edge network, which ensures latency below 500ms. With just a minimal Python setup, developers can quickly create their first agent by leveraging platforms like Gemini Realtime, OpenAI, Deepgram, ElevenLabs, Stream, or other compatible providers. Furthermore, Vision Agents accommodates both real-time speech-to-speech models and tailored speech-to-text, language processing, and text-to-speech pipelines, allowing teams to either rapidly deploy a functional voice agent or exercise complete control over the components involved in speech recognition, language reasoning, and text-to-speech functionalities. Overall, this framework not only simplifies the process of building sophisticated AI agents but also enhances flexibility and performance across diverse applications.

VideoLingo offers a cloud-based service focused on video localization, catering to course instructors, educators, technical creators, bloggers, and various publishers who aim to reach multilingual audiences. This platform provides bilingual subtitles and dubbed videos, ensuring that translations maintain cultural nuances and industry-specific jargon. Its workflow encompasses tasks such as subtitle segmentation and timing, synthesized speech generation, and video export, with varying features and limitations depending on the selected plan. Users of the free plan can process up to 15 minutes of video, upload content in English and Chinese, generate bilingual subtitles, receive 480p video output, access dubbing services, and will notice a watermark on their videos. In contrast, paid subscriptions enhance processing capabilities, allow for input in eight different languages, offer 1080p output quality, and include additional dubbing features. Furthermore, for those who prefer a self-hosted solution, there is an open-source edition available for installation on Windows, macOS, or Linux systems. This flexibility provides users with multiple options to suit their specific needs and preferences.

Irreality is an innovative AI video production platform accessible through web browsers, tailored for filmmakers, independent creators, production companies, agencies, and audiovisual teams. This platform integrates screenplay writing or importing with scene breakdowns, visual references, shot lists, and storyboards, while also facilitating the generation of AI-created images, video takes, dialogue, and voiceovers. Through dedicated project workspaces, teams can efficiently organize their assets, invite collaborators, and share materials for client review and feedback. Users have the capability to compare different takes, select preferred versions, utilize AI-enhanced video effects, and export their project assets seamlessly. Additionally, a diverse catalog of third-party AI models is available to assist with tasks related to image, video, audio, and upscaling, with usage tracked through a credit-based plan system. This versatile product is specifically designed to accommodate various audiovisual projects, including films and advertisements, guiding users from initial concepts and storyboarding all the way to the final generated shots and delivery phases. The platform’s comprehensive features aim to streamline the creative process and enhance collaboration among teams.

Zoice is an online platform that allows users to create AI-generated avatar videos tailored for various purposes such as social media, marketing, education, and training. Users have the option to upload their own images or design a character, write a script or upload audio, select or import a voice, and produce a video featuring a talking or singing avatar. The platform's capabilities encompass lip synchronization, facial expressions and gestures, action prompts, the ability to reuse avatar and voice profiles, as well as speech previews, while also providing controls for aspect ratio and resolution, with final outputs reaching 4K quality. Additionally, Zoice accommodates scripts in over 170 languages, offers voice cloning features, and allows users to import voice profiles from popular services like ElevenLabs and Fish Audio. A developer API enhances the functionality by enabling avatar video generation programmatically. The service operates on a credit-based system and is accessible online, with avatar video creation available through various paid subscription plans, making it a versatile tool for content creators across different fields.