Project Name

Multi-Modal Model Python Project

Overview

This project is a multi-modal model that accepts audio, images, and text as inputs, generating corresponding audio, images, and text outputs.

Features

• Streamlit Interface : Coming Soon
• Input Modalities: Audio, Images, Text, videos , emojis, multi inputs
• Output Modalities: Audio, Images, Text, Videos , emojis , segmented images, images objects detection coordinates, multi outputs

Getting Started

Prerequisites

• Python 3.x
• Dependencies listed in requirements.txt

Installation

git clone https://github.com/Kind-Unes/Multi-Model-V1.git
cd 'MultiMODEL Template'
pip install -r requirements.txt

Usage

python model.py

Credits

TXT2IMG Models

• OpenDalleV1.1
• SSD-1B.
• SSD-1B-Anime

Text Generation Model

• GOOGLE-GEMINI

IMG2TXT Model

• BLIP_IMAGE_CAPTIONING_LARGE

TTS Model

• FACEBOOK_MMS_TTS_ENG

STT Model

• OPENAI_WHISPER_LARGE_V2

Others . . . . .

Websites

• Base64-Image-Viewer.
• Base64-Audio-Reader.