Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.1k 93

  2. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 751 51

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 677 33

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 564 41

  5. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 444 51

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 367 24

Repositories

Showing 10 of 13 repositories
  • VideoGPT-plus Public

    Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

    mbzuai-oryx/VideoGPT-plus’s past year of commit activity
    Python 141 CC-BY-4.0 6 9 1 Updated Jul 14, 2024
  • LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    mbzuai-oryx/LLaVA-pp’s past year of commit activity
    Python 751 51 15 2 Updated Jul 10, 2024
  • Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

    mbzuai-oryx/Video-ChatGPT’s past year of commit activity
    Python 1,068 CC-BY-4.0 93 13 0 Updated Jun 16, 2024
  • CVRR-Evaluation-Suite Public

    Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs".

    mbzuai-oryx/CVRR-Evaluation-Suite’s past year of commit activity
    Python 36 CC-BY-4.0 1 0 0 Updated Jun 15, 2024
  • groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    mbzuai-oryx/groundingLMM’s past year of commit activity
    Python 677 33 13 0 Updated Jun 2, 2024
  • PALO Public

    Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 74 Apache-2.0 5 4 0 Updated Mar 26, 2024
  • GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    mbzuai-oryx/GeoChat’s past year of commit activity
    Python 367 24 26 1 Updated Mar 24, 2024
  • BiMediX Public

    Bilingual Medical Mixture of Experts LLM

    mbzuai-oryx/BiMediX’s past year of commit activity
    23 1 1 0 Updated Mar 17, 2024
  • MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    mbzuai-oryx/MobiLlama’s past year of commit activity
    Python 564 Apache-2.0 41 12 2 Updated Mar 3, 2024
  • ClimateGPT Public

    [EMNLP'23] ClimateGPT: a specialized LLM for conversations related to Climate Change and Sustainability topics in both English and Arabic languages.

    mbzuai-oryx/ClimateGPT’s past year of commit activity
    Python 71 9 0 0 Updated Jan 31, 2024
View all repositories

Top languages

Python