Pinned Loading

1. LingCloud LingCloud Public

   Attaching human-like eyes to the large language model. The codes of IEEE TMM paper "LMEye: An Interactive Perception Network for Large Language Model""

   Python 48 1

2. HITsz-TMG/UMOE-Scaling-Unified-Multimodal-LLMs HITsz-TMG/UMOE-Scaling-Unified-Multimodal-LLMs Public

   The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"

   Python 681 39

3. HITsz-TMG/VisionGraph HITsz-TMG/VisionGraph Public

   The benchmark and datasets of the ICML 2024 paper "VisionGraph: Leveraging Large Multimodal Models for Graph Theory Problems in Visual Context"

   Python 13 1

4. HITsz-TMG/Cognitive-Visual-Language-Mapper HITsz-TMG/Cognitive-Visual-Language-Mapper Public

   The codes and datasets about our ACL 2024 Main Conference paper titled "Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment"

   Python 12 2

5. HITsz-TMG/Anim-Director HITsz-TMG/Anim-Director Public

   The codes of Siggraph Asia 2024 paper "Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation"

   Python 42 3