LLMs will evolve into LMMs in 2024 according to eBay

Senthil Padmanabhan, Vice President, Fellow, and Head of User Experience at eBay, shares his 2024 predictions on AI evolution, including why Large Multimodal Models (LMMs) are set to replace LLMs, and what a glimpse into the future of AI looks like, on the path towards Artificial General Intelligence (AGI).

(LLMs) Large Language Models will evolve into (LMMs) Large Multimodal Models

Large Language Models (LLMs), which powered the ChatGPT breakthrough and started the AI paradigm shift, will evolve into Large Multimodal Models (LMMs) and oust LLMs. Both open and closed Large Multimodal Models (LMMs) will keep emerging, and the discussions will be about multimodal evaluation, multimodal safety, etc. LMMs will interleave various modalities - text, vision, audio, video, and motion sensory signals - mirroring the natural progression of language as the bedrock of human interaction, enhanced by other sensory dimensions.

LMMs will be the future of AI and a stepping stone towards Artificial General Intelligence (AGI).