AI that can understand or create text, images, sound, and video.
Multimodal AI is like a kid with the TV sound back on. It sees the pie hit the face and hears the splat.
It lets AI read pictures and hear audio. You meet it when an app answers questions about a photo or a video.
LLM
Multimodal AI gives the LLM more than words to read and make.
Embedding
Embedding helps different media match up inside the AI.
Diffusion
Diffusion helps Multimodal AI make images.
Foundation-model
Foundation-model gives Multimodal AI one shared base.