Meta introduces generative AI model ‘CM3leon’ for text, images

Synopsis With CM3leon’s capabilities, the company said that the image generation tools can produce more coherent imagery that better follows the input prompts. TOI. in Meta (formerly Facebook) has introduced a generative artificial intelligence (AI) model — ” CM3leon ” (pronounced like chameleon), that does both text-to-image and image-to-text generation.

“CM3leon is the first multimodal model trained with a recipe adapted from text-only language models , including a large-scale retrieval-augmented pre-training stage and a second multitask supervised fine-tuning (SFT) stage,” Meta said in a blogpost on Friday. With CM3leon’s capabilities, the company said that the image generation tools can produce more coherent imagery that better follows the input prompts. According to Meta, CM3leon requires only five times the computing power and a smaller training dataset than previous transformer-based methods.

When compared to the most widely used image generation benchmark (zero-shot MS-COCO), CM3Leon achieved an FID (Frechet Inception Distance) score of 4. 88, establishing a new state-of-the-art in text-to-image generation and outperforming Google’s text-to-image model, Parti. Moreover, the tech giant said that CM3leon excels at a wide range of vision-language tasks, such as visual question answering and long-form captioning.

Discover the stories of your interest Blockchain 5 Stories Cyber-safety 7 Stories Fintech 9 Stories E-comm 9 Stories ML 8 Stories Edtech 6 Stories CM3Leon’s zero-shot performance compares favourably to larger models trained on larger datasets, despite training on a dataset of only three billion text tokens. “With the goal of creating high-quality generative models, we believe CM3leon’s strong performance across a variety of tasks is a step toward higher-fidelity image generation and understanding,” Meta said. “Models like CM3leon could ultimately help boost creativity and better applications in the metaverse.

We look forward to exploring the boundaries of multimodal language models and releasing more models in the future,” it added. Don’t miss out on ET Prime stories! Get your daily dose of business updates on WhatsApp. click here! Sunday, 16 Jul, 2023 Experience Your Economic Times Newspaper, The Digital Way! Read Complete Print Edition » Front Page Pure Politics Bottom Line Deep Dive More See Myself in Non-Executive Role at Bank: Uday Kotak Uday Kotak, Asia’s richest banker, who single-handedly built one of the country’s most-valued lenders bearing his family name, will likely take a non-executive role soon at Kotak Mahindra Bank, having shepherded it through capital scarcity of an autarkic licence raj four decades ago, to the visible abundance of a liberalised India that is among the world’s primary growth engines.

MNCs may Hire Half a Million in India This Fiscal Global capability centres (GCCs) of multinationals in India have ramped up their talent search this fiscal year even as recessionary pressures and macroeconomic headwinds keep hiring muted in the West, said top industry officials. Online Gaming Cos Call for Relook at 28% GST Levy Around 130 online gaming companies and industry associations, including Mobile Premier League (MPL), Nazara Technologies, Gameskraft Technologies and Winzo Games, have jointly appealed for reconsideration of the GST Council’s recommendation to impose 28% tax on the full face value of online gaming. Read More News on meta language models generative AI CM3leon generative artificial intelligence Stay on top of technology and startup news that matters.

Subscribe to our daily newsletter for the latest and must-read tech news, delivered straight to your inbox. . .

. more less ETPrime stories of the day Strategy Sugar isn’t sweet anymore. PepsiCo, Coca-Cola turn to diet and energy drinks to counter slump.

10 mins read Auto Maruti’s rise as an SUV, MPV maker has a hidden message for its balance sheet. (Think affordability) 7 mins read Markets Why rising crude prices won’t affect stock markets? Answer lies in Reliance’s weightage in Nifty. 7 mins read Subscribe to ETPrime.