{"id":25148,"date":"2023-11-16T20:10:43","date_gmt":"2023-11-16T20:10:43","guid":{"rendered":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/"},"modified":"2023-11-16T20:10:45","modified_gmt":"2023-11-16T20:10:45","slug":"meta-introduces-ai-models-for-video-generation-image-editing","status":"publish","type":"post","link":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/","title":{"rendered":"Meta introduces AI models for video generation, image editing"},"content":{"rendered":"
\n

Social media giant Meta has introduced its latest artificial intelligence (AI) models for content editing and generation, according to a blog post on Nov. 16.\u00a0<\/p>\n

The company is introducing two AI-powered generative models. The first, Emu Video, which leverages Meta’s previous Emu model, is capable of generating video clips based on text and image inputs. While the second model, Emu Edit, is focused on image manipulation, promising more precision in image editing.<\/p>\n

The models are still in the research stage, but Meta says their initial results show potential use cases for creators, artists and animators alike.<\/p>\n

Meta displays its new generative model Emu Edit. Source: Meta<\/em><\/figcaption><\/figure>\n

According to Meta’s blog post, the Emu Video was trained with a \u201cfactorized\u201d approach, dividing the training process into two steps to allow the model to be responsive to different inputs:<\/p>\n

“We\u2019ve split the process into two steps: first, generating images conditioned on a text prompt, and then generating video conditioned on both the text and the generated image. This \u201cfactorized\u201d or split approach to video generation lets us train video generation models efficiently.”<\/p><\/blockquote>\n

Based on a text prompt, the same model can “animate” images. According to Meta, instead of relying on a “deep cascade of models”, Emu Video only uses two diffusion models to generate 512×512 four-second long videos at 16 frames per second. <\/p>\n

Emu Edit, focused on image manipulation, will allow users to remove or add backgrounds to images, perform color and geometry transformations, as well as local and global editing of images.<\/p>\n

“We argue that the primary objective shouldn\u2019t just be about producing a \u201cbelievable\u201d image. Instead, the model should focus on precisely altering only the pixels relevant to the edit request,” Meta noted, claiming its model is able to precisely follow instructions:<\/p>\n

“For instance, when adding the text \u201cAloha!\u201d to a baseball cap, the cap itself should remain unchanged.”<\/p><\/blockquote>\n

Meta trained Emu Edit using computer vision tasks with a dataset of 10 million synthesized images, each with an input image and a description of the task, as well as the targeted output image. “We believe it\u2019s the largest dataset of its kind to date,” the company said. <\/p>\n

Meta’s newly released Emu model was trained using 1.1 billion pieces of data, including photos and captions shared by users on Facebook and Instagram, CEO Mark Zuckerberg revealed during the Meta Connect event in September.<\/p>\n

Regulators are closely scrutinizing Meta’s AI-based tools, resulting in a cautious deployment approach by the technology company. Recently, Meta disclosed it won’t allow political campaigns and advertisers to use its AI tools to create ads on Facebook and Instagram. The platform’s general advertising rules, however, do not include any rules addressing AI specifically.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Social media giant Meta has introduced its latest artificial intelligence (AI) models for content editing and generation, according to a blog post on Nov. 16.\u00a0 The company is introducing two AI-powered generative models. The first, Emu Video, which leverages Meta’s previous Emu model, is capable of generating video clips based on text and image inputs. […]<\/p>\n","protected":false},"author":1,"featured_media":25149,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"footnotes":""},"categories":[42],"tags":[],"class_list":["post-25148","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-crypto"],"yoast_head":"\nMeta introduces AI models for video generation, image editing | NFT & Crypto News<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Meta introduces AI models for video generation, image editing | NFT & Crypto News\" \/>\n<meta property=\"og:description\" content=\"Social media giant Meta has introduced its latest artificial intelligence (AI) models for content editing and generation, according to a blog post on Nov. 16.\u00a0 The company is introducing two AI-powered generative models. The first, Emu Video, which leverages Meta’s previous Emu model, is capable of generating video clips based on text and image inputs. […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\" \/>\n<meta property=\"og:site_name\" content=\"NFT & Crypto News\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-16T20:10:43+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-16T20:10:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"799\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\"},\"author\":{\"name\":\"Staff\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/352194e8b0cb9ae3ad5480e201b5f792\"},\"headline\":\"Meta introduces AI models for video generation, image editing\",\"datePublished\":\"2023-11-16T20:10:43+00:00\",\"dateModified\":\"2023-11-16T20:10:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\"},\"wordCount\":459,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg\",\"articleSection\":[\"Crypto\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\",\"url\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\",\"name\":\"Meta introduces AI models for video generation, image editing | NFT & Crypto News\",\"isPartOf\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg\",\"datePublished\":\"2023-11-16T20:10:43+00:00\",\"dateModified\":\"2023-11-16T20:10:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage\",\"url\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg\",\"contentUrl\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg\",\"width\":1200,\"height\":799},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/nftandcrypto-news.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Meta introduces AI models for video generation, image editing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#website\",\"url\":\"https:\/\/nftandcrypto-news.com\/\",\"name\":\"NFT & Crypto News\",\"description\":\"Latest NFT and Crypto News\",\"publisher\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nftandcrypto-news.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#organization\",\"name\":\"NFT & Crypto News\",\"url\":\"https:\/\/nftandcrypto-news.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2022\/02\/nft-logo-dark-1.png\",\"contentUrl\":\"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2022\/02\/nft-logo-dark-1.png\",\"width\":844,\"height\":205,\"caption\":\"NFT & Crypto News\"},\"image\":{\"@id\":\"https:\/\/nftandcrypto-news.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/352194e8b0cb9ae3ad5480e201b5f792\",\"name\":\"Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/f1725824bb0aca42c3c5b57f7a3adb20?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/f1725824bb0aca42c3c5b57f7a3adb20?s=96&d=mm&r=g\",\"caption\":\"Staff\"},\"sameAs\":[\"https:\/\/nftandcrypto-news.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Meta introduces AI models for video generation, image editing | NFT & Crypto News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/","og_locale":"en_US","og_type":"article","og_title":"Meta introduces AI models for video generation, image editing | NFT & Crypto News","og_description":"Social media giant Meta has introduced its latest artificial intelligence (AI) models for content editing and generation, according to a blog post on Nov. 16.\u00a0 The company is introducing two AI-powered generative models. The first, Emu Video, which leverages Meta’s previous Emu model, is capable of generating video clips based on text and image inputs. […]","og_url":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/","og_site_name":"NFT & Crypto News","article_published_time":"2023-11-16T20:10:43+00:00","article_modified_time":"2023-11-16T20:10:45+00:00","og_image":[{"width":1200,"height":799,"url":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","type":"image\/jpeg"}],"author":"Staff","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Staff","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#article","isPartOf":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/"},"author":{"name":"Staff","@id":"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/352194e8b0cb9ae3ad5480e201b5f792"},"headline":"Meta introduces AI models for video generation, image editing","datePublished":"2023-11-16T20:10:43+00:00","dateModified":"2023-11-16T20:10:45+00:00","mainEntityOfPage":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/"},"wordCount":459,"commentCount":0,"publisher":{"@id":"https:\/\/nftandcrypto-news.com\/#organization"},"image":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage"},"thumbnailUrl":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","articleSection":["Crypto"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/","url":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/","name":"Meta introduces AI models for video generation, image editing | NFT & Crypto News","isPartOf":{"@id":"https:\/\/nftandcrypto-news.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage"},"image":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage"},"thumbnailUrl":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","datePublished":"2023-11-16T20:10:43+00:00","dateModified":"2023-11-16T20:10:45+00:00","breadcrumb":{"@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#primaryimage","url":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","contentUrl":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","width":1200,"height":799},{"@type":"BreadcrumbList","@id":"https:\/\/nftandcrypto-news.com\/crypto\/meta-introduces-ai-models-for-video-generation-image-editing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/nftandcrypto-news.com\/"},{"@type":"ListItem","position":2,"name":"Meta introduces AI models for video generation, image editing"}]},{"@type":"WebSite","@id":"https:\/\/nftandcrypto-news.com\/#website","url":"https:\/\/nftandcrypto-news.com\/","name":"NFT & Crypto News","description":"Latest NFT and Crypto News","publisher":{"@id":"https:\/\/nftandcrypto-news.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nftandcrypto-news.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/nftandcrypto-news.com\/#organization","name":"NFT & Crypto News","url":"https:\/\/nftandcrypto-news.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nftandcrypto-news.com\/#\/schema\/logo\/image\/","url":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2022\/02\/nft-logo-dark-1.png","contentUrl":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2022\/02\/nft-logo-dark-1.png","width":844,"height":205,"caption":"NFT & Crypto News"},"image":{"@id":"https:\/\/nftandcrypto-news.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/352194e8b0cb9ae3ad5480e201b5f792","name":"Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nftandcrypto-news.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f1725824bb0aca42c3c5b57f7a3adb20?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f1725824bb0aca42c3c5b57f7a3adb20?s=96&d=mm&r=g","caption":"Staff"},"sameAs":["https:\/\/nftandcrypto-news.com"]}]}},"jetpack_featured_media_url":"https:\/\/nftandcrypto-news.com\/wp-content\/uploads\/2023\/11\/bc6ff69d-7ecb-486a-a103-ad68975b6d80.jpg","_links":{"self":[{"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/posts\/25148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/comments?post=25148"}],"version-history":[{"count":1,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/posts\/25148\/revisions"}],"predecessor-version":[{"id":25150,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/posts\/25148\/revisions\/25150"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/media\/25149"}],"wp:attachment":[{"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/media?parent=25148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/categories?post=25148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nftandcrypto-news.com\/wp-json\/wp\/v2\/tags?post=25148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}