{"id":120941,"date":"2023-04-27T14:09:40","date_gmt":"2023-04-27T18:09:40","guid":{"rendered":"https:\/\/filmmakermagazine.com\/?p=120941"},"modified":"2023-08-10T15:30:10","modified_gmt":"2023-08-10T19:30:10","slug":"interview-adobe-michael-cioni-ai-media-production","status":"publish","type":"post","link":"https:\/\/filmmakermagazine.com\/120941-interview-adobe-michael-cioni-ai-media-production\/","title":{"rendered":"How AI Will Change Your Future Media Workflow"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">The two big product updates from Adobe at NAB were <\/span><a href=\"https:\/\/blog.adobe.com\/en\/publish\/2023\/04\/13\/nab-2023-introducing-text-based-editing-premiere-pro-properties-panel-after-effects-more\"><span style=\"font-weight: 400;\">text-based editing in Premiere<\/span><\/a><span style=\"font-weight: 400;\"> and still photo support in Camera to Cloud (you can <a href=\"https:\/\/filmmakermagazine.com\/?p=120946&amp;preview=true\">read our coverage on Frame.io updates here<\/a>). <\/span><span style=\"font-weight: 400;\">But in chatting with Michael Cioni, Adobe\u2019s Senior Director of Global Innovation, things took a fascinating turn when discussing Firefly, <\/span><a href=\"https:\/\/blog.adobe.com\/en\/publish\/2023\/04\/17\/reimagining-video-audio-adobe-firefly\"><span style=\"font-weight: 400;\">Adobe\u2019s generative AI model<\/span><\/a><span style=\"font-weight: 400;\">, and the future of AI in media production.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Our conversation explored the integration of AI tools in Adobe\u2019s products, as well as the broader implications of AI-driven technologies on the creative process.\u00a0<\/span><span style=\"font-weight: 400;\">Michael shared his insights on how the shift towards generative AI solutions could significantly reduce traditional media production, alter the landscape of creative roles and reshape the way we consume content.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">His thought-provoking perspective on the inevitability of these changes and the importance of adapting to them prompted us to ponder the role of human creativity in this rapidly evolving landscape. <\/span><span style=\"font-weight: 400;\">And while GPT-4 wrote most of this article\u2019s introduction based on the context of the transcript, the interview happened IRL (you can <a href=\"https:\/\/youtu.be\/qjM1HO3Xghg\">watch a video<\/a> of it below).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The transcript has also been slightly edited and condensed for clarity.<\/span><\/p>\n<p><b>Filmmaker<\/b><span style=\"font-weight: 400;\">: Talking about AI, do you see future developments with the Frame.io platform of tools to help organize footage? I know Adobe Premiere has some stuff going out now, but even being able to search footage or tagging or identifying objects, like using it as a media library.<\/span><\/p>\n<p><b>Cioni<\/b><span style=\"font-weight: 400;\">: Absolutely. <\/span>Look, AI is going to be the most polarizing bloodbath of the last 20 years. It&#8217;s going to be really incredible. It&#8217;s going to happen really fast. And there&#8217;s going to be people on all sides of these issues<span style=\"font-weight: 400;\">. Adobe is really building a system, Firefly, that is a generative AI solution. And that&#8217;s part of our ability to make sure that there are copyrights considered with that. <\/span><span style=\"font-weight: 400;\">These are things that are really important to the Adobe brand to make sure that those things are considered. But you still have to recognize that this is an inevitability, right?\u00a0<\/span><\/p>\n<p>My advice to cinematographers and photographers, creatives in general, is to really recognize that, enormously, the <span style=\"font-weight: 400;\">percentage of images that are photographed or recorded in the world for production is going to go down. <\/span><span style=\"font-weight: 400;\">Now news and sports are different, because you can&#8217;t generate news and sports. But when it comes to narrative, and elements like that, there&#8217;s going to be a big change. You want to position yourself at businesses, companies and technologies that really support a world where we&#8217;re going to be able to generate so much more than we could possibly imagine, right? <\/span><span style=\"font-weight: 400;\">It&#8217;s going to even change things like actors&#8217; contracts. [There will be] the legal ability to buy someone&#8217;s likeness and generate that instead of paying them to shoot it. <\/span><span style=\"font-weight: 400;\">This is going to be really, really different.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">So I&#8217;m excited about that opportunity. I don&#8217;t know exactly how it&#8217;s going to play out, but I&#8217;m pretty certain it is going to [result in] a significant reduction in overall production because it&#8217;ll be cheaper to generate it than to shoot it. P<\/span><span style=\"font-weight: 400;\">roductions that are looking for that kind of savings are just going to go right there.\u00a0<\/span><span style=\"font-weight: 400;\">If we fight this technological change, I think it&#8217;ll be a miss. If you exert the wrong amount of calories and the wrong issues, you&#8217;re going to end up wasting energy and still find yourself in a tricky situation.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">So lean into it. Much like 10, 15, 20 years ago with digital cinema, people fought it. <\/span><span style=\"font-weight: 400;\">There were people that said, &#8220;I&#8217;m not shooting anything unless it&#8217;s on film.&#8221;\u00a0<\/span><span style=\"font-weight: 400;\">What a silly argument, right? People said, \u201cWe&#8217;re not shooting 4K, we don&#8217;t want 4K.\u201d Some people still argue we shouldn&#8217;t have HDR. <\/span><span style=\"font-weight: 400;\">They&#8217;re wasting energy on small issues.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The big issue is gonna be, what are we gonna generate, what are we gonna shoot, how&#8217;s that gonna change?\u00a0<\/span><span style=\"font-weight: 400;\">And when we edit, are we gonna edit it, or is it gonna edit itself? Computational editing is gonna start to replace a lot of the creative editing at some level. <\/span><span style=\"font-weight: 400;\">I&#8217;m not trying to say it&#8217;s good or bad, I&#8217;m just reporting the weather here.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">I don&#8217;t actually know how it&#8217;ll play out, but I&#8217;m trying to position myself from a posture of learning and listening, and I think Adobe&#8217;s doing the same thing, to try to learn and listen and position ourselves to be considerate of the situation, but it&#8217;s a lot of unknowns, and if we just sit back and see how it goes, I think a lot of creatives are gonna put themselves in a compromising situation. <\/span>So my advice is to be proactive, learn, read, try it, test it and figure out where you can fit to make sure that on the other side of this transition, much like digital or 4K or files or tape or whatever, you are on the side that has growth and opportunity still affiliated with it.<\/p>\n<p><span style=\"font-weight: 400;\"><b>Filmmaker<\/b>: When you say you think we&#8217;re going to actually film less and produce overall less, are you thinking that production will turn into generating backgrounds and filming people and compositing them, and then that gradually shifts to maybe people being just generated too?<\/span><\/p>\n<p><b>Cioni: <\/b><span style=\"font-weight: 400;\">A lot of people have seen camera tests where they have camera A and camera B. They post it and they go, &#8220;This was shot a test of camera A and camera B.&#8221; <\/span><span style=\"font-weight: 400;\">Can you tell me which one&#8217;s better? Can you tell me the difference? People love doing that. <\/span>What you&#8217;re going to see in less than three years is, \u201cIs this human a human? Or is this just generated?\u201d<\/p>\n<p><b>Filmmaker:<\/b><span style=\"font-weight: 400;\"> Is the pope really <\/span><a href=\"https:\/\/slate.com\/technology\/2023\/03\/pope-coat-midjourney-puffer-jacket-balenciaga-explained.html\"><span style=\"font-weight: 400;\">wearing a white puffy jacket<\/span><\/a><span style=\"font-weight: 400;\">?\u00a0<\/span><\/p>\n<p><b>Cioni: <\/b><span style=\"font-weight: 400;\">Right. Tell the difference and we start to take this beautiful generative AI and start to apply it at 24 images per second, which will inevitably happen, then all of a sudden we can start to generate actors. <\/span><span style=\"font-weight: 400;\">We can generate images. I mean, advertising agencies and fashion won&#8217;t pay for supermodels. They&#8217;ll just generate a supermodel wearing the items and they won&#8217;t have to paint out wrinkles. They just won&#8217;t generate wrinkles, right? <\/span><span style=\"font-weight: 400;\">It&#8217;ll be easier and faster to do that than to pay a model $1 million a photographer $100,000 dollars to shoot [the spot].\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">I know that disrupts the market, but this is what it&#8217;s going to do. Again, I&#8217;m not saying I&#8217;m necessarily in favor of this, I&#8217;m just saying it&#8217;s inevitable. When humans are actually generated in motion, you can&#8217;t tell the difference and it&#8217;s easy and fast, then would something like a sitcom rather pay seven actors $1 million an episode? Or just generate them and pay them nothing an episode, right?<\/span><\/p>\n<p><iframe title=\"Will we be filming less in a world with AI? A chat with Frame.io&#039;s Michael Cioni [NAB 2023]\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/qjM1HO3Xghg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<p><b>Filmmaker: <\/b><span style=\"font-weight: 400;\">The one thing with the generative models, it&#8217;s based on stuff that humans have already made. So do you still feel like there&#8217;s a spot where human creativity comes in if the algorithms are possibly editing the videos in the future and generating the people, but it\u2019s all based on things we created and fed it? <\/span><span style=\"font-weight: 400;\">Where does the human creativity come in?\u00a0<\/span><\/p>\n<p><b>Cioni: <\/b><span style=\"font-weight: 400;\">We generate what gets generated, I guess, right? And we draw from all these experiences. That&#8217;s part of what Adobe Firefly is trying to do is make sure it&#8217;s cognizant of where these images come from, where that stuff comes from.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Look, I don&#8217;t have the answers. <\/span>I&#8217;m just saying that this is an opportunity where the right creatives will find a way to make sure that they&#8217;re relevant in this change. <span style=\"font-weight: 400;\">They always do. When digital still cameras came out, people said, \u201cOh, that&#8217;s the end of photography.\u201d\u00a0<\/span><span style=\"font-weight: 400;\">Not at all, right? It just changed. Same with digital cameras. \u201cOh, this is going to plummet the quality of cinema.\u201d No, it actually made it better quality. The same thing will happen.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">We just have to be open-minded to what this is going to unlock and figure out how to make sure that our creative impressions, our creative opportunities and our creative outlets are still there, but they&#8217;re going to be in a different envelope. <\/span><span style=\"font-weight: 400;\">That&#8217;s the opportunity, and that&#8217;s gonna ruffle some feathers. It&#8217;s going to create super new, amazing things we never thought of before.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Even the feed that you scroll is given to you via algorithms. What if the same show produces what a Person A likes versus Person B?\u00a0<\/span><span style=\"font-weight: 400;\">If Person A likes a certain type of drink and shops at Ross, that&#8217;ll be in that, and if Person B likes a different drink and shops at TJ Maxx, it&#8217;ll be that version. <\/span><span style=\"font-weight: 400;\">And it&#8217;s the same show. Those little nuances become possible and they become automatic. It just knows what zip code you&#8217;re in and what&#8217;s there and if you love Taco Bell, your credit card knows that. <\/span><span style=\"font-weight: 400;\">I mean, all this stuff gets factored in. All of a sudden they&#8217;re eating Taco Bell on a show, and they&#8217;re eating at Chili&#8217;s in the same episode of a different region.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">People gotta get behind that and make sure it works, make sure it looks real, make sure you suspend disbelief and you have great stories to tell. I think all that still plays out, but the way in which we deliver it is gonna be a little bit less hitting record and saying, &#8220;lights, camera, action.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">I think we&#8217;ve learned a little bit from the video game community, because they generate these images, videos, edits and stuff like that.\u00a0<\/span><span style=\"font-weight: 400;\">These are all early versions of this. And things like Unreal Engine and Unity, they&#8217;re going to be really, really powerful things. <\/span><span style=\"font-weight: 400;\">I&#8217;m excited to see where it goes.\u00a0<\/span><\/p>\n<p><b>Filmmaker: <\/b><span style=\"font-weight: 400;\">Yeah, it&#8217;s really cool. This will be a good conversation to look back on 10 years from now and see what the deal is.\u00a0<\/span><\/p>\n<p class=\"p1\"><em><span class=\"s1\">Joey Daoud is a media producer and founder of the agency<span class=\"Apple-converted-space\">\u00a0 <\/span><a href=\"https:\/\/newterritory.media\/\">New Territory Medi<span class=\"s2\">a<\/span><\/a>. He is also an award-winning documentary filmmaker, with past work streaming on Netflix, The New York Times, and National Geographic. You can follow him on <a href=\"https:\/\/twitter.com\/C47\">Twitte<span class=\"s2\">r<\/span><\/a> and <a href=\"https:\/\/www.youtube.com\/channel\/UCxOvRHjhTXChB3jygEA51ug\">YouTub<span class=\"s2\">e<\/span><\/a>, where he posts videos about gear, content, and marketing.<\/span><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The two big product updates from Adobe at NAB were text-based editing in Premiere and still photo support in Camera to Cloud (you can read our coverage on Frame.io updates here). But in chatting with Michael Cioni, Adobe\u2019s Senior Director of Global Innovation, things took a fascinating turn when discussing Firefly, Adobe\u2019s generative AI model, and the future of AI in media production.\u00a0 Our conversation explored the integration of AI tools in Adobe\u2019s products, as well as the broader implications of AI-driven technologies on the creative process.\u00a0Michael shared his insights on how the shift towards generative AI solutions could significantly [&hellip;]<\/p>\n","protected":false},"author":8305,"featured_media":120943,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","wds_primary_category":0,"wds_primary_column":0},"categories":[9285,9283,9282],"tags":[24178,24179,23680,18608,24181,24180],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/posts\/120941"}],"collection":[{"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/users\/8305"}],"replies":[{"embeddable":true,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/comments?post=120941"}],"version-history":[{"count":5,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/posts\/120941\/revisions"}],"predecessor-version":[{"id":121819,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/posts\/120941\/revisions\/121819"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/media\/120943"}],"wp:attachment":[{"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/media?parent=120941"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/categories?post=120941"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/filmmakermagazine.com\/wp-json\/wp\/v2\/tags?post=120941"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}