{"id":227638,"date":"2022-06-22T11:40:26","date_gmt":"2022-06-22T15:40:26","guid":{"rendered":"https:\/\/supchina.com\/?p=227638"},"modified":"2022-06-22T17:52:11","modified_gmt":"2022-06-22T21:52:11","slug":"china-re-rendered","status":"publish","type":"post","link":"https:\/\/thechinaproject.com\/2022\/06\/22\/china-re-rendered\/","title":{"rendered":"China re-rendered"},"content":{"rendered":"<p>This article was originally published on <a href=\"http:\/\/neocha.com\/magazine\/\">Neocha<\/a> and is republished with permission.<\/p>\n<hr>\n<p>How did the socialites of Shanghai dress a century ago? What did the Great Wall look like before a century\u2019s worth of human and natural damage? What would one of the terracotta soldiers of Xi\u2019an look like in real life?<\/p>\n<p>New York-based artist Hu Wengu, better known by the online handle of\u00a0<a href=\"https:\/\/www.youtube.com\/channel\/UCzzsYBF4qwtMwJaPJZ5SuPg\" target=\"_blank\" rel=\"noopener\">DGSpitzer<\/a>, has pondered long and hard on these questions. In his search for answers, he\u2019s using AI and machine-learning software to restore archival footage of China, offering audiences a high-definition glimpse into the country\u2019s past.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-227639 size-full\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-4.jpg\" alt=\"\" width=\"1180\" height=\"857\" srcset=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-4.jpg 1180w, https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-4-500x363.jpg 500w, https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-4-768x558.jpg 768w\" sizes=\"(max-width: 1180px) 100vw, 1180px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-227640 size-full\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-3.jpg\" alt=\"\" width=\"1180\" height=\"849\" srcset=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-3.jpg 1180w, https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-3-500x360.jpg 500w, https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/DGSpitzer-3-768x553.jpg 768w\" sizes=\"(max-width: 1180px) 100vw, 1180px\" \/><\/p>\n<p>Hu works full-time as a game developer, and his original impetus for learning AI was to learn how the technology can be incorporated into his game-design workflow. He quickly realized that it could be applied in nearly every area of game development, whether it be training in-game NPCs, generating vast maps, or even composing original music. \u201cIt actually has interesting applications in a wide range of fields, even social and human sciences,\u201d Hu says. \u201cSo this year I made a series of videos introducing people to how AI can compose music, paint, generate faces, and more.\u201d<\/p>\n<p>As Hu\u2019s understanding of AI deepened, he began exploring how the technology could carry over into other domains. This interest eventually led him to AI-enhanced video. Since then, he\u2019s leveraged the power of AI to create a stunning collection of color-restored videos showcasing China\u2019s past.<\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u30104K, 60Fps Colorized\u3011Peking (Beijing) in 100 years ago, Ancient China (Around1910-1920)\u3010AI Recovery\u3011\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/5bQwGlMEeOE?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p>Three of Hu\u2019s AI-enhanced works include footage sourced from the University of South Carolina Moving Image Research Collections, which showcase a Beijing streetside barber, a Shanghai fashion show, and the construction of the Broadway Mansion Hotel. Hu discovered their footage archives by chance, and as he dug through the video library, he became more and more fascinated. \u201cMIRC has recordings of China from the 1930s, which is extraordinary,\u201d he says. \u201cIn the old Beijing barber video, there was a bald, charismatic guy who left a profound impression on me. So much so that, after I watched it, I got in touch with the university and asked if I could use their black-and-white videos in my AI project. They responded quickly and were happy to oblige. They even helped look into the exact dates of when the films were shot.\u201d<\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u3010AI Restoration\u3011China Fashion Show in Shanghai, 1929, 90 years ago\u30104K, 60Fps Colorized\u3011\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/sIYjspeZxQ0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u30104K, 60Fps Colorized\u3011Peking (Beijing) in 1929, 90 years ago\u3010AI Restoration\u3011\" width=\"500\" height=\"375\" src=\"https:\/\/www.youtube.com\/embed\/7jfceEnkTfk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u30104K, 60Fps Colorized\u3011Laborers of Shanghai Broadway Mansions, 1934, 80 years ago\u3010AI Restoration\u3011\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/jOGXXwdB2DQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p>Hu\u2019s video restorations happen in three stages. The first involves adding in extra frames, then the footage is colorized, and finally, the resolution is upscaled. His arsenal of AI software, which includes DAIN, DeOldify, DeepRemaster, and PaddleGAN, all tackle these tasks independently. \u201cFor example, the AI that adds missing frames, it analyzes the first frame and last frame to logically work out what should fit between them to smooth out the framerate,\u201d he explains. \u201cAs for the colorizing AI, it almost like a human toddler. It examines large amounts of black-and-white photos, eventually learning that when a plant-shaped object appears, it should be green; when the sky and clouds appear, they should be blue and white; and when a human face appears, it should be flesh colored. The resolution upscaling AI works in a similar way, and by combining the output of these AI software, the footage is restored.\u201d<\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u3010AI Colorized\u3011A Life in Portraits 1907-1968 Ye Jinglu&#039;s 62 annual portraits\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/WASyl8DQquk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p class=\"video-wrap video-rt video-provider-youtube\"><span class=\"embed-container embed-video embed-rt embed-provider-youtube\"><iframe loading=\"lazy\" title=\"\u3010AI Restoration\u3011Terracotta Warrior&#039;s &quot;Real&quot; Face? AI recovered ancient Chinese faces\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/UeCpI__eSxI?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/span><\/p>\n<p>Despite the amount of work and time Hu has invested in the project, he confesses that he\u2019s not exactly a history buff. Instead, he considers himself a sci-fi nerd. \u201cWhen I watched black-and-white videos in the past, they felt like history lessons,\u201d he shrugs. \u201cI would fast forward it to get through it quicker. They just didn\u2019t catch my interest.\u201d<\/p>\n<p>However, to restore a piece of footage, sped-up viewing was no longer an option. Watching at regular speeds, he was able to discover a ton of details that he overlooked on the initial watch, such as a young man staring at the cameraman from behind a tree, a group of carefree kids playing in the street, or a curious worker studying the camera as he passes by.<\/p>\n<p>These little moments of connection fascinate Hu. \u201cIt reminds me of the fact that even though we\u2019re living centuries apart, we\u2019re still under the same sky and walking the same earth,\u201d he says. \u201cIt\u2019s like watching a century-old vlog.\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-227642 size-full aligncenter\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/china-rerendered-06.gif\" alt=\"\" width=\"600\" height=\"883\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-227643 aligncenter\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/china-rerendered-07.gif\" alt=\"\" width=\"600\" height=\"883\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-227644 aligncenter\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/china-rerendered-05.gif\" alt=\"\" width=\"600\" height=\"883\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-227645 aligncenter\" src=\"https:\/\/thechinaproject.com\/wp-content\/uploads\/2022\/06\/china-rerendered-04.gif\" alt=\"\" width=\"600\" height=\"883\" \/><\/p>\n<p>Hu has also begun looking into restoring historical footage from other countries. Recently, he\u2019s working with a German artist to restore a documentary shot in Dresden in 1936, even taking it a step further with the implementation of AR technology that will allow viewers to overlay the AI-enhanced scenes atop locations in real-life to see how the area has changed over the years.<\/p>\n<p>Aside from video-related endeavors, he\u2019s also begun using AI to colorize and upscale old portrait photography from China. Through his use of neural networks, Hu hopes for viewers to experience the simplicity of the past and immerse themselves in the lives of these people long gone\u2014if only for a few short minutes. \u201cIt can be a moment of respite when you allow people to look into the past,\u201d he says. \u201cStepping into the shoes of these people on camera and\u00a0 looking at history through the lens of the present can perhaps help us gain a greater understanding of culture and what it means to be human.\u201d<\/p>\n<p>History can often seem dull, appearing as unrelatable lines of text tucked inside of course books, but Hu believes it doesn\u2019t have to be. Through his AI-enhanced videos, Hu hopes that people who may have previously dismissed how interesting history can be are able to find renewed excitement for the subject, and in turn, develop a healthy appetite for knowledge in all forms and shapes.<\/p>\n<hr>\n<p style=\"text-align: center;\">Like this story? Follow Neocha on <a href=\"https:\/\/t2m.io\/2U84uXuZ\" target=\"_blank\" rel=\"noopener\">Facebook<\/a>\u00a0and\u00a0<a href=\"https:\/\/t2m.io\/vNPmftws\" target=\"_blank\" rel=\"noopener\">Instagram<\/a>.<\/p>\n<p style=\"text-align: center;\"><strong>Youtube<\/strong>:\u00a0<a href=\"https:\/\/www.youtube.com\/channel\/UCzzsYBF4qwtMwJaPJZ5SuPg\" target=\"_blank\" rel=\"noopener\">~\/DGSpitzer<\/a><br \/>\n<strong>Weibo<\/strong>:\u00a0<a href=\"https:\/\/weibo.com\/daguspitzer\" target=\"_blank\" rel=\"noopener\">~\/\u5927\u8c37Spitzer<\/a><br \/>\n<strong>Bilibili<\/strong>:\u00a0<a href=\"https:\/\/space.bilibili.com\/176003?from=search&amp;seid=6571898231551440693\" target=\"_blank\" rel=\"noopener\">~\/\u5927\u8c37\u7684\u6e38\u620f\u521b\u4f5c\u5c0f\u5c4b<\/a><\/p>\n<p style=\"text-align: center;\">Contributor:\u00a0<a href=\"https:\/\/neocha.com\/magazine\/category\/stories-by-chen-yuan\" target=\"_blank\" rel=\"noopener\">Chen Yuan<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The past as seen through the eyes of AI<\/p>\n","protected":false},"author":19953,"featured_media":227646,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"episode_type":"","audio_file":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","date_recorded":"","explicit":"","block":"","filesize_raw":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[12908],"tags":[14100,14222,14995],"column":[],"class":[],"coauthors":[17886],"acf":[],"la_post_categories":{"society-and-culture":"Society &amp; Culture"},"la_post_tags":{"ai":"AI","art":"art","artificial-intelligence":"artificial intelligence"},"content_writeup":{"rendered":"<p><!-- Copy and paste the converted output. --><\/p>\n<p><!-- Yay, no errors, warnings, or alerts! --><\/p>\n<p>\nHow did the socialites of Shanghai dress a century ago? What did the Great Wall look like before a century\u2019s worth of human and natural damage? What would one of the terracotta soldiers of Xi\u2019an look like in real life?\n<\/p>\n<p>\nNew York\u2013based artist Hu Wengu, better known by the online handle of <a href=\"https:\/\/www.youtube.com\/channel\/UCzzsYBF4qwtMwJaPJZ5SuPg\">DGSpitzer<\/a>, has pondered these questions long and hard. In his search for answers, he\u2019s using AI and machine-learning software to restore archival footage of China, offering audiences a high-definition glimpse into the country\u2019s past.\n<\/p>\n<p>\n<a href=\"https:\/\/thechinaproject.com\/2022\/06\/22\/china-re-rendered\/\">Click through to The China Project to read more about Hu\u2019s AI-powered restoration work<\/a>.<\/p>\n"},"_links":{"self":[{"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/posts\/227638"}],"collection":[{"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/users\/19953"}],"replies":[{"embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/comments?post=227638"}],"version-history":[{"count":0,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/posts\/227638\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/media\/227646"}],"wp:attachment":[{"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/media?parent=227638"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/categories?post=227638"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/tags?post=227638"},{"taxonomy":"column","embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/column?post=227638"},{"taxonomy":"class","embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/class?post=227638"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/thechinaproject.com\/wp-json\/wp\/v2\/coauthors?post=227638"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}