{"id":96182,"date":"2022-10-13T19:57:15","date_gmt":"2022-10-13T19:57:15","guid":{"rendered":"https:\/\/harchi90.com\/google-is-serious-about-its-giant-video-chat-booths-starts-real-world-testing\/"},"modified":"2022-10-13T19:57:15","modified_gmt":"2022-10-13T19:57:15","slug":"google-is-serious-about-its-giant-video-chat-booths-starts-real-world-testing","status":"publish","type":"post","link":"https:\/\/harchi90.com\/google-is-serious-about-its-giant-video-chat-booths-starts-real-world-testing\/","title":{"rendered":"Google is serious about its giant video chat booths, starts real-world testing"},"content":{"rendered":"<div itemprop=\"articleBody\">\n<figure class=\"intro-image intro-left\">\n  <figcaption class=\"caption\">\n<div class=\"caption-text\">enlarge <span class=\"sep\">\/<\/span> A Project Starline booth, featuring a 3D display and a massive array of cameras. <\/div>\n<p>Google<\/p>\n<\/figcaption><\/figure>\n<aside id=\"social-left\" class=\"social-left\" aria-label=\"Read the comments or share this article\">\n<\/aside>\n<p><!-- cache hit 1199:single\/related:cd34b53e13b3e09c12a4c9ff2a0bf98d --><!-- empty --><\/p>\n<p>Google actually seems serious about its wild &#8220;Project Starline&#8221; video booth idea.  The mysterious project was announced as part of the Google I\/O 2021 keynote but was initially overshadowed by more tangible Wear OS and Android announcements.  It&#8217;s a year later now and Google is still plowing ahead with the idea, announcing expanded enterprise testing with third parties.  Google says it&#8217;s also working on making Starline &#8220;more accessible.&#8221;<\/p>\n<p>Project Starline basically asks the question, &#8220;What if Zoom was a giant, sit-down arcade machine?&#8221;  While the home console version of video chat just involves a tiny camera above your laptop screen, Starline brings 3D video chat to life in a 7\u00d77-foot sit-down booth, with seemingly no regard given to cost, size, or commercialization.  The goal is to make it seem like the other person is in the room with you, and Google categorizes it as a &#8220;research project.&#8221;<\/p>\n<p>As for what Starline actually is, a Google Research paper contains a good amount of detail.  The display side of the video booth features 14 cameras and 16 IR projectors, which all work to create, capture, and track a real-time, photorealistic 3D avatar of the user.  four microphones and two speakers don&#8217;t just play back speech;  spatialized audio and dynamic beamforming supposedly make the speech sound like it&#8217;s coming out of the avatar&#8217;s mouth.<\/p>\n<div class=\"gallery shortcode-gallery gallery-wide\">\n<ul>\n<li data-thumb=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/37-150x150.jpg\" data-src=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/37.jpg\" data-responsive=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/37-980x765.jpg 1080, https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/37.jpg 2560\" data-sub-html=\"#caption-1889779\">\n<figure style=\"height:849px;\"><figcaption id=\"caption-1889779\">\n                  <span class=\"icon caption-arrow icon-drop-indicator\"\/><\/p>\n<p>                      That&#8217;s a lot of sensors.                     <\/p>\n<p>\n                      <span class=\"icon icon-camera\"\/><\/p>\n<p>                                              Google                                          <\/p>\n<\/figcaption><\/figure>\n<\/li>\n<li data-thumb=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_ZS8ZUAwO0X-150x150.png\" data-src=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_ZS8ZUAwO0X.png\" data-responsive=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_ZS8ZUAwO0X.png 1080, https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_ZS8ZUAwO0X.png 2560\" data-sub-html=\"#caption-1889783\">\n<figure style=\"height:849px;\"><figcaption id=\"caption-1889783\">\n                  <span class=\"icon caption-arrow icon-drop-indicator\"\/><\/p>\n<p>                      An annotated version of what everything does.  It&#8217;s a really big version of Face ID.                     <\/p>\n<p>\n                      <span class=\"icon icon-camera\"\/><\/p>\n<p>                                              Google                                          <\/p>\n<\/figcaption><\/figure>\n<\/li>\n<li data-thumb=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_XEmbpzsY2q-150x150.png\" data-src=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_XEmbpzsY2q.png\" data-responsive=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_XEmbpzsY2q-980x849.png 1080, https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/chrome_XEmbpzsY2q.png 2560\" data-sub-html=\"#caption-1889782\">\n<figure style=\"height:849px;\"><figcaption id=\"caption-1889782\">\n                  <span class=\"icon caption-arrow icon-drop-indicator\"\/><\/p>\n<p>                      Here are some of the 3D avatars that get generated, plus their meatspace counterparts.                     <\/p>\n<p>\n                      <span class=\"icon icon-camera\"\/><\/p>\n<p>                                              Google                                          <\/p>\n<\/figcaption><\/figure>\n<\/li>\n<\/ul><\/div>\n<p>Sending a 3D avatar over the video chat connection allows Google to correct for eyeline, which is continually a problem with normal video chat.  Where a webcam on top of a display makes it impossible to make eye contact while looking at a display, a 3D avatar can fudge the disconnect between the center of a camera and the center of a display, allowing for mutual eye contact.  Google is crunching all this data in a beefy dual-Xeon workstation with &#8220;four NVIDIA GPUs (two Quadro RTX 6000 and two Titan RTX).&#8221;<\/p>\n<aside class=\"ad_wrapper\" aria-label=\"In Content advertisement\">\n    <span class=\"ad_notice\">Advertisement <\/span>    <\/p>\n<\/aside>\n<p>The display is a 65-inch, 8 K, 60 Hz autostereoscopic lenticular panel that generates a glasses-free 3D view of a life-size avatar.  It&#8217;s basically a big Nintendo 3DS\u2014but with a bigger sweet spot thanks to head tracking.  The other side of the booth features an infrared backlight and a rather rigid-looking bench to restrict the user into the display&#8217;s 3D sweet spot and to limit the scope of the whole avatar-generation system.  Google even built a small barrier between the bench and the display to hide the bottom of the display.  Rather than have an avatar awkwardly end once you hit the bottom of the screen, a physical occlusion over the bottom of the display supposedly tricks your brain into thinking the rest of the avatar exists behind the barrier.  Google seems committed to controlling every possible variable with Project Starline, to the point that the booth even features its own lighting system, with both diffuse visible lighting to help with 3D texture capture and a big infrared backlight to help with 3D imaging,<\/p>\n<p>People who have tried Starline seem to like it, but considering you have to be personally invited by Google to try it, that&#8217;s only a very small handful of people.  It&#8217;s hard to imagine much of a market for what must be a six-figure video booth the size of a small bathroom, but Google is pushing ahead with more testing.  A Google statement says: &#8220;Today, Project Starline prototypes are found in Google offices across the US, with employees using the technology every day for meetings, employee onboarding and building rapport between colleagues.&#8221;<\/p>\n<figure class=\"video\">\n<p><div class=\"ast-oembed-container\" style=\"height: 100%;\"><iframe loading=\"lazy\" title=\"Project Starline: A high-fidelity telepresence system\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/kDgToq5aXh0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<figcaption class=\"caption\">\n<p>Unlike the highly polished teaser video, this Siggraph presentation explains what&#8217;s going on a lot better.<\/p>\n<\/figcaption><\/figure>\n<p>The company continues: &#8220;Beyond Google employees, we&#8217;ve also invited more than 100 enterprise partners in areas like media, healthcare and retail to participate in demos at Google&#8217;s offices and provide us with feedback on the experience and applications to their businesses. We see many ways Project Starline can add business value across a number of industries, and we remain focused on making it more accessible.&#8221;  Salesforce, WeWork, T-Mobile, and Hackensack Meridian Health have signed up to try it.  WeWork, a company based around renting too-expensive-to-own office space, seems particularly enthused with the idea.<\/p>\n<aside class=\"ad_wrapper\" aria-label=\"In Content advertisement\">\n    <span class=\"ad_notice\">Advertisement <\/span>    <\/p>\n<\/aside>\n<p>Google can talk all it wants about &#8220;research,&#8221; but the company is famously aggressive when it comes to killing things that don&#8217;t have hundreds of millions of users.  Will there ever be a product here?  Starline is sort of adjacent to the huge enterprise meeting equipment market, but a few limitations make Starline tough for serious meetings.  Enterprise meeting equipment is usually geared for a big group sitting at a table, and wide compatibility means anyone can call into the meeting with almost any hardware.  Starline only works with one person for one-to-one chats, and you can only talk to other Starline booths.  Is there a market for VIP-to-VIP communication booths, like a modern version of the president&#8217;s red phone?<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>enlarge \/ A Project Starline booth, featuring a 3D display and a massive array of cameras. Google Google actually seems serious about its wild &#8220;Project Starline&#8221; video booth idea. The mysterious project was announced as part of the Google I\/O 2021 keynote but was initially overshadowed by more tangible Wear OS and Android announcements. It&#8217;s &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"https:\/\/harchi90.com\/google-is-serious-about-its-giant-video-chat-booths-starts-real-world-testing\/\"> <span class=\"screen-reader-text\">Google is serious about its giant video chat booths, starts real-world testing<\/span> Read More &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-global-header-display":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true},"categories":[4],"tags":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":95888,"url":"https:\/\/harchi90.com\/googles-project-starline-is-the-real-deal\/","url_meta":{"origin":96182,"position":0},"title":"Google&#8217;s Project Starline is the real deal","date":"October 13, 2022","format":false,"excerpt":"It looked like I could grab the apple. Jason Lawrence, a Google researcher, was sitting across from me, holding the fruit in his hand. I could see it, it was red and shiny, and my brain was telling me it was right there. But Lawrence and the apple were actually\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":96434,"url":"https:\/\/harchi90.com\/google-will-soon-test-project-starline-video-chat-booths-in-the-real-world\/","url_meta":{"origin":96182,"position":1},"title":"Google will soon test Project Starline video chat booths in the real world","date":"October 14, 2022","format":false,"excerpt":"Google's elaborate video chat booths will soon exist as more than just a clever design exercise. Ars Technica reports the company will start installing Project Starline prototypes in some of its corporate partners' offices for \"regular\" tests later this year. In other words, Google will see how its \"magic windows\"\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":96105,"url":"https:\/\/harchi90.com\/googles-3d-video-calling-booths-project-starline-will-now-be-tested-in-the-real-world-techcrunch\/","url_meta":{"origin":96182,"position":2},"title":"Google&#8217;s 3D video calling booths, Project Starline, will now be tested in the real world \u2022 TechCrunch","date":"October 13, 2022","format":false,"excerpt":"While Meta is trying to convince consumers to strap on its VR headsets to enter the metaverse, Google continues to experiment with a different sort of false reality: its holographic video chat project known as Project Starline. Announced last year, Project Starline is a video-calling booth that uses 3D imagery,\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":97334,"url":"https:\/\/harchi90.com\/googles-holographic-video-chat-feels-like-the-opposite-of-vr\/","url_meta":{"origin":96182,"position":3},"title":"Google&#8217;s Holographic Video Chat Feels Like the Opposite of VR","date":"October 14, 2022","format":false,"excerpt":"Weirdly calming. Oddly immersive. Invisible? These weren't the words I expected to come to my lips after sitting in a room for 30 minutes demoing Project StarlineGoogle's prototype big-screen 3D video chat platform that's now being tested in a few corporate offices outside of Google. Aside from a fist-bump that\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":94912,"url":"https:\/\/harchi90.com\/google-starts-testing-holographic-video-chats-at-real-offices\/","url_meta":{"origin":96182,"position":4},"title":"Google Starts Testing Holographic Video Chats at Real Offices","date":"October 12, 2022","format":false,"excerpt":"Project StarlineGoogle's experimental technology using holographic light field displays to video chat with distant co-workers, is moving out of Google's offices and into some real corporate locations for testing starting this year.Google's Project Starline tech, announced last year at the company's I\/O developer conference, uses giant light field displays and\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":98878,"url":"https:\/\/harchi90.com\/google-hologram-video-call-booths-coming-to-wework-t-mobile-offices\/","url_meta":{"origin":96182,"position":5},"title":"Google hologram video call booths coming to WeWork, T-Mobile offices","date":"October 16, 2022","format":false,"excerpt":"Holograms aren't just for dead celebrities anymore. In fact, it might not be long before you're attending a virtual work meeting with lifelike, 3D representations of your colleagues.That's the future Google is working toward: The company says it's expanding testing of its Project Starline, 3D video call booths where you\u2026","rel":"","context":"In &quot;Technology&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"fifu_image_url":"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2022\/10\/Starline-760x380.jpg","_links":{"self":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts\/96182"}],"collection":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/comments?post=96182"}],"version-history":[{"count":0,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts\/96182\/revisions"}],"wp:attachment":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/media?parent=96182"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/categories?post=96182"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/tags?post=96182"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}