Home / News & Analysis / Inside Dolby Laboratories, and the Future of Sound and Vision

Inside Dolby Laboratories, and the Future of Sound and Vision

Dolby Laboratories recently invited 40+ international journalists, some from as far away as China and India, to its San Francisco headquarters for an inside peek at Dolby's biophysical lab, where staff studies the science of sound and vision and its effect on the human form.

Dolby's lobby set the scene—full of trippy imagery curated within the Dolby Art Series. As we waited for the day to start, journalists knocked back caffeine and recovered from jet lag next to a video installation, Substance: a Study of Matter, created by Javier Cruz and Kamil Nawratil to show off the power of Dolby Atmos.

Dolby wants you to know that it's much more than a cool sound promo in the movie theater.

"At Dolby we have something unique to offer," Kevin Yeaman, President and CEO, told us. "By focusing on the science of sight and sound, we can create and enable these immersive experiences. With a channel-based system, you might have five channels, maybe with 50 speakers, but [in other theaters] they are grouped. With Dolby Atmos, [creators can utilize], the world's first object-based audio, with up to 128 sound objects at a time, in a three-dimensional soundscape where the sound moves around you with pinpoint accuracy."

In a demo, 3D sounds shot across the darkened cinema in a choreographed flow that reminded me why, sophisticated home entertainment systems aside, there's nothing like a state-of-the-art theater.

Dolby Labs

Which is probably why AMC partnered with Dolby Cinema at 80 venues in the US, to date. Dolby is also keen to expand its international footprint (hence the presence of journalists from around the globe that day), and has partnerships in countries like China, the United Arab Emirates, France, and Spain.

Dolby Laboratories, founded in London in 1965 by engineer and physicist Dr. Ray Dolby, moved its HQ to San Francisco in 1967 and has been associated with Hollywood ever since Star Wars came out in ear-thrilling Dolby Stereo. In 1992, Batman Returns was released in Dolby Digital and in 1999, Star Wars: Episode I-The Phantom Menace debuted in Dolby Surround EX. Next out of the gate is Blade Runner 2049, mastered in Dolby Vision and Dolby Atmos.

Dolby Labs

"We sit side by side with directors, colorists, and sound engineers," said Yeaman. "We seek to understand whether our innovation is, in fact, a palette they can work with and what tools do they need to be successful."

Another demo showed off Dolby Vision's laser projection system, which utilizes high dynamic range (HDR) and wide color gamut (WCG) to show colors that pop, brilliantly; true deep blacks and luminous whites.

"You need dark blacks and colors that come alive," David Leitch, director of Atomic Blonde, said in a video featuring testimonials from Hollywood directors. Dolby Vision and Dolby Atmos "add another level to the complexity of storytelling. It's immersive. You want to exhibit your work in the highest quality—it allows the audience to see it in its purest form—and I'm going to take advantage of that."

It was time to head upstairs, to the labs, where Dolby is looking at the effects of sound, vision, and VFX. There, Poppy Crum, Chief Scientist, had a willing participant hooked up to a bunch of biosensors, including a 64-channel EEG, watching two fire dancers battle a vivid conflagration on a high-end monitor.

You guessed it: the fire was shot in Dolby Vision, so the biosensors went crazy. We got to see the participant's physical responses tracked and analyzed in real time on multiple screens. It was evident she perceived the intense heat, due to the high-fidelity visuals, as real.

Dolby Labs

"As a neurophysiologist, my focus has been on the bi-directional interplay between tech innovation and the sensory experience," Crum explained. "We really are at a point where tech is enabling us to engage our sensory systems in such authentic ways, whether it's in the cinema or virtual/augmented reality.

"Our computational neuroscientists, here in the biophysical lab are looking at how human experience can be modeled in different ways, for immersive technologies. We want to take content creators' intent and amplify it, using our tools to create better insights and results."

Related

Sadly, Dolby isn't using its biophysical research as a managed software service for public dissemination; it's more of an internal collaboration with those in the sound and vision business, like Hollywood, but it was interesting stuff. It would be wild to get hooked up to their system while watching movies to see exactly how easy it is to manipulate our neuroendocrine systems.

Next up? We didn't see a demo of this, but Dolby is looking to lead in VR/AR/MR too, with the latest release of authoring tools for Dolby Atmos, allowing high-end mapped projection and 3D video via the various head-mounted displays.

At the end of the day, as we all drifted out past the video installation, the smart soundscape and vivid visuals appeared prescient of a futuristic off-world colony transit hub. So perhaps Dolby Laboratories is indeed on its way to next-gen sound and vision. In fact, just before we exited the main lobby, executives told us to be back at 10:30 a.m. as—surprise—they'd be taking us to Skywalker Sound, a key Dolby Laboratories partner. But that's another story.

Read more

Check Also

UK health minister sets out tech-first vision for future care provision

The UK’s still fairly new in post minister for health, Matt Hancock, quickly made technology one of his stated priorities. And today he’s put more meat on the bones of his thinking, setting out a vision for transforming, root and branch, how the country’s National Health Service operates to accommodate the plugging in of “healthtech” apps and services — to support tech-enabled “preventative, predictive and personalised care”. How such a major IT upgrade program would be paid for is not clearly set out in the policy document. But the government writes that it is “committed to working with partners” to deliver on its grand vision. “Our ultimate objective is the provision of better care and improved health outcomes for people in England,” Hancock writes in the ‘future of healthcare’ policy document. “But this cannot be done without a clear focus on improving the technology used by the 1.4 million NHS staff, 1.5 million-strong social care workforce and those many different groups who deliver and plan health and care services for the public.” The minister is proposing that NHS digital services and IT systems will have to meet “a clear set of open standards” to ensure interoperability and updatability. Meaning that existing systems that don’t meet the incoming standards will need to be phased out and ripped out over time. The tech itself that NHS trusts and clinical commissioners can choose to buy will not be imposed upon them from above. Rather the stated intent is to encourage “competition on user experience and better tools for everyone”, says Hancock. In a statement, the health and social care secretary said: “The tech revolution is coming to the NHS. These robust standards will ensure that every part of the NHS can use the best technology to improve patient safety, reduce delays and speed up appointments. “A modern technical architecture for the health and care service has huge potential to deliver better services and to unlock our innovations. We want this approach to empower the country’s best innovators — inside and outside the NHS — and we want to hear from staff, experts and suppliers to ensure our standards will deliver the most advanced health and care service in the world.” The four stated priorities for achieving the planned transformation are infrastructure (principally but not only related to patient records); digital services; innovation; and skills and culture: “Our technology infrastructure should allow systems to talk to each other safely and securely, using open standards for data and interoperability so people have confidence that their data is up to date and in the right place, and health and care professionals have access to the information they need to provide care,” the document notes. The ‘tech for health’ vision — which lacks any kind of timeframe whatsoever — loops in an assortment of tech-fuelled case studies, from applying AI for faster diagnoses (as DeepMind has been trying) to Amazon Alexa skills being used as a memory aid for social care. And envisages, as a future success metric, that “a healthy person can stay healthy and active (using wearables, diet-tracking apps) and can co-ordinate with their GP or other health professional about targeted preventative care”. The ‘techiness’ of the vision is unsurprising, given Hancock was previously the UK’s digital minister and has made no secret of his love of apps. Even having an app of his own developed to connect with his constituents (aka the eponymous Matt Hancock App — albeit running into some controversy for problems with the app’s privacy policy). Hancock has also been a loud advocate for (and a personal user of) London-based digital healthcare startup Babylon Health, whose app initially included an AI diagnostic chatbot, in addition to offering video and text consultations with (human) doctors and specialists. The company has partnered with the NHS for a triage service, and to offer a digital alternative to a traditional primary care service via an app that offers remote consultations (called GP at Hand). But the app has also faced criticism from healthcare professionals. The AI chatbot component specifically has been attacked by doctors for offering incorrect and potentially dangerous diagnosis advice to patients. This summer Babylon pulled the AI element out of the app, leaving the bot to serve unintelligent triage advice — such as by suggesting people go straight to A&E even with just a headache. (Thereby, said its critics, piling pressure on already over-stretched NHS hospital services.) All of which underlines some of the pitfalls of scrambling too quickly to squash innovation and healthcare together. The demographic cherrypicking that can come inherently bundled with digital healthcare apps which are most likely to appeal to younger users (who have fewer complex health problems) is another key criticism of some of these shiny, modern services — with the argument being they impact non-digital NHS primary care services by saddling the bricks-and-mortar bits with more older, sicker patients to care for while the apps siphon off (and monetize) mostly the well, tech-savvy young. Hancock’s pro-tech vision for upgrading the UK’s healthcare service doesn’t really engage with that critique of modern tech services having a potentially unequal impact on a free-at-the-point-of-use, taxpayer-funded health service. Rather, in a section on “inclusion”, the vision document talks about the need to “design for, and with, people with different physical, mental health, social, cultural and learning needs, and for people with low digital literacy or those less able to access technology”. But without saying exactly how that might be achieved, given the overarching thrust being to reconfigure the NHS to be mobile-first, tech-enabled and tech-fuelled. “Different people may need different services and some people will never use digital services themselves directly but will benefit from others using digital services and freeing resources to help them,” runs the patter. “We must acknowledge that those with the greatest health needs are also the most at risk of being left behind and build digital services with this in mind, ensuring the highest levels of accessibility wherever possible.” So the risk is being acknowledged — yet in a manner and context that suggests it’s simultaneously being dismissed, or elbowed out of the way, in the push for technology-enabled progress. Hancock also appears willing to tolerate some iterative tech missteps — again towards a ‘greater good’ of modernizing the tech used to deliver NHS services so it can be continuously responsive to user needs, via updates and modular plugins, all greased by patient data being made reliably available via the envisaged transformation. Though there is a bit of a cautionary caveat for healthcare startups like Babylon too. At least if they make actual clinical claims, with the document noting that: “We must be careful to ensure that we follow clinical trials where the new technology is clinical but also to ensure we have appropriate assurance processes that recognise when an innovation can be adopted faster. We must learn to adopt, iterate and continuously improve innovations, and support those who are working this way.” Another more obvious contradiction is Hancock’s claim that “privacy and security” is one of four guiding principles for the vision (alongside “user need; interoperability and openness; and inclusion”), yet this is rubbing up against active engagement with the idea of sensitive social care data being processed by and hosted by a commercial ecommerce giant like Amazon, for example. The need for patient trust and buy in gets more than passing mention, though. And there’s a pledge to introduce “a healthtech regulatory sandbox working with the ICO, National Data Guardian, NICE and other regulators” to provide support and an easier entry route for developers wanting to build health apps to sell in to the NHS, with the government also saying it will take other steps to “simplify the landscape for innovators”. “If data is to be used effectively to support better health and care outcomes, it is essential that the public has trust and confidence in us and can see robust data governance, strong safeguards and strict penalties in place for misuse,” the policy document notes. Balancing support for data-based digital innovation, including where data-thirsty technologies like AI are concerned, with respect for the privacy of people’s highly sensitive health data will be a tricky act for the government to steer, though. Perhaps especially given Hancock is so keenly rushing to embrace the market. “We need to build nationally only those few services that the market can’t provide and that must be done once and for everyone, such as a secure login and granular access to date,” runs the ministerial line. “This may mean some programmes need to be stopped.” Although he also writes that there is a “huge role” for the NHS, care providers and commissioners to “develop solutions and co-create them with industry”. “Some of our user needs are unique, like carers in a particular geographical location or patients using assistive technologies. Or sometimes we can beat something to market because we know what we need and are motivated to solve the problem first. “In those circumstances where industry won’t see the economies of scale they need to invest, we must be empowered to build our own digital services, often running on our data and networks. We will do that according to the government’s Digital Service Standard, and within the minimal rules we set for our infrastructure.” “We also want to reassure those who are currently building products that we have no intention or desire to close off the market – in fact we want exactly the opposite,” the document also notes. “We want to back innovations that can improve our health and care system, wherever they can be found – and we know that some of the best innovations are being driven by clinicians and staff up and down the country.” Among the commercial entities currently building products targeted at the NHS is Google -owned DeepMind, which got embroiled in a privacy controversy related to a data governance failure by the NHS Trust it worked with to co-develop an app for the early detection of a kidney condition. DeepMind’s health data ambitions expand beyond building alert apps or even crafting diagnostic AIs to also wanting to build out and own healthcare app delivery infrastructure (aka, a fast healthcare interoperability resource, or FHIR) — which, in the aforementioned project, was bundled into the app contract with the Royal Free NHS Trust, locking the trust into sending data to DeepMind’s servers by prohibiting it from connecting to other FHIR servers. So not at all a model vision of interoperability. Earlier this year DeepMind’s own independent reviewer panel warned there was a risk of the company gaining excessive monopoly power. And Hancock’s vision for health tech seems to be proposing to outlaw such contractual lock ins. Though it remains to be seen whether the guiding principle will stand up to the inexorable tech industry lobbying. “We will set national open standards for data, interoperability, privacy and confidentiality, real-time data access, cyber security and access rules,” the vision grandly envisages. “Open standards are not an abstract technical goal. They permit interoperability between different regions and systems but they also, crucially, permit a modular approach to IT in the NHS, where tools can be pulled and replaced with better alternatives as vendors develop better products. This, in turn, will help produce market conditions that drive innovation, in an ecosystem where developers and vendors continuously compete on quality to fill each niche, rather than capturing users.” Responding to Hancock’s health tech plan, Sam Smith, coordinator of patient data privacy advocacy group medConfidential, told us: “There’s not much detail in here. It’s not so much ‘jam tomorrow’, as ‘jam… sometime’ — there’s no timeline, and jam gets pretty rancid after not very long. He says “these are standards”, but they’re just a vision for standards — all the hard work is left to be done.” On the privacy plus AI front, Smith also picks up on Hancock’s vision including suggestive support for setting up “data trusts to facilitate the ethical sharing of data between organisations”, with the document reiterating the government’s plan to launch a pilot later this year. “Hancock says “we are supportive” of stripping the NHS of its role in oversight of commercial exploitation of data. Who is the “we” in that as it should be a cause for widespread concern. If Matt thinks the NHS will never get data right, what does he know that the public don’t?” said Smith on this. He also points out at previous grand scheme attempts to overhaul NHS IT — most notably the uncompleted NHS National Programme for IT, which in the early 2000s tried and failed to deliver a top-down digitization of the service — taking a decade and sinking billions in the process. “The widely criticised National Programme for IT also started out with similar lofty vision,” he noted. “This is yet another political piece saying what “good looks like”, but none of the success criteria are about patients getting better care from the NHS. For that, better technology has to be delivered on a ward, and in a GP surgery, and the many other places that the NHS and social care touch. Reforming procurement and standards do matter, and will help, but it helps in the same way a good accountant helps — and that’s not by having a vision of better accounting.” On the vision’s timeframe, a Department of Health spokesman told us: “Today marks the beginning of a conversation between technology experts across the NHS, regulatory bodies and industry as we refine the standards and consider timeframes and details. The iterated standards document will be published in December once we receive feedback and the mandate will be rolled out gradually. “We have been clear that we will phase out any system which does not meet these standards, will not procure systems which do not comply and will look to end contracts with suppliers who do not meet the standards.”

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Disclaimer: Trading in bitcoins or other digital currencies carries a high level of risk and can result in the total loss of the invested capital. theonlinetech.org does not provide investment advice, but only reflects its own opinion. Please ensure that if you trade or invest in bitcoins or other digital currencies (for example, investing in cloud mining services) you fully understand the risks involved! Please also note that some external links are affiliate links.