Home / Business / Apple confirms it has acquired Spektral, a Danish computer vision startup, for augmented reality technology

Apple confirms it has acquired Spektral, a Danish computer vision startup, for augmented reality technology

On the heels of Apple this morning inking a $600 million deal to acquire IP, talent and licenses from Dialog Semiconductor in Europe, it has also confirmed another acquisition of a smaller startup in the region.

Apple has purchased Spektral, a computer vision company based out of Denmark that has worked on segmentation technology, a more efficient way to “cut out” figures from their backgrounds in digital images and videos, reportedly for over $30 million.

This type of technology can be used, for example, to make quicker and more accurate/realistic cut-out images in augmented reality environments, but also for more standard applications like school photos. That was actually the first market the startup targeted, in 2015, although it appeared to shift strategy after that to build up IP and make deeper inroads into video. You can see a demo of how its technology works at the bottom of this post.

Rumors of the deal started to surface yesterday, first in Danish financial newspaper Børsen, without confirmation from Apple. We reached out, and Apple has today finally confirmed the deal with its standard statement: “Apple buys smaller technology companies from time to time, and we generally do not discuss our purpose or plans.”

From what we understand, the acquisition happened a while back — which lines up with a LinkedIn profile for Toke Jansen, who had been a co-founder of Spektral but now notes that as of December 2017 he has been a manager of computational imaging at Apple.

Others associated with the company — including the other co-founder, Henrik Paltoft — have not updated their profiles, so it’s unclear how many others have joined. Børsen reports that the deal includes the company’s engineers and was in the region of 200 million Danish kroner, which is equivalent to around $31 million.

Spektral started life as CloudCutout, built on algorithms from Jansen’s PhD. The startup initially pitched its product as a cheaper and more efficient “green screen” technology, to remove primary images from their plain (typically green) or standard-pattern backgrounds, with an early iteration of the product built by training the system on over 100,000 professional cutouts.

Spectral’s first application may have been the fairly retro world of school pictures, but what’s most notable here is what Spektral might contribute to Apple’s imaging business. That could be for applications that Apple has yet to launch, but also to improve the quality of those that are already in the market, from legacy products like PhotoBooth through to ARKit, the company’s platform for mobile development.

Segmentation could help add live filters to human figures in a photo but can also be effective in occluding AR environments behind figures to make digital AR content appear to interact with the position of humans.

Spektral’s segmentation technology is also able to run on mobile phones, making it potentially a quicker and more efficient way of processing AR images directly on devices. And one of its main selling points is how it copes with very fine details, such as hair.

“To provide high quality cutouts, the core of our engine exploits recent advances in spectral graph theory and neural networks. The computation of pixel transparencies (the alpha channel) for a single image involves solving multiple large-scale equation systems, as well as carrying out multiple feed-forward passes in our neural networks,” we reported the founders saying when the startup raised a seed round. (It raised more funding in 2017, $2.8 million from Litecap and Amp Ventures, to diver deeper into video.)

“We pose the problem of determining an alpha channel of an image as a machine learning task. Compared to usual chroma keying, this allows us to consider a much broader range of backgrounds since the model will learn, i.e., texture representations from existing training data.”

Computer vision has been a focus (sorry!) for Apple for a while now. The iPhone and Mac giant has made more than 40 acquisitions in Europe in the last 10 years — I guess we may still have some hunting to do — and a number of its acquisitions both in Europe and elsewhere have been in the area of computer vision. They have included Akonia Holographics, InVisage Technologies, Regaind, Vrvana, SensoMotoric Instruments, Indoor.io, Flyby Media, Emotient, Faceshift, Metaio, Polar Rose and more.

SPEKTRAL from Spektral on Vimeo.

Additional reporting Natasha Lomas.

Check Also

Cryptocurrency wallet startup Cobo raises $13M Series A to enter the U.S. and Southeast Asia

Cobo, a cryptocurrency wallet startup headquartered in Beijing, has raised a $13 million Series A to enter new international markets. The round was led by DHVC and Wu Capital, a family office based in China. Cobo plans to expand in the United States and Southeast Asia, in particular Vietnam and Indonesia. Cobo is also now taking pre-orders for Cobo Vault, a hardware wallet (pictured above) that it claims is military grade. Cobo’s Series A brings its total funding to $20 million so far. Cobo Wallet allows users to store both proof-of-stake and proof-of-work coins. One incentive for people to pick the app over its competitors is the ability to pool proof-of-stake assets with other users so they can increase their chances of mining and validating new blocks on the blockchain. Since launching earlier this year, Cobo says its digital wallet has gained more than 500,000 users. The startup was founded last year by CEO Shixing Mao, who is known as Discus Fish in the crypto community, and CTO Changhao Jiang, a former platform engineer at Facebook and Google who co-founded Bihang, a cryptocurrency wallet acquired by OKCoin in 2013. Discus Fish, meanwhile, is known for launching F2Pool, China’s first mining pool. Cobo Vault, which will retail for $479, meets the MIL-STD-810G U.S. military standard for equipment, Cobo’s head of hardware Lixin Liu said in an email, adding that it was built with proprietary firmware created especially for the device, a bank-grade encryption chip and military-grade aluminum. Cobo Vault’s creation was prompted by an August 2017 incident in which F2Pool was hacked and more than 8,000 ETH was stolen from Discus Fish’s account. Fish also refunded customers’ lost ETH from his own assets. “As a result, Discus Fish was resolute on the fact that for crypto to gain mass market adoption, products had to be made to be hacker-resistant and truly safe,” said Liu.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Disclaimer: Trading in bitcoins or other digital currencies carries a high level of risk and can result in the total loss of the invested capital. theonlinetech.org does not provide investment advice, but only reflects its own opinion. Please ensure that if you trade or invest in bitcoins or other digital currencies (for example, investing in cloud mining services) you fully understand the risks involved! Please also note that some external links are affiliate links.