Video | Agriculture | Confidence | Economy | Energy | Employment | Finance | Media | Property | RBNZ | Science | SOEs | Tax | Technology | Telecoms | Tourism | Transport | Search

 

Digital doppelgangers now a reality

14th March 2019


Creating your true digital twin is now possible and will provide a groundbreaking 3D future for the entertainment, gaming, tourism and telecommunication industries, says a global expert on computational photography and computer vision.

Professor Jingyi Yu, of ShanghaiTech University and DGene, uses a combination of light field acquisition and reconstruction technology to generate an exact 3D digital replica of a person.

He has been studying and developing Augmented and Virtual Reality technology for 20 years and will be presenting at New Zealand’s AI Day 2019 conference in Auckland on 27-28 March.

Light field technology works by capturing all light emitting from an object, such as a person, in place of 2D images. Then using advanced machine learning and image processing technology, Dr. Yu and his team can recover ultra high resolution and super realistic dynamic human models from their real twins, in real time.

While seemingly futuristic the technology is expected to become commonplace within a few years, replacing 2D imagery with 3D for most digital communications.

Dr Yu says the potential is huge for areas such as events and venues, as well as uses for remote education and medicine, and virtual tourism.

“We have lived in a 2D image world for decades but we are close to when 3D imaging will become normal, and bring a new dimension and more reality to our digital experience,” he says.

The light field technology’s first foray into practical use came when it was used to show products on e-commerce sites. This enables a product to be shown in 3D, such as a bottle of perfume, with the ability to rotate it as if you were picking it up off a shelf in a shop.

“From these small beginnings the technology has grown to encompass both medium and large scale applications,” he says.

“We can now capture all aspects of a person’s appearance automatically including skin reflection, light, depth, colour, clothing textures and aspect, to provide an ultra-realistic and finely detailed reproduction of anyone in real time. We can now all have a ‘digital twin’.

“A larger scale use would be for a live broadcast and using it for 360 degree and 3D imaging - people will never miss a single angle and even freeze any moment and replay. The personal TMO is not far away, which may solve some discussions about the referee’s decision,” he says.

All of this is possible using current broadband speeds, which will accelerate and improve once 5G arrives.

The exact replica imaging is the result of multiple cameras, up to 80 being used, to capture constant images of every angle that are then reconstructed in 3D instantly. The technology is powered by accelerated computer and algorithm speeds.

Ben Reid, Executive Director of the AI Forum of New Zealand, says this is an incredible example of visual technology enabled by and working with Artificial Intelligence:

“The recent advances in machine learning technology are enabling the rapid development of these new augmented reality capabilities. We are all getting used to images of ‘virtual humans’ that are realistic, but you can still see they are computer generated. But with this technology you won’t be able to tell the difference. Managed correctly, this will open up enormous potential in any industry or service where digital communication plays a role, and increasingly this is just about everywhere,” he says.

“We are delighted to have such an international expert as Jingyi Yu with us for AI Day to bring us a fascinating snapshot of what has already been two decades of groundbreaking innovation.

“China is one of the world’s leading centres of AI investment and it is essential that New Zealand’s AI innovators build strong and lasting links with the Chinese AI market.”

Prof Yu’s visit is supported by Asia New Zealand Foundation, New Zealand’s leading authority on Asia which provides experiences and resources to help New Zealanders build their knowledge, skills and confidence to thrive in Asia.

AI Day 2019 is a two day conference held in Auckland and NZ’s premier event about Artificial Intelligence.

It starts at 4.00pm on Wednesday 27th March with a showcase day/night programme of international speakers from the US and China, as well as Kiwi trailblazers, discussing conversational AI, the future of natural language processing and AI design.

March 28th will be a full day of back-to-back revelation about the impact of AI on people, business and society, running through to the finale networking party at 5.30pm.

The conference will be followed by seven workshops at AUT on 3-4 April, giving attendees the chance to dive deep into demonstrations, case studies and detailed discussion, and a hackfest on 6-7 April where 25 teams will develop and pitch “AI for Earth” concepts.

For a full schedule and tickets to attend AI Day 2019 go to https://www.ai-day.com

ENDS


© Scoop Media

 
 
 
Business Headlines | Sci-Tech Headlines

 

NZTA: Major New Zealand Upgrade Programme Projects Go To Tender

Two major New Zealand Upgrade Programme projects are beginning tenders for construction. The New Zealand Upgrade Programme is a $6.8 billion investment to get our cities moving, to save lives and boost productivity in growth areas. The first Auckland ... More>>

Reserve Bank: RBNZ Seeks To Preserve Benefits Of Cash

The Reserve Bank – Te Pūtea Matua is taking on a new role of steward of the cash system “to preserve the benefits of cash for all who need them”, Assistant Governor Christian Hawkesby told the Royal Numismatics Society of New Zealand annual conference ... More>>

ALSO:

Economy: Double-Dip Recession Next Year, But Housing Rolls On

New Zealand's economy is expected to slip back into recession early next year as delayed job losses, falling consumer spending, and the absence of international tourists bites into growth. More>>

ALSO:

Microsoft New Zealand: Microsoft Expands “Highway To A Hundred Unicorns” Initiative To Support Startups In Asia Pacific

New Zealand, 14 October 2020 – Today Microsoft for Startups launches the Highway to a Hundred Unicorns initiative in Asia Pacific to strengthen the region’s startup ecosystem. This follows the initiative’s success in India, where 56 startups were ... More>>

Fonterra: Farmers Taking Another Step Towards New Zealand’s Low Emissions Food Production

They’re hot off the press and intended to help take the heat out of climate change. Fonterra farmers are already among the world’s most sustainable producers of milk and now have an additional tool in their sustainability toolbox. Over the last few ... More>>

ALSO:

Electricity: New Zealand Remains In Top 10 For Energy Balance

The World Energy Council’s Energy Trilemma Index has become part of the energy dialogue both globally and in New Zealand. The Index illustrates the need for countries to balance energy security, energy equity and environmental sustainability. New Zealand ... More>>

ALSO:


Courts: Businessman Eric Watson Sentenced To A Four-Month Jail Term

New Zealand businessman Eric Watson has been sentenced to a four-month jail term in the UK for contempt of court, TVNZ reports. More>>

OECD: Area Employment Rate Falls By 4.0 Percentage Points, To 64.6% In Second Quarter Of 2020

The OECD area employment rate – the share of the working-age population with jobs – fell by 4.0 percentage points, to 64.6%, in the second quarter of 2020, its lowest level since the fourth quarter of 2010. Across the OECD area, 560 million persons ... More>>

Spark: Turns On 5G In Auckland And Offers A Glimpse Into The Future Of Smart Cities

Spark turned on 5G in downtown Auckland today and has partnered with Auckland Transport (AT) to showcase some of the latest in IoT (Internet of Things) technology and demonstrate what the future could look like for Auckland’s CBD with the power of 5G. 5G is ... More>>

Stats NZ: Monthly Migration Remains Low

Since the border closed in late-March 2020, net migration has averaged about 300 a month, Stats NZ said today. In the five months from April to August 2020, overall net migration was provisionally estimated at 1,700. This was made up of a net gain ... More>>

University of Canterbury: Proglacial Lakes Are Accelerating Glacier Ice Loss

Lake Tasman, New Zealand | 2016 | Photo: Dr Jenna Sutherland Meltwater lakes that form at glacier margins cause ice to recede much further and faster compared to glaciers that terminate on land, according to a new study. But the effects of these glacial ... More>>

ALSO:

Dairy: Fonterra Sells China Farms

Fonterra has agreed to sell its China farms for a total of $555 million (RMB 2.5 billion*1), after successfully developing the farms alongside local partners. Inner Mongolia Natural Dairy Co., Ltd, a subsidiary of China Youran Dairy Group Limited ... More>>

ALSO: