Given HKUST’s reputation for enterprise, innovation and advanced technology built up over the past two decades, it is fitting that its 20th Anniversary book should celebrate these aspects of the University by becoming the first major publication in Hong Kong to utilize markerless augmented reality.

Augmented reality, or AR, combines a real scenario with a virtual scenario created by computer to enhance or “augment” the user’s visual experience and ability to participate. As Thomas Ng, Director of the Publishing Technology Center at HKUST, said: “We wanted to provide readers of HKUST – Our Miracle Continues with a new and exciting way of interacting with the book as well as showcase HKUST’s position as a leading technology advocate and communicator.”

To move this from concept to physical reality, the Publishing Technology Center assigned Leovation, an AR specialist in the development of mass augmented reality technologies for printed publications, to be its technical partner in the project.

The next step was for the Publishing Technology Center to create the storyboard, featuring President Tony F. Chan introducing the University and the book. It then took a four-person Leovation team of programmers and animators a full month’s work, spread over two, to complete the different stages involved in the 90-second AR introduction, including building up the 3D model, programming, and enhancing the user experience.

The story outline also called for a flock of “Redbirds”, based on HKUST’s iconic sundial, flying across the screen. To create this animation, different visual approaches were explored and new algorithms devised by Leovation to ensure it matched the design theme. After this, it was presented to HKUST’s 20th Anniversary Publication Sub-committee, which supported the idea.

 

Creative cover
The AR introduction, which is embedded in the book’s cover, can be set in motion by downloading the appropriate software and holding the cover in front of a webcam-equipped computer screen. This brings the President, scenes of HKUST, and the animated graphics to life on screen, with Professor Chan talking directly to each reader. Interaction with the images is also possible by moving the physical book in different directions.

Leovation’s founder and CEO Andrew Pang explained: “The concept was to show the outstanding nature of HKUST through involving the reader in the use of advanced technology. This was done by combining the physical and digital worlds through the book’s cover.”

 

Out-of-the-box approach
The publication breaks new ground in Hong Kong by using “markerless” augmented reality. This eliminated the need for a black frame, or marker, to serve as a computer recognition system, enabling the technology to be integrated into the regular design of the book cover to retain the look’n’feel of the HKUST brand.

The result is a book with a unique niche in publishing in Hong Kong. Thomas Ng said: “Being involved in the AR production for the 20th Anniversary book was a challenging yet rewarding experience for my team. The Publishing Technology Center will continue to explore emerging publishing technologies to tell the University’s stories, and help the HKUST ‘miracle’ to continue.”