New Zealand’s first Mixed Reality Hackathon

Explore Assurity 4 April 2017 Maria Ayoung and Steph Beaumont

The ProjectR Mixed Reality Hackathon was the first of its kind in New Zealand.

A lucky few from our Wellington office had the opportunity to not only host the event in the Level 3 space, but also take part as Microsoft HoloLens testers and consultants.

Starting at 4:30pm on Friday 17 March through to the evening of Sunday 19, Assurity hosted four teams comprised of a mixture of industry professionals and tertiary students, all interested in learning and creating a mixed reality experience, app or game for Microsoft HoloLens users. Unity helpers and people familiar with HoloLens were on site helping with the development of the teams’ concepts. Here’s some context to the event...

What’s a 'hackathon'?

Contrary to the connotations the term ‘hacking’ invokes, a ‘hackathon’ is a completely legal gathering where programmers (or, in this case, creatively minded people with little to no experience technically) are encouraged to collaboratively code and create in an intense way over a short period of time, typically over a 48-hour period. While working on a particular project, the idea is for each person or team to have the ability and freedom to work on whatever they want.

The hardware used

Microsoft HoloLens is the first self-contained, holographic computer. Transparent lenses and spatial sound enables the user to engage with digital content and interact with holograms in the real world around them.

About ProjectR

ProjectR is a soon to be opened as a national virtual and mixed reality centre. This innovation hub is being set up in Wellington to provide a space for idea sharing, problem solving, development and testing of world-first uses for reality technologies.

So what’s next?

For us, we continue learning. There’s so much to know and discover in this new industry – so by being open to opportunities like this, we may well find ourselves testing for it. It’s time to get excited.

There are plans to run another ProjectR hackathon during Wellington techweek. So keep an eye out in this space and sign up quick because it will undoubtedly be popular.

The networks formed as a result of this experience will no doubt lend to more interesting Virtual and Mixed Reality endeavours in future. We’d like to thank Grant and the Assurity staff involved for letting us use the L3 space and for being a part of this awesome opportunity.

Observations from a weekend of working with Microsoft HoloLens

Prior to the Mixed Reality Hackathon weekend, we had little knowledge and zero experience in the practice of testing for any kind of Mixed Reality medium. Was it an exciting opportunity? Undoubtedly, yes. Did we anticipate how intense a full 48 hours of sharing a space with developers and creative people would be? We had no idea – and we (thankfully!) have no regrets. All that we observed, experienced and contributed to over this time has given us a much better insight into the emerging VR/AR/MR industry in New Zealand. Our key observations:

  • At a retail price of nearly $5,000, having the opportunity to handle the HoloLens headset felt like a surreal experience at first. The real fear of accidentally dropping and damaging something this valuable was very present in our minds. After a few practices though, this fear faded and placing the headset on felt natural and the adjusting of it second nature.

  • We struggled at first to establish our own direction when it came to consulting with the teams. We barely understood how the HoloLens worked. How could we test its usability and accessibility? How could we incorporate these into the early development stages of a product? What are we asking the teams to think about?

  • We found that many of the teams already had an idea of usability for their project, but few really knew what accessibility for their projects meant. So, while we stressed that thinking about who their audience was and what their audience would be anticipating/ looking for when using their product, the main considerations we suggested involved the limitations and possible accessibility issues their audience might encounter. These included colour blindness, hearing impairments and even spatial accessibility (in a 3D-holographic mixed reality setting, your real-world environment is a crucial consideration when developing a mixed reality product).

  • By the second day, we had defined an approach to working with HoloLens... and that was to use it, use it, use it. The more exposure we obtained through practice, the better we understood the potential limitations that HoloLens posed for its users. We concluded that, by being familiar with the hardware, we could put ourselves in the shoes of the target users and really empathise and imagine how the HoloLens product may be received.

  • Lastly, with the HoloLens, the users are interacting with 3D objects in their real-world environment. One of the most important usability observations we made about this was how applicable using a HoloLens in an office environment was. To put it very frankly, seeing a person wandering around or standing stationary while performing bizarre hand gesture, put the question in our minds; How usable is it? Would this headset fit in with a corporate professional office environment? Also, how is this going to change our work and social environments in the future? Is people behaving in this manner going to become the new norm – and should we be thinking of making the HoloLens more natural – aka something viable to corporate users who, at the end of the day, don’t want to look like ‘that one strange guy’ wandering around the office using tech the world is only just now accepting.

At the end of the day, our testing and consulting experience in the mixed reality scene is still in its infancy (a scene which a quick Google search can tell us has been around since 1994).

The main points we’ve taken from our experience is that usability and accessibility, even for this new industry, needs to be utilised from the early stages of developing a product through to the final iteration.

You just can’t underestimate the power of a solid, usable product. It’s what will keep the target audience coming back to you for more – and what will keep the fun factor of using the HoloLens past the initial ‘wow, this is so cool’ honeymoon stage. Ultimately, we now know much more about this space than what we knew when we went in. Bring on the future of mixed reality. We are *somewhat more* ready than before.