|
Getting your Trinity Audio player ready...
|
Please give us an overview of your background, what inspired you to get into immersive tech, and your journey into the XR industry.
I’ve been in computer software engineering for 25 years, starting my journey when I was just six years old. I discovered an old Commodore 64 in my attic, and despite coming from a challenging family environment, I managed to fix it and ignite my passion for technology. This drive to tinker and explore led me through various fields including electronics, manufacturing, hardware engineering, software engineering, and cloud computing.
Video games played a crucial role in my development. The game Halo, in particular, provided a rare bonding experience with my brothers and made me want to pursue game development. However, my path into immersive technology didn’t truly begin until my undergraduate years. I went straight from high school to university, and during my studies, someone approached me with an opportunity to learn about immersive tech in Japan, which I eagerly accepted.
In Japan, I pursued both my Masters and PhD, diving deeper into XR technology. One of my early projects involved creating a Hatsune Miku dance app for Google Glass, which gained significant attention. For my PhD, I worked on an ambitious project turning Osaka City into a large-scale AR video game using Microsoft HoloLenses. This project really pushed the boundaries of what was possible with AR at the time.
During my PhD, I also worked in Singapore on educational technology projects, which allowed me to bridge my interests in game development with more practical applications. This experience was crucial in shaping my understanding of how XR could be applied in real-world scenarios.
Throughout my career, I’ve worked on various projects and technologies. I founded two companies, B.E.E.R Labs and later ARUX Inc, to pursue my vision for XR technology. Most recently, I’ve been involved with a wearable technology project centered around the open-source Project Northstar headset. We’ve developed a backpack pc system we’ve named the “Regalia,” which features A small windows PC, 4G communications, GPS and External swappable batteries, plus LED’s for the gamer feels. It became a unique way for us to engage with people and showcase our work in immersive tech.
My journey has taken me across the United States, allowing me to connect with thousands of people and share our vision for immersive technology. It’s been an incredible experience that combines my technical expertise with a flair for marketing and public engagement.
While my passion for technology and innovation has been a driving force, I’ll admit that my ultimate goal was to start a family. This personal motivation has been a significant factor in my entrepreneurial efforts in the XR industry.
You’ve tackled a wide range of projects in your career. What was a particularly challenging project that taught you a valuable lesson about development or leadership?
One particularly challenging project that taught me valuable lessons about development and leadership was a video game based on Australia’s famous outlaw, Ned Kelly. We attempted to fund this through Kickstarter about a year ago. The game aimed to retell Ned’s story with a unique twist, blending historical elements with innovative gameplay.
The project pushed me far beyond my limits. I was juggling multiple responsibilities – managing B.E.E.R Labs, overseeing two other industry projects, and dealing with the Ned Kelly game. My main collaborator on the Ned Kelly project didn’t have my back and wasn’t performing the simple tasks I needed help with the most, which added significantly to the challenges. At the peak, I was working up to 110 hours a week, often with barely 4 hours of sleep daily. I found myself wearing “the role of five people at once,” handling everything from development to marketing to project management.
To complicate matters further, during this project, I had to move both my laboratory and my personal residence. This is where our wearable tech, the Regalia, really proved its worth. I developed functions that allowed me to stay in constant communication with my team, and my industry clients, even while packing boxes and dealing with the move. It became a crucial tool for managing the chaos.
The Kickstarter campaign was another major challenge. While it was on track for funding, despite being the only one pushing the non-game development related tasks across the line. The stress was so intense, I ended up hospitalizing myself. Sadly between this; and the constant conflict over the direction the game should go, I elected to do the responsible thing – pull the Kickstarter down regardless of how close to funded it was.
This experience taught me crucial lessons in development and leadership. I learned the critical importance of having reliable collaborators and the need for robust project management systems to handle multiple concurrent projects. It highlighted the need for clear communication protocols and the value of building flexible, scalable systems that can adapt to changing priorities.
From a leadership perspective, I learned the weight of responsibility that comes with being in charge. Every decision I made impacted not just the project, but the livelihoods of my team members. This realization led me to develop more empathetic leadership strategies and improve my delegation skills.
The project’s intense pressure honed my problem-solving skills. When faced with critical deadlines and limited resources, I had to quickly reorganize our workflow and reprioritize tasks, teaching me valuable lessons in agile development practices.
Although the project was incredibly stressful, it ultimately strengthened our team dynamics. We learned to rely on each other’s strengths and support one another during high-pressure situations. This experience has shaped how we approach teamwork in all our subsequent projects.
In the long term, this challenging project has influenced how we structure our company and approach new ventures. We now have more robust systems in place for managing multiple projects, and we’ve incorporated regular team check-ins to ensure everyone is aligned and supported.
The lessons learned from this project continue to influence my leadership style and development approach today. It taught me the importance of resilience, innovative problem-solving, and the critical role of teamwork. But perhaps most importantly, it taught me about the potential personal costs of extreme dedication to a project, and the need to balance ambition with self-care and sustainable work practices.
(As a side note, I’ve since purchased the IP for the game, and intend to bring someone else aboard to see it’s completion to the end).
Can you tell us more about what you’re currently working on?
Currently, I’m working on developing what I believe an Augmented Reality (AR) operating system should be. This project stems from my frustration with the current state of AR technology, including disappointments with existing hardware like the Apple Vision Pro, Microsoft HoloLens and Magic Leap. Despite the availability of advanced hardware, we still can’t use AR glasses as a true digital extension of our body for everyday tasks.
My goal is to create software that allows us to use computers as an extension of our body, merging our digital environment with the real world. The key focus is on pure utility, not entertainment. We’re aiming to replace mobile phones for workplace and daily use cases by enabling hands-free, quick interactions with the digital world.
The system we’re developing includes functionalities like file management, email browsing, communications, and other basic utilities we typically access on our phones. We’re also incorporating a personal assistant feature, which I call “Steph,” that can provide real-time information and assistance through the headset.
I’m using the Project Northstar headset for development due to its low assembly cost, although the operating system itself is designed to be hardware-agnostic. While the operating system stack isn’t open-source, we have made some drivers for the Northstar headset open-source to encourage community involvement.
The announcement of Apple Vision Pro and their coining of the term “spatial computing” really motivated me to take action. I had been wearing my own creation, the Regalia, for about six months at that point and was already experiencing the benefits of wearable AR technology, even with its improvised components.
We’re also working on developing smaller form factor glasses to make the technology more accessible and less obtrusive. The potential applications are vast – we envision FedEx workers using AR for package routing, farmers grading fruit on the fly, or professionals accessing real-time information during meetings.
In addition to this main project, we’re working on a couple of other initiatives:
- We’re combining architecture with virtual reality for a client in Japan, which we’re looking to commercialize.
- We’ve developed a video game based on Ned Kelly, Australia’s most famous outlaw – think of him as our version of Billy the Kid, but in the Australian bush setting.
These projects showcase our focus on innovating in the XR (Extended Reality) technology space, and the entertainment medium particularly in how we can integrate digital experiences with real-world environments and cultural narratives.
While our primary focus is on software development, we do have plans to commercialize this technology. Our aim is to create a system that’s not just technologically advanced, but also practical and transformative for everyday use.
You’re known for being a bit of a visionary! Where do you see XR technology in 5-10 years? What are some of the breakthroughs you’re anticipating?
In 5-10 years, I see XR technology, particularly Augmented Reality (AR), replacing the mobile phone as we know it today. My end game is to make this a reality, especially for workplace and daily use cases. The key is to enable hands-free, quick interactions with the digital world, essentially making AR an extension of our body.
I anticipate a significant shift in how we approach AR technology. Currently, there’s a heavy focus on media and entertainment in the XR industry, which I find problematic, especially for AR. While virtual reality (VR) makes sense for entertainment and media playback, AR should be developed as a practical tool rather than just another entertainment medium.
The breakthrough I’m anticipating and working towards is the development of AR as a utilitarian technology. By focusing on AR as a tool, we can create more useful and forgiving experiences. This approach contrasts with gaming applications, where users tend to be impatient and easily dissatisfied. We’re likely to see specific use cases emerge, such as FedEx workers using AR for package routing or farmers grading fruit on the fly.
In terms of hardware, I expect we’ll see significant advancements in form factor. We’re already working on smaller, more discrete AR glasses that will be less obtrusive and more socially acceptable for everyday use.
The key breakthrough will be creating AR systems that are as intuitive and essential as smartphones are today, but with the added benefit of being hands-free and more integrated with our natural field of vision. This will likely involve advancements in user interfaces, possibly moving towards more gesture-based interactions.
Software development will be crucial in realizing AR’s potential. We need to focus on creating robust, user-friendly operating systems and applications that truly enhance productivity and accessibility. This is where I believe real innovation will happen.
However, we must also address the challenges. Privacy and ethical concerns will be significant as AR becomes more integrated into our daily lives. We need to develop these technologies responsibly, with user privacy and security at the forefront.
Another challenge is ensuring open development platforms. I’m concerned about big tech companies like Meta dominating the VR/AR industry and stifling diversity and innovation. We need to foster an open ecosystem that encourages innovation from a wide range of developers and companies.
In essence, I see XR technology, particularly AR, evolving from a novelty or entertainment-focused technology to an indispensable tool that enhances our daily lives and work processes. It will revolutionize how we work, communicate, and interact with our environment in ways we’re only beginning to imagine. However, realizing this vision will require overcoming significant technical, social, and ethical challenges.
With your experience in both research and commercialization, what are some of the biggest hurdles you see holding back the adoption of XR technology? How can we overcome them?
From my experience in both research and commercialization, I see several significant hurdles holding back the adoption of XR technology.
From a research perspective, one of the biggest challenges is our limited understanding of how humans interact with XR. Take keyboard interaction as an example. There are many ways to approach it, but nobody has nailed it yet. This is largely because researchers haven’t had the opportunity to use the equipment extensively on a daily basis. We need more long-term, real-world usage to truly understand and optimize these interactions. It’s precisely why I wear the Regalia daily!
From an adoption perspective, the main hurdle is that XR technology isn’t yet a tool that people happily use every day. Until it becomes something that offers clear, significant benefits over existing technologies, we won’t see mass adoption. People need to either be able to do something they’ve never been able to do before, or do what they can already do, but significantly better.
To overcome these hurdles, we need to focus on developing XR as a utility rather than just an entertainment medium. We need to create applications that provide clear, practical benefits in everyday life and work scenarios. For example:
- Logistics workers could look at packages and immediately see routing information without needing to check a separate device.
- Agricultural workers could grade fruit on the fly while picking, improving efficiency in packing.
- For business professionals, having instant access to meeting information, location data, and personal dossiers on the people they’re meeting can be incredibly valuable.
The key to overcoming adoption hurdles is to focus on pure utility. Every pixel rendered should serve an incredibly useful purpose for the user. We need to move away from the current focus on media and entertainment in the XR industry, especially for AR applications.
Another crucial factor is form factor. We need to develop systems that are as unobtrusive as possible – think glasses form factor rather than bulky headsets. This, combined with utility-focused applications, will drive adoption.
From a development perspective, we need to focus on creating robust, user-friendly operating systems and software stacks for XR. While hardware is important, it’s the software that will ultimately drive adoption and monetization.
I believe that with proper funding and focus, we could overcome these hurdles and see significant adoption of practical XR technology within two to five years. The key is to keep pushing for practical, utility-focused applications that seamlessly integrate into users’ daily lives.
What are your thoughts about privacy and the ethics behind it, especially how these technologies will be developed? And what are your thoughts on that?
The responsibility will ultimately be on the individual, but as developers, we have a crucial role to play in creating ethical technologies. When the Apple Vision Pro came out, I actually foresaw a repeat of the “Google Glass hole” phenomenon happening. It did occur to an extent, but not as severely, mainly because the Apple Vision Pro is very obvious when you’re using it.
What’s more interesting, and concerning, is what happened with the Ray-Ban smart glasses. People were still acting in incorrigible ways, taking photos and videos without permission, but there wasn’t as much backlash. That’s mainly because it looks just like a normal pair of glasses. I think this is horrible, honestly. We’re seeing people capture and share information without consent, and that’s deeply problematic.
I’ve experienced this ethical dilemma firsthand. At one point, I had sensor access and facial scanning technology in my headset. If I looked at someone, I could do a quick Google search on them. It would freak people out because I’d flip the headset down and they could see all sorts of things happening on the display. I stopped doing it immediately. It was a great tool, but at what cost?
This experience really drove home the point that with great power comes great responsibility. As developers of these technologies, we really, really need to be responsible in how we design them. We need to consider the potential for misuse and build in safeguards and transparency.
Moving forward, I believe we need to focus on creating XR technologies that enhance our lives and interactions without infringing on personal privacy. We need to be proactive about addressing these ethical concerns, possibly through a combination of technological solutions, user education, and perhaps even advocating for appropriate regulations. It’s a complex issue, but one that we absolutely must grapple with as we push the boundaries of XR technology.
What advice would you give to someone who is just starting out in the XR industry? What kind of mindset or skill set is most important for success, in your opinion?
For someone just starting out in the XR industry, I’d offer several key pieces of advice:
- Develop a diverse, multi-disciplinary skill set. In XR, you’re not just looking at software engineering – you need to understand media design, interactivity design, art, and even audio design. There isn’t a single XR dev worth their salt who doesn’t have multiple skill sets. That’s why they call me a Jack of all trades – you need to be versatile in this field.
- Understand different XR environments. If you’re working in VR, think about how to leverage the fact that the user isn’t moving around much. For AR, consider how to constrain the environment to a specific area since you’re dealing with dynamic situations. Each environment has its unique challenges and opportunities.
- Aim for extraordinary skills. Push yourself to excel in your chosen areas. The goal is to be so good that you’re valuable beyond just the XR industry. This versatility will serve you well as the industry evolves.
- Gain practical experience. Use XR technology regularly. The more hands-on experience you have, the better you’ll understand its potential and limitations.
- Cultivate problem-solving skills. XR often involves tackling complex, novel problems. Develop your ability to think creatively and find innovative solutions.
- Network and get involved in the community. The XR industry is collaborative and fast-moving. Building relationships and staying connected can open up opportunities and keep you informed about the latest developments.
- Be adaptable and embrace continuous learning. The field is constantly evolving, so being open to change and ready to learn new things is crucial for long-term success.
- Cultivate passion for technology. Genuine enthusiasm for XR will fuel your motivation and help you push through challenges.
- Develop resilience and perseverance. Like any cutting-edge field, XR can be challenging. You’ll need to be able to bounce back from setbacks and keep pushing forward.
- Don’t neglect your personal life. This is a personal lesson I’ve learned the hard way. Make sure you put time aside to rest, recover, and socialize. Work-life balance is crucial, even though I’ve struggled with it myself because I enjoy the work so much.
The mindset that’s most important for success in XR is one of curiosity, adaptability, and integration. You need to be willing to explore different aspects of the field and able to connect various disciplines. XR isn’t just about coding or just about design – it’s about bringing together software engineering, visual design, user experience, and even elements of psychology to create immersive and effective experiences.
Remember, success in the XR industry isn’t just about technical skills. It’s about having the vision to see how these technologies can solve real-world problems and enhance human experiences. Stay curious, keep learning, and never lose sight of the potential impact of your work.
You’ve been a pioneer in pushing the boundaries of XR technology. Do you see brain-computer interfaces (BCI) as a crucial part of the future of XR? Why or why not?
It’s interesting that you mention brain-computer interfaces (BCI) in relation to XR technology. We’ve actually experimented with combining early versions of XR headsets with BCI, so I have some firsthand experience with this integration.
While I see potential in BCI technology, I wouldn’t say it’s a crucial part of the immediate future of XR, at least not for mainstream applications. There are several challenges that need to be overcome first:
- Form factor: When we tried integrating BCI with XR headsets, the result was incredibly bulky. For widespread adoption, we need to minimize the size significantly.
- Signal noise: The signals coming from the brain are still not well understood, and there’s a lot of noise in the data. This makes it incredibly hard to translate these signals into something useful for XR applications.
- Data sources: Some attempts have been made to create smaller BCI devices, like nodes attached to the temples. However, with fewer data sources, you have to question the efficiency and accuracy of the signals.
That being said, I do see significant potential for BCI in specific use cases, particularly for individuals with disabilities. For people who can’t easily browse a computer or communicate in traditional ways, BCI technology could be life-changing. Imagine someone being able to text their friend just by thinking about it – that’s where BCI could truly shine.
I’ve seen some promising advancements in this field. For instance, in New York, I saw a BCI interface that used a stem inserted into blood vessels to capture brain signals. The results were impressive and done live, which was the first time I’d seen BCI tech that wasn’t, frankly, bullshit.
However, for mainstream XR applications, I’ve actually gone a different route. Instead of trying to automate inputs from our brain, I’m more interested in utilizing the interpersonal connections we can achieve with a headset. I believe this approach has more immediate potential for everyday users.
In conclusion, while I see BCI as a promising technology with specific use cases, particularly in assistive technology, I don’t currently see it as crucial for the mainstream future of XR. The technology needs more work to overcome issues of size, signal quality, and practical application before it can be widely integrated into XR systems. For now, I believe we can achieve more by focusing on other aspects of XR technology that enhance our interpersonal connections and daily interactions with digital information. That said, I’m excited to see how BCI technology develops and its potential applications in specialized fields.
Who have been your most important mentors? Why? How did you meet them?
Throughout my career, I’ve had several important mentors who’ve influenced me in different ways, both positively and negatively.
One of my most significant mentors was my supervising professor, Christian Sandor. While our relationship was complicated – he could be quite difficult to work with and very narcissistic – I’m grateful for what I learned from him about the research world and academic writing, which was my weakest skill set. His approach taught me valuable lessons about what to do and what not to do as a mentor and leader.
Another crucial mentor was Hirokazu Kato, one of the original creators of AR toolkit and considered one of the godfathers of augmented reality. He was an absolute blessing of a man and provided invaluable guidance in the field of AR.
Interestingly, one of my most impactful mentors wasn’t from academia at all, but a homeless man I encountered. He gave me wisdom about work-life balance that I now pass on to others. He recognized my lack of sleep and time off just by looking at me and warned me about the potential consequences. While I didn’t heed his advice at the time, his words have stuck with me and shaped my understanding of the importance of balance in one’s career.
My colleagues in the Japanese laboratory where I did my Masters and PhD were also mentors in their own right. The diverse group, which felt like something straight out of an anime, taught me a lot about different perspectives and approaches to work and life.
I’ve also had various supervisors throughout my many jobs who’ve helped me focus my attention, which is crucial given my ADHD. They’ve taught me how to channel my energy effectively to achieve my goals.
It’s worth noting that I met most of these mentors through my academic journey, which took me from Australia to Japan for my Masters and PhD, and then to various countries including Singapore, Taiwan, China, Finland, and others in Europe and the UK.
Each of these mentors has contributed to shaping who I am today, providing different perspectives, skills, and life lessons that have been crucial in my journey in the XR industry and beyond.
What’s your favorite inspirational quote? What about the quote inspires you?
I actually have two favorite inspirational quotes, if I may be a bit selfish and share both.
The first one, which really speaks to my character, is from Rocky: “It’s not about how hard you can hit, but rather how hard you can get hit and keep going.” This quote inspires me because it embodies resilience and perseverance. Over my 25-year career, especially in the last five years, I’ve faced numerous challenges and setbacks that have tried to make me miserable. But every time, I get up, look in the mirror, give myself a harsh pep talk, and keep moving forward. This quote reminds me that life isn’t about avoiding difficulties, but about having the strength to keep pushing through them.
The second quote is from the anime Naruto, specifically from the character Rock Lee: “As long as I work to make myself better than myself yesterday, then that’s progress.” I’m drawn to Rock Lee because he’s a character who doesn’t have any special abilities, just his physical strength, which he works on relentlessly every day. This quote inspires me because it emphasizes the importance of continuous self-improvement. It’s not about being better than others, but about being better than you were yesterday.
These quotes inspire me because they align with my philosophy in life and work. I often tell my students that as long as you put your energy and everything you have into what you’re doing, you will achieve a result. It may not always be the result you want, but at the very least, it’s something you can learn from.
Both quotes emphasize the importance of perseverance, hard work, and continuous improvement – values that have been crucial in my journey through the tech industry and in overcoming the many challenges I’ve faced along the way.
Is there anything else you’d like to share about your journey in XR, or what you’re most excited about for the future?
Absolutely, there’s a lot I’d like to share about my journey and my thoughts on the future of XR.
First, this journey has been eye-opening for me. Coming from a tin shed in the middle of nowhere in Australia, getting to see what the rest of the Western world and everyone else is doing has been incredibly valuable. It’s given me a broader perspective on the industry and the world at large.
As for the future of XR tech, I believe we need more independent developers and small companies getting involved. The big companies are often too slow to innovate effectively, and when they do, it’s usually driven by profit rather than genuine advancement of the technology. Take Meta, for example – they’ve dominated the VR industry to the point where it’s nearly impossible for others to enter, which stifles diversity and innovation.
I’m excited about the potential for open development in XR. When platforms are open and accessible, it fosters innovation and prevents the creation of walled gardens that suppress progress. This is why I’m such a strong advocate for projects like the open-source Northstar headset.
Another aspect that both excites and concerns me is the ethical implications of XR technology, particularly regarding privacy. As these technologies become more prevalent and less conspicuous – like the Ray-Ban smart glasses – we’re seeing people capture and share information without permission. This is a significant issue that needs addressing. I’ve experienced this firsthand when I experimented running facial scanning technology using my headsets scanners, google searching the person based on the results. I could already foresee the reaction if I was to use it publicly, making me realize the immense responsibility we have as developers. It is ultimately why I refuse to use the sensors in such a fashion anymore. I’d hate it if people stopped talking to me due to fear of privacy breaches.
Looking to the future, I’m most excited about the potential for XR to become a truly useful, integrated part of our daily lives. I envision a future where XR replaces mobile phones, especially in workplace and daily use cases. The key is to enable hands-free, quick interactions with the digital world.
I’m particularly interested in developing XR as a utilitarian technology rather than just an entertainment medium. Every pixel rendered should serve an incredibly useful purpose for the user. I see tremendous potential in areas like logistics, agriculture, and business, where XR can provide immediate, practical benefits.
However, I believe it’s crucial that we approach this responsibly. We need to consider the ethical implications of our work and strive to create technology that enhances life without infringing on personal privacy or freedom.
Lastly, I’m grateful for the opportunities I’ve had, especially my recent journey through the USA. It’s been an incredible experience that has broadened my perspectives and reinforced my passion for pushing the boundaries of XR technology. I’ve met thousands of people, shared our vision, and gained invaluable insights.
Moving forward, I’m excited to continue developing our AR operating system, focusing on pure utility and seamless integration with our daily lives. I believe that with the right focus and approach, we could see significant adoption of practical XR technology within the next two to five years.
In the end, what drives me is the potential to create technology that truly improves people’s lives. That’s what I’m most excited about for the future of XR.
Find Dr Damien on LinkedIn, Facebook, Instagram and learn more about his companies B.E.E.R Labs & Arux Inc.
Know someone who should be interviewed for an XR Creator Spotlight? Please email us at hello@xrcreators.org.
Add Comment