Machine Learning

Development, Machine Learning, Spatial Computing

In the Era of Multi-Dimensional Computing, XR is the Future of Front-End; AI is the Future of Back-End

My work over the past ten+ (wtf?) years has focused on emerging technologies, primarily spatial computing and machine learning – so this moment is pretty spectacular to see. We’re entering a new age where generative AI can create infinite worlds of content as a tool to aid and augment human creativity and understanding, and with today’s announcement, we’re creeping ever-closer to advancements in spatial computing hardware that allows us to experience technology in ways that allow us to use our natural cognition to better facilitate our relationship to information.

Read more
Development, Machine Learning, neurodivergence

SelfOS: Visions of a Personal Agent

As we begin crossing a new productivity frontier with the availability of large language models and advances in artificial intelligence algorithms, I’ve been thinking a lot about the use of these tools in helping us introspect and communicate. Enter the idea of SelfOS. My long-term vision for SelfOS is ambitious – a personal operating system for anyone. In practice, there will be infinite ways of building a SelfOS. It’s not a single technology stack, but instead a series of principles grounded in the belief that technology should be used as a tool to empower individuals, rather than as systems of oppression.

Read more
Development, Machine Learning, Mozilla Hubs, Spatial Computing

Authoring Immersive Environments with glTF for Multi-User Mixed Reality Web Applications

I was invited to give a lightning talk at the W3C Inclusive Design for Immersive Technology workshop about what we’re doing with scene authoring through Spoke for Hubs. As with many of my talks, I think they make better blog posts, and I’m excited to share this one with you today. About Hubs & Spoke For those of you who aren’t familiar with the work we’re doing a Mozilla on social mixed reality, Hubs is

Read more
Development, Machine Learning, Spatial Computing

Captioning Three.js WebGL Canvas Elements with Machine Learning

I just skimmed back into an earlier blog post and realized that while I posted about leaving High Fidelity, I never actually updated with where I was headed. I didn’t post it here, though I did an announcement on Twitter with the news: I joined Mozilla back in March to work on their Mixed Reality initiatives, and finally have been able to go full-time into open source, web-based, asymmetric social 3D / VR spaces. Working

Read more