The Metaphor of a Large Memory Model (LMM)

I can understand the appeal of language models. Language - the act and structure of communicating the cognitive processes I undergo on a day to day basis - is observable, whereas memory is not.Over the past several months, I've been working through the development of an architecture that may someday

TIL: The One-Model-Many-Models Paradigm

Because foundation models are used to build many other models that are trained to new, more specific tasks, it can be hard to evaluate models consistently. The one-model-many-models paradigm attempts to study interpretability of foundation models by looking for similarities and differences across th

TIL: The CRFM's Five Stages for Evaluating Foundation Models

Today I read about the five stages of foundation model development. The paper breaks foundation models down into these stages in order to specify the unique challenges and ethical considerations at each step of the process. The five stages are: data creation, data curation, training, adaptation, and

No, Llama 2 is not actually open source

While LLAMA 2 is certainly interesting, and more openly licensed than some other AI language models, it's definitely not open source. Open source is a term that is defined by a non-profit called the Open Source Initiative. The OSI explicitly calls out that it is not sufficient for code to be open fo

Google Bard lied to me to try and sell me a non-existent cloud offering

I turned to Bard to help brainstorm ideas for how I can replace the OpenAI Completions API in a project that a former colleague worked on, and it helpfully recommended me three alternatives. It turns out that the Bard API doesn't exist - at least, it doesn't exist yet.

Resistance to Change is Often a Lack of Clarity

I'm on exchange at London Business School this week to study Strategic Innovation. Today, we covered a lot of ground, starting with why it is challenging for established organizations to truly innovate, as well as the individual thought patterns that challenge us in thinking "outside of the box". An

The Essentialism of Existentialism

I often joke that it is impossible to work on emerging technologies without also adopting the mindset of an existentialist philosopher. Perhaps it is a defense mechanism; a way that I call out into the collective intelligence of human knowledge to find others who question what it means to build our

Multidimensional Computing Accessibility in the Age of XR and AI

Today, I'm sharing the slides that I prepared for my talk at the 2023 XR Access Symposium. In building this presentation, I had a few goals - the first was to establish my own new paradigm for talking about XR and AI. I found that "multidimensional computing" encompassed both of those characteristic

Google Bard: OpenAI's Exclusivity Deal with Microsoft may Violate Anti-Trust Law in US

I decided to ask both ChatGPT and Google Bard to provide three arguments about why this particular exclusivity deal was in violation with the Sherman Act. Completely in alignment with my expectations, ChatGPT immediately announced that it was unable to answer such a question, but it happily explaine

TIL: Adding a Not-Yet-Landed Patch into my Local Firefox Build

I wanted to build Firefox from source in order to implement the changes found in the patch stack linked above. That's the beauty of open source - I was able to be sent a patch that someone wrote last summer, and even though it hasn't been made production-ready and merged, I can start working with it