jtmoulia’s intermittent journal, guides, and recipes. See recent posts below, and links to archives in the header.
OpenAI introduces the GPT Store
First announced back at their dev days, today OpenAI officially opened up their app store. I’m looking at how it’s structured, what applications are featured, and the missing payouts. I’m still waiting for access to the store to be rolled out to me, so starting with the glaring hole: there is still no transparency on the revenue sharing. OpenAI briefly noted:
In Q1 we will launch a GPT builder revenue program. As a first step, US builders will be paid based on user engagement with their GPTs. We’ll provide details on the criteria for payments as we get closer.
…
Documents worth chatting to
I have reams of documents from over the years. Initially handwritten, post-college as digital text—the documents cover communications, all kinds of notes, recordings, personal metadata, etc. To plumb together a personal RAG system I’ll need to nail down the sources.
Let’s start by brainstorming easily accessible digital sources:
- org/obsidian files (how to chunk?)
- emails (pull using offlineimap)
- calendar (one-time export)
- health data, (Apple HealthKit, Google Fit
- voice/video chat recordings (which I don’t have)
- source code (not really useful to bring in)
- ‘sketches’, blueprints, mind maps which don’t really exist
Beyond the digital sources I’ve been accumulating from are the potential sources of the future. For example, better logging my thoughts and processes in the hope LLMs will give that personal text personal utility and accessibility (yes, that’s what this doc is.).
…Giving attention to transformers
I want to understand transformers, so I’ve been banging my head against them since the New Year from all angles: YouTube, podcasts, O’Reilly books, attempting an explanation towards anyone who’d listen, etc. I’m getting close, I think! (at least for the basic feed forward inference – gradient descent remains mysterious) Possibly premature, but I’m feeling that two chumps like my Dad and I are capable of understanding how LLM’s work. As non-chumps have pointed out, the math isn’t too complicated, the real unlocks seems to be scale + data. (somewhat on that note: wtf is Chinchilla optimal?)
…2024 LLM Journal Arcs
This journal and my professional life are getting a reboot (LLMs!). It’s a space for reflection, for marking time, and for organizing my daily journey. January has been designated as my immersion month, and I am already amidst the chaos of various half-understood topics and the creative zeal of individuals pushing the boundaries. The frontier is in constant motion. This journaling endeavor is tasked with outlining the threads I am following, providing some continuity in a shifting landscape.
…OCR for [my] handwriting
My Aunt & Uncle Christmas gifted me the pragmatically German LAMY Safari fountain pen, and it sparked an urge to handwrite the rough draft of my journal entries. I mean, this pen feels wicked smooth, I’ve spent an insane amount of time learning to and writing throughout my life, and it connects me to my past, to my mother who has beautiful handwriting.
But I still got to digitize. As text, the entries can be edited, searched, and published. And, this brings us to the point: how can I most easily OCR my handwritten notes.
…