These are a set of minimal notes and code snippets. I wrote these notes for myself for quick reference. These notes are a work in progress.
topics
ssm
These notes focus on my use cases of state space models. These are not the linear deterministic kind of SSM used in big bad LLMs like Mamba, but instead Bayesian inference in stochastic (non)linear dynamical models.
- state space model
- hidden markov model
- linear gaussian ssm
- nonlinear gaussian ssm
- generalised gaussian ssm
- kalman filtering and smoothing
- ssm in dynamax
- online learning using ssm
- structural time series models
- state space gaussian process
- ssm resources
llm
Read Ravin’s GenAI guidebook or Vicki Boykis’ normcore-llm.md instead.
- language modelling
- transformer architecture
- multi-headed self-attention
- llm pre-training
- llm fine-tuning
- word2vec
- retrieval augmented generation
research engineering
| File | date modified | date created |
|---|---|---|
| PGVector + SQLModel | 4:19 PM - March 20, 2026 | 10:05 AM - March 03, 2024 |
| populate a PostgreSQL database with SQLModel | 4:19 PM - March 20, 2026 | 10:03 AM - March 03, 2024 |
| sqlmodel (sqlalchemy) cascade | 4:19 PM - March 20, 2026 | 3:14 AM - April 13, 2024 |
| SQL and NoSQL | 4:19 PM - March 20, 2026 | 5:12 AM - February 17, 2024 |
| d3.js | 6:19 PM - January 09, 2026 | 6:19 PM - January 09, 2026 |
| mac setup | 10:54 AM - December 26, 2025 | 7:59 AM - January 30, 2024 |
| jax.vmap | 7:04 PM - November 17, 2025 | 8:30 AM - February 04, 2024 |
| splitting keys in jax | 4:50 PM - November 14, 2025 | 1:59 AM - June 21, 2024 |
| pytensor | 5:11 PM - September 15, 2025 | 3:35 AM - June 01, 2024 |
| cross-account sts assume role | 11:43 AM - August 16, 2025 | 11:36 AM - August 16, 2025 |
| ray on sagemaker | 5:02 PM - March 15, 2025 | 9:36 PM - March 13, 2025 |
| mlflow | 7:44 PM - March 11, 2025 | 7:13 AM - May 30, 2024 |
| docker | 7:47 PM - January 24, 2025 | 10:10 AM - February 08, 2024 |
| infrastructure as code | 10:07 PM - January 13, 2025 | 8:47 AM - May 03, 2024 |
| kubernetes | 10:07 PM - January 13, 2025 | 7:52 PM - January 13, 2025 |
| beartype | 5:08 PM - November 10, 2024 | 9:51 PM - October 12, 2024 |
| pandera | 10:43 PM - October 12, 2024 | 10:32 PM - October 12, 2024 |
| observable plot | 9:09 AM - October 02, 2024 | 8:42 AM - October 02, 2024 |
| python versioning, virtual environments and packaging | 3:54 PM - September 09, 2024 | 12:00 AM - January 30, 2024 |
| serverless functions | 10:58 AM - September 04, 2024 | 10:01 AM - September 04, 2024 |
other
| File | date modified | date created |
|---|---|---|
| stochastic calculus | 9:55 AM - March 21, 2026 | 12:59 PM - March 17, 2026 |
| pg_dump | 4:19 PM - March 20, 2026 | 1:47 PM - March 22, 2024 |
| explicit and implicit layers | 1:36 PM - March 16, 2026 | 11:48 AM - August 03, 2024 |
| fixed point iteration | 1:36 PM - March 16, 2026 | 11:43 AM - July 30, 2024 |
| implicit function theorem | 1:35 PM - March 16, 2026 | 11:46 AM - August 03, 2024 |
| automatic differentiation | 1:35 PM - March 16, 2026 | 1:45 PM - August 03, 2024 |
| index | 1:02 PM - March 16, 2026 | 10:57 AM - January 31, 2024 |
| probability distribution websites | 7:54 PM - February 11, 2026 | 7:45 PM - February 11, 2026 |
| internals of pyro and numpyro | 6:18 PM - January 09, 2026 | 5:35 PM - January 09, 2026 |
| marginalisation of variables and rao-blackwell | 5:35 PM - January 09, 2026 | 5:25 PM - January 09, 2026 |
| penzai named array axis | 10:04 PM - December 15, 2025 | 6:47 PM - December 07, 2025 |
| time series features | 7:53 PM - December 07, 2025 | 5:10 PM - April 30, 2025 |
| jax and state | 7:48 PM - December 07, 2025 | 5:48 PM - December 05, 2025 |
| jax and pytree | 7:45 PM - December 07, 2025 | 6:27 PM - December 05, 2025 |
| neural networks in jax | 7:36 PM - December 07, 2025 | 7:02 AM - August 29, 2024 |
| linear model as a neural network | 6:52 PM - December 07, 2025 | 5:32 AM - February 04, 2024 |
| treescope | 6:46 PM - December 07, 2025 | 6:37 AM - August 31, 2024 |
| jax sharding | 6:27 PM - December 05, 2025 | 5:42 PM - December 05, 2025 |
| jax checkify | 6:09 PM - December 05, 2025 | 5:43 PM - December 05, 2025 |
| jax.jit | 5:55 PM - December 05, 2025 | 5:40 PM - December 05, 2025 |