These are a set of minimal notes and code snippets. I wrote these notes for myself for quick reference. These notes are a work in progress.
topics
ssm
These notes focus on my use cases of state space models. These are not the linear deterministic kind of SSM used in big bad LLMs like Mamba, but instead Bayesian inference in stochastic (non)linear dynamical models.
- state space model
- linear gaussian ssm
- nonlinear gaussian ssm
- generalised gaussian ssm
- hidden markov model
- kalman filtering and smoothing
- continuous-discrete state space model
- structural time series models
- state space gaussian process
- online learning using ssm
- ssm in dynamax
- robust innovations
- ssm resources
llm
Read Ravin’s GenAI guidebook or Vicki Boykis’ normcore-llm.md instead.
- language modelling
- transformer architecture
- multi-headed self-attention
- llm pre-training
- llm fine-tuning
- word2vec
- retrieval augmented generation
research engineering
| File | date modified | date created |
|---|---|---|
| functions or classes | 4:44 PM - June 08, 2026 | 3:20 AM - January 31, 2024 |
| mac setup | 11:08 PM - May 10, 2026 | 11:59 PM - January 29, 2024 |
| PGVector + SQLModel | 4:19 PM - March 20, 2026 | 10:05 AM - March 03, 2024 |
| populate a PostgreSQL database with SQLModel | 4:19 PM - March 20, 2026 | 10:03 AM - March 03, 2024 |
| sqlmodel (sqlalchemy) cascade | 4:19 PM - March 20, 2026 | 3:14 AM - April 13, 2024 |
| SQL and NoSQL | 4:19 PM - March 20, 2026 | 5:12 AM - February 17, 2024 |
| d3.js | 6:19 PM - January 09, 2026 | 6:19 PM - January 09, 2026 |
| jax.vmap | 7:04 PM - November 17, 2025 | 8:30 AM - February 04, 2024 |
| splitting keys in jax | 4:50 PM - November 14, 2025 | 1:59 AM - June 21, 2024 |
| pytensor | 5:11 PM - September 15, 2025 | 3:35 AM - June 01, 2024 |
| cross-account sts assume role | 11:43 AM - August 16, 2025 | 11:36 AM - August 16, 2025 |
| ray on sagemaker | 5:02 PM - March 15, 2025 | 9:36 PM - March 13, 2025 |
| mlflow | 7:44 PM - March 11, 2025 | 7:13 AM - May 30, 2024 |
| docker | 7:47 PM - January 24, 2025 | 10:10 AM - February 08, 2024 |
| infrastructure as code | 10:07 PM - January 13, 2025 | 8:47 AM - May 03, 2024 |
| kubernetes | 10:07 PM - January 13, 2025 | 7:52 PM - January 13, 2025 |
| beartype | 5:08 PM - November 10, 2024 | 9:51 PM - October 12, 2024 |
| pandera | 10:43 PM - October 12, 2024 | 10:32 PM - October 12, 2024 |
| observable plot | 9:09 AM - October 02, 2024 | 8:42 AM - October 02, 2024 |
| python versioning, virtual environments and packaging | 3:54 PM - September 09, 2024 | 12:00 AM - January 30, 2024 |
other
| File | date modified | date created |
|---|---|---|
| index | 6:42 PM - October 07, 2026 | 2:57 AM - January 31, 2024 |
| curvewise intervals | 6:23 PM - October 07, 2026 | 6:12 PM - October 06, 2026 |
| discrete choice models | 5:37 PM - June 19, 2026 | 4:44 PM - June 08, 2026 |
| INLA | 12:53 PM - May 22, 2026 | 9:22 AM - May 03, 2024 |
| internals of pyro and numpyro | 12:34 PM - May 22, 2026 | 5:35 PM - January 09, 2026 |
| automatic differentiation | 7:49 PM - March 31, 2026 | 7:49 PM - March 31, 2026 |
| stochastic calculus | 6:00 PM - March 31, 2026 | 12:59 PM - March 17, 2026 |
| time series features | 7:33 PM - March 30, 2026 | 5:10 PM - April 30, 2025 |
| jax sharding | 10:10 AM - March 26, 2026 | 5:42 PM - December 05, 2025 |
| pg_dump | 4:19 PM - March 20, 2026 | 1:47 PM - March 22, 2024 |
| explicit and implicit layers | 1:36 PM - March 16, 2026 | 11:48 AM - August 03, 2024 |
| fixed point iteration | 1:36 PM - March 16, 2026 | 11:43 AM - July 30, 2024 |
| implicit function theorem | 1:35 PM - March 16, 2026 | 11:46 AM - August 03, 2024 |
| probability distribution websites | 7:54 PM - February 11, 2026 | 7:45 PM - February 11, 2026 |
| marginalisation of variables and rao-blackwell | 5:35 PM - January 09, 2026 | 5:25 PM - January 09, 2026 |
| penzai named array axis | 10:04 PM - December 15, 2025 | 6:47 PM - December 07, 2025 |
| jax and state | 7:48 PM - December 07, 2025 | 5:48 PM - December 05, 2025 |
| jax and pytree | 7:45 PM - December 07, 2025 | 6:27 PM - December 05, 2025 |
| neural networks in jax | 7:36 PM - December 07, 2025 | 7:02 AM - August 29, 2024 |
| linear model as a neural network | 6:52 PM - December 07, 2025 | 5:32 AM - February 04, 2024 |