Posts

Gaussian Expectation Propagation

Description of Expectation Propagation using Multivariate Normal factors for the global approximation.
Last updated on Feb 10, 2024 4 min read expectation-propagation

Multivariate Normal as an Exponential Family Distribution

How to rewrite a Multivariate Normal distribution as a member of the Exponential Family.
Last updated on Mar 13, 2020 3 min read statistics

Expectation Propagation - The Essential Minimum

The bare practical minimum to understand Expectation Propagation
Last updated on Mar 9, 2020 1 min read expectation-propagation

Summary of the SNEP algorithm

Concised summary of Stochastic Natural Gradient Expectation Propagation algorithm by Hasenclever et al.
Last updated on Mar 19, 2020 4 min read paper-summaries, expectation-propagation

Visualizing Measure Theory for Markov Chains

Measure-theoretic concepts underpinning the development of Markov Chains and Markov Chains Monte Carlo (MCMC) via insightful diagrams.
Last updated on May 6, 2021 7 min read visualization, mcmc, markov-chains, markov-chain-monte-carlo, measure-theory

Logistic Regression

Rigorous summary of results and formulas concerning Bayesian Logistic Regression.
Last updated on Mar 9, 2020 11 min read classification

Paper Summary: An Introduction To Transformers - Turner (2023)

Input to the Transformer The input to the transformer is a sequence \(X^{(0)}\in\mathbb{R}^{D\times N}\) where \(N\) is the length of …
Last updated on Feb 12, 2024 4 min read attention, transformers, deep-learning