LSTM vs GRU vs KDA: Is memory a dictionary?
I keep a plain explanation of [LSTM vs GRU](/post/rnn-what-is-the-difference-between-lstm-and-gru) on this site already. This is its playable sibling, plus a third contestant most explainers skip:…
Yorkies, Go!
Education materials shared by the owner.
Blog
Distance Metrics: How to measure differences?
*Every clustering, nearest-neighbor, and recommendation algorithm depends on one choice you make before anything runs: what the word "close" means. There is no universal answer, because the right…
Game Theory: Which game is your empoyer playing?
*Work hard is not a strategy. Google, Meta, NVIDIA, OpenAI, and Anthropic are playing five different games, and the same effort pays out differently in each one.* If you are a software engineer or a…
Emerging AI Weekly: November 6, 2026
What's new in AI this week: shopping agents went multimodal and in-store, frontier models turned to cybersecurity at scale, image generation got faster, and regulators opened a personalized-pricing…
Loss Functions: Which to use?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math to learners of all…
Physical AI for Seniors: What Does SafelyYou Do?
I spent two years at Blueprint Technologies helping build the retail version of a video analytics product -- the system that later became…
SVM: How does Support Vector Machine work?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math of learners of all…
Linear Algebra: What does a Matrix actually do?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math to learners of all…
Transformer Attention: What are Query, Key, and Value?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math to graduate students…
Activation Functions: Which to use?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math to graduate students…
Transformer Attention: How does ROPE work?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, deep learning, statistics, and math to graduate students…
RNN: What is the difference between LSTM and GRU?
# Questions from My Students: "What Is the Difference Between LSTM and GRU?" *This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I…
Transformer Attention: Why does Gemma4 let most layers see only a small window?
*This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine learning, statistics, and math to graduate students and working…
Transformer Attention: Why does Attention need more than one head?
# Questions from My Students #5: "Why Does Attention Need More Than One Head?" *This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I…
Transformer Attention: Why can not GPT look ahead?
# Questions from My Students #4: "Why Can't GPT Look Ahead?" *This is a series where I answer the questions my tutoring students really ask -- the ones textbooks tend to skip. I teach machine…
Transformer Attention: What is the difference between Kimi Delta Network and LSTM?
One of my students asked me a question last week that I couldn't answer with a diagram alone: **"How does Delta Network attention actually differ from an LSTM? If the same token arrives with the same…
Transformer Attention: What is Attention Actually Doing?
# Questions from My Students #1: "What Is Attention Actually Doing?" *This is a series where I answer the questions my tutoring students really ask — the ones textbooks tend to skip. I teach machine…
Emerging AI Weekly - October 30, 2026
# Emerging AI Weekly — October 30, 2026 *What's new in AI this week: world models, open weights, local AI hardware, enterprise agents, and a $17B grocery deal.* **Emerging Signals:** 1. **Google…