Positional Encoding
carl nohre
No ratings yetEducationAges 4+
Get it free on the App StoreOpens Apple's App Store
Screenshots
About this app
This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM). Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper. In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.
What's new
Version 1.2 · Sep 15, 2025
fixed a bug in dark-mode.
More from carl nohre
You might also like
Fibonacci anyonSungjun Kim
topological gateSungjun Kim
Circle Coordinate CalculatorHeng Jia Liang
path integralSungjun Kim
Trig Solver - TrigonifyMobin Akhter
BibleRealmCatherine Henry
Grover algorithm 2Sungjun Kim
MyHero: Bedtime StoriesMert Ohancan
Trigonometry Toolkit by CSChatStick Company Limited
The Matrix MentorEdwin Veger