AppYonder

Positional Encoding

carl nohre

No ratings yetEducationAges 4+

Get it free on the App StoreOpens Apple's App Store

Screenshots

About this app

This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM). Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper. In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.

What's new

Version 1.2 · Sep 15, 2025

fixed a bug in dark-mode.

More from carl nohre

You might also like