feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 36a72e5 Running DebasishDhal99 commited on 3 days ago
feat: made attention logits plot more interactive and added intuitive logic fir attention logits and attention scores 4f0e23c DebasishDhal99 commited on 10 days ago
feat: enhance attention visualization with token context and improve markdown explanations 0342a67 DebasishDhal99 commited on 11 days ago
fix: made the sequence length accurate for real model setup and also added information on which attention head is attending which set of dims 3a74c51 DebasishDhal99 commited on 11 days ago
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 4ed3b70 DebasishDhal99 commited on 12 days ago
feat: increase seq_len and auto-update of dim on UI during compute c9744fe DebasishDhal99 commited on 12 days ago
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding aa7bfed DebasishDhal99 commited on 12 days ago