Commit Graph

7 Commits

Author SHA1 Message Date
k
478010c8cc added Positional encodeings 2026-01-06 21:38:12 -05:00
k
3b590b3ce7 added dropout to ffn 2026-01-06 21:26:51 -05:00
k
957aad2239 Implimented Transformer(decode only) 2026-01-06 21:26:24 -05:00
k
23f62c7e64 Implimented TransformerBlock 2026-01-06 19:53:37 -05:00
k
77aa0de0eb Implimented MultiHeadAttention 2026-01-06 19:41:12 -05:00
k
c4e5e332ba fixed cast in ffn 2026-01-06 19:40:45 -05:00
k
d6b9f45fcc Implimented Feed Forward Netwok 2026-01-06 18:31:04 -05:00