|
|
6daa8ec46c
|
Added code to generate training batches
|
2026-01-07 01:15:18 -05:00 |
|
|
|
229c564811
|
CosineAnnealing with optimizer Group
|
2026-01-07 00:26:04 -05:00 |
|
|
|
478010c8cc
|
added Positional encodeings
|
2026-01-06 21:38:12 -05:00 |
|
|
|
3b590b3ce7
|
added dropout to ffn
|
2026-01-06 21:26:51 -05:00 |
|
|
|
957aad2239
|
Implimented Transformer(decode only)
|
2026-01-06 21:26:24 -05:00 |
|
|
|
23f62c7e64
|
Implimented TransformerBlock
|
2026-01-06 19:53:37 -05:00 |
|
|
|
77aa0de0eb
|
Implimented MultiHeadAttention
|
2026-01-06 19:41:12 -05:00 |
|
|
|
c4e5e332ba
|
fixed cast in ffn
|
2026-01-06 19:40:45 -05:00 |
|
|
|
d6b9f45fcc
|
Implimented Feed Forward Netwok
|
2026-01-06 18:31:04 -05:00 |
|
