Skip to content

brrich/multiheaded-self-attention

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

multiheaded-self-attention

A Multiheaded self attention transformer architeture implementation, without using pytorch transformers.

Very inefficient, credit to Andrej Karpathy for a nice tutorial!

About

A Multiheaded self attention transformer architeture implementation, without using pytorch transformers.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors