Stroy Former

This is a simple implementation of transformer models uisng nothing but some of the pytorch libraries(mostly releated to tensor multiplication and adam optimizer)

this code currently will spell out stories but could be trained on any text input.

To run this

git clone 'https://github.com/KrishnaAgarwal1308/Story-former.git'
cd 'Story-former'
python run full_paper_made.py 

this by iteself will install the dataset and will train on your gpu or cpu as available.

All issues are invited

This code is given to get an graps of how transformer works under the hood in pytorch which is helpful in understanding the vit model 'https://github.com/KrishnaAgarwal1308/scratch_cnn' which is based on traditional transformer to do image classification.