#software #ai #llm #open-source
https://github.com/jimwang99/understanding-llama2/tree/main/pytorch
Above GitHub repo is an implementation of LLaMA2 and test-case use TinyStories in PyTorch
Example output
------ tinystories110M ------
Once upon a time, there was a little girl named Lily. She loved to play with her toys, especially her favorite teddy bear. One day, Lily's mommy gave her a big box to play with. Lily was so happy and she jumped up and down with joy.
Lily's mommy said, "Be careful, Lily. Don't break the box." Lily nodded her head and promised to be careful. She opened the box and saw that it was empty. "Mommy, can we fill the box with my toys?" Lily asked.
"Of course, sweetie," her mommy replied. They started to fill the box with all of Lily's toys. Suddenly, Lily's teddy bear fell out of the box and onto the floor. "Oh no! Teddy fell out of the box!" Lily cried.
"Don't worry, Lily. We'll pick him up and put him back in the box," her mommy said. They picked up the teddy bear and put him back in the box. Lily was so happy that her toys were safe in the box and she could play with them again.
------- the end ------