Skip to content
GitLab
Projects
Groups
Topics
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Register
Sign in
Toggle navigation
Menu
tchatela
llm.c - GPT2
Wiki
Distributed Model
Distributed Model
· Changes
Page history
Update Distributed Model
authored
Sep 18, 2024
by
tchatela
Show whitespace changes
Inline
Side-by-side
Distributed-Model.md
View page @
4a7b477f
...
...
@@ -159,4 +159,4 @@ With B=16, T=1024, 1 rank/socket
| 8 | 2 | 7421 ms | 1104 | 4.9 |
| 16 | 4 | 15084 ms | 1086 | 4.9 |
| 32 | 8 | 31649 ms | 1035 | 4.6 |
| 64 | 16 |
| |
|
| 64 | 16 |
68377 | 958.4 | 4.3
|