... | ... | @@ -32,8 +32,6 @@ The particularity of this given order is that we don't have to fully complete a |
|
|
|
|
|
With everything that has been stated, we can now create the following data flow diagram : !![GPT-2_task_based_model](uploads/0b71cb63f70b983d90c46001bcc29702/GPT-2_task_based_model.png)
|
|
|
|
|
|
![GPT-2_task_based_model-legend](uploads/795fa5f34780b4860c5a2b3a050be977/GPT-2_task_based_model-legend.png)
|
|
|
|
|
|
# First implementation
|
|
|
|
|
|
To begin with, we will put a taskwait between each call of the main training loop. However the rest of the program will be task-based, as shown by the following sketch:
|
... | ... | |