From the GitHub Readme "The rest of the complexity is just being clever with batching (both across examples and over sequence length) so that training is efficient."
What kind of complexities is he talking about? Is it simply the complexity of having a batch dimension? (compared to more simple single input code)
What kind of complexities is he talking about? Is it simply the complexity of having a batch dimension? (compared to more simple single input code)