torch.amp

print(“\n### SECTION D: end-to-end Transformer (vanilla fp32 vs Apex fused + AMP) ###”) VOCAB, D, NHEAD, LAYERS, SEQ, BATCH, STEPS…