Best Practices for Text-Classification with Distillation Part (3/4) – Word Order Sensitivity (WOS)

In this post, I introduce a metric for estimating the complexity level of your dataset and task, and I describe how to utilize it to optimize distillation performance.