It lets BERT use both left and right context to predict each word, producing more fluent summaries.