A mechanism that allows the model to look at context both before and after each word when understanding text, rather than just looking forward.