The goal of this project is to build an improved speech language model for conversational English that explores non-local lexical dependencies between words.