A robot control system that understands both visual observations and natural language instructions to decide what actions to take.