Neural Feature Fields for Language-Guided Robot Manipulation