Deep neural networks lack fundamental capabilities necessary for learning to reason. We will make fundamental changes to existing neural network models that are capable of variable-binding ; a requirement for reasoning and something that conventional neural network models are incapable of. We envision these fundamental changes will support deep learning methods that can solve more complex and generalizable tasks.