This research project is in the area of Reinforcement Learning and AI for Programming Education. Given that programming tasks are open-ended and conceptual, novice students often struggle when learning to program. AI-driven tutors hold great promise in automatically assisting and teaching novice students. The project will focus on developing technology for machine-assisted teaching in open-ended domains by bridging reinforcement learning, cognitive science, and symbolic reasoning.