About Me
I’m a PhD student of Computing & Data Sciences at Boston University, where I work with Prof. Aldo Pacchiano. My primary research interest is Sequential Decision-Making with a focus on Reinforcement Learning, Model Selection, and Foundation Models.
Previously, I received my Bachelor’s degree in Applied Mathematics with a minor in Computer Science from Sharif University of Technology. During my undergraduate studies, I was fortunate to collaborate with Prof. Mojtaba Tefagh, Prof. Radu Grosu, and Prof. Antti Oulasvirta.
- Sequential Decision Making
- Reinforcement Learning
- Foundation Models
-
Ph.D. in Data Science, 2023-Present
Boston University, MA, USA
-
B.Sc. in Applied Mathematics, 2018-2023
Sharif University of Technology, Tehran, Iran
Experience
Courses:
- Reinforcement Learning (Spring 2023)
- Applied Linear Algebra (Spring 2021)
- Mathematical Optimization (Fall 2021)
- Principles of Computer Systems (Fall 2020)
- Computer Networking (Spring 2022)
Papers
We present a model selection framework for Learning Rate-Free Reinforcement Learning that selects the optimal learning rate on the fly during RL training. This approach of adaptive learning rate tuning neither depends on the underlying RL algorithm nor the optimizer and solely uses the reward feedback to select the learning rate; hence, the framework can input any RL algorithm and produce a learning rate-free version of it.
Projects
Contact
- aafshar@bu.edu
- Commonwealth Avenue, Boston, Massachusetts