About Me
I’m a PhD student at Boston University, where I’m fortunate to work with Aldo Pacchiano. My primary research interests are Sequential Decision-Making and Statistical Foundations of Continual Learning.
Previously, I received my Bachelor’s degree in Mathematics with a minor in Computer Science from Sharif University of Technology. During my undergrad, I spent two summers at TU Wien and Aalto University as a research intern.
- Sequential Decision Making
- Reinforcement Learning
- Model Selection
-
Ph.D. in Data Science, 2023-Present
Boston University, MA, USA
-
B.Sc. in Applied Mathematics, 2018-2023
Sharif University of Technology, Tehran, Iran
Experience
Courses:
- Reinforcement Learning (Spring 2023)
- Applied Linear Algebra (Spring 2021)
- Mathematical Optimization (Fall 2021)
- Principles of Computer Systems (Fall 2020)
- Computer Networking (Spring 2022)
Papers
We present a model selection framework for Learning Rate-Free Reinforcement Learning that selects the optimal learning rate on the fly during RL training. This approach of adaptive learning rate tuning neither depends on the underlying RL algorithm nor the optimizer and solely uses the reward feedback to select the learning rate; hence, the framework can input any RL algorithm and produce a learning rate-free version of it.
Projects
Contact
- aafshar@bu.edu
- Commonwealth Avenue, Boston, Massachusetts