Markov Decision Processes, Approximate Dynamic Programming, Reinforcement Learning, Deep Learning, Scientific Machine Learning, Nonlinear System Identifications, Federated Learning, Renewable Energies and Large Language Models
I am a Machine Learning and Data Scientist at
Max Planck Institute of Geoanthropology, Jena, Germany. Prior to that I
was at Max Planck Institute for Dynamics of Technical complex Systems,
Magdeburg, Germany and Helmholtz Center for Environmental Research,
Leipzig, Germany.
My Area
of expertise are Machine Learning, Large Language Models, Sparse
Identification of Non linear Dynamical Systems, Physic Informed Neural
Network, Stochastic Dynamic Programming, Deep Reinforcement Learning,
Markov Decision Processes, Approximate Dynamic Programming,
Reinforcement Learning, Multi-layer Networks, Graph Mining, Compressive
Sampling, Network Control System, Wind Turbine Control Systems, even
though not limited to the mentioned subjects.
I have been
developing MATLAB, and Python platforms based on my PhD thesis and
Postdoc projectsfor the Markov Decision Processes(MDP), Approximate
Dynamic Programming, Model Predictive Control MDP, and Reinforcement
Learning problems since 2015. Moreover, on my recent role at Max Planck
Institute and Helmholtz Center I worked on Physique Informed Neural
Network and Sparse Identification of Nonlinear Dynamical System (ODEs
and PDEs), Asynchronous Federated Learning, Reinforcement Learning and
Approximate Dynamic Programming, and application of Machine Learning and
LLM for renewable energies.
I
have more than 3 years of industrial experience in the field of control
and instrumentation. Moreover, I have been active in research since
2011 at various places such as Niroo Research Institute(Iran),
University of Sannio (Italy), University of Salerno (Italy), Maynooth
University (Ireland), Max Planck Institute (Germany), Helmholtz Center
for Environmental Research (Germany) .
My Github repository is at: https://github.com/Ali-Forootani
My Website: https://aliforootani.com/
