Biography
Education
Experience
-
Graduate Research Assistant, Tennessee Technological University, Cookeville, Tennessee, USA (Spring 2023 – Present)
HVAC Systems, Game-Theoretic Reinforcement Learning
Designed a reinforcement learning-based control framework for multi-agent graphical games to optimize HVAC systems and Quanser Cars (Q-Cars), handling non-zero-sum scenarios using data-driven strategies.
Proposed a data-driven Q-learning method to optimize energy usage and comfort in HVACs. Results validated against generalized algebraic Riccati equations (GAREs). Published in Journal of Systems Science and Complexity, 2025.
Developed a model-free Q-learning controller to handle disturbances and unknown dynamics in HVACs, achieving effective thermal control through optimal mass flow and temperature adjustment.
-
Manager (Research and Development), Project Management Organization (Expert Engineering), Rawalpindi, Pakistan (June 2013 – Aug 2022)
Electrical / Electronics Projects
Led a 10-member team to produce power cables, harnesses, and UPS units. Boosted output by 15% while meeting stringent quality standards.
Developed an auto-throttle controller for diesel tractor engines using PIC microcontrollers, fully automating RPM control.
Engineered a 28V 420A DC power distribution system with <1% operational troubleshooting during real-world deployment.
Optimized HVAC boiler control, cutting electrical consumption by 11% and saving approximately 0.27 million PKR per month.
Technical Skills
Related Coursework: Machine Learning Specialization (Regression and Classification, Advanced Learning Algorithms and Unsupervised Learning, Recommenders, Reinforcement Learning), Optimal Control, Adaptive and Reinforcement Learning Control, Linear Control System, Nonlinear Control, Digital Control, and Multivariable Control
Programming Languages: C/C++, MATLAB, Python, ROS 1, Verilog HDL
Design and Analysis Tools: SCADA, Simulink, LabVIEW, ETAP, PSPICE, Proteus, ROS I, MPLAB, Embedded C Programming, AutoCAD, Gazebo, Zuken (PCB Design), OpenCV, HTML, Verilog, PLC Programming,
QUARC (Real Time Control Software), LaTeX, localization, mapping, planning, and controls
|