AI & Learning
Reinforcement Learning · Learning-Based Control · Imitation Learning · Deep Learning
Autonomous Systems · Robotics · AI
I'm Wenliang Zhang, a researcher and engineer working on motion planning, control, simulation, and machine learning for autonomous systems.
Skills
Optimisation-based planning and control, state estimation, simulation, and learning-based methods for safety-critical autonomous systems.
Reinforcement Learning · Learning-Based Control · Imitation Learning · Deep Learning
Motion Planning · Model Predictive Control · Trajectory Tracking · State Estimation
Autonomous Driving · Robotics · Decision-Making · Safety-Critical Systems
Physical Modelling · Digital Validation · Co-Simulation · Real-Time Optimisation
A closed-loop workflow: validation feeds back into models, objectives, and assumptions.
Physical and learned representations at the fidelity required for prediction, design, and real-time decisions.
Modelica · Dymola · CarSim / TruckSim · CarMakerMotion, trajectory, and decision problems formulated with safety, progress, energy, and comfort.
CasADi · acados · rockit · Gurobi · IpoptConstraint-aware control and state estimation that turn planned motion into closed-loop behaviour.
MPC · OCP · MHE · EKF / UKFReinforcement learning that complements physical structure and improves adaptation.
RL · DL · Learning Control · leap-c · PyTorchRepeatable scenarios and evidence that expose closed-loop strengths, limits, and trade-offs.
Scenario Design · Co-Simulation · FMI / FMU · PythonNonlinear MPCTrajectory PlanningCasADiWheel-Slip ControlCombined-Slip ModellingModel-Based RLDynamic ModelNeural Tyre ResidualsTrajectory OptimisationTorque VectoringMPCCOCPNeural NetworksTrajectory GenerationTransformer-Based ModelsAutonomous RacingModelicaHPIPMModel ValidationYaw Stability ControlDriving Simulator StudiesLinear Tyre ModelsSteer-by-WirePyTorchState EstimationClosed-Loop EvaluationAgent Behaviour ModellingSingle-Track ModelAgentic CodingFMI / FMUState EstimationReinforcement LearningRobust / Adaptive ControlImitation LearningPath FollowingIpoptEKF / UKFSafety GuaranteesInterior-Point MethodsSafety-Constrained ControlFour-Wheel SteeringRide & HandlingPythonMCP ServersCarSim / TruckSimLoad Transfer AnalysisTyre Parameter IdentificationBehaviour PlanningKinematic ModelHPMPCMPCToolsSignal ProcessingEmbedded OptimisationPhysics-Informed Data GenerationAutonomous SystemsScenario Designleap-cscikit-learnSIL / HIL TestingNumerical OptimisationAutomated Evaluation WorkflowsAutonomous DrivingFault ToleranceNumPyODE / DAEMATLAB / SimulinkOver-Actuated VehiclesMulti-Objective OptimisationCollision AvoidanceABS / ESC / TCSrockitActive CamberElectric VehiclesReal-Time OptimisationReal-Time Decision MakingClaude Code / CodexMotion PlanningMHERoboticsModel EvaluationLearning-Based ControlMulti-Agent OrchestrationPrompt EngineeringMotion ComfortYALMIPqpOASESBrush Tyre ModelSim-to-Real ValidationLimit-Handling ManoeuvresDouble-Track ModelTyre ModellingGurobiSideslip ControlQuadratic ProgrammingEnergy-Efficient ControlMultibody DynamicsSensor FusionMPCOptimal ControlNonlinear ProgrammingMagic Formula Tyre ModelBehaviour CloningCarMakerActive SafetyEnd-to-End LearningSafety-Critical SystemsVehicle DynamicsDymolaacadosDigital ValidationFMU-Based Co-SimulationReward ShapingDeep LearningTrajectory Tracking
Projects
Problems, methods, and results from current and completed projects.
Current Research Direction
Combining model predictive control with reinforcement learning for motion planning and control—learned policies under safety constraints, with real-time feasibility and interpretability as design requirements.
Research Project · 2026 — 2027
Contributing to a Chalmers research project on robust control and safety guarantees for over-actuated autonomous electric vehicles—failsafe behaviour and control allocation under degraded actuators.
Research Project · 2023 — 2025
Principal investigator at KTH for an industry-linked project on multi-criteria motion control of automated electric vehicles—treating safety, energy, comfort, and travel time as coupled design objectives, validated on a test vehicle.
Engineering Infrastructure
Built dynamic models and FMU-based co-simulation workflows—closed-loop evaluation of models, algorithms and scenarios before physical testing.
Demos
Videos from an over-actuated autonomous electric vehicle platform, showing how vehicle dynamics, optimisation, and learning-based control behave in daily driving and handling limits.
Open-ended and closed-circuit roads are generated in the same representation the MPC reads: curvature, width, slope, banking, and friction. Rule-based layouts can be refined by a VAE or diffusion model. The road extends only slightly beyond the prediction horizon for long-running closed-loop and preview testing.
View Post and Discussion on LinkedInDouble lane change, slalom, steady-state circular, step steer, and accelerate-then-brake, each driven closed-loop by an MPC controller. Per-wheel suspension makes the body roll, pitch, and heave visible, and the physics, control, 3D rendering, and tyre sound all run on open-source Python packages.
View Post and Discussion on LinkedInThe MPC holds a steady-state drift for a 50-metre circle at roughly 19° sideslip, with visible counter-steering in a 3D model with per-wheel suspension.
View Post and Discussion on LinkedInFields of 50 and 100 learned drivers—each car a checkpoint from one reinforcement learning run—show state-dependent MPC weights, ranked by lap time from still-learning to polished performance.
View Post and Discussion on LinkedInOptuna uses Bayesian optimisation to tune 18 fixed MPC configurations, creating distinct controller personalities that trade off grip, rotation, and lap time through torque vectoring.
View Post and Discussion on LinkedInExperience
Research, teaching, and supervision roles, with multi-partner projects throughout.
Chalmers University of Technology, Gothenburg, Sweden
Motion planning and control combining MPC with RL under safety constraints. Co-supervising a PhD student and a M.Sc. thesis on learning-based control; supervised a nine-student bachelor's project that built a small-scale over-actuated car, from hardware to algorithm.
KTH Royal Institute of Technology, Stockholm, Sweden
Led multi-partner research on multi-criteria motion control, energy-efficient trajectory planning, and motion-comfort evaluation.
KTH Royal Institute of Technology, Stockholm, Sweden
Developed planning, control, and simulation methods for over-actuated autonomous electric vehicles; taught the M.Sc. course Applied Vehicle Dynamics Control and supervised industry-proposed thesis and project teams.
IEEE Transactions and international journals
Reviewed 30+ papers on autonomous driving, vehicle control, and learning-based methods for venues including IEEE Transactions on Vehicular Technology and Vehicle System Dynamics.
KTH Royal Institute of Technology, Stockholm, Sweden
Research on vehicle dynamics, active safety, optimal control, state estimation, and FMU-based co-simulation for over-actuated autonomous electric vehicles.
Contributions
Peer-reviewed papers and invited talks from the research; open-source tools and articles from the engineering and writing practice alongside it.
Change task status and append timestamped text for context.
Workflow State · Interaction DesignBridge notes with Todoist tasks while preserving the rich context tasks came from.
Context Preservation · IntegrationCurate a list of important tags as meaningful entry points to a knowledge base.
Information Retrieval · CurationSend tasks, blocks, and notes to canvas files as plain text, links, and embeds.
Visual Thinking · Information ArchitectureMaintain note links automatically when splitting or reorganising notes.
Change Safety · RefactoringSelected from 12 open-source Obsidian plugins I developed for PTKM.
Safety-assured control, learning-based method, scenario generation, and reproducible simulation.