ENGR7732 Estimation and Machine Learning

You are viewing an older version of this curriculum item. Select the current year or your commencing year of study from the drop down above. For Pre-2022 Course Rules, use the link located on the right-hand side of the screen.

Overview

How noisy sensor measurements can be interpreted in time? How can autonomous systems (in the virtual or in the real world) use their noisy measurements to learn the best course of actions (policy) to take? This topic teaches how to get robots to incorporate uncertainty into estimating and learning from a dynamic and changing world. Robust estimation techniques are employed to produce values that tend to be closer to the true values of the measurements and their associated calculated values and are an essential part of the development of advanced navigation systems and principles of machine learning (mainly reinforcement learning and deep reinforcement learning) will be applied to optimize the agent's behaviour in its environment. In other words, the syllabus includes probabilistic algorithms, Markov decision processes, Bayesian filtering and reinforcement learning.

Topic availabilities

To view topic availabilities, select an availability from the drop down, towards the top right of the screen.

Tuition pattern

To view tuition patterns, select an availability from the drop down, towards the top right of the screen.

Aims

This topic aims to introduce students to the fundamental principles of theory and practice of estimation and machine learning applied on the interpretation of noisy sensor data from any source. The performance of the sensors, including precision, accuracy, repeatability, sensitivity, linearity and dynamic performance, are analysed. Calibration and estimation techniques are also examined. Reinforcement learning and Deep Reinforcement Learning will be introduced as a means to take the students to the state-of-the-art of modern intelligent systems and sensor interpretation.

Learning outcomes

On completion of this topic you will be expected to be able to:

Understand the principles used by the various instrumentation sensors to determine attitude, position, acceleration, velocity, heading

Analyse the factors affecting measurement performance with respect to navigation sensors

Criticise various design solutions for estimation and machine learning algorithms to be applied in distinct situations

Create experimental frameworks for the various situations investigated

Evaluate the results and outcomes of experiments

Assessments

To view assessment information, select an availability from the drop down, towards the top right of the screen.

Requisites information

Pre-requisites:

Assumed knowledge

Students undertaking the one year honours programs should check to make sure they have the appropriate background from their undergraduate degree/s.

Handbook

Estimation and Machine Learning

ENGR7732

4.5 Units