EE60013: Estimation of Signals and Systems

Welcome to this PG level course.

  • Class timings: Monday 12:00-12:55, Tuesday: 10:00 - 11:55, Thursday: 08:00-08:55
  • Venue: MS Teams
  • Instructor: Prof. Ashish Hota

Course Content (Tentative)

Here is a basic overview of the topics that are planned to be covered.

  1. Introduction to Probability Theory and Random Variables (2 weeks)
  2. Joint and Conditional Distributions, Conditional Expectation, Limit Theorems (2 weeks)
  3. Static Estimation: Maximum Likelihood Estimation, Maximum Aposteriori Estimation, Minimum Mean Square Estimation, Principle of Orthogonality, Linear Mean Square Estimation (2 week)
  4. Dynamic Estimation: Kalman Filter (2 weeks)
  5. System Identification (2 weeks)
  6. Case Study (1 week)
  7. Optional: Stochastic Processes: Stationarity, Ergodicity, Second-order theory (2 weeks)

Reference Materials

There is no single textbook for this subject. We will discuss a variety of topics from different books. The first reference below will be a standard text for most of the course. You are encouraged to refer the other texts below depending on your interests. Of course there are several advanced texts on probability theory, random processes, estimation theory, statistical signal processing and system identification, but we will mostly be content with the following.

  1. Random Process For Engineers by Bruce Hajek, a preprint of the book is available here.
  2. Stochastic Processes, Estimation and Control by Jason Speyer and Walter Chung. Available in library.
  3. Probability and Random Processes by Geoffrey Grimmett and David Stirzaker. Contains lots of numerical and conceptual problems.
  4. Stochastic Systems: Estimation, Identification, and Adaptive Control by P. R. Kumar and Pravin Variaya. Another classic text.
  5. System Identification: Theory for the User by Lennart Ljung. This is a standard textbook for system identification.