|
|
|||||||||||||||||
Course Catalog 2013-2014
ASE-7516 Dynamic Planning with Incomplete Information, 5 cr |
Additional information
The course will be lectured in every second year.
Suitable for postgraduate studies
Person responsible
Risto Ritala
Lessons
| Study type | P1 | P2 | P3 | P4 | Summer | Implementations | Lecture times and places |
|
|
|
|
|
|
|
|
|
Requirements
Exam and exercise work.
Learning Outcomes
This course expresses the planning problem as discrete-time dynamic programming with both action and information channel degrees of freedom. Problems studied include both discrete state and continuous state systems. Is capable (grade 3/5) 1. To formulate the control of the system and the selection of the information channels as a partially observable Markov decision process (POMDP) problem. 2. To produce approximate solutions to POMDP problems and to assess their suboptimality. 3. To explain the opportunities of approximate dynamic programming with POMDPs when system models are uncertain.
Content
| Content | Core content | Complementary knowledge | Specialist knowledge |
| 1. | Concurrent planning action on system and selection of information channels. | ||
| 2. | Partially observable Markov decision process (POMDP). | ||
| 3. | Solving dynamic programming problem for linear-quadratic-Gaussian POMDP. | ||
| 4. | Solving dynamic programming problem for discrete state POMDP | ||
| 5. | Dealing with model uncertainties by applying approximated dynamic programming methods. |
Instructions for students on how to achieve the learning outcomes
Exam and exercise work.
Assessment scale:
Numerical evaluation scale (1-5) will be used on the course
Study material
| Type | Name | Author | ISBN | URL | Edition, availability, ... | Examination material | Language |
| Lecture slides | No | Suomi |
Prerequisites
| Course | Mandatory/Advisable | Description |
| ASE-5030 Optimaalinen mallipohjainen estimointi ja ennustaminen | Advisable | 1 |
| ASE-5036 Optimal Estimation and Prediction Based on Models | Advisable | 1 |
| ASE-5050 Optimoiva ja robusti säätö Matlabilla | Advisable | 2 |
| ASE-5056 Optimal and Robust Control with Matlab | Advisable | 2 |
1 . Alternative options.
2 . Alternative options.
Prerequisite relations (Requires logging in to POP)
Correspondence of content
| Course | Corresponds course | Description |
|
|
|
More precise information per implementation
| Implementation | Description | Methods of instruction | Implementation |
| Lectures |
Contact teaching: 0 % Distance learning: 0 % Self-directed learning: 0 % |