Optimal self-driven sampling for estimation based on value of information

Touraj Soleymani, Sandra Hirche, John S. Baras

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

18 Scopus citations

Abstract

Consider an observer (reporter) who desires to inform optimally a distant agent regarding a physical stochastic process in the environment while the directed communication of the observer to the agent has a price. We define a metric, from a task oriented perspective, for the information transferred from the observer to the agent. We develop a framework for optimizing an augmented cost function which is a convex combination of the transferred information and the paid price over a finite horizon. We suppose that the decision making takes place inside a source encoder, and that the sampling schedule is the decision variable. Moreover, we assume that no measurement at the current time is available to the observer for the decision making. We derive the optimal self-driven sampling policy using dynamic programming, and we show that this policy corresponds to a self-driven sampling policy based on a quantity that is in fact the value of information at each time instant. In addition, we use a semi-definite programming relaxation to provide a suboptimal sampling policy. Numerical and simulation results are presented for a simple unstable system.

Original languageEnglish
Title of host publication2016 13th International Workshop on Discrete Event Systems, WODES 2016
EditorsChristos G. Cassandras, Alessandro Giua, Alessandro Giua, Zhiwu Li
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages183-188
Number of pages6
ISBN (Electronic)9781509041909
DOIs
StatePublished - 22 Jun 2016
Event13th International Workshop on Discrete Event Systems, WODES 2016 - Xi'an, China
Duration: 30 May 20161 Jun 2016

Publication series

Name2016 13th International Workshop on Discrete Event Systems, WODES 2016

Conference

Conference13th International Workshop on Discrete Event Systems, WODES 2016
Country/TerritoryChina
CityXi'an
Period30/05/161/06/16

Keywords

  • Approximate Dynamic Programming
  • Estimation
  • Self-Driven Sampling
  • Value of Information

Fingerprint

Dive into the research topics of 'Optimal self-driven sampling for estimation based on value of information'. Together they form a unique fingerprint.

Cite this