Show simple item record

dc.contributor.authorKoltunova, Veronika
dc.date.accessioned2013-01-21 19:46:56 (GMT)
dc.date.available2013-01-21 19:46:56 (GMT)
dc.date.issued2013-01-21T19:46:56Z
dc.date.submitted2013-01-10
dc.identifier.urihttp://hdl.handle.net/10012/7222
dc.description.abstractContext information on a smart phone can be used to tailor applications for specific situations (e.g. provide tailored routing advice based on location, gas prices and traffic). However, typical context-aware smart phone applications use very limited context information such as user identity, location and time. In the future, smart phones will need to decide from a wide range of sensors to gather information from in order to best accommodate user needs and preferences in a given context. In this thesis, we present a model for active sensor selection within decision-making processes, in which observational features are selected based on longer-term impact on the decisions made by the smart phone. This thesis formulates the problem as a partially observable Markov decision process (POMDP), and proposes a non-myopic solution to the problem using a state of the art approximate planning algorithm Symbolic Perseus. We have tested our method on a 3 small example domains, comparing different policy types, discount factors and cost settings. The experimental results proved that the proposed approach delivers a better policy in the situation of costly sensors, while at the same time provides the advantage of faster policy computation with less memory usage.en
dc.language.isoenen
dc.publisherUniversity of Waterlooen
dc.subjectActive Sensingen
dc.subjectSmart Sensor Selectionen
dc.subjectPOMDPen
dc.subjectMarkov Decision Processen
dc.subjectProbabilityen
dc.subjectUtilityen
dc.subjectSensoren
dc.subjectNetworksen
dc.titleActive Sensing for Partially Observable Markov Decision Processesen
dc.typeMaster Thesisen
dc.pendingfalseen
dc.subject.programComputer Scienceen
uws-etd.degree.departmentSchool of Computer Scienceen
uws-etd.degreeMaster of Mathematicsen
uws.typeOfResourceTexten
uws.peerReviewStatusUnrevieweden
uws.scholarLevelGraduateen


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record


UWSpace

University of Waterloo Library
200 University Avenue West
Waterloo, Ontario, Canada N2L 3G1
519 888 4883

All items in UWSpace are protected by copyright, with all rights reserved.

DSpace software

Service outages