Back to Search

A Tutorial on Thompson Sampling

AUTHOR Kazerouni, Abbas; Van Roy, Benjamin; Russo, Daniel J.
PUBLISHER Now Publishers (07/12/2018)
PRODUCT TYPE Paperback (Paperback)

Description
Thompson sampling is an algorithm for online decision problems where actions are taken sequentially in a manner that must balance between exploiting what is known to maximize immediate performance and investing to accumulate new information that may improve future performance. The algorithm addresses a broad range of problems in a computationally efficient manner and is therefore enjoying wide use. A Tutorial on Thompson Sampling covers the algorithm and its application, illustrating concepts through a range of examples, including Bernoulli bandit problems, shortest path problems, product recommendation, assortment, active learning with neural networks, and reinforcement learning in Markov decision processes. Most of these problems involve complex information structures, where information revealed by taking an action informs beliefs about other actions. It also discusses when and why Thompson sampling is or is not effective and relations to alternative algorithms.
Show More
Product Format
Product Details
ISBN-13: 9781680834703
ISBN-10: 1680834703
Binding: Paperback or Softback (Trade Paperback (Us))
Content Language: English
More Product Details
Page Count: 112
Carton Quantity: 70
Product Dimensions: 6.14 x 0.24 x 9.21 inches
Weight: 0.38 pound(s)
Country of Origin: US
Subject Information
BISAC Categories
Computers | Machine Theory
Descriptions, Reviews, Etc.
publisher marketing
Thompson sampling is an algorithm for online decision problems where actions are taken sequentially in a manner that must balance between exploiting what is known to maximize immediate performance and investing to accumulate new information that may improve future performance. The algorithm addresses a broad range of problems in a computationally efficient manner and is therefore enjoying wide use. A Tutorial on Thompson Sampling covers the algorithm and its application, illustrating concepts through a range of examples, including Bernoulli bandit problems, shortest path problems, product recommendation, assortment, active learning with neural networks, and reinforcement learning in Markov decision processes. Most of these problems involve complex information structures, where information revealed by taking an action informs beliefs about other actions. It also discusses when and why Thompson sampling is or is not effective and relations to alternative algorithms.
Show More
List Price $80.00
Your Price  $79.20
Paperback