Item – Thèses Canada

​
Numéro d'OCLC
1036283824
Lien(s) vers le texte intégral
Exemplaire de BAC
Auteur
Shein, Mariah,
Titre
A spiking neural network of state transition probabilities in model-based reinforcement learning
Diplôme
M. Math -- University of Waterloo, 2017
Éditeur
Waterloo, Ontario, Canada : University of Waterloo, 2017.
Description
1 online resource (xi, 58 pages) :illustrations (some colour)
Notes
"A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics in Computer Science."
Includes bibliographical references (pages 52-58).
Résumé
The development of the field of reinforcement learning was based on psychological studies of the instrumental conditioning of humans and other animals. Recently, reinforcement learning algorithms have been applied to neuroscience to help characterize neural activity and animal behaviour in instrumental conditioning tasks. A specific example is the hybrid learner developed to match human behaviour on a two-stage decision task. This hybrid learner is composed of a model-free and a model-based system. The model presented in this thesis is an implementation of that model-based system where the state transition probabilities and Q-value calculations use biologically plausible spiking neurons. Two variants of the model demonstrate the behaviour when the state transition probabilities are encoded in the network at the beginning of the task, and when these probabilities are learned over the course of the task. Various parameters that affect the behaviour of the model are explored, and ranges of these parameters that produce characteristically model-based behaviour are found. This work provides an important first step toward understanding how a model-based system in the human brain could be implemented, and how this system contributes to human behaviour.
Autre lien(s)
hdl.handle.net
uwspace.uwaterloo.ca
Sujet
Probabilities.
Decision making.
Neural circuitry.
Neural networks (Computer science)
Machine learning.
Reinforcement learning.
Probabilités.
Prise de décision.
Réseaux nerveux.
Réseaux neuronaux (Informatique)
Apprentissage automatique.
Apprentissage par renforcement (Intelligence artificielle)
reinforcement learning
model-based reinforcement learning
spiking neural model
state transition probability
decision task