Pavlov

Navigation Menu
  • archive
  • about
  • contact

Contextual

Multi-armed bandits in R

Interactive Bandits

Code, Contextual, Lablog, R, Research, Statistics • March 2, 2019 • Robin van Emden

To help students get a better feel for three of the most popular “multi-armed bandit” exploration/exploitation balancing strategies (Epsilon Greedy, Thompson Sampling, and Upper Confidence Bound), I combined my R package “contextual” with the versatile …

StreamingBandit; Experimenting with Bandit Policies

Code, Contextual, Lablog, Python • September 9, 2018 • Robin van Emden

A paper I have been coauthoring and co-developing with Jules Kruijswijk, Petri Parvinen and Maurits Kaptein has just been accepted at the Journal of Statistical Software. The paper, “StreamingBandit: Experimenting with Bandit Policies” describes one of …

Shrinkage in Contextual Bandits with Dependent Observations

Code, Contextual, Lablog, Multi Armed Bandits, R, Research, Statistics • April 1, 2018 • Robin van Emden

Jules Kruijswijk (first author), Maurits Kaptein and Florian Böing-Messing and I have recently been working on a paper on the application of partial pooling (or shrinkage) models in (contextual) multi-armed bandit problems: The (contextual) multi-armed …

R Development Presentation

Code, Contextual, R • March 29, 2018 • Robin van Emden

Slides from my recent presentation at the biweekly “Computational Personalisation” lab meeting – an outline of R Package Development, based on my experience in developing the R package “Contextual“. How to create an R package …

StreamingBandit UI

Code, Contextual, ES6, Javascript, Lablog, React, Research, Statistics • February 23, 2018 • Robin van Emden

Recently, I have completed a Javascript (ES6, React, and Material Design) admin application for “StreamingBandit”, a Python server that helps setting up and running online streaming (contextual) bandit experiments. This management front-end makes it very easy …

At the Jheronimus Academy of Data Science

Contextual, Lablog, Minds, Psychology, Research, Technology, Writing • September 5, 2017 • Robin van Emden

I am happy to announce that I have been accepted as a researcher at the Jheronimus Academy of Data Science! In a nutshell, this means that I am now allowed to travel to beautiful ‘s-Hertogenbosch …

Copyright 2018 | Robin van Emden | Pavlov.tech