In this talk I will give a sample of some of the research done at AWS. In particular I will talk about some recent results in Reinforcement Learning using a combined on-policy and off-policy approach to obtain rapidly converging and sample efficient algorithms. The key idea in this work is to use propensity scoring and effective sample size reweighting to obtain an optimization algorithm that converges rapidly and that takes advantage of a large replay buffer.

Secondly, I will discuss some recent results in multivariate time series prediction. By applying de Finetti’s theorem and causal ordering we are able to obtain a necessary and sufficient characterization of sequence data that consists of a local and global decomposition. The resulting model is computationally efficient and has a high degree of accuracy. Lastly, I will give an update on the D2L.ai project which aims to bring deep learning education to every scientists and engineer.

Bio:
Alex studied physics at the University of Technology in Munich. After a PhD in computer science at the University of Technology in Berlin in 1998 he worked as researcher at the IDA Group of the GMD. He joined the Australian National University in Canberra in 2000 and NICTA in 2004 where he served as group leader and professor until 2008. From 2008 until 2012 he worked at Yahoo Research and subsequently from 2012 until 2014 at Google Research. He has served as adjunct professor at UC Berkeley in 2011-12 and 2019. In addition to that he was full professor at CMU in 2013-17. After founding Marianas Labs in 2015 he moved to Amazon Web Services in 2016 where he currently serves as VP and Distinguished Scientist. Alex has published over 200 papers and 5 books. His research interests cover kernel methods, Bayesian nonparametrics, large scale inference and deep learning.

More Info: https://www.cs.cmu.edu/calendar/mon-2019-09-09-1630/amazon-presentation