Thanks for this post, Suki Lau. It served me as a great reference while I was working on a problem using Adam optimization.