adam

On the Variance of the Adaptive Learning Rate and Beyond

#安卓#Adam (or adm) is a coroutine-friendly Android Debug Bridge client written in Kotlin

#计算机科学#Learning Rate Warmup in PyTorch

#自然语言处理#ADAM - A Question Answering System. Inspired from IBM Watson

RAdam implemented in Keras & TensorFlow

This is a repo for my master thesis research about the Fusion of Visual SLAM and GPS. It contains the research paper, code and other interesting data.

8-bit systems to ESP32 WiFi Multifunction Firmware

Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and effi...

#计算机科学#A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

#计算机科学#Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch

AdamW optimizer for Keras

A tour of different optimization algorithms in PyTorch.

#计算机科学#ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achiev...

Easy-to-use AdaHessian optimizer (PyTorch)

Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.

Lion and Adam optimization comparison

Easy-to-use linear and non-linear solver

#计算机科学#Toy implementations of some popular ML optimizers using Python/JAX

#自然语言处理#Deep learning projects including applications (face recognition, neural style transfer, autonomous driving, sign language reading, music generation, translation, speech recognition and NLP) and theori...

Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)