adam-optimizer · GitHub Topics

LiyuanLucasLiu / RAdam

On the Variance of the Adaptive Learning Rate and Beyond

optimizer adam adam-optimizer warmup

Python 2.55 k

4 年前

parasdahal / deepnet

Deep learning library in plain Numpy.

cnn dropout adam-optimizer

Python 321

3 年前

SirRob1997 / Crowded-Valley---Results

#计算机科学#This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"

深度学习深度神经网络 adam-optimizer

180

4 年前

tirtharajdash / CS-F425_Deep-Learning

#计算机科学#CS F425 Deep Learning course at BITS Pilani (Goa Campus)

机器学习深度神经网络 generative-model optimisation adam-optimizer 深度学习

Jupyter Notebook 111

4 个月前

YanaiEliyahu / AdasOptimizer

#计算机科学#ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achiev...

optimizer adam adam-optimizer 深度学习 mnist 机器学习

C++ 85

4 年前

aditya9211 / SVHN-CNN

#计算机科学#Google Street View House Number(SVHN) Dataset, and classifying them through CNN

cnn convolutional-neural-networks 机器视觉 convolutional-neural-network confusion-matrix mnist dropout tesnorflow 机器学习 adam-optimizer tensorboard-visualizations

Jupyter Notebook 64

7 年前

nengwp / Lion-vs-Adam

Lion and Adam optimization comparison

adam adam-optimizer

Jupyter Notebook 61

2 年前

v-iashin / CS231n

#计算机科学#PyTorch/Tensorflow solutions for Stanford's CS231n: "CNNs for Visual Recognition"

机器视觉 convolutional-neural-networks 神经网络机器学习 stanford-university backpropagation recurrent-neural-networks lstm style-transfer Generative Adversarial Network Jupyter Notebook Tensorflow adam-optimizer NumPy solutions assignment PyTorch 深度学习

Jupyter Notebook 51

4 年前

yashkant / padam-tensorflow

Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge

optimization Tensorflow Keras adam-optimizer

Python 51

6 年前

sagarvegad / Adam-optimizer

Implemented Adam optimizer in python

adam-optimizer gradient

Python 48

8 年前

shreyansh26 / ML-Optimizers-JAX

#计算机科学#Toy implementations of some popular ML optimizers using Python/JAX

jax optimization-algorithms optimizers 机器学习 gradient-descent adam-optimizer adam momentum

Python 44

4 年前

Arko98 / Gradient-Descent-Algorithms

#计算机科学#A collection of various gradient descent algorithms implemented in Python from scratch

人工智能机器学习深度学习 gradient-descent adam-optimizer

Python 38

2 年前

VivianoRiccardo / Learning-Lab-C-Library

#计算机科学#This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

深度学习神经网络 C Library backpropagation convolutional-layers residual-networks adam-optimizer opencl optimization-algorithms transformer lstm

C 32

2 年前

rdspring1 / Count-Sketch-Optimizers

#计算机科学#A compressed adaptive optimizer for training large-scale deep learning models using PyTorch

adam-optimizer 深度学习神经网络 language-model count-min-sketch hashing imagenet transformer PyTorch

Python 27

6 年前

RudreshVeerkhare / CustomXGBoost

Modified XGBoost implementation from scratch with Numpy using Adam and RSMProp optimizers.

NumPy adam-optimizer gradient-boosting-machine

Jupyter Notebook 26

5 年前

yaricom / TimeSeriesLearning

#计算机科学#The project aimed to implement Deep NN / RNN based solution in order to develop flexible methods that are able to adaptively fillin, backfill, and predict time-series using a large number of heterogen...

深度学习深度神经网络 recurrent-neural-networks rnn adam-optimizer time-series

Python 26

9 年前