distributed-deep-learning

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

#计算机科学#Distributed Keras Engine, Make Keras faster with only one line of code.

#计算机科学#Learn applied deep learning from zero to deployment using TensorFlow 1.8+

A Portable C Library for Distributed CNN Inference on IoT Edge Clusters

Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.

#计算机科学#sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

Distributed training of DNNs • C++/MPI Proxies (GPT-2, GPT-3, CosmoFlow, DLRM)

#计算机科学#RocketML Deep Neural Networks

#计算机科学#SHADE: Enable Fundamental Cacheability for Distributed Deep Learning Training

Intel® End-to-End AI Optimization Kit

Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k communication volume which is asymptotically optimal) with the d...

#计算机科学#🚨 Prediction of the Resource Consumption of Distributed Deep Learning Systems

#计算机科学#TensorFlow (1.8+) Datasets, Feature Columns, Estimators and Distributed Training using Google Cloud Machine Learning Engine

#计算机科学#Decentralized Asynchronous Training on Heterogeneous Devices

Eager-SGD is a decentralized asynchronous SGD. It utilizes novel partial collectives operations to accumulate the gradients across all the processes.

#自然语言处理#Scalable NLP model fine-tuning and batch inference with Ray and Anyscale

WAGMA-SGD is a decentralized asynchronous SGD based on wait-avoiding group model averaging. The synchronization is relaxed by making the collectives externally-triggerable, namely, a collective can be...

#计算机科学#Java based Convolutional Neural Network package running on Apache Spark framework

#计算机科学#This repository contains the implementation of a wide variety of Deep Learning Projects in different applications of computer vision, NLP, federated, and distributed learning. These projects include u...

#计算机科学#Distributed deep learning framework based on pytorch/numba/nccl and zeromq.