Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

[ICLR 2021] HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pytorch/Tensorflow, single-machine/distributed, synchronized/asynchronous.

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

Nerlnet is a framework for research and development of distributed machine learning models on IoT

Python module for simulating gossip learning.

[NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training

🔨 使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程

vector quantization for stochastic gradient descent.

The code of AAAI-21 paper titled "Defending against Backdoors in Federated Learning with Robust Learning Rate".

Atomo: Communication-efficient Learning via Atomic Sparsification

🔨 A Flexible Federated Learning Simulator for Heterogeneous and Asynchronous.

Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab

Implementation of asynchronous federated learning in flower.

A PS ML training architecture with p4 programmable switches.

A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).

[NeurIPS 2022] GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations

Distributed Neural Networks Training

[DCC 2020] DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression

Chimera is a Python package for distributed machine learning.