Introduce all_reduce_hook to support gradient aggregation across replica groups.#7764
Closed
zhengchenyu wants to merge 3 commits intodeepspeedai:masterfrom
Closed
Introduce all_reduce_hook to support gradient aggregation across replica groups.#7764zhengchenyu wants to merge 3 commits intodeepspeedai:masterfrom
zhengchenyu wants to merge 3 commits intodeepspeedai:masterfrom
