Jiaming Yuan 8bad677c2f
Update collective implementation. (#10152)
* Update collective implementation.

- Cleanup resource during `Finalize` to avoid handling threads in destructor.
- Calculate the size for allgather automatically.
- Use simple allgather for small (smaller than the number of worker) allreduce.
2024-03-30 18:57:31 +08:00
..
2023-10-28 16:33:58 +08:00
2023-10-22 23:33:19 -07:00
2023-10-28 16:33:58 +08:00
2024-03-26 23:26:24 +08:00