Jiaming Yuan 8bad677c2f
Update collective implementation. (#10152)
* Update collective implementation.

- Cleanup resource during `Finalize` to avoid handling threads in destructor.
- Calculate the size for allgather automatically.
- Use simple allgather for small (smaller than the number of worker) allreduce.
2024-03-30 18:57:31 +08:00
..
2024-03-26 23:26:24 +08:00
2024-03-26 23:26:24 +08:00
2024-03-26 23:26:24 +08:00
2023-08-24 05:29:52 +08:00
2024-03-26 23:26:24 +08:00
2024-03-26 23:26:24 +08:00
2024-03-26 23:26:24 +08:00
2022-09-21 18:06:50 +08:00
2024-03-26 23:26:24 +08:00
2024-03-26 23:26:24 +08:00
2023-03-01 00:39:06 +08:00
2024-03-26 23:26:24 +08:00
2020-08-12 01:26:02 -07:00