Title: | Efficient All-to-All Broadcast Schemes in Distributed-memory Parallel Computer |
Authors: | Eunseuk Oh, Iyad A. Kanj |
Abstract: | Distributed-memory parallel computers refers to parallel
computers in which each processor has its own private memory. In such a system, processors communicate by message passing via inter-connected network. One of important method to share distributed data is broadcasting. All-to-all broadcasting is the process that each processor broadcasts its distinct message to all other processors and receives different messages from all other processors. We investigate two all-to-all communication costs: time and message to measure the performance on the considered distributed-memory parallel model. We develop efficient communication scheme to reduce not only the communication times but also the minimal number of messages under the model with the half-duplex and full-duplex communication capability. The measurement is compared with the known bounds to verify the efficiency of the suggested scheme. |
Full Paper: | [ps] |