Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

Sukjong Ha; Jingjing Zhang; Osvaldo Simeone; Joonhyuk Kang

doi:10.1109/ISIT.2019.8849507

Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

Sukjong Ha, Jingjing Zhang, Osvaldo Simeone, Joonhyuk Kang

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

27 Scopus citations

Abstract

Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which the distributed processors, operating on generally distinct coded data, are connected via shared wireless channels accessed via full-duplex transmission. The study accounts for both wireless and computing impairments, including interference, imperfect Channel State Information, and straggling processors, and it assumes a Map-Shuffle-Reduce coded computing paradigm. The total latency of the system, obtained as the sum of computing and communication delays, is studied for different shuffling strategies revealing the interplay between distributed computing, coding, and cooperative or coordinated transmission.

Original language	English (US)
Title of host publication	2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	2649-2653
Number of pages	5
ISBN (Electronic)	9781538692912
DOIs	https://doi.org/10.1109/ISIT.2019.8849507
State	Published - Jul 2019
Event	2019 IEEE International Symposium on Information Theory, ISIT 2019 - Paris, France Duration: Jul 7 2019 → Jul 12 2019

Publication series

Name	IEEE International Symposium on Information Theory - Proceedings
Volume	2019-July
ISSN (Print)	2157-8095

Conference

Conference	2019 IEEE International Symposium on Information Theory, ISIT 2019
Country/Territory	France
City	Paris
Period	7/7/19 → 7/12/19

All Science Journal Classification (ASJC) codes

Theoretical Computer Science
Information Systems
Modeling and Simulation
Applied Mathematics

Access to Document

10.1109/ISIT.2019.8849507

Cite this

Ha, S., Zhang, J., Simeone, O., & Kang, J. (2019). Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI. In 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings (pp. 2649-2653). Article 8849507 (IEEE International Symposium on Information Theory - Proceedings; Vol. 2019-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISIT.2019.8849507

Ha, Sukjong ; Zhang, Jingjing ; Simeone, Osvaldo et al. / Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI. 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 2649-2653 (IEEE International Symposium on Information Theory - Proceedings).

@inproceedings{d5b4872a0ca64300998949e688d7814f,

title = "Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI",

abstract = "Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which the distributed processors, operating on generally distinct coded data, are connected via shared wireless channels accessed via full-duplex transmission. The study accounts for both wireless and computing impairments, including interference, imperfect Channel State Information, and straggling processors, and it assumes a Map-Shuffle-Reduce coded computing paradigm. The total latency of the system, obtained as the sum of computing and communication delays, is studied for different shuffling strategies revealing the interplay between distributed computing, coding, and cooperative or coordinated transmission.",

author = "Sukjong Ha and Jingjing Zhang and Osvaldo Simeone and Joonhyuk Kang",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 2019 IEEE International Symposium on Information Theory, ISIT 2019 ; Conference date: 07-07-2019 Through 12-07-2019",

year = "2019",

month = jul,

doi = "10.1109/ISIT.2019.8849507",

language = "English (US)",

series = "IEEE International Symposium on Information Theory - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "2649--2653",

booktitle = "2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings",

address = "United States",

}

Ha, S, Zhang, J, Simeone, O & Kang, J 2019, Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI. in 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings., 8849507, IEEE International Symposium on Information Theory - Proceedings, vol. 2019-July, Institute of Electrical and Electronics Engineers Inc., pp. 2649-2653, 2019 IEEE International Symposium on Information Theory, ISIT 2019, Paris, France, 7/7/19. https://doi.org/10.1109/ISIT.2019.8849507

Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI. / Ha, Sukjong; Zhang, Jingjing; Simeone, Osvaldo et al.
2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 2649-2653 8849507 (IEEE International Symposium on Information Theory - Proceedings; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

AU - Ha, Sukjong

AU - Zhang, Jingjing

AU - Simeone, Osvaldo

AU - Kang, Joonhyuk

PY - 2019/7

Y1 - 2019/7

N2 - Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which the distributed processors, operating on generally distinct coded data, are connected via shared wireless channels accessed via full-duplex transmission. The study accounts for both wireless and computing impairments, including interference, imperfect Channel State Information, and straggling processors, and it assumes a Map-Shuffle-Reduce coded computing paradigm. The total latency of the system, obtained as the sum of computing and communication delays, is studied for different shuffling strategies revealing the interplay between distributed computing, coding, and cooperative or coordinated transmission.

AB - Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which the distributed processors, operating on generally distinct coded data, are connected via shared wireless channels accessed via full-duplex transmission. The study accounts for both wireless and computing impairments, including interference, imperfect Channel State Information, and straggling processors, and it assumes a Map-Shuffle-Reduce coded computing paradigm. The total latency of the system, obtained as the sum of computing and communication delays, is studied for different shuffling strategies revealing the interplay between distributed computing, coding, and cooperative or coordinated transmission.

UR - http://www.scopus.com/inward/record.url?scp=85073149420&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073149420&partnerID=8YFLogxK

U2 - 10.1109/ISIT.2019.8849507

DO - 10.1109/ISIT.2019.8849507

M3 - Conference contribution

AN - SCOPUS:85073149420

T3 - IEEE International Symposium on Information Theory - Proceedings

SP - 2649

EP - 2653

BT - 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2019 IEEE International Symposium on Information Theory, ISIT 2019

Y2 - 7 July 2019 through 12 July 2019

ER -

Ha S, Zhang J, Simeone O, Kang J. Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI. In 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 2649-2653. 8849507. (IEEE International Symposium on Information Theory - Proceedings). doi: 10.1109/ISIT.2019.8849507

Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this