TY - JOUR
T1 - Regularization-Based Coflow Scheduling in Optical Circuit Switches
AU - Tan, Haisheng
AU - Zhang, Chi
AU - Xu, Chao
AU - Li, Y P
AU - Han, Zhenhua
AU - Li, Xiang Yang
N1 - Funding Information:
Manuscript received April 25, 2020; revised October 8, 2020 and January 6, 2021; accepted February 4, 2021; approved by IEEE/ACM TRANSACTIONS ON NETWORKING Editor H. Shen. Date of publication February 19, 2021; date of current version June 16, 2021. This work was supported in part by the National Key R&D Program of China under Grant 2018YFB0803400, in part by NSFC under Grant 61772489 and Grant 61751211, in part by the Key Research Program of Frontier Sciences (CAS) under Grant QYZDY-SSW-JSC002, and in part by the project of “FANet: PCL Future Greater-Bay Area Network Facilities for Large-Scale Experiments and Applications under Grant LZC0019. A preliminary version of this work titled “Reco: Efficient Regularization-Based Coflow Scheduling in Optical Circuit Switches” was published in Proc. of the 39th IEEE International Conference on Distributed Computing Systems (ICDCS 2019), Dallas, Texas, USA, July 2019. (Corresponding author: Xiang-Yang Li.) Haisheng Tan, Chi Zhang, Chao Xu, and Xiang-Yang Li are with the LINKE Lab and CAS Key Laboratory of Wireless-Optical Communications, University of Science and Technology of China (USTC), Hefei 230052, China (e-mail: [email protected]; [email protected]; [email protected]; [email protected]).
Publisher Copyright:
© 1993-2012 IEEE.
PY - 2021/6
Y1 - 2021/6
N2 - To improve the application-level data efficiency, the scheduling of coflows, defined as a collection of parallel flows sharing the same objective, is prevailing in recent data centers. Meanwhile, optical circuit switches (OCS) are gradually applied to provide high data rate with low power consumption. However, so far few research outputs have covered the flow, let alone the coflow, scheduling in the context of OCS. In this work, we investigate coflow scheduling in OCS-based data centers. We first derive a novel operation called regularization processed respectively on the flow traffic demands and the flow start times, which can be efficiently implemented and reduce the circuit reconfiguration frequency dramatically. We then propose a 2-approximation algorithm, called Reco-Sin, for single coflow scheduling to minimize the coflow completion time (CCT). For multiple coflows, we derive Reco-Mul to minimize the total weighted CCT, which can transform any non-preemptive multi-coflow scheduling in packet switches to a scheduling scheme in OCS. Reco-Mul can achieve a constant approximation under the assumption that no tiny flows will be transmitted in OCS. To get rid of this assumption, we present another multiple coflow scheduling scheme, named Reco-Mul+, which has an approximation ratio of O(K). Here, K is the total number of coflows. Extensive simulations based on Facebook data traces show that our approaches outperform state-of-the-art schemes significantly, i.e., one single coflow can be finished up to 1.97times faster with Reco-Sin, and multiple coflows can be completed up to more than 2times faster with Reco-Mul and Reco-Mul+.
AB - To improve the application-level data efficiency, the scheduling of coflows, defined as a collection of parallel flows sharing the same objective, is prevailing in recent data centers. Meanwhile, optical circuit switches (OCS) are gradually applied to provide high data rate with low power consumption. However, so far few research outputs have covered the flow, let alone the coflow, scheduling in the context of OCS. In this work, we investigate coflow scheduling in OCS-based data centers. We first derive a novel operation called regularization processed respectively on the flow traffic demands and the flow start times, which can be efficiently implemented and reduce the circuit reconfiguration frequency dramatically. We then propose a 2-approximation algorithm, called Reco-Sin, for single coflow scheduling to minimize the coflow completion time (CCT). For multiple coflows, we derive Reco-Mul to minimize the total weighted CCT, which can transform any non-preemptive multi-coflow scheduling in packet switches to a scheduling scheme in OCS. Reco-Mul can achieve a constant approximation under the assumption that no tiny flows will be transmitted in OCS. To get rid of this assumption, we present another multiple coflow scheduling scheme, named Reco-Mul+, which has an approximation ratio of O(K). Here, K is the total number of coflows. Extensive simulations based on Facebook data traces show that our approaches outperform state-of-the-art schemes significantly, i.e., one single coflow can be finished up to 1.97times faster with Reco-Sin, and multiple coflows can be completed up to more than 2times faster with Reco-Mul and Reco-Mul+.
KW - Approximation Algorithm
KW - Coflow Scheduling
KW - Data centers
KW - Integrated circuit modeling
KW - Optical Circuit Switch
KW - Optical packet switching
KW - Optical switches
KW - Scheduling
KW - Scheduling algorithms
UR - http://www.scopus.com/inward/record.url?scp=85101742658&partnerID=8YFLogxK
U2 - 10.1109/TNET.2021.3058164
DO - 10.1109/TNET.2021.3058164
M3 - Journal article
AN - SCOPUS:85101742658
SN - 1063-6692
VL - 29
SP - 1280
EP - 1293
JO - IEEE/ACM Transactions on Networking
JF - IEEE/ACM Transactions on Networking
IS - 3
M1 - 9359108
ER -