TY - GEN
T1 - ENTS: An Edge-native Task Scheduling System for Collaborative Edge Computing
AU - Zhang, Mingjin
AU - Cao, Jiannong
AU - Yang, Lei
AU - Zhang, Liang
AU - Sahni, Yuvraj
AU - Jiang, Shan
N1 - Funding Information:
IX. ACKNOWLEDGEMENT This work was supported by the Research Institute for Artificial Intelligence of Things, The Hong Kong Polytechnic University, HK RGC Research Impact Fund No. R5060-19, and General Research Fund No. PolyU 15220020.
Publisher Copyright:
© 2022 IEEE.
PY - 2023/1
Y1 - 2023/1
N2 - Collaborative edge computing (CEC) is an emerging paradigm enabling sharing of the coupled data, computation, and networking resources among heterogeneous geo-distributed edge nodes. Recently, there has been a trend to orchestrate and schedule containerized application workloads in CEC, while Kubernetes has become the de-facto standard broadly adopted by the industry and academia. However, Kubernetes is not preferable for CEC because its design is not dedicated to edge computing and neglects the unique features of edge nativeness. More specifically, Kubernetes primarily ensures resource provision of workloads while neglecting the performance requirements of edge-native applications, such as throughput and latency. Furthermore, Kubernetes neglects the inner dependencies of edge-native applications and fails to consider data locality and networking resources, leading to inferior performance. In this work, we design and develop ENTS, the first edge-native task scheduling system, to manage the distributed edge resources and facilitate efficient task scheduling to optimize the performance of edge-native applications. ENTS extends Kubernetes with the unique ability to collaboratively schedule computation and networking resources by comprehensively considering job profile and resource status. We showcase the superior efficacy of ENTS with a case study on data streaming applications. We mathematically formulate a joint task allocation and flow scheduling problem that maximizes the job throughput. We design two novel online scheduling algorithms to optimally decide the task allocation, bandwidth allocation, and flow routing policies. The extensive experiments on a real-world edge video analytics application show that ENTS achieves 43% -220% higher average job throughput compared with the state-of-the-art.
AB - Collaborative edge computing (CEC) is an emerging paradigm enabling sharing of the coupled data, computation, and networking resources among heterogeneous geo-distributed edge nodes. Recently, there has been a trend to orchestrate and schedule containerized application workloads in CEC, while Kubernetes has become the de-facto standard broadly adopted by the industry and academia. However, Kubernetes is not preferable for CEC because its design is not dedicated to edge computing and neglects the unique features of edge nativeness. More specifically, Kubernetes primarily ensures resource provision of workloads while neglecting the performance requirements of edge-native applications, such as throughput and latency. Furthermore, Kubernetes neglects the inner dependencies of edge-native applications and fails to consider data locality and networking resources, leading to inferior performance. In this work, we design and develop ENTS, the first edge-native task scheduling system, to manage the distributed edge resources and facilitate efficient task scheduling to optimize the performance of edge-native applications. ENTS extends Kubernetes with the unique ability to collaboratively schedule computation and networking resources by comprehensively considering job profile and resource status. We showcase the superior efficacy of ENTS with a case study on data streaming applications. We mathematically formulate a joint task allocation and flow scheduling problem that maximizes the job throughput. We design two novel online scheduling algorithms to optimally decide the task allocation, bandwidth allocation, and flow routing policies. The extensive experiments on a real-world edge video analytics application show that ENTS achieves 43% -220% higher average job throughput compared with the state-of-the-art.
KW - bandwidth allocation
KW - distributed computing
KW - Edge computing
KW - edge-native
KW - task scheduling
UR - http://www.scopus.com/inward/record.url?scp=85145681305&partnerID=8YFLogxK
U2 - 10.1109/SEC54971.2022.00019
DO - 10.1109/SEC54971.2022.00019
M3 - Conference article published in proceeding or book
AN - SCOPUS:85145681305
T3 - Proceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022
SP - 149
EP - 161
BT - Proceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 7th IEEE/ACM Symposium on Edge Computing, SEC 2022
Y2 - 5 December 2022 through 8 December 2022
ER -