WADIFF: A Differential Testing Framework for WebAssembly Runtimes

Shiyao Zhou; Muhui Jiang; Wemin Chen; Hao Zhou; Haoyu Wang; Xiapu Luo

WADIFF: A Differential Testing Framework for WebAssembly Runtimes

Shiyao Zhou, Muhui Jiang, Wemin Chen, Hao Zhou, Haoyu Wang, Xiapu Luo

Department of Computing

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

WebAssembly (Wasm) runtime provides a virtual machine that can execute the WebAssembly modules and is widely used in different areas (e.g., browsers, edge computing, blockchain). Thus, the precision and reliability of the WebAssembly runtime are important and deserve our attention. To ensure the correctness and detect potential bugs in WebAssembly runtimes, we propose WADIFF, a differential testing framework, which consists of a sufficient test case generator and a deterministic differential testing engine. To evaluate the effectiveness of WADIFF, we apply it to seven popular WebAssembly runtimes and found 417 inconsistent instructions due to bugs and different implementations in the runtimes. Furthermore, we identify 21 bugs from 7 WebAssembly runtimes, and 8 of them are confirmed by their developers.

Original language	English
Title of host publication	2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)
Publication status	Published - Sept 2023

Cite this

@inproceedings{3390125647ea4ff89108971be0221f36,

title = "WADIFF: A Differential Testing Framework for WebAssembly Runtimes",

abstract = "WebAssembly (Wasm) runtime provides a virtual machine that can execute the WebAssembly modules and is widely used in different areas (e.g., browsers, edge computing, blockchain). Thus, the precision and reliability of the WebAssembly runtime are important and deserve our attention. To ensure the correctness and detect potential bugs in WebAssembly runtimes, we propose WADIFF, a differential testing framework, which consists of a sufficient test case generator and a deterministic differential testing engine. To evaluate the effectiveness of WADIFF, we apply it to seven popular WebAssembly runtimes and found 417 inconsistent instructions due to bugs and different implementations in the runtimes. Furthermore, we identify 21 bugs from 7 WebAssembly runtimes, and 8 of them are confirmed by their developers.",

author = "Shiyao Zhou and Muhui Jiang and Wemin Chen and Hao Zhou and Haoyu Wang and Xiapu Luo",

year = "2023",

month = sep,

language = "English",

booktitle = "2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)",

}

TY - GEN

T1 - WADIFF: A Differential Testing Framework for WebAssembly Runtimes

AU - Zhou, Shiyao

AU - Jiang, Muhui

AU - Chen, Wemin

AU - Zhou, Hao

AU - Wang, Haoyu

AU - Luo, Xiapu

PY - 2023/9

Y1 - 2023/9

N2 - WebAssembly (Wasm) runtime provides a virtual machine that can execute the WebAssembly modules and is widely used in different areas (e.g., browsers, edge computing, blockchain). Thus, the precision and reliability of the WebAssembly runtime are important and deserve our attention. To ensure the correctness and detect potential bugs in WebAssembly runtimes, we propose WADIFF, a differential testing framework, which consists of a sufficient test case generator and a deterministic differential testing engine. To evaluate the effectiveness of WADIFF, we apply it to seven popular WebAssembly runtimes and found 417 inconsistent instructions due to bugs and different implementations in the runtimes. Furthermore, we identify 21 bugs from 7 WebAssembly runtimes, and 8 of them are confirmed by their developers.

AB - WebAssembly (Wasm) runtime provides a virtual machine that can execute the WebAssembly modules and is widely used in different areas (e.g., browsers, edge computing, blockchain). Thus, the precision and reliability of the WebAssembly runtime are important and deserve our attention. To ensure the correctness and detect potential bugs in WebAssembly runtimes, we propose WADIFF, a differential testing framework, which consists of a sufficient test case generator and a deterministic differential testing engine. To evaluate the effectiveness of WADIFF, we apply it to seven popular WebAssembly runtimes and found 417 inconsistent instructions due to bugs and different implementations in the runtimes. Furthermore, we identify 21 bugs from 7 WebAssembly runtimes, and 8 of them are confirmed by their developers.

M3 - Conference article published in proceeding or book

BT - 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)

ER -

WADIFF: A Differential Testing Framework for WebAssembly Runtimes

Abstract

Fingerprint

Cite this