Fri 19 Jul 2024 10:30 - 11:00 at Lounge - Poster Session 4

Deep learning (DL) is a critical tool for real-world applications, and comprehensive testing of DL models is vital to ensure their quality before deployment. However, recent studies have shown that even subtle deviations in DL operators can result in catastrophic consequences, underscoring the importance of rigorous testing of these components. Unlike testing other DL system components, operator analysis poses unique challenges due to complex inputs and uncertain outputs. The existing DL operator testing approach has limitations in terms of testing efficiency and error localization. In this paper, we propose Meta, a novel operator testing framework based on metamorphic testing that automatically tests and assists bug location based on metamorphic relations (MRs). Meta distinguishes itself in three key ways: (1) it considers both parameters and input tensors to detect operator errors, enabling it to identify both implementation and precision errors; (2) it uses MRs to guide the generation of more effective inputs (i.e., tensors and parameters) in less time; (3) it assists the precision error localization by tracing the error to the input level of the operator based on MR violations. We designed 21 metamorphic relations (MRs) for testing 10 widely used DL operators. To assess the effectiveness of our proposed Meta, we conducted experiments on 9 released versions of 5 popular DL libraries. Our results revealed that Meta successfully detected 32 bugs, including 14 new ones that were reported to the respective platforms and partially confirmed. Additionally, Meta demonstrated high efficiency, outperforming the baseline by detecting x~1.89 times more errors while only requiring x~ 0.5 times the cost of the baseline.

Fri 19 Jul

Displayed time zone: Brasilia, Distrito Federal, Brazil change

10:30 - 11:00
Poster Session 4Posters at Lounge
10:30
30m
Poster
Understanding the Impact of APIs Behavioral Breaking Changes on Client Applications
Posters
Dhanushka Jayasuriya University of Auckland, Valerio Terragni University of Auckland, Jens Dietrich Victoria University of Wellington, Kelly Blincoe University of Auckland
10:30
30m
Poster
Your Code Secret Belongs to Me: Neural Code Completion Tools Can Memorize Hard-coded Credentials
Posters
Yizhan Huang The Chinese University of Hong Kong, Yichen LI The Chinese University of Hong Kong, Weibin Wu Sun Yat-sen University, Jianping Zhang The Chinese University of Hong Kong, Michael Lyu The Chinese University of Hong Kong
10:30
30m
Poster
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large Language Models
Posters
Yan Wang Central University of Finance and Economics, Xiaoning Li Central University of Finance and Economics, Tien N. Nguyen University of Texas at Dallas, Shaohua Wang Central University of Finance and Economics, Chao Ni School of Software Technology, Zhejiang University, Ling Ding Central University of Finance and Economics
10:30
30m
Poster
PyRadar: Towards Automatically Retrieving and Validating Source Code Repository Information for PyPI Packages
Posters
Kai Gao University of Science and Technology Beijing, Weiwei Xu Peking University, Wenhao Yang Peking University, Minghui Zhou Peking University
10:30
30m
Poster
"The Law Doesn’t Work Like a Computer": Exploring Software Licensing Issues Faced by Legal Practitioners
Posters
Nathan Wintersgill William & Mary, Trevor Stalnaker William & Mary, Laura A. Heymann William & Mary, Oscar Chaparro William & Mary, Denys Poshyvanyk William & Mary
10:30
30m
Poster
RavenBuild: Context, Relevance, and Dependency Aware Build Outcome Prediction
Posters
Gengyi Sun University of Waterloo, Sarra Habchi Ubisoft Montréal, Shane McIntosh University of Waterloo
10:30
30m
Poster
MirrorFair: Fixing Fairness Bugs in Machine Learning Software via Counterfactual Predictions
Posters
Ying Xiao King's College London / Southern University of Science and Technology, Jie M. Zhang King's College London, Yepang Liu Southern University of Science and Technology, Mohammad Reza Mousavi King's College London, Sicen Liu Southern University of Science and Technology, Dingyuan Xue Southern University of Science and Technology
10:30
30m
Poster
Do Code Generation Models Think Like Us? - A Study of Attention Alignment between Large Language Models and Human Programmers
Posters
Bonan Kou Purdue University, Shengmai Chen Purdue University, Zhijie Wang University of Alberta, Lei Ma The University of Tokyo & University of Alberta, Tianyi Zhang Purdue University
10:30
30m
Poster
Dependency-Induced Waste in Continuous Integration: An Empirical Study on NPM Dependencies
Posters
Nimmi Weeraddana University of Waterloo, Mahmoud Alfadel University of Waterloo, Shane McIntosh University of Waterloo
10:30
30m
Poster
A Miss Is as Good as A Mile: Metamorphic Testing for Deep Learning Operators
Posters
Jinyin Chen Zhejiang University of Technology, Chengyu Jia Zhejiang University of Technology, Yunjie Yan Zhejiang University of Technology, Jie Ge Zhejiang University of Technology, haibin zheng Zhejiang University of Technology, Yao Cheng TÜV SÜD Asia Pacific Pte. Ltd.
10:30
30m
Poster
Investigating Documented Privacy Changes in Android OS
Posters
Chuan Yan University of Queensland, Mark Huasong Meng National University of Singapore, Fuman Xie University of Queensland, Guangdong Bai University of Queensland
10:30
30m
Poster
Analyzing Quantum Programs with LintQ: A Static Analysis Framework for Qiskit
Posters
Matteo Paltenghi University of Stuttgart, Michael Pradel University of Stuttgart
10:30
30m
Poster
Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions
Posters
Tao Xiao Nara Institute of Science and Technology, Hideaki Hata Shinshu University, Christoph Treude Singapore Management University, Kenichi Matsumoto Nara Institute of Science and Technology
10:30
30m
Poster
Bloat beneath Python's Scales: A Fine-Grained Inter-Project Dependency Analysis
Posters
Georgios-Petros Drosos ETH Zurich, Thodoris Sotiropoulos ETH Zurich, Diomidis Spinellis Athens University of Economics and Business & Delft University of Technology, Dimitris Mitropoulos University of Athens

Information for Participants
Fri 19 Jul 2024 10:30 - 11:00 at Lounge - Poster Session 4
Info for room Lounge:

This room is conjoined with the Foyer to provide additional space for the coffee break, and hold poster presentations throughout the event.