GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Pinjia He*, Shuming Shi, Zhaopeng Tu.
ICLR'24: International Conference on Learning Representations
Selected/Recent Publications
Testing Graph Database Systems via Equivalent Query Rewriting
Qiuyang Mang+, Aoyang Fang+, Boxi Yu, Hanfei Chen, Pinjia He*.
ICSE'24: International Conference on Software Engineering
DivLog: Log Parsing with Prompt Enhanced In-Context Learning
Junjielong Xu, Ruichun Yang, Yintong Huo, Chengyu Zhang, Pinjia He*.
ICSE'24: International Conference on Software Engineering
An Exploratory Investigation of Log Anomalies in Unmanned Aerial Vehicles
Dinghua Wang, Shuqing Li, Guanping Xiao, Yepang Liu, Yulei Sui, Pinjia He*, Michael R. Lyu.
ICSE'24: International Conference on Software Engineering
Deep Learning or Classical Machine Learning? An Empirical Study on Log-Based Anomaly Detection
Boxi Yu, Jiayi Yao, Qiuai Fu, Zhiqing Zhong, Haotian Xie, Yaoliang Wu, Yuchi Ma, Pinjia He*.
ICSE'24: International Conference on Software Engineering
UniLog: Automatic Logging via LLM and In-Context Learning
Junjielong Xu, Ziang Cui, Yuan Zhao, Xu Zhang, Shilin He, Pinjia He, Liqun Li, Yu Kang, Qingwei Lin, Yingnong Dang, Saravan Rajmohan, Dongmei Zhang.
ICSE'24: International Conference on Software Engineering
Hue: A User-Adaptive Parser for Hybrid Logs
Junjielong Xu, Qiuai Fu, Zhouruixing Zhu, Yutong Cheng, Zhijing Li, Yuchi Ma, Pinjia He*.
ESEC/FSE'23: Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection
Yintong Huo, Yichen Li, Yuxin Su, Pinjia He, Zifan Xie, Michael R. Lyu.
ASE'23: International Conference on Automated Software Engineering
An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software
Wenxuan Wang, Jingyuan Huang, Jen-tse Huang, Chang Chen, Jiazhen Gu, Pinjia He, Michael R. Lyu.
ASE'23: International Conference on Automated Software Engineering
Automated Testing and Improvement of Named Entity Recognition Systems
Boxi Yu, Yiyan Hu, Qiuyang Mang, Wenhan Hu, Pinjia He*.
ESEC/FSE'23: Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
BiasAsker: Measuring the Bias in Conversational AI System
Yuxuan Wan, Wenxuan Wang, Pinjia He, Jiazhen Gu, Haonan Bai, Michael R. Lyu.
ESEC/FSE'23: Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
ROME: Testing Image Captioning Systems via Recursive Object Melting
Boxi Yu, Zhiqing Zhong, Jiaqi Li, Yixing Yang, Shilin He, Pinjia He*.
ISSTA'23: International Symposium on Software Testing and Analysis
Validating Multimedia Content Moderation Software via Semantic Fusion
Wenxuan Wang, Jingyuan Huang, Chang Chen, Jiazhen Gu, Jianping Zhang, Weibin Wu, Pinjia He*, Michael R. Lyu.
ISSTA'23: International Symposium on Software Testing and Analysis
MTTM: Metamorphic Testing for Textual Content Moderation Software
Wenxuan Wang, Jen-tse Huang, Weibin Wu, Jianping Zhang, Yizhan Huang, Shuqing Li, Pinjia He*, Michael R. Lyu.
ICSE'23: International Conference on Software Engineering
AEON: A Method for Automatic Evaluation of NLP Test Cases
Jen-tse Huang, Jianping Zhang, Wenxuan Wang, Pinjia He*, Yuxin Su, Michael R. Lyu.
ISSTA'22: International Symposium on Software Testing and Analysis
Automated Testing of Image Captioning Systems
Boxi Yu, Zhiqing Zhong, Xinran Qin, Jiayi Yao, Yuancheng Wang, Pinjia He*.
ISSTA'22: International Symposium on Software Testing and Analysis
SanRazor: Reducing Redundant Sanitizer Checks in C/C++ Programs
Jiang Zhang, Shuai Wang, Manuel Rigger, Pinjia He, Zhendong Su.
OSDI'21: USENIX Symposium on Operating Systems Design and Implementation
A Survey on Automated Log Analysis for Reliability Engineering
Shilin He, Pinjia He*, Zhuangbin Chen, Tianyi Yang, Yuxin Su, Michael R. Lyu.
CSUR'21: ACM Computing Surveys
Testing Machine Translation via Referential Transparency
Pinjia He, Clara Meister, Zhendong Su.
ICSE'21: International Conference on Software Engineering
Machine Translation Testing via Pathological Invariance
Shashij Gupta, Pinjia He*, Clara Meister, Zhendong Su.
ESEC/FSE'20: Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
Structure-Invariant Testing for Machine Translation
Pinjia He, Clara Meister, Zhendong Su.
ICSE'20: International Conference on Software Engineering
Logzip: Extracting Hidden Structures via Iterative Clustering for Log Compression
Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He*, Zibin Zheng, Michael R. Lyu.
ASE'19: International Conference on Automated Software Engineering
Characterizing the Natural Language Descriptions in Software Logging Statements
Pinjia He, Zhuangbin Chen, Shilin He, Michael R. Lyu.
ASE'18: International Conference on Automated Software Engineering
Towards Automated Log Parsing for Large-Scale Log Data Analysis
Pinjia He, Jieming Zhu, Shilin He, Jian Li, Michael R. Lyu.
TDSC'18: IEEE Transactions on Dependable an Secure Computing
Drain: An Online Log Parsing Approach with Fixed Depth Tree
Pinjia He, Jieming Zhu, Zibin Zheng, Michael R. Lyu.
ICWS'17: International Conference on Web Services
Experience Report: System Log Analysis for Anomaly Detection
Shilin He, Jieming Zhu, Pinjia He, Michael R. Lyu.
ISSRE'16: International Symposium on Software Reliability Engineering
Most Influential Paper Award
* Corresponding Author, + Equal Contribution
Complete list: [Google Scholar][DBLP]