Competing Large Language Models in Multi-Agent Gaming Environments
Jen-tse Huang, Eric John Li, Man Ho Lam, Tian Liang, Wenxuan Wang (Corresponding), Youliang Yuan, Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Michael R. Lyu
ICLR, 2025
| arXiv | code |

Apathetic or Empathetic? Evaluating LLMs' Emotional Alignment with Humans
Jen-tse Huang, Man Ho Lam, Eric John Li, Shujie Ren, Wenxuan Wang (Corresponding), Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
NeurIPS, 2024
| arXiv | code |

On the Reliability of Psychological Scales on Large Language Models
Jen-tse Huang, Wenxiang Jiao, Man Ho Lam, Eric John Li, Wenxuan Wang (Corresponding), Michael R. Lyu
EMNLP Main, 2024
| arXiv | code |

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models
Yuxuan Wan*, Wenxuan Wang*, Yiliu Yang, Youliang Yuan, Jen-tse Huang, Pinjia He, Wenxiang Jiao, Michael R. Lyu
EMNLP Main, 2024
| arXiv | code |

New Job, New Gender? Measuring the Social Bias in Image Generation Models
Wenxuan Wang, Haonan Bai, Jen-tse Huang, Yuxuan Wan, Youliang Yuan, Haoyi Qiu, Nanyun Peng, Michael R. Lyu
[Oral 174/4385 3.97%] ACMMM, 2024
| arXiv | code |

Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models
Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, Michael R. Lyu
ACL Main, 2024
| arXiv |

All Languages Matter: On the Multilingual Safety of Large Language Models
Wenxuan Wang, Zhaopeng Tu, Chang Chen, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
ACL Findings, 2024
| arXiv | code |

On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs
Jen-tse Huang, Wenxuan Wang, Eric John Li, Man Ho Lam, Shujie Ren, Youliang Yuan, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
[Oral 86/7404 1.16%] ICLR, 2024
| arXiv | code |

GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Pinjia He, Shuming Shi, Zhaopeng Tu
ICLR, 2024
| arXiv | code |

An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software
Wenxuan Wang, Jingyuan Huang, Jen-tse Huang, Chang Chen, Jiazhen Gu, Pinjia He, Michael R. Lyu
ASE, 2023
| arXiv |

Validating Multimedia Content Moderation Software via Semantic Fusion
Wenxuan Wang, Jingyuan Huang, Chang Chen, Jiazhen Gu, Jianping Zhang, Weibin Wu, Pinjia He, Michael Lyu
ISSTA, 2023
| arXiv | code |

MTTM: Metamorphic Testing for Textual Content Moderation Software
Wenxuan Wang, Jen-tse Huang, Weibin Wu, Jianping Zhang, Yizhan Huang, Shuqing Li, Pinjia He, Michael Lyu
ICSE, 2023
| arXiv | code |

BiasAsker: Measuring the Bias in Conversational AI System
Yuxuan Wan*, Wenxuan Wang*, Pinjia He, Jiazhen Gu, Haonan Bai, Michael Lyu
FSE, 2023
| arXiv | code |

Improving the Transferability of Adversarial Samples by Path-Augmented Method
Jianping Zhang, Jen-tse Huang, Wenxuan Wang, Yichen Li, Weibin Wu, Xiaosen Wang, Yuxin Su, Michael R. Lyu
CVPR, 2023
| arXiv |

ParroT: Translating During Chat Using Large Language Models tuned with Human Translation and Feedback
Wenxiang Jiao, Jen-tse Huang, Wenxuan Wang, Zhiwei He, Tian Liang, Xing Wang, Shuming Shi, Zhaopeng Tu
EMNLP Findings, 2023
| arXiv | code |

Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation
Wenxuan Wang, Wenxiang Jiao, Yongchang Hao, Xing Wang, Shuming Shi, Zhaopeng Tu, Michael Lyu
ACL Main, 2022
| arXiv |

Improving Adversarial Transferability via Neuron Attribution-Based Attacks
Jianping Zhang, Weibin Wu, Jen-tse Huang, Yizhan Huang, Wenxuan Wang, Yuxin Su, Michael R. Lyu
CVPR, 2022
| arXiv | code |

Rethinking the Value of Transformer Components
Wenxuan Wang, Zhaopeng Tu
COLING, 2020
| arXiv |

FPETS : Fully Parallel End-to-End Text-to-Speech System
Dabiao Ma*, Zhiba Su*, Wenxuan Wang*, Yuhao Lu
[Oral 200/7737 2.59%] AAAI, 2020
| arXiv |

VisFactor: Benchmarking Fundamental Visual Cognition in Multimodal Large Language Models
Jen-tse Huang, Dasen Dai, Jen-yuan Huang, Youliang Yuan, Xiaoyuan Liu, Wenxuan Wang (Corresponding), Wenxiang Jiao, Pinjia He, Zhaopeng Tu
arXiv, 2025
| arXiv | code |

Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
Wenxuan Wang, Xiaoyuan Liu, Kuiyi Gao, Jen-tse Huang, Youliang Yuan, Pinjia He, Shuai Wang, Zhaopeng Tu
arXiv, 2025
| arXiv |

VLMs as GeoGuessr Masters: Exceptional Performance, Hidden Biases, and Privacy Risks
Jingyuan Huang, Jen-tse Huang, Ziyi Liu, Xiaoyuan Liu, Wenxuan Wang (Corresponding), Jieyu Zhao
arXiv, 2025
| arXiv | code |

Fact-or-Fair: A Checklist for Behavioral Testing of AI Models on Fairness-Related Queries
Jen-tse Huang, Yuhang Yan, Linqi Liu, Yixin Wan, Wenxuan Wang (Corresponding), Kai-Wei Chang, Michael R Lyu
arXiv, 2025
| arXiv | code |

Insight Over Sight? Exploring the Vision-Knowledge Conflicts in Multimodal LLMs
Xiaoyuan Liu, Wenxuan Wang, Youliang Yuan, Jen-tse Huang, Qiuzhi Liu, Pinjia He, Zhaopeng Tu
arXiv, 2024
| arXiv | code |

Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step
Wenxuan Wang, Kuiyi Gao, Zihan Jia, Youliang Yuan, Jen-tse Huang, Qiuzhi Liu, Shuai Wang, Wenxiang Jiao, Zhaopeng Tu
arXiv, 2024
| arXiv |

Learning to Ask: When LLMs Meet Unclear Instruction
Wenxuan Wang, Juluan Shi, Chaozheng Wang, Cheryl Lee, Youliang Yuan, Jen-tse Huang, Michael R. Lyu
arXiv, 2024
| arXiv |

On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents
Jen-tse Huang, Jiaxu Zhou, Tailin Jin, Xuhui Zhou, Zixi Chen, Wenxuan Wang (Corresponding), Youliang Yuan, Michael R. Lyu, Maarten Sap
arXiv, 2024
| arXiv | code |

Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Jiahao Xu, Tian Liang, Pinjia He, Zhaopeng Tu
arXiv, 2024
| arXiv | code |

The Earth is Flat? Unveiling Factual Errors in Large Language Models
Wenxuan Wang, Juluan Shi, Zhaopeng Tu, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
arXiv, 2024
| arXiv |

Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine
Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Xing Wang, Shuming Shi, Zhaopeng Tu
arXiv, 2023
| arXiv | code |