Exploring the Reasoning Depth of Small Language Models in Software Architecture: A Multidimensional Evaluation Framework Towards Software Engineering 2.0

Ha Vo, Nhut Tran, Khang Vo, Phat T. Tran-Truong, Son Ha

A multidimensional framework benchmarking 10 state-of-the-art Small Language Models (SLMs) on their reasoning capabilities for Architectural Decision Records generation, analyzing the trade-offs between model size, context windows, and performance.