Presentation
Spec2Plan: A Robust LLM-Powered Framework for Verification Plan Generation and Evaluation
DescriptionVerification planning is a critical but highly time and effort consuming stage in modern hardware design flows, requiring engineers to interpret lengthy and complex specifications to derive comprehensive and high-quality verification plans. Moreover, manual plan authoring is an error-prone process that can lead to extended verification cycles and reducing productivity. We present Spec2Plan, a structured LLM-driven framework for generating detailed, coverage-oriented, and robust verification plans directly from hardware specifications. Spec2Plan combines four key components: (i) coverage-guided prompting, (ii) two-pass plan-and-generate strategy, (iii) testing techniques injection and (iv) iterative coverage refinement loop to generate robust verification plans. To assess plan quality, we developed a cross-LLM-validation framework that evaluates four key aspects: specification coverage, expert-plan alignment, testing methodology robustness, and plan redundancy. Experiments on six OpenTitan IP blocks demonstrate that Spec2Plan significantly improves in all above metrics when compared to a one-pass prompting baseline. These results establish Spec2Plan as a practical step toward trustworthy and automation-ready verification planning that can be seamlessly integrated into downstream verification workflows.
Event Type
Work in Progress
TimeMonday, July 276:40pm - 6:41pm PDT
LocationExhibit Hall