paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Prompt Engineering in Software Engineering Education: An Empirical Study of Demand, Supply, and Assessment

软件工程教育中的提示工程:需求、供给与评估的实证研究
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 1/10 · 该论文关注软件工程教育中的提示工程课程需求、供给与评估,属于教育实证研究,与用户画像中的静态分析、Agentic 程序分析、浮点程序分析、贝叶斯程序分析及 LLM/Agent 改进静态分析等核心方向基本无关。虽然涉及提示工程与评估,但并非程序语言或形式化方法研究。引用 0 inbox
Mohamad Kassab
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:通过招聘广告与课程描述的大规模实证三角互证,揭示提示工程能力在产业需求与课程供给间的错配,并提出评估导向建议。

提示工程日益嵌入软件开发实践,但软件工程课程缺乏基于证据的指导,不清楚应优先培养哪些提示相关能力以及如何评估。本文对主要经济体招聘广告中的提示相关职位进行分析,并审计顶尖计算机科学项目的课程描述,对产业需求与课程供给进行大规模实证三角互证。研究发现实践期望与正式教育覆盖之间存在系统性错配:产业需求强调提示设计与评估测试,并重视提示优化、检索增强与编排;大学课程则主要关注提示创建与精炼,对系统评估强调不足。基于三个反复出现的差距,文章提出评估导向的启示,明确可检查的学生制品,如评估测试框架、生命周期文档与安全测试证据,使提示工程能力可按软件工程方式评价,为 LLM 快速扩散下的课程设计与评估提供实证基础。

问题
软件工程课程缺乏关于应优先培养哪些提示工程能力以及如何评估这些能力的证据指导。
方法
对主要经济体招聘广告和顶尖计算机科学项目课程描述进行大规模实证三角互证,分析产业需求与课程供给之间的一致性与错配。
评估
通过识别招聘需求与课程供给间的系统性错配,提炼三个反复出现的差距,并提出基于可检查学生制品的评估建议。
原文摘要(Abstract)

Prompt engineering is increasingly embedded in software development practice, yet software engineering curricula lack evidence-grounded guidance on which prompt-related competencies to prioritize and how to assess them. This paper presents a large-scale empirical triangulation of industry demand and curricular supply for prompt-engineering competencies in software development. By analysing prompt-related job advertisements across major economies and auditing course descriptions from leading computer science programs, we identify systematic mismatches between practice-facing expectations and formal educational coverage. Industry demand consistently emphasizes prompt design alongside evaluation and testing, with strong signals for prompt optimization and a substantial subset of postings highlighting retrieval augmentation and orchestration. In contrast, university curricula predominantly foreground prompt creation and refinement, with limited explicit emphasis on systematic evaluation. Building on this triangulated evidence, we distil three recurring gaps and derive assessment-oriented implications, specifying inspectable student artefacts, such as evaluation harnesses, lifecycle documentation, and safety testing evidence, that allow prompt-engineering competence to be evaluated in software engineering terms. Collectively, the study provides an empirical foundation to inform curriculum design and assessment in software engineering education amid the rapid diffusion of large language models.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{Kassab26,
  title = {Prompt Engineering in Software Engineering Education: An Empirical Study of Demand, Supply, and Assessment},
  author = {Mohamad Kassab},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805788}
}