一句话:主张软件工程是负责任 AI 的关键枢纽,并呼吁从构建功能转向发现和管理 AI 系统的涌现功能。
尽管大量高层伦理原则、风险框架和算法保障取得进展,负责任 AI 仍难以落地;与此同时,AI 正颠覆软件工程,使人们必须从不透明的机器学习模型和自然语言提示生成的代码中构建系统级质量与对齐。该演讲分享通过发明新软件工程方法帮助产业实现负责任 AI 的经验,剖析风险孤岛、原则—算法鸿沟等产业挑战,以及需求缺失、涌现属性和系统不透明等研究挑战,主张软件工程是负责任 AI 的关键枢纽。作者进一步提出软件工程需根本性反思:从把功能构建进 AI 系统,转向发现并管理 AI 系统涌现的功能,从而承担从理解人类智能到构建繁荣人—AI 共生等新角色。
From humanity's existential risks to safety risks in critical systems to ethical risks, responsible AI, as the saviour, has become a major research challenge with significant real-world consequences. However, achieving responsible AI remains elusive despite the plethora of high-level ethical principles, risk frameworks and progress in algorithmic assurance. In the meantime, software engineering (SE) is being upended by AI, grappling with building system-level quality and alignment from inscrutable machine learning models and code generated from natural language prompts. The upending poses new challenges and opportunities for engineering AI systems responsibly. This talk will share our experiences in helping the industry achieve responsible AI systems by inventing new SE approaches. It will dive into industry challenges (such as risk silos and principle-algorithm gaps) and research challenges (such as lack of requirements, emerging properties and inscrutable systems) and make the point that SE is the linchpin of responsible AI. But SE also requires some fundamental rethinking - shifting from building functions into AI systems to discovering and managing emerging functions from AI systems. Only by doing so can SE take on critical new roles, from understanding human intelligence to building a thriving human-AI symbiosis.