Experimentation in the Operating System: The Windows Experimentation Platform
2月 10, 2021 | 12:00 - 1:00 上午 (UTC) 國際標準時間
準備好開始使用 AI 和最新技術嗎? Microsoft Reactor 提供活動、訓練和社群資源,協助開發人員、企業家和初創公司建置 AI 技術等等。 加入我們!
Experimentation in the Operating System: The Windows Experimentation Platform
2月 10, 2021 | 12:00 - 1:00 上午 (UTC) 國際標準時間
準備好開始使用 AI 和最新技術嗎? Microsoft Reactor 提供活動、訓練和社群資源,協助開發人員、企業家和初創公司建置 AI 技術等等。 加入我們!
Experimentation in the Operating System: The Windows Experimentation Platform
2月 10, 2021 | 12:00 - 1:00 上午 (UTC) 國際標準時間
主題: DevSecOps 和開發人員工具
語言: 英文
Online controlled experiments are the gold standard for evaluating improvements and accelerating innovations in online and app worlds. However, little is known about applicability, implementation, and efficacy of experimentation for operating systems (OS), where many features are non-user-facing. In this paper, we present the Windows Experimentation platform (WExp), and insights from implementation and execution of real-world experiments in the OS. We start by discussing the need for experimentation in OS, using real experiments to illustrate the benefits. We then describe the architecture of WExp, focusing on unique considerations in its engineering. Finally, we discuss learnings and challenges from conducting real-world experiments.
Our experiences and insights can motivate practitioners to start experimenting as well as to help them to successfully build their experimentation platforms. The learnings can also guide experimenters with best-practices and highlight promising avenues for future research.
Speaker: Mary Hu, Senior Data Scientist, Microsoft
Mary Hu is a data science lead for Windows Experimentation Platform at Microsoft. She has been working as a data scientist on the Connected Service and Experiences Data Team for five years, with a primary focus on running randomized control trials for various types of features in the operating system to ensure end users have a good experience with Windows.