Wearable Cognitive Assistance (WCA) applications present a challenge to benchmark and characterize due to their human-in-the-loop nature. Employing user testing to optimize system parameters is generally not feasible, given the scope of the problem and the number of observations needed to detect small but important effects in controlled experiments. Considering the intended mass-scale deployment of WCA applications in the future, there exists a need for tools enabling human-independent benchmarking. We present in this paper the first model for the complete end-to-end emulation of humans in WCA. We build this model through statistical analysis of data collected from previous work in this field, and demonstrate its utility by studying application task durations. Compared to first-order approximations, our model shows a ~36% larger gap between step execution times at high system impairment versus low. We further introduce a novel framework for stochastic optimization of resource consumption-responsiveness tradeoffs in WCA, and show that by combining this framework with our realistic model of human behavior, significant reductions of up to 50% in number processed frame samples and 20% in energy consumption can be achieved with respect to the state-of-the-art.
翻译:使用用户测试以优化系统参数,以优化系统参数,一般来说不可行,因为问题的范围以及发现受控实验中小型但重要影响所需的观测量。考虑到未来大规模部署WCA应用的预期规模,有必要制定能够确定人类独立基准的工具。我们在本文件中提出了在WCA中完全模拟人类的端到端模式。我们通过对该领域以往工作中收集的数据进行统计分析来建立这一模型,并通过研究应用任务期限来证明它的效用。与一阶近似相比,我们的模型显示,在高度系统缺陷和低水平的阶段执行时间之间差距高达36%。我们进一步引入了一个新的框架,以对WCA中的资源消费反应权衡进行随机优化,并表明,通过将这一框架与我们现实的人类行为模式相结合,可以显著地将经过处理的框架样本数量减少到50%,能源消费20%可以实现。