其他2022ris.utwente.nl
使用 Proctorio 进行在线监考的有效性研究（2021）
On the efficacy of online proctoring using Proctorio (2021)
进阶 · 约 40 分钟读完前置知识：在线考试与评估制度、浏览器/进程监控与逆向基础、实证实验设计
导读
这篇论文（特文特大学，2021）考察在线监考工具 Proctorio 的实际有效性：这类远程监考软件究竟在多大程度上能防范考试作弊，又带来了哪些成本。HN 上的讨论基本围绕“监考软件是不是安全剧场”展开，读者从制度激励和技术实现两个角度质疑其效果。
HN 关注点：在线监考究竟是真正保障考试诚信，还是把责任转嫁给外部厂商的“安全剧场”；以及闭卷限时这种考核形式本身是否已经过时。
HN 评论精选
这几条评论里：支持 1 补充 2 亲历 1
补充监考软件的真实功能是转移责任，而不是防作弊。
这类工具的目的并不是防止作弊。就像大多数 DRM 方案一样，它的作用和请外部顾问一样：让学校管理层可以把可能发生的作弊相关责任推给第三方，一旦被质疑，就可以回答“我们已经采取了合理可靠的技术措施来保证考试诚信”。考试诚信是否真被保证并不重要，因为开发这种“保姆软件”的公司公开承担了责任，或者通过责任分摊，校方和厂商可以互相指责，责任就像往常一样凭空消失了。大多数“安全剧场”都是如此。只要公众不知道自己被欺骗，就会把这种说法奉为圭臬，不再深究。而正如预期，世界在没有真正安全的情况下照常运转，因为系统对一定程度的自私、小规模的违规（比如考试作弊）通常是鲁棒的，只要没人受到伤害就一切安好。
liminalsunset查看英文原文
The purpose of these kinds of tools isn't to prevent cheating. Just like most DRM schemes, the purpose of these tools is the same as any other external consultant - so that the administration or people in charge of the school can offload the responsibilities related to any cheating that may happen to an external party, and if questioned, can respond that "reasonably secure technical measures have been taken to guarantee the integrity of the exam". Whether the integrity of the exams is actually guaranteed is immaterial, because the company that made the nanny software went on the record and took responsibility, and/or by splitting the responsibility, the school admin and the nanny software vendor can point fingers at each other and the responsibility essentially disappears like it usually does. You can see this with most other security theater type things. As long the "general public" is unaware that they have been lied to, they will accept this kind of positioning as gospel, and not look into it further. For the most part, as expected, the world turns around just fine without real security because systems tend to be robust to a certain level of bad actors doing selfish and small scale bad things like exam cheating, and as long as nobody's feelings are hurt, it's all fine.
补充闭卷限时考试已过时，应转向开卷和项目式评估。
通过闭卷、限时考试来衡量能力的传统做法正在迅速过时。过去在实地工作中，实践知识和死记硬背同样难以获得，所以二者地位大致相当；如今情况已经改变，死记硬背的知识随手一搜就能找到。我希望看到更多考试转向开卷模式，允许考生使用一切资源，就像实际工作那样。当然，这会增加组织难度，因为学校不能再反复复用旧题——它们迟早会出现在网上。总体而言，越来越多的评估会从考试转向基于项目的评估，我认为后者在考察技能方面更优越。看看旧形式还能撑多久。
Aperocky查看英文原文
The traditional methods of measuring competence via a closed-book, fixed time test is being rapidly dated. Practical knowledge and rote memorization have held mostly equal status, since out in the field both used to be inaccessible. Our tests are still structured around this, however the reality has moved on and rote memorization is now easily a search away. I like to see more tests moving to open-book model where test takers are allowed to use all resources, as in work. Of course, this will be harder to administer because schools can't just reuse tests over and over again since they're bound to show up in the internet. Overall, more and more of evaluations will move from testing altogether into some project based evaluation, which I believe is superior in terms of accessing skill. Let's see how long the old format hangs on.
亲历作者亲自逆向 Proctorio 并 dump 出黑名单进程，证明其防护很容易绕过。
远程监考软件纯粹是安全剧场，他们在防止作弊上投入的努力少得可笑。我自己写了一个 ring 3（用户态）rootkit 感染自己的系统，修改注册表值来隐藏远程软件，从而完全彻底地拿下考试本身。……代码略……其中 `g_Globals` 是一个 4 字节指针，在主模块中出现多次。在内存中打开 `g_Globals` 并浏览上述被访问的指针（如 0x0C91C），会到达一个包含数百个字符串的自定义数组类型。根据结构体类型和数组迭代代码，我写了一个基本结构并 dump 出了所有黑名单进程……（附完整黑名单列表链接）。
gzer0查看英文原文
Remote proctor software is nothing but security theatre. It's so laughable the little effort they put at all to prevent any sort of cheating whatsoever. I created my own ring 3 rootkit (user land) and infected my own system to modify registry values to hide remote software to allow complete and total pwnage of the exam itself. TerminateBlacklist: mov [esp-4], esi lea esp, [esp-4] push offset loc_C81CF9 push ds:TerminateProcess jmp locret_6CCBD5 EnumerateBlacklist: mov edx, g_Globals mov ecx, [edx+0C904h] mov eax, [edx+0C8FCh] mov esi, [edx+0C91Ch] mov eax, [ecx+eax] mov [esi+edi+28h], eax add edi, 2Ch The pointer ‘g_Globals’ is a 4-byte pointer- seen multiple times in the main module. Opening ‘g_Globals’ in memory and browsing through the pointers accessed above such as 0x0C91C brings us to a custom array type containing hundreds of strings. Taking a look through the struct type and looking back at the array iteration code, wrote a basic structure and dumped all blacklisted processes: class BlacklistedProcess { public: PCHAR window_name; PCHAR process_name; char pad[0x24]; }; Here's a list of all current blacklisted processes: https://pastebin.com/raw/bidPLAU7
支持只要决心够，任何监考/监控软件都能被绕过，属于安全剧场。
和 TSA 类似，我发现这类平台和“保姆软件”（比如 Life360）大多不过是安全剧场。只要一个人足够坚决，总能找到绕过的办法——他们这么做是好事，这类软件无论把自己包装得多“高尚”，对社会都不是净收益。不算最贴切的例子：我刚看了一个视频，讲的是用摄像头监控屏幕、再用机器人物理移动鼠标来实现在电子游戏里无法被检测的作弊。
TobyTheDog123查看英文原文
Similar to the TSA, I've found a lot of these platforms and nanny-software (Life360 et al) to be little more than security theater. If the person is determined enough, they will always find ways around it -- and good on them for doing so, this software is not a net-benefit on society no matter how "noble" they try to appear. Not the most related example, but I was just watching a video about undetectable online cheating in video games with a camera that monitors the screen and a robot that will physically move the mouse to accomodate. https://www.pcworld.com/article/696507/this-real-aimbot-uses-a-physical-mouse-to-cheat-at-shooting-games.html
历次讨论
- 2022Hacker News 讨论帖191 分 · 119 评
同领域还值得读
每个好的系统调节器都必须是该系统的一个模型 (1970)
Every Good Regulator of a System Must Be a Model of That System (1970)
这是控制论经典论文（Conant 与 Ashby，1970）：它试图论证，任何“好的”调节器都必须是其所调节系统的模型——即调节器与被控系统之间必须存在同构或模型关系。
其他2018 · 202 分 · 59 评进阶 · 约 45 分钟编辑精选复杂系统如何失效
How complex systems fail (2002)
总结了复杂系统如何失败的若干条经验法则：系统总是在多重故障的边缘运行，事故是多重因素叠加的结果，操作者实际上同时承担着维持生产与防范故障的双重角色，而事后归因往往把事故简化为某个…
其他2017 · 154 分 · 19 评入门 · 约 30 分钟编辑精选如何阅读论文
How to Read a Paper (2016)
介绍如何高效阅读学术论文，提出“三遍阅读法”：先快速浏览摘要、结论和图表把握概览，再理解主要内容，最后深入细节。
其他2017 · 715 分 · 80 评入门 · 约 10 分钟公元 1021 年欧洲人已在美洲存在的证据
Evidence for European presence in the Americas in AD 1021
这篇 Nature 论文用树木年轮定年，并结合公元 993 年宇宙射线事件标记，把纽芬兰 L'Anse aux Meadows 的 Norse 活动精确到公元 1021 年，为欧…
其他2021 · 655 分 · 391 评进阶 · 约 45 分钟一次通古斯级空爆摧毁了约旦河谷青铜时代城市 Tall el-Hammam
A Tunguska size burst destroyed Tall el-Hammam, Bronze Age city in Jordan Valley
研究约旦河谷青铜时代城市 Tall el-Hammam 被毁的原因。
其他2021 · 653 分 · 342 评入门 · 约 45 分钟