经济与社会科学2020arxiv.org
Sci-Hub 效应:Sci-Hub 下载带来更多论文引用
The Sci-Hub Effect: Sci-Hub downloads lead to more article citations
进阶 · 约 60 分钟读完前置知识:计量经济学基础、因果推断基础、学术出版与开放获取背景
导读
这篇 arXiv 论文声称 Sci-Hub 上的下载量会导致论文获得更多引用(即“Sci-Hub 效应”),作者通过对比有 Sci-Hub 下载记录与无下载记录的论文的引用数得出该结论。但 HN 上的讨论普遍质疑这一因果推断:论文下载量本身可能只是论文受关注程度的代理指标,而非引用增加的原因。
HN 关注点:这篇论文的因果推断是否成立——相关性显然存在,但“下载导致引用”的因果结论缺乏识别策略,讨论焦点集中在混杂因素和计量方法上。
HN 评论精选
这几条评论里:质疑 3 补充 1
质疑数据只能说明受欢迎的论文引用更多,对照组论文其实也在 Sci-Hub 上,结论不成立
也许我理解有误,但他们的数据似乎表明:没人愿意从 Sci-Hub 下载的无趣论文引用数更少,而更有趣、被下载更多的论文引用更多。这怎么能支持“Sci-Hub 下载导致更多引用”的结论?我读了论文,也看到他们考虑的其他因素,但这些因素都不如来自任何渠道(ScienceDirect 或 Sci-Hub)的自然下载数更能预测论文受关注程度。另外要说明的是,他们所谓“受限访问”对照组的论文其实也能在 Sci-Hub 上找到,开放程度和实验组一样。
oefrha查看英文原文
Maybe I misunderstood something, but it seems to me their data demonstrate that less interesting papers that nobody bothered to download from SciHub tend to have fewer citations than more interesting ones that are downloaded? How does that support the conclusion “Sci-Hub downloads lead to more article citations” (emphasis mine)? (Yes I read the paper and I’ve seen all the other factors they considered, but those factors simply aren’t as good predictors/indicators of interest as an organic download number from any channel, whether it’s ScienceDirect or SciHub.) Edit: To be clear, papers in their supposedly "limited access" (if we want to draw the same conclusion) control group appear to be available on Sci-Hub, i.e. as open access as their Sci-Hub group. Details in this comment: https://news.ycombinator.com/item?id=23710992
质疑论文缺乏识别策略,因果效应未被识别,结论没有证据力
这篇论文缺少的是计量经济学所说的“识别策略”——即找到 x(Sci-Hub 下载)中独立于 y(引用)的变异来源来评估其影响。理想情况是随机对照试验,次优是某种外生冲击让部分论文突然在 Sci-Hub 上可用或不可用。这篇论文什么都没有,可以说这个关系“未被识别”。这不意味着结论一定错,只是论文没有提供有意义的证据。参见 Angrist 和 Krueger (2001)。用 Pearl/DAG 的语言说,论文本身的质量或吸引力是明显的混杂因素/后门路径。
setgree查看英文原文
The econometric term for what this paper lacks is "identification strategy" -- a way for assessing the impact of x (downloads on sci-hub) on y (citations) which _identifies_ a source of variation in x that is independent of y. A randomized controlled trial would be ideal. Second-best would be something that, say, suddenly caused some papers to be available or not available on Sci-Hub, or a "plausibly exogenous" (to y) cutoff around which papers would be either available on Sci-Hub or not. This paper offers nothing. I think we can say the relationship is "not identified." Doesn't mean the conclusion is wrong, just that this paper doesn't produce meaningful evidence on the question. For more see Angrist and Krueger (2001) https://economics.mit.edu/files/18 (In Pearl/DAG language, the underlying quality or appeal of the paper is, as others have noted, an obvious confound/backdoor path).
质疑下载与引用可能有共同原因(论文吸引力),下载只是预测性代理而非原因
Sci-Hub 下载量和引用数可能有共同原因,比如论文对科学家有吸引力。如果 Sci-Hub 下载是兴趣度的好代理且发生得更早,它可以有效预测引用,但不一定是原因——下载的人和引用的人可能是不同的人。我从论文中看不出他们是否考虑了这一点,也不知道他们认为的因果图是什么样的。
skybrian查看英文原文
It seems like downloads from Sci-Hub and citations could have a common cause, for example, being interesting to scientists. If Sci-Hub downloads are a good proxy for interest and they happen first, then they could usefully be used to predict citations, without necessarily being a cause. Different people could be using SciHub versus making citations. I couldn't tell from the paper whether they considered this, or what they think the cause graph looks like.
补充补充 FUTON bias 概念:开放获取论文天然更易被引用
参见维基百科的 FUTON bias(“网上全文”偏差):学者倾向于优先引用开放获取、可在网上免费获得全文的期刊论文,而非需要付费的出版物。
PudgePacket查看英文原文
https://en.wikipedia.org/wiki/FUTON_bias > FUTON bias (acronym for "full text on the Net")[1] is a tendency of scholars to cite academic journals with open access—that is, journals that make their full text available on the Internet without charge—in preference to toll-access publications.
相关资源
从这篇论文所有 HN 讨论帖的全部评论里整理出来的链接。
- 评论区提到的论文
历次讨论
- 2020Hacker News 讨论帖754 分 · 92 评
同领域还值得读
一切的回报率,1870–2015
The Rate of Return on Everything, 1870–2015
利用1870–2015年多国的长期数据,估算股票、住房等各类资本的回报率,并将其与经济增长率进行比较。
经济与社会科学2019 · 487 分 · 260 评进阶 · 约 100 分钟编辑精选一切资产的回报率,1870–2015
The Rate of Return on Everything, 1870–2015
构建了 1870–2015 年 16 个国家的长周期资产回报数据集,覆盖股票、住房、政府债券和短期票据,系统比较各类资产的真实回报与波动性。
经济与社会科学2018 · 215 分 · 151 评进阶 · 约 120 分钟编辑精选一切资产的回报率,1870–2015(2019)
The Rate of Return on Everything, 1870–2015 (2019)
这篇发表于《经济学季刊》的论文构建了 1870–2015 年间 16 个主要发达国家的股票、债券、房地产等资产收益率的长周期数据库。
经济与社会科学2024 · 190 分 · 148 评进阶 · 约 80 分钟编辑精选想法是否越来越难找?
Are ideas getting harder to find?
探讨“想法是否越来越难找到”:通过衡量多个领域的“研究生产率”,发现维持相同的增长需要投入指数级增长的研究资源,即研究效率在持续下降。
经济与社会科学2016 · 182 分 · 106 评入门 · 约 60 分钟编辑精选比特币与区块链的经济极限
The Economic Limits of Bitcoin and the Blockchain
芝加哥大学 Eric Budish 的论文从经济学角度分析比特币与区块链的根本限制:核心论点是只要攻击网络(双花或砸盘做空)的收益超过挖矿成本,51% 算力攻击就有利可图,而挖矿…
经济与社会科学2018 · 176 分 · 37 评进阶 · 约 90 分钟编辑精选