How To Read A Paper.pdf

How to Read a Paper
S. Keshav
David R. Cheriton School of Computer Science, University of Waterloo
Waterloo, ON, Canada
keshav@uwaterloo.ca
ABSTRACT
Researchers spend a great deal of time reading research pa-
pers. However, this skill is rarely taught, leading to much
wasted effort. This article outlines a practical and efficient
three-pass method for reading research papers. I also de-
scribe how to use this method to do a literature survey.
Categories and Subject Descriptors: A.1 [Introductory
and Survey]
General Terms: Documentation.
Keywords: Paper, Reading, Hints.
1. INTRODUCTION
Researchers must read papers for several reasons: to re-
view them for a conference or a class, to keep current in
their field, or for a literature survey of a new field. A typi-
cal researcher will likely spend hundreds of hours every year
reading papers.
Learning to efficiently read a paper is a critical but rarely
taught skill. Beginning graduate students, therefore, must
learn on their own using trial and error. Students waste
much effort in the process and are frequently driven to frus-
tration.
For many years I have used a simple approach to efficiently
read papers. This paper describes the ‘three-pass’ approach
and its use in doing a literature survey.
2. THE THREE-PASS APPROACH
The key idea is that you should read the paper in up to
three passes, instead of starting at the beginning and plow-
ing your way to the end. Each pass accomplishes specific
goals and builds upon the previous pass: The f irst pass
gives you a general idea about the paper. The second pass
lets you grasp the paper’s content, but not its details. The
third pass helps you understand the paper in depth.
2.1 The first pass
The first pass is a quick scan to get a bird’s-eye view of
the paper. You can also decide whether you need to do any
more passes. This pass should take about five to ten minutes
and consists of the following steps:
1. Carefully read the title, abstract, and introduction
2. Read the section and sub-section headings, but ignore
everything else
3. Read the conclusions
4. Glance over the references, mentally ticking off the
ones you’ve already read
At the end of the first pass, you should be able to answer
the five Cs:
1. Category: What type of paper is this? A measure-
ment paper? An analysis of an existing system? A
description of a research prototype?
2. Context: Which other papers is it related to? Which
theoretical bases were used to analyze the problem?
3. Correctness: Do the assumptions appear to be valid?
4. Contributions: What are the paper’s main contribu-
tions?
5. Clarity: Is the paper well written?
Using this information, you may choose not to read fur-
ther. This could be because the paper doesn’t interest you,
or you don’t know enough about the area to understand the
paper, or that the authors make invalid assumptions. The
first pass is adequate for papers that aren’t in your research
area, but may someday prove relevant.
Incidentally, when you write a paper, you can expect most
reviewers (and readers) to make only one pass over it. Take
care to choose coherent section and sub-section titles and
to write concise and comprehensive abstracts. If a reviewer
cannot understand the gist after one pass, the paper will
likely be rejected; if a reader cannot understand the high-
lights of the paper after five minutes, the paper will likely
never be read.
2.2 The second pass
In the second pass, read the paper with greater care, but
ignore details such as proofs. It helps to jot down the key
points, or to make comments in the margins, as you read.
1. Look carefully at the figures, diagrams and other illus-
trations in the paper. Pay special attention to graphs.
Are the axes properly labeled? Are results shown with
error bars, so that conclusions are statistically sig-
nificant? Common mistakes like these will separate
rushed, shoddy work from the truly excellent.
2. Remember to mark relevant unread references for fur-
ther reading (this is a good way to learn more about
the background of the paper).

The second pass should take up to an hour. After this
pass, you should be able to grasp the content of the paper.
You should be able to summarize the main thrust of the pa-
per, with supporting evidence, to someone else. This level of
detail is appropriate for a paper in which you are interested,
but does not lie in your research speciality.
Sometimes you won’t understand a paper even at the end
of the second pass. This may be because the subject matter
is new to you, with unfamiliar terminology and acronyms.
Or the authors may use a proof or experimental technique
that you don’t understand, so that the bulk of the pa-
per is incomprehensible. The paper may be poorly written
with unsubstantiated assertions and numerous forward ref-
erences. Or it could just be that it’s late at night and you’re
tired. You can now choose to: (a) set the paper aside, hoping
you don’t need to understand the material to be successful
in your career, (b) return to the paper later, perhaps after
reading background material or (c) persevere and go on to
the third pass.
2.3 The third pass
To fully understand a paper, particularly if you are re-
viewer, requires a third pass. The key to the third pass
is to attempt to virtually re-implement the paper: that is,
making the same assumptions as the authors, re-create the
work. By comparing this re-creation with the actual paper,
you can easily identify not only a paper’s innovations, but
also its hidden failings and assumptions.
This pass requires great attention to detail. You should
identify and challenge every assumption in every statement.
Moreover, you should think about how you yourself would
present a particular idea. This comparison of the actual
with the virtual lends a sharp insight into the proof and
presentation techniques in the paper and you can very likely
add this to your repertoire of tools. During this pass, you
should also jot down ideas for future work.
This pass can take about four or five hours for beginners,
and about an hour for an experienced reader. At the end
of this pass, you should be able to reconstruct the entire
structure of the paper from memory, as well as be able to
identify its strong and weak points. In particular, you should
be able to pinpoint implicit assumptions, missing citations
to relevant work, and potential issues with experimental or
analytical techniques.
3. DOING A LITERATURE SURVEY
Paper reading skills are put to the test in doing a literature
survey. This will require you to read tens of papers, perhaps
in an unfamiliar field. What papers should you read? Here
is how you can use the three-pass approach to help.
First, use an academic search engine such as Google Scholar
or CiteSeer and some well-chosen keywords to find three to
five recent papers in the area. Do one pass on each pa-
per to get a sense of the work, then read their related work
sections. You will find a thumbnail summary of the recent
work, and perhaps, if you are lucky, a pointer to a recent
survey paper. If you can find such a survey, you are done.
Read the survey, congratulating yourself on your good luck.
Otherwise, in the second step, find shared citations and
repeated author names in the bibliography. These are the
key papers and researchers in that area. Download the key
papers and set them aside. Then go to the websites of the
key researchers and see where they’ve published recently.
That will help you identify the top conferences in that field
because the best researchers usually publish in the top con-
ferences.
The third step is to go to the website for these top con-
ferences and look through their recent proceedings. A quick
scan will usually identify recent high-quality related work.
These papers, along with the ones you set aside earlier, con-
stitute the first version of your survey. Make two passes
through these papers. If they all cite a key paper that you
did not find earlier, obtain and read it, iterating as neces-
sary.
4. EXPERIENCE
(text continued on next image description)

(continued from previous image)
I’ve used this approach for the last 15 years to read con-
ference proceedings, write reviews, do background research,
and to quickly review papers before a discussion. This dis-
ciplined approach prevents me from drowning in the details
before getting a bird’s-eye-view. It allows me to estimate the
amount of time required to review a set of papers. More-
over, I can adjust the depth of paper evaluation depending
on my needs and how much time I have.
5. RELATED WORK
If you are reading a paper to do a review, you should also
read Timothy Roscoe’s paper on “Writing reviews for sys-
tems conferences” [2]. If you’re planning to write a technical
paper, you should refer both to Henning Schulzrinne’s com-
prehensive web site [3] and George Whitesides’s excellent
overview of the process [4]. Finally, Simon Peyton Jones
has a website that covers the entire spectrum of research
skills [1].
6. A REQUEST
I would like to make this a living document, updating it
as I receive comments. Please take a moment to email me
any comments or suggestions for improvement. You can also
add comments at CCRo, the online edition of CCR [5].
7. ACKNOWLEDGMENTS
The first version of this document was drafted by my stu-
dents: Hossein Falaki, Earl Oliver, and Sumair Ur Rahman.
My thanks to them. I also benefited from Christophe Diot’s
perceptive comments and Nicole Keshav’s eagle-eyed copy-
editing.
This work was supported by grants from the National
Science and Engineering Council of Canada, the Canada
Research Chair Program, Nortel Networks, Microsoft, Intel
Corporation, and Sprint Corporation.
8. REFERENCES
[1] S. Peyton Jones, “Research Skills,”
http://research.microsoft.com/ simonpj/Papers/giving-
a-talk/giving-a-talk.htm.
[2] T. Roscoe, “Writing Reviews for Systems
Conferences,”
http://people.inf.ethz.ch/troscoe/pubs/review-
writing.pdf.
[3] H. Schulzrinne, “Writing Technical Articles,”
http://www.cs.columbia.edu/ hgs/etc/writing-
style.html.
(text from current image)
[4] G.M. Whitesides, “Whitesides’ Group: Writing a
Paper,”
http://www.che.iitm.ac.in/misc/dd/writepaper.pdf.
[5] ACM SIGCOMM Computer Communication Review
Online, http://www.sigcomm.org/ccr/drupal/.

how to read a paper.pdf

Tags

paper academia

More Posts from Resources-blr and Others

resources-blr

3 months ago

Tags

gif dividers graphic resources

213 notes View Post

resources-blr

3 months ago

YouTube Channels for Kids by JLPT Levels

(⁠｡⁠•̀⁠ᴗ⁠-⁠)⁠✧ resources

こんにちは, Japanese learners! Learning a language is an exciting adventure, isn't it? To add a spark of joy to your Japanese learning journey, here's a collection of YouTube channels tailored for kids. Organized by JLPT levels, these channels offer a blend of education and entertainment for learners at different stages. Keep in mind, though, that JLPT levels aren't an exact science like math – language learning can be subjective in terms of difficulty. However, these resources provide a fantastic starting point and a fun way to explore the world of Japanese language and culture. Let's hop into this delightful world of animated learning and playful discoveries!

Friendly reminder to adjust your way of learning in order to make the most of what you're studying to reach the goal you truly want! read my post about it (ᵔ◡ᵔ)

꒰ა ˚₊ ✧・┈・╴N 5 ╴・┈・𐑺 ‧₊˚໒꒱

— Curious George (N5 level)

https://youtube.com/@CuriousGeorgeJP?feature=shared

— Japanese folk tales/anime series (Japanese audio/Japanese subtitles) from BomBom Academy (N5 level)

YouTube

日本の昔ばなし・アニメシリーズ（日本語音声・日本語字幕）

みんなが知っている日本の昔ばなしをアニメで読み聞かせ ▶日本の昔ばなしアニメ（日本語版）桃太郎 MOMOTARO - PEACH BOY／金太郎 KINTARO／牛若丸 USHIWAKAMARU／かぐや姫 SHINING PRINCESS／舌切りすずめ THE TONGUELE

— Peppa Pig (N5-4 level)

YouTube

ペッパピッグー Peppa Pig

ペッパピッグ公式YouTubeチャンネルへようこそ！どんなファンでも喜んでもらえる様に、エピソードやコンピレーションを集めました。ぜひ、楽しんで、登録を忘れずに！かわいいこぶたの女の子ペッパピッグが、弟のジョージピッグ、パパのダディピッグ、ママのマミーピッグと繰り広げる、思わ

— Anpanman (N5-4 level)

YouTube

それいけ!アンパンマン【アニメ公式】

「それいけ！アンパンマン」のアニメ公式チャンネルです。アニメ本編や歌の動画の他、映画最新情報のPVも続々配信していきますので、ぜひご家族でお楽しみください♪ ★TVシリーズの新しいおはなしの更新日は毎月１日頃を予定しています。 ※休日/祝日の場合は翌平日の更新となります ※

— NHK education (N5-4 level)

YouTube

NHKエデュケーショナル

株式会社NHKエデュケーショナルが運営するYoutubeチャンネルです。弊社で行うイベントなどの情報をお届けします！お問い合わせは、以下URLよりお送りください。 https://www.nhk-ed.co.jp/personal/contact-event/

꒰ა ˚₊ ✧・┈・╴N4 ╴・┈・𐑺 ‧₊˚໒꒱

— Cinnamon Roll, Sanrio (N4 level)

YouTube

CINNAMOROLL /シナモロール【Sanrio Official】

ぼく、シナモンです。ぼくの公式YouTubeチャンネルだよ☆ ぼくの事やフレンズの事をみんなにもっと知ってもらえたら嬉しいな！ --- 名前：シナモンお誕生日: 3月6日出身地: 遠いお空の雲の上性格：おとなしいけれど、とても人なつっこい趣味：カフェのテラスでお昼寝

— [Anime] Atashin'chi (N4-3 level)

YouTube

[Anime] Atashin'chi Official Channel

The Tachibanas are the quintessential Japanese family, unassuming and infinitely relatable. There’s Mother, who isn’t the best cook and is q

꒰ა ˚₊ ✧・┈・╴N3 ╴・┈・𐑺 ‧₊˚໒꒱

— Sesame Street Japan (N3 level)

YouTube

セサミストリート日本公式

セサミストリート日本公式 YouTube チャンネルへようこそ！ここでは、エルモやクッキーモンスターなどが登場するセサミストリートのビデオをお届けしています。ぜひチャネル登録して、セサミストリートのかわいい仲間たちと楽しい時間をお過ごしください。セサミストリートは、非営

— Chibi Maruko Chan (N3-2 level)

YouTube

Chibi Maruko Channel

Chibi Maruko Channel is running by Nippon Animation Co.,Ltd. We'd like to have more people to watch and know "Chibi Maruko Chan." There are

꒰ა ˚₊ ✧・┈・╴N2 ╴・┈・𐑺 ‧₊˚໒꒱

— Precure (N2 level)

YouTube

プリキュア公式YouTubeチャンネル

「ひろがるスカイ！プリキュア」を始めとする、プリキュアに関する映像をお届けするプリキュア公式YouTubeチャンネル！ダンスレッスンや変身シーンなどお楽しみコンテンツ続々更新中。チャンネルを登録すると、映像の更新情報がいち早くゲットできます！

またね～@inkichan

꒰ა ˚₊ ✧・┈・╴﹕꒰ ᐢ｡- ༝ -｡ᐢ ꒱﹕╴・┈・𐑺 ‧₊˚໒꒱

Tags

languages

814 notes View Post

resources-blr

3 months ago

I reblog resources!

Header: pin.it

PFP: pin.it

Navigation by tags:

Tags

quotes tech gif study tips pixel dividers languages png graphic resources subjects flashcards papers

1 note View Post

resources-blr

3 months ago

日本のオノマトぺ

In Japanese, there are 3 types of onomatopoeia.

日本語のオノマトペには、擬声語=動物や人間の声を表す言葉、擬音語=物の音を表す言葉、擬態語=動作や様子を表す言葉。

擬声語- 犬がワンワンとほえる。- dogs go ‘wanwan’ (woof woof in English)

擬音語- 水をごくごくと飲んでいる。- I ‘glug’ water

擬態語- ドアがバタンと閉まった。- the door ‘slams’ shut

My favourite one so far is しくしく which is like ‘sobs’ but it reminds me of sniffling 😢.

Tags

languages

98 notes View Post

resources-blr

2 weeks ago

2K notes View Post

resources-blr

3 months ago

Essentials You Need to Become a Web Developer

HTML, CSS, and JavaScript Mastery

Text Editor/Integrated Development Environment (IDE): Popular choices include Visual Studio Code, Sublime Text.

Version Control/Git: Platforms like GitHub, GitLab, and Bitbucket allow you to track changes, collaborate with others, and contribute to open-source projects.

Responsive Web Design Skills: Learn CSS frameworks like Bootstrap or Flexbox and master media queries

Understanding of Web Browsers: Familiarize yourself with browser developer tools for debugging and testing your code.

Front-End Frameworks: for example : React, Angular, or Vue.js are powerful tools for building dynamic and interactive web applications.

Back-End Development Skills: Understanding server-side programming languages (e.g., Node.js, Python, Ruby , php) and databases (e.g., MySQL, MongoDB)

Web Hosting and Deployment Knowledge: Platforms like Heroku, Vercel , Netlify, or AWS can help simplify this process.

Basic DevOps and CI/CD Understanding

Soft Skills and Problem-Solving: Effective communication, teamwork, and problem-solving skills

Confidence in Yourself: Confidence is a powerful asset. Believe in your abilities, and don't be afraid to take on challenging projects. The more you trust yourself, the more you'll be able to tackle complex coding tasks and overcome obstacles with determination.

Tags

tech coding web development

1K notes View Post

resources-blr

1 month ago

.。･:*:･૮ ˙ ﻌ˙ ა Dog Gifs ૮ ˘ﻌ˘ ა･:*:･。.

Tags

gif pixel art web graphics graphic resources

304 notes View Post

resources-blr

5 days ago

Tags

web

82 notes View Post

resources-blr

3 months ago

CREATING A STUDY SCHEDULE/ROUTINE

PLANNING/SCHEDULING

LIST YOUR ACADEMIC STRENGTHS AND WEAKNESSES. This is so you can allocate time accordingly and avoid wasting any time.

PRIORITISE ANY SUBJECTS. These may be subjects that will help you in your future career or just a subject you especially want a good grade in. Anything for these subjects then becomes the most important on your to-do list.

DIVIDE TIME EACH DAY. Not all days you are going to be able to sit down at your desk at the same time. Instead, according to your energy levels and planned activities, divide your time.

E.g I have cheerleading after school and I'm going to be so tired, so I’ll do my studying in the morning instead.

ESTABLISH BREAKS. Depending on how long you can study for, place a suitable break in between. This helps make studying more productive, but only if your breaks are.

CREATING

USE YOUR TIMETABLE. On days you don’t have a specific subject, dedicate more time to that one.

CONSIDER YOUR LEARNING STYLE. This helps to be a bit more specific when creating it, instead of winging it and just doing anything. Having a consistent way of studying helps us learn better.

E.g I’m a visual learner, so I’ll watch animations. I'm an auditory learner so I’ll watch a video of someone explaining it.

KNOW WHAT YOU WILL DO DURING STUDYING. Do not just wing studying, it’s unproductive and you’re more likely to waste time instead of using it.

Before you start studying, write a to-do list of everything you need to do during that session and how you will do it. Less time time-consuming and allows you to use time productively.

SAMPLE – this is Lanny’s daily study routine without any upcoming tests, as an early bird, kinesthetic learner and needs breaks to think with clarity.

Morning

Review my flashcards in preparation for any test.

Write/note any flashcards I'm struggling with.

Afterschool

Check seqta/school website to access my courses, in which I’ll write down which subjects I had.

Do a few quick blurts on paper of everything I learned in those subjects with prior reading. I only do this for HASS, math and science + any electives that require it. (blurting method)

Then I recheck my blurts, add in anything that I’ve missed and correct with a different coloured pen.

After, I push those papers aside but I do not discard them. I’ll then complete my online science homework + class workbook. If I happen not to understand anything I’ll watch a video on it and then complete some questions on that.

I’ll take a break around now because, on an estimate, it has been around 20-40 minutes since I started depending on how my science homework is. I usually eat something and then get back to it.

Math is next. I’ll complete any math homework, then I’ll practice doing math questions on my own. What I like to do is watch a math video, pause the question without the answer then watch to see if I got it. Effective because they explain it and I can see where I went wrong without analysing my working out which is rather time-consuming.

I take another break. Math stuff usually takes around 20-30 minutes.

I then do HASS, which is the easiest. I usually read an article or watch a video on hass then apply that knowledge by answering questions OR doing assigned chapter work.

I do not study English after school, but I usually read an assigned passage/book and then try to apply any techniques/knowledge by taking that paragraph apart and analysing it. Sometimes, I write my paragraphs using any taught techniques and then mark them.

Then, I redo my blurtings again but without prior reading then recheck and correct. Then I am finished for the afternoon!!

Evening

Review flashcards then watch a video/read an article on what I was struggling with in the morning but I do not do anything to consolidate this knowledge.

That is all, please feel free to ask me about any questions about studying as I don't really post much about it, I'll love to help out any fellow students!

Tags

study tips

663 notes View Post

resources-blr

2 months ago