Advanced Operating Systems

Emphasis: Big Data

CS 644

Fall 2014

MWF 2-3, SC 334

General Information

Instructor

Jeanna Matthews
Office: Science Center 389
Phone: 268-6288
E-mail: jnm@clarkson.edu
Homepage: http://www.clarkson.edu/~jnm
Class Times: MWF 2-3, ITL lab (SC 334)
Office Hours: TBA COSI/ITL labs/SC 334-336

Papers

I expect to discuss 1-2 papers per class period. The papers for each class will be listed in the syllabus below. Each person should prepare written notes/ reaction for each paper and bring to class. The reaction should include clear answers to the following questions:

First Half Questions


1) What is the primary lesson you took away from this paper? 2) What do you think would be the most interesting way to extend this work? 3)If you had to list a criticism of this paper, what would it be?


Second Half Questions


1) Technical details ( approach/technique) that you found novel/ Something specific you learned that you didn't know before 2)Could I have done this work if I had the idea why or why not? 3)Is there anything I could do to repeat or validate? 4) What is my best idea for follow on work that I could personally do? 5)What is my best idea for follow on work that I'd like to see the authors do? 6)Any logistical experimental lessons I learned? 7)How does this compare to the other papers we read? Most similar? How different? Other comparisons? 8)What is your biggest criticism of the paper?

Book

Blown to Bits: Your Life, Liberty, and Happiness After the Digital Explosion , Abelson, Ledeen and Lewis.

Objectives

Outcomes

Exams

There will be a final exam in this class.

Attendance

Participation in class discussions is an essential part of this class so attendance is required and the papers must be read prior to the class period.

Late Work

This is a small class and I expect to solicit group input when setting deadlines. Once set, I expect everyone to meet the deadlines.

Tentative Grading Scheme

Tentative Syllabus

Date Topic Other Notes
Mon
8/25
Introduction, Course Logistics, What is Research
An Evaluation of the Ninth SOSP Submissions
Efficient Reading of Papers in Science and Technology
Discussion: What is systems research? Hot topics? Current vs classic
Look over OSDI 2014 , SOSP13 , OSDI12 , SOSP11 , OSDI10 , SOSP09 , programs
USENIX Best Papers and SIGOPS Hall of Fame
Wed
8/27
Meeting Times/Travel, Feedback on Evaluation of 9th SOSP Submisions
Fri
8/29
SOSP 2003: The Google File System Read GFS paper and write reaction to GFS paper, list of 5-10 papers from the above lists that look interesting to you and why.
Mon
9/1
OSDI04: MapReduce: Simplified Data Processing on Large Clusters
Improving MapReduce Performance in Heterogeneous Environments
Weds
9/3
OSDI06: Bigtable: A Distributed Storage System for Structured Data
Fri
9/5
Chapter 1, Blown to Bits
Quantified Self
Data.gov
Big Data Genomics
Human Face of Big Data
Mon
9/8
OSDI12 (Replication): Spanner: Google's Globally-Distributed Database
Wed
9/10
OSDI12 (Big Data): GraphChi: Large-Scale Graph Computation on Just a PC
PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs
Fri
9/12
Chapter 2, Blown to Bits
Our Twitter papers
Mon
9/15
OSDI12(Big Data): Flat Data Center Storage
Wed
9/17
OSDI12 (Privacy)
Fri
9/19
k-Anonymity: A Model for Protecting Privacy
Chapter 3, Blown to Bits
Mon
9/22
OSDI 14
Weds
9/24
OSDI 14
Fri
9/26
Chapter 4, Blown to Bits
t-Closenes: Privacy Beyond k-Anonymith and l-Diversity
Mon
9/29
NO CLASS - FALL BREAK
Weds
10/1
OSDI14
Fri
10/3
Chapter 5, Blown to Bits
Mon
10/6
OSDI in Denver, Twitter HowTo?
Weds
10/8
OSDI in Denver, Twitter HowTo?
Fri
10/10
OSDI Debrief
Mon
10/13
Weds
10/15
Fri
10/17
Chapter 6, Blown to Bits
Mon
10/20
Weds
10/22
Fri
10/24
Chapter 7, Blown to Bits
Mon
10/27
SOSP 2007: Dynamo: Amazon's Highly Available Key-Value Store
OSDI 2010: Finding a Needle in a Haystack: Facebook's Photo Sharing
Weds
10/29
Fri
10/31
Chapter 8, Blown to Bits
Mon
11/3
Project Discussion
Wed
11/5
A little virtualization:
HALL OF FAME: Disco: Running Commodity Operating Systems on Scalable Multiprocessors

SOSP03: Xen and the art of virtualization
Fri
11/7
Conclusion, Blown to Bits
Mon
11/10
Live Migration of Virtual Machines
Xen and the Art of Repeated Research
Weds
11/12
A little security:
CCS09: Hey, you, get off of my cloud
ACDC09: Virtual Machine Contracts for Datacenter and Cloud Computing Environments
Fri
11/14
OSDI2012: Dissent in Numbers: Making Strong Anonymity Scale
Mon
11/17
ICAC14: Conquering Big Data with Spark and BDAS
Wed
11/19
Fri
11/21
Mon
11/24
Wed
11/26
NO CLASS; THANKSGIVING
Fri
11/28
NO CLASS; THANKSGIVING
Mon
12/1
Wed
12/3
Writeups from revisiting 3 papers due
Fri
12/5
Mon
12/8
FINALS TBA
Wed
12/10
Projects due

Good places to look for operating systems papers

ACM's Computing Research Repository

Citeseer: The NECI Scientific Literature Digital Library

Computer Science Bibliographies

ACM SIGOPS

SOSP

OSDI

HOTOS05