Advanced Operating Systems

Emphasis: Big Data

CS 644

Fall 2014

MWF 2-3, SC 334

General Information

Instructor

Jeanna Matthews
Office: Science Center 389
Phone: 268-6288
E-mail: jnm@clarkson.edu
Homepage: http://www.clarkson.edu/~jnm
Class Times: MWF 2-3, ITL lab (SC 334)
Office Hours: MWF 3-4, T 1-3, R 9:30-10:30 COSI/ITL labs/SC 334-336

Papers

I expect to discuss 1-2 papers per class period. The papers for each class will be listed in the syllabus below. Each person should prepare written notes/ reaction for each paper and bring to class. The reaction should include clear answers to the following questions:

First Half Questions


1) What is the primary lesson you took away from this paper? 2) What do you think would be the most interesting way to extend this work? 3)If you had to list a criticism of this paper, what would it be?


Second Half Questions


1) Technical details ( approach/technique) that you found novel/ Something specific you learned that you didn't know before 2)Could I have done this work if I had the idea why or why not? 3)Is there anything I could do to repeat or validate? 4) What is my best idea for follow on work that I could personally do? 5)What is my best idea for follow on work that I'd like to see the authors do? 6)Any logistical experimental lessons I learned? 7)How does this compare to the other papers we read? Most similar? How different? Other comparisons? 8)What is your biggest criticism of the paper?

Book

Blown to Bits: Your Life, Liberty, and Happiness After the Digital Explosion , Abelson, Ledeen and Lewis.

Objectives

Outcomes

Exams

There will be a final exam in this class.

Attendance

Participation in class discussions is an essential part of this class so attendance is required and the papers must be read prior to the class period.

Late Work

This is a small class and I expect to solicit group input when setting deadlines. Once set, I expect everyone to meet the deadlines.

Tentative Grading Scheme

Tentative Syllabus

Date Topic Other Notes
Mon
8/25
Introduction, Course Logistics, What is Research
Meeting Times/Travel
An Evaluation of the Ninth SOSP Submissions
Efficient Reading of Papers in Science and Technology
How to Get a Paper Accepted at OOPSLA
Discussion: What is systems research? Hot topics? Current vs classic
Look over OSDI 2014 , SOSP13 , OSDI12 , SOSP11 , OSDI10 , SOSP09 , programs
USENIX Best Papers and SIGOPS Hall of Fame
Wed
8/27
Feedback on Evaluation of 9th SOSP Submisions Read GFS paper and write reaction to GFS paper, list of 5-10 papers from the above lists that look interesting to you and why.
Fri
8/29
SOSP 2003: The Google File System
Mon
9/1
OSDI04: MapReduce: Simplified Data Processing on Large Clusters
Improving MapReduce Performance in Heterogeneous Environments
Weds
9/3
OSDI06: Bigtable: A Distributed Storage System for Structured Data
Fri
9/5
OSDI12 (Replication): Spanner: Google's Globally-Distributed Database
Mon
9/8
OSDI12 (Big Data): GraphChi: Large-Scale Graph Computation on Just a PC
PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs
Wed
9/10
OSDI12(Big Data): Flat Data Center Storage
Fri
9/12
Chapter 1, Blown to Bits
USACM Privacy Policy Recommendations
Quantified Self
Data.gov
Big Data Genomics
Human Face of Big Data
Mon
9/15
OSDI12 (Privacy)
Eternal Sunshine of the Spotless Machine
Hails
Wed
9/17
CleanOS
Fri
9/19
Chapter 2, Blown to Bits
Sample of our Twitter papers: Its you on photo?: Automatic Detection of Twitter Accounts Infected With the Blackhole Exploit Kit
Mon
9/22
2013: GraphX: Graph Processing in a Distributed Dataflow Framework
Weds
9/24
OSDI 14: GraphX: Graph Processing in a Distributed Dataflow Framework
Fri
9/26
k-Anonymity: A Model for Protecting Privacy
Chapter 3, Blown to Bits
Mon
9/29
NO CLASS - FALL BREAK
Weds
10/1
OSDI 14: Arrakis: The Operating System is the Control Plane
Jitk: A Trustworthy In-Kernel Interpreter Infrastructure
Fri
10/3
Chapter 4, Blown to Bits
l-Diversity: Privacy Beyond k-Anonymity
Also skim the journal version and identify similarities/differences: PDF
Mon
10/6
OSDI in Denver, Finish discussion of l-Diversity papers
Weds
10/8
Twitter Howto (Supraja)
Fri
10/10
OSDI Debrief
Mon
10/13
IX: A Protected Dataplane Operating System for High Throughput and Low Latency
Weds
10/15
Shielding Applications from an Untrusted Cloud with Haven
Fri
10/17
Chapter 5, Blown to Bits
t-Closenes: Privacy Beyond k-Anonymity and l-Diversity
Mon
10/20
Torturing Databases for Fun and Profit
Weds
10/22
All File Systems Are Not Created Equal: On the Complexity of Crafting Crash-Consistent Applications
Fri
10/24
Chapter 6, Blown to Bits
Mon
10/27
SOSP11 Virtualization: Breaking up is hard to do
SOSP11 Virtualization: Cloud Visor
Weds
10/29
SOSP11 Virtualization: Cloud Visor
VirtuOS
Fri
10/31
Chapter 7, Blown to Bits
OSDI 12: Dissent in Numbers: Making Strong Anonymity Scale
Mon
11/3
The Velocity of Censorship: High-Fidelity Detection of Microblog Post Deletions
Take This Personally: Pollution Attacks on Personalized Services
Wed
11/5
A little virtualization:
HALL OF FAME: Disco: Running Commodity Operating Systems on Scalable Multiprocessors

SOSP03: Xen and the art of virtualization
Fri
11/7
Chapter 8, Blown to Bits
Mon
11/10
Live Migration of Virtual Machines
Xen and the Art of Repeated Research
Weds
11/12
A little security:
CCS09: Hey, you, get off of my cloud
ACDC09: Virtual Machine Contracts for Datacenter and Cloud Computing Environments
Fri
11/14
Conclusion, Blown to Bits
Mon
11/17
ICAC14: Conquering Big Data with Spark and BDAS
Wed
11/19
OSDI 2010: Finding a Needle in a Haystack: Facebook's Photo Sharing
SOSP13: An Analysis of Facebook Photo Caching
Fri
11/21
SOSP 2007: Dynamo: Amazon's Highly Available Key-Value Store
Mon
11/24
Wed
11/26
NO CLASS; THANKSGIVING
Fri
11/28
NO CLASS; THANKSGIVING
Mon
12/1
Wed
12/3
Fri
12/5
Tues
12/9
FINAL EXAM - 8 AM
Wed
12/10
Projects due

Good places to look for operating systems papers

ACM's Computing Research Repository

Citeseer: The NECI Scientific Literature Digital Library

Computer Science Bibliographies

ACM SIGOPS

SOSP

OSDI

HOTOS05