Advanced Operating Systems

Emphasis: Distributed Storage, Consistency/Availability, Geo-Replication

CS 644

Fall 2012

WF 2:15-3:30, SC 334

General Information

Instructor

Jeanna Matthews
Office: Science Center 389
Phone: 268-6288
E-mail: jnm@clarkson.edu
Homepage: http://www.clarkson.edu/~jnm
Class Times: WF 2:15-3:30, COSI lab
Office Hours: MW 10-11, 12-1 W 6-7 COSI/ITL labs/SC 334-336

Papers

I expect to discuss 1-2 papers per class period. The papers for each class will be listed in the syllabus below. Each person should prepare a reaction for each paper and link it off their class page before the beginning of each class. The reaction should contain a summary of the paper and an answer to the following questions:
First Half Questions
1) What is the primary lesson you took away from this paper? 2) What do you think would be the most interesting way to extend this work? 3)If you had to list a criticism of this paper, what would it be?
Second Half Questions
1) Technical details ( approach/technique) that you found novel/ Something specific you learned that you didn't know before 2)Could I have done this work if I had the idea why or why not? 3)Is there anything I could do to repeat or validate? 4) What is my best idea for follow on work that I could personally do? 5)What is my best idea for follow on work that I'd like to see the authors do? 6)Any logistical experimental lessons I learned? 7)How does this compare to the other papers we read? Most similar? How different? Other comparisons? 8)What is your biggest criticism of the paper?

Objectives

Outcomes

Exams

There will be a final exam in this class.

Attendance

Participation in class discussions is an essential part of this class so attendance is required and the papers must be read prior to the class period.

Late Work

This is a small class and I expect to solicit group input when setting deadlines. Once set, I expect everyone to meet the deadlines.

Tentative Grading Scheme

Tentative Syllabus

Date Topic Other Notes
Mon
8/27
Introduction, Course Logistics, What is Research
An Evaluation of the Ninth SOSP Submissions
Efficient Reading of Papers in Science and Technology
Discussion: What is systems research? Hot topics? Current vs classic
Look over SOSP09 , OSDI10 , SOSP11 , OSDI12 (if available) programs
USENIX Best Papers and SIGOPS Hall of Fame
Mon
9/3
Adobe Connect Logistics, Meeting Times, Feedback on Evaluation of 9th SOSP Submisions
Weds
9/5
SOSP 2003: The Google File System Read GFS paper and write reaction to GFS paper, list of 3-5 papers from the above lists that look interesting to you and why.
Wed
9/12
HALL OF FAME: Scale and Performance in a Distributed File System
Fri
9/14
OSDI10: Availability in Globally Distributed Storage Systems
Wed
9/19
SOSP11: Windows Azure Storage
Fri
9/21
SOSP 2007: Dynamo: Amazon's Highly Available Key-Value Store
ACM Queue: Eventually Consistent
Weds
9/26
OSDI 2012: Making Geo-Replicated Systems Fast as Possible, Consistent when Necessary
HALL OF FAME: Time, Clocks and the Ordering of Events in a Distributed System
Fri
9/28
SOSP 11: Transactional storage for geo-replicated systems
CLASSIC: Notes on Distributed Databases
Weds
10/3
OSDI2000: Design and evaluation of a continuous consistency model for replicated services
TOCS92: Disconnected operation in the Coda File System
Fri
10/5
Discuss backgrounds
Watch video for "Making Geo-Replicated Systems Fast" and one more of your choice as they are available
Weds
10/10
OSDI Debrief
SOSP95: Managing update conflicts in Bayou, a weakly connected replicated storage system
Fri
10/12
SOSP11: Don't settle for eventual: scalable causal consistency for wide-area storage with COPS
Weds
10/17
OSDI 2010: Depot: Cloud Storage with Minimal Trust
USENIX 1994: Resolving File Conflicts in the Ficus File System
Fri
10/19
OSDI 2010: SPORC: Group Collaboration using Untrusted Cloud Resources
Weds
10/24
VLDB 2008: PNUTS: Yahoo!'s hosted data serving platform
Fri
10/26
OSDI 2010: Finding a Needle in a Haystack: Facebook's Photo Sharing
LADIS: Cassandra: a decentralized structured storage system
Weds
10/31
Read both:
OSDI04: MapReduce
OSDI06: Big Table
Fri
11/2
Project Discussion
OSDI2012: Spanner: Googles Globally-Distributed Database
Lamport's The part time parliament
Paxos Made Simple Paxos (wikipedia)
Wed
11/7
A little virtualization:
HALL OF FAME: Disco: Running Commodity Operating Systems on Scalable Multiprocessors

SOSP03: Xen and the art of virtualization
Fri
11/9
Live Migration of Virtual Machines
Xen and the Art of Repeated Research
Weds
11/14
A little security:
CCS09: Hey, you, get off of my cloud
ACDC09: Virtual Machine Contracts for Datacenter and Cloud Computing Environments
Fri
11/16
OSDI2012: Dissent in Numbers: Making Strong Anonymity Scale
Wed
11/21
NO CLASS; THANKSGIVING
Fri
11/23
NO CLASS; THANKSGIVING
Wed
11/28
Hudson:Probabilistically Bounded Statelness paper , website
Hu: Version Vector
Writeups from revisiting 3 papers due
Fri
11/30
Bull: NFS
Jiang: GraphChi
Wed
12/5
Zhang: BigHouse
Fri
12/7
Soni: Pastiche
Hicks: Ivy
Weds
12/12
Projects due
Fri
12/14
FINAL SC 382; 11:45 AM

Good places to look for operating systems papers

ACM's Computing Research Repository

Citeseer: The NECI Scientific Literature Digital Library

Computer Science Bibliographies

ACM SIGOPS

SOSP

OSDI

HOTOS05