COMS W6998-6: Cloud Computing and Data Center Networking

Fall 2010

 

HOME

ANNOUNCEMENTS

SYLLABUS

PROJECTS

GRADES

PAPERS

RESOURCES

Syllabus

Num

Day

Date

Topic and Paper List

Presentation

Slides

Remarks

01

Wed

09/08

Lecture Notes: Introduction

-          Course Overview

-          Different types of Clouds, examples

 

 

 

02

Wed

09/15

Cloud Building Blocks: Virtualization basics

-          Virtualization, hypervisor

-          VM management example

-          Demonstration using EC2 and ESX vSphere

Lecture Notes: Lecture 2

 

Reading Materials:

1. An overview of virtualization methods, architectures and implementations

2. Architecture of VMWare ESXi (White Paper)

 

Presentation Papers:

1. MapReduce: Simplified Data Processing on Large Clusters

2. Above the Clouds: A Berkeley View of Cloud Computing

 

 

 

 

03

Wed

09/22

Building Clouds: Let’s look Cloud Provision/Management APIs

-          Open Nebula basics

-          Provisioning using Open Nebula APIs

 

Lecture Note: Lecture 3

 

Reading Materials:

  1. OpenNebula Management Functionalities
  2. OpenNebula Installation Guide
  3. Open Nebula Express
  4. Libvirt Summary
  5. VMWare SDK details
  6. Eucalyptus API
  7. XML RPC Client

 

Presentation papers

1. Eucalyptus, OpenNebula

2. Xen and the Art of Virtualization

 

 

04

Wed

09/29

Building Cloud: Automated Provisioning

-          Automated provisioning using virtual appliance

-          Single VM

-          Composite VM

-          Provisioning scripts, virtual image format

-          Example of a multi-VM provisioning

 

Lecture Notes: Lecture 4

Speaker: Dr. Ajay Mohindra

 

Reading Materials:

  1. Eucalyptus Community Cloud, Eucalyptus Open Source Cloud Computing System (CCA08)
  2. VMWare Virtual Appliance Marketplace
  3. A good article on creating virtual appliance
  4. Automating deployment and activation of virtual images

 

Presentation Papers:

      We shall complete the Eucalyptus and Xen paper presentation from last week.

x

 

05

Wed

10/06

Build-A-Cloud: We shall demonstrate cloud building details through an example implementation including monitoring, management and scaling.

 

Lecture Notes: Lecture 5

Speaker: Upendra Sharma

 

Reading Materials:

  1. ESX vSphere Web Services SDK Guide

 

 

Presentation Papers:

1. Eucalyptus paper from last week

2. Comparison of different cloud APIs

 

 

 

06

Wed

10/13

Migration and Cloud

-          Migration across VMs in a LAN

-          WAN migration

-          Migrating enterprise applications to Cloud

 

Lecture Notes: Migration in Cloud

Guest Speaker: Dr. Kunwadee Sripanidkulchai, PhD CMU

                         Research Staff Member, IBM Research

 

Reading Materials:

  1. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A.Warfield.   Live Migration of Virtual Machines, NSDI 2005.
  2. Robert Bradford, Evangelos Kotsovinos, Anja Feldmann, Harald Schiöberg.

      Live Wide-Area Migration of Virtual Machines Including Local Persistent State, VEE 07.

 

  1. Virtual Machine Mobility with Vmware VMotion 

 

Presentation Papers:

    1. K. Ramakrishnan; Prashant Shenoy; Kobus van der Merwe, Live Data Center Migration across WANs: A Robust Cooperative Context Aware Approach, INM 2007

 

    1. Mohammad Hajjat, Xin Sun, Yu-Wei Sung, Dave Maltz, Sanjay Rao, Kunwadee Sripanidkulchai and Mohit Tawarmalani. Cloudward Bound: Planning for Benefical Migration of Enterprise Applications to the Cloud, Sigcomm 2010.

 

 

 

 

 

 

07

Wed

10/20

We discussed project ideas in this lecture. The lecture slides provide a set of starter ideas for class projects. You could choose implementation, analytical/simulation or survey oriented projects.

 

Lecture Notes: Project Ideas

 

 

 

08

Wed

10/27

Cloud Security

 

Guest Speaker: Dr. Dimitris Pendarakis, PhD Columbia University

                          Manager and Research Staff Member, Security Group, IBM Research

 

Reading Materials:

  1. Cloud Security Alliance: http://www.cloudsecurityalliance.org/csaguide.pdf
  2. Berger, S.  Caceres, R.  Goldman, K.  Pendarakis, D.  Perez, R.  Rao, J. R.  Rom, E.  Sailer, R.  Schildhauer, W.  Srinivasan, D.  Tal, S.  Valdez, E.  Security for the cloud infrastructure: Trusted virtual data center implementation

 

Presentation Papers:

 

  1. Tom Ristenpart, Eran Tromer, Hovac Shacham, Stefan Savage. Hey, You, Get Off of My Cloud: Exploring Information Leakage from Third Party Compute Cloud, CCS 2009.
  2. Joshua Schiffman, Tom Moyer, Hayawardh Vijayakumar. Seeding Clouds with Trust Anchors, CCS 2010.

 

 

 

 

 

09

Wed

11/03

Platform as a Service (PaaS)

                    1. Azure Cloud

                    2. Google App Engine, appscale – Open Source Google App Engine

 

Guest Speaker: Dr. Winnie Cheng, PhD MIT

                         Research Staff Member IBM

 

Lecture Notes: Azure

 

Reading Materials:

                1.  Introducing the Windows Azure Platform,  David Chappell

                2. An Introduction to Windows Azure AppFabric for Developers, Keith Brown

                3. Java based API for Google App Engine

 

Presentation Papers:

                1. http://www.usenix.org/events/osdi10/tech/full_papers/Gunda.pdf

                2. http://www.usenix.org/events/osdi10/tech/full_papers/Ports.pdf

                3. http://www.usenix.org/events/osdi10/tech/full_papers/Power.pdf

 

 

 

 

10

Wed

11/10

Migration to Cloud

1.       Fast migration of instances from local data center to EC2

2.       Build new migration capabilities to migrate virtual machines from the local data center (in whichever image format you like – VMWare, Xen, etc.) to EC2. 

3.       Explore how to use S3 and image conversion technologies to ami. Examine if one can optimize migration performance using caching, deduplication, etc.

 

Lectures Notes: Migration to Cloud

Guest Speaker: Dr. Kunwadee Sripanidkulchai, PhD CMU

                        Research Staff Member, IBM

 

Reading Materials:

 

1. Mohammad Hajjat, Xin Sun, Yu-Wei Sung, Dave Maltz, Sanjay Rao, Kunwadee Sripanidkulchai  and Mohit Tawarmalani. Cloudward Bound: Planning for Benefical  Migration of Enterprise Applications to the Cloud, Sigcomm 2010. http://www.ece.purdue.edu/~sanjay/Papers/sigcomm10.pdf

 

2.Ang Li, Xiaowei Yang, Srikanth Kandula and Ming Zhang.  CloudCmp: Shopping for a Cloud Made Easy.  HotCloud 2010.

http://www.usenix.org/event/hotcloud10/tech/full_papers/Li.pdf

 

3. Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif.   Black-box and Gray-box Strategies for Virtual Machine Migration.

Proceedings of the Fourth Symposium on Networked Systems Design and Implementation (NSDI), Cambridge, MA, April 2007.

http://www.cs.umass.edu/~twood/pubs/NSDI07.pdf

 

Presentation Papers (Security papers)

 

1.       Security Audits of Multi-tier Virtual Infrastructures in Public Infrastructure  Clouds, ACM CCS 2010 

      http://openfoo.org/research/ccsw2010.pdf

 

2.       A new form of DOS attack in a cloud and its prevention mechanism, Huan Liu, ACM CCS 2010

 

 

 

 

11

Wed

11/17

Storage Cloud – Data Challenges in Cloud

 

 

12

Wed

11/23

Thanksgiving Break

 

 

13

Wed

11/30

Energy Efficiency

 

Presentation Papers:

1.      Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: A Distributed Storage System for Structured Data

 

 

 

14

Wed

12/07

Data Center Networking

 

 

15

Wed

12/13

Project Presentation

 

 

16

Wed

12/20

Project Presentation