NDLI: Flight data recorder: monitoring persistent-state interactions to improve systems management

Please wait, while we are loading the content...

Rethink the sync

SafeDrive: safe and recoverable extensions using language-based techniques

Operating system profiling via latency analysis

EXPLODE: a lightweight, general system for finding serious storage system errors

HQ replication: a hybrid quorum protocol for byzantine fault tolerance

EnsemBlue: integrating distributed storage and consumer electronics

Making information flow explicit in HiStar

Ceph: a scalable, high-performance distributed file system

Experiences building PlanetLab

Type-safe disks

BrowserShield: vulnerability-driven filtering of dynamic HTML

CRAMM: virtual memory support for garbage-collected applications

Securing software by enforcing data-flow integrity

BAR gossip

Persistent personal names for globally connected mobile devices

Splitting interfaces: making trust between applications and operating systems configurable

Distributed directory service in the Farsite file system

iPlane: an information plane for distributed services

Stasis: flexible transactional storage

XFI: software guards for system address spaces

Flight data recorder: monitoring persistent-state interactions to improve systems management

From uncertainty to belief: inferring the specification within

Bigtable: a distributed storage system for structured data

A modular network layer for sensorsets

Connection handoff policies for TCP offload network interfaces

The Chubby lock service for loosely-coupled distributed systems

Fidelity and yield in a volcano monitoring sensor network

Flight data recorder: monitoring persistent-state interactions to improve systems management

Content Provider	ACM Digital Library
Author	Verbowski, Chad Kumar, Arunvijay Wang, Yi-Min Lu, Shan Kiciman, Emre Daniels, Brad Lee, Juhan Roussev, Roussi
Abstract	Mismanagement of the persistent state of a system---all the executable files, configuration settings and other data that govern how a system functions---causes reliability problems, security vulnerabilities, and drives up operation costs. Recent research traces persistent state interactions---how state is read, modified, etc.---to help troubleshooting, change management and malware mitigation, but has been limited by the difficulty of collecting, storing, and analyzing the 10s to 100s of millions of daily events that occur on a single machine, much less the 1000s or more machines in many computing environments. We present the Flight Data Recorder (FDR) that enables always-on tracing, storage and analysis of persistent state interactions. FDR uses a domain-specific log format, tailored to observed file system workloads and common systems management queries. Our lossless log format compresses logs to only 0.5--0.9 bytes per interaction. In this log format, 1000 machine-days of logs---over 25 billion events---can be analyzed in less than 30 minutes. We report on our deployment of FDR to 207 production machines at MSN, and show that a single centralized collection machine can potentially scale to collecting and analyzing the complete records of persistent state interactions from 4000+ machines. Furthermore, our tracing technology is shipping as part of the Windows Vista OS.
Starting Page	117
Ending Page	130
Page Count	14
File Format	PDF
ISBN	1931971471
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2006-11-06
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Flight data recorder: Monitoring persistent-state interactions to improve systems management (2006)

Flight Data Recorder: Monitoring persistent-state interactions to improve systems management (2006)

Flight Data Recorder: Monitoring persistent-state interactions to improve systems management (2006)

Analyzing persistent state interactions to improve state management

Glass-box: an intelligent flight data recorder and real-time monitoring system.

Analyzing persistent state interactions to improve state management

Transportation state comprehensive monitoring recorder system design

An Intelligent Flight Data Recorder And Real-Time Monitoring System

A Data Filter for Identifying Steady-State Operating Points in Engine Flight Data for Condition Monitoring Applications

Flight data recorder: monitoring persistent-state interactions to improve systems management

Similar Documents

Flight data recorder: Monitoring persistent-state interactions to improve systems management (2006)

Flight Data Recorder: Monitoring persistent-state interactions to improve systems management (2006)

Flight Data Recorder: Monitoring persistent-state interactions to improve systems management (2006)

Analyzing persistent state interactions to improve state management

Glass-box: an intelligent flight data recorder and real-time monitoring system.

Analyzing persistent state interactions to improve state management

Transportation state comprehensive monitoring recorder system design

An Intelligent Flight Data Recorder And Real-Time Monitoring System

A Data Filter for Identifying Steady-State Operating Points in Engine Flight Data for Condition Monitoring Applications

Flight data recorder: monitoring persistent-state interactions to improve systems management