NDLI: Discovering recurring anomalies in text reports regarding complex space systems

Content Provider	IEEE Xplore Digital Library
Author	Srivastava, A.N. Zane-Ulman, B.
Copyright Year	2005
Description	Author affiliation: NASA Ames Res. Center, Moffett Field, CA (Srivastava, A.N.)
Abstract	Many existing complex space systems have a significant amount of historical maintenance and problem data bases that are stored in unstructured text forms. The problem that we address in this paper is the discovery of recurring anomalies and relationships between problem reports that may indicate larger systemic problems. We illustrate our techniques on data from discrepancy reports regarding software anomalies in the Space Shuttle. These free text reports are written by a number of different people, thus the emphasis and wording vary considerably. We test four automatic methods of anomaly detection in text that are popular in the current literature on text mining. The first method that we describe is k-means or Gaussian mixture model and its application to the term-document matrix. The second method is the Sammon nonlinear map, which projects high dimensional document vectors into two dimensions for visualization and clustering purposes. The third method is based on an analysis of the results of applying a clustering method, expectation maximization on a mixture of von Mises Fisher distributions that represents each document as a point on a high dimensional sphere. In this space, we perform clustering to obtain sets of similar documents. The results are derived from a new method known as spectral clustering, where vectors from the term-document matrix are embedded in a high dimensional space for clustering. The paper concludes with recommendations regarding the development of an operational text mining system for analysis of problem reports that arise from complex space systems. We also contrast such systems with general purpose text mining systems, illustrating the areas in which this system needs to be specified for the space domain
Starting Page	3853
Ending Page	3862
File Size	10255994
Page Count	10
File Format	PDF
ISBN	0780388704
DOI	10.1109/AERO.2005.1559692
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-03-05
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data mining Information analysis Aerospace testing Text mining Functional analysis Data analysis Sensor systems Thermal sensors Manufacturing processes Algorithm design and analysis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Discovering recurring anomalies in text reports regarding complex space systems

Discovering system health anomalies using data mining techniques

Discovering Structural Anomalies in Graph-Based Data

Enabling the discovery of recurring anomalies in aerospace system problem reports using high-dimensional clustering techniques

Discovering Manufacturing Process from Timed Data: the BJT4R Algorithm

Situation-awareness and sensor stream mining for sustainable society

Advanced thermal sensing circuit and test techniques used in a high performance 65nm processor

Temperature Sensor Design in a High Volume Manufacturing 65nm CMOS Digital Process

Data mining siam presentation

Discovering recurring anomalies in text reports regarding complex space systems

Similar Documents

Discovering recurring anomalies in text reports regarding complex space systems

Discovering system health anomalies using data mining techniques

Discovering Structural Anomalies in Graph-Based Data

Enabling the discovery of recurring anomalies in aerospace system problem reports using high-dimensional clustering techniques

Discovering Manufacturing Process from Timed Data: the BJT4R Algorithm

Situation-awareness and sensor stream mining for sustainable society

Advanced thermal sensing circuit and test techniques used in a high performance 65nm processor

Temperature Sensor Design in a High Volume Manufacturing 65nm CMOS Digital Process

Data mining siam presentation

Discovering recurring anomalies in text reports regarding complex space systems