NDLI: Development of a name translation system using CRAY T94

Content Provider	IEEE Xplore Digital Library
Author	Wentong Cai Peng Xu Wu, P. Jyh, H.
Copyright Year	1997
Description	Author affiliation: Sch. of Appl. Sci., Nanyang Technol. Inst., Singapore (Wentong Cai)
Abstract	Natural language processing (NLP) is an important research direction, since it addresses the needs of the approaching information age. In this paper, we report our study on the problem of translating people's English names into their corresponding Chinese Pinyin names. A name translation system (NTS) has been developed based on statistical approaches. There are two components in the NTS: dictionary creation and name translation. The dictionary is generated using a statistics-based dictionary generator (SBDG), and the name translation is done by using a modified address normalization system (ANS). As in many other NLP applications, the SBDG and ANS suffer the drawback of requiring extremely large computational resources, both in terms of computation time and memory. To make the NTS fast and feasible, therefore, the use of a high-performance computer becomes necessary. The CRAY T94 is a powerful large-scale and general-purpose parallel-vector supercomputer. In this paper, we first describe the system design of the NTS, and then explain how the NTS is optimized to execute on the CRAY T94. The results we obtained are also discussed. Our experience shows that algorithms and data structures are very important in obtaining optimal performance. The performance monitoring/analysis tools provided by The CRAY T94 programming environment are also proved to be very useful in making optimization decisions. In addition, our study also demonstrates that using the CRAY T94, performance improvements can be achieved not only in the traditional areas of scientific computation but also in NLP applications.
Starting Page	295
Ending Page	300
File Size	471257
Page Count	6
File Format	PDF
ISBN	0818679018
DOI	10.1109/HPC.1997.592163
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1997-04-28
Publisher Place	South Korea
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Dictionaries Natural language processing Application software Large-scale systems Supercomputers System analysis and design Design optimization Data structures Monitoring Performance analysis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Resource-based Natural Language Processing

A Large Scale File Processing Application on a Hypercube

Sentiment mining in WebFountain

A representational scheme for a hybrid natural language processing system

Performance characterization and optimization of parallel I/O on the Cray XT

Red Storm/XT Supercomputers Cooling System Design and Optimization

The anticipated impact of supercomputers on finite-element analysis

Integrating parallel application development with performance analysis in periscope

Overcoming the Language Barrier (Invited Paper)

Development of a name translation system using CRAY T94

Similar Documents

Resource-based Natural Language Processing

A Large Scale File Processing Application on a Hypercube

Sentiment mining in WebFountain

A representational scheme for a hybrid natural language processing system

Performance characterization and optimization of parallel I/O on the Cray XT

Red Storm/XT Supercomputers Cooling System Design and Optimization

The anticipated impact of supercomputers on finite-element analysis

Integrating parallel application development with performance analysis in periscope

Overcoming the Language Barrier (Invited Paper)

Development of a name translation system using CRAY T94