NDLI: Sirius:An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers (CARN, Vol. 43, Issue. 1)

Content Provider	ACM Digital Library
Author	Rovinski, Austin Mudge, Trevor Mars, Jason Zhang, Yunqi Tang, Lingjia Dreslinski, Ronald G. Hauswald, Johann Petrucci, Vinicius Khurana, Arjun Li, Cheng Laurenzano, Michael A.
Abstract	As user demand scales for intelligent personal assistants (IPAs) such as Apple's Siri, Google's Google Now, and Microsoft's Cortana, we are approaching the computational limits of current datacenter architectures. It is an open question how future server architectures should evolve to enable this emerging class of applications, and the lack of an open-source IPA workload is an obstacle in addressing this question. In this paper, we present the design of Sirius, an open end-to-end IPA web-service application that accepts queries in the form of voice and images, and responds with natural language. We then use this workload to investigate the implications of four points in the design space of future accelerator-based server architectures spanning traditional CPUs, GPUs, manycore throughput co-processors, and FPGAs. To investigate future server designs for Sirius, we decompose Sirius into a suite of 7 benchmarks (Sirius Suite) comprising the computationally intensive bottlenecks of Sirius. We port Sirius Suite to a spectrum of accelerator platforms and use the performance and power trade-offs across these platforms to perform a total cost of ownership (TCO) analysis of various server design points. In our study, we find that accelerators are critical for the future scalability of IPA services. Our results show that GPU- and FPGA-accelerated servers improve the query latency on average by 10x and 16x. For a given throughput, GPU- and FPGA-accelerated servers can reduce the TCO of datacenters by 2.6x and 1.4x, respectively.
Starting Page	223
Ending Page	238
Page Count	16
File Format	PDF
ISSN	01635964
DOI	10.1145/2786763.2694347
Journal	ACM SIGARCH Computer Architecture News (CARN)
Volume Number	43
Issue Number	1
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1981-04-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Emerging workloads Intelligent personal assistants Warehouse scale computers Datacenters
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Sirius:An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers (SIGP, Vol. 50, Issue. 4)

Sirius: An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers

Designing Future Warehouse-Scale Computers for Sirius, an End-to-End Voice and Vision Personal Assistant

Sirius: An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers

DIABLO:A Warehouse-Scale Computer Network Simulator using FPGAs (CARN, Vol. 43, Issue. 1)

CoolAir:Temperature- and Variation-Aware Management for Free-Cooled Datacenters (CARN, Vol. 43, Issue. 1)

Prophet:Precise QoS Prediction on Non-Preemptive Accelerators to Improve Utilization in Warehouse-Scale Computers (CARN, Vol. 45, Issue. 1)

Baymax:QoS Awareness and Increased Utilization for Non-Preemptive Accelerators in Warehouse Scale Computers (CARN, Vol. 44, Issue. 2)

ReQoS:reactive static/dynamic compilation for QoS in warehouse scale computers (CARN, Vol. 41, Issue. 1)

Sirius:An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers (CARN, Vol. 43, Issue. 1)

Similar Documents

Sirius:An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers (SIGP, Vol. 50, Issue. 4)

Sirius: An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers

Designing Future Warehouse-Scale Computers for Sirius, an End-to-End Voice and Vision Personal Assistant

Sirius: An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers

DIABLO:A Warehouse-Scale Computer Network Simulator using FPGAs (CARN, Vol. 43, Issue. 1)

CoolAir:Temperature- and Variation-Aware Management for Free-Cooled Datacenters (CARN, Vol. 43, Issue. 1)

Prophet:Precise QoS Prediction on Non-Preemptive Accelerators to Improve Utilization in Warehouse-Scale Computers (CARN, Vol. 45, Issue. 1)

Baymax:QoS Awareness and Increased Utilization for Non-Preemptive Accelerators in Warehouse Scale Computers (CARN, Vol. 44, Issue. 2)

ReQoS:reactive static/dynamic compilation for QoS in warehouse scale computers (CARN, Vol. 41, Issue. 1)

Sirius:An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers (CARN, Vol. 43, Issue. 1)