NDLI: Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up

Please wait, while we are loading the content...

Is there a future for empirical software engineering?

Comparing the fault-proneness of new and modified code: an industrial case study

Analysis of the influence of communication between researchers on experiment replication

A framework for the analysis of software cost estimation accuracy

An empirical comparison between pair development and software inspection in Thailand

Successful software project and products: An empirical investigation

Maximising the information gained from an experimental analysis of code inspection and static analysis for concurrent java components

The evolution of FreeBSD and linux

A follow up study of the effect of personality on the performance of software engineering teams

Improving software testing by observing practice

Common refactorings, a dependency graph and some code smells: an empirical study of Java OSS

A goal question metric based approach for efficient measurement framework definition

Requirement error abstraction and classification: an empirical study

Evaluating the efficacy of test-driven development: industrial case studies

Predicting fault-prone components in a java legacy system

Evaluating guidelines for empirical software engineering studies

A comparative study of attribute weighting heuristics for effort estimation by analogy

PBR vs. checklist: a replication in the n-fold inspection context

A case study on the application of UML in legacy development

Predicting good requirements for in-house development projects

Testing and inspecting reusable product line components: first empirical results

A family of empirical studies to compare informal and optimization-based planning of software releases

An empirical study of developers views on software reuse in statoil ASA

An industrial case study of structural testing applied to safety-critical embedded software

Drivers for software refactoring decisions

Evaluating the practical use of different measurement scales in requirements prioritisation

Identifying domain-specific defect classes using inspections and change history

Evaluating advantages of test driven development: a controlled experiment with professionals

Predicting component failures at design time

Using observational pilot studies to test and improve lab packages

Cross-company and single-company effort models using the ISBSG database: a further replicated study

An empirical analysis and comparison of random testing techniques

Documenting design decision rationale to improve individual and team design decision making: an experimental evaluation

Agile customer engagement: a longitudinal qualitative case study

A literature survey of the quality economics of defect-detection techniques

Empirical estimates of software availability of deployed systems

Distributed versus face-to-face meetings for architecture evalution: a controlled experiment

An empirical evaluation of a testing and debugging methodology for Excel

Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up

Content Provider	ACM Digital Library
Author	Ali Babar, Muhammed Biffl, Stefan
Abstract	Scenarios are extensively used in software architecture evaluation. These scenarios are elicited from stakeholders using either a topdown or bottom-up approach. The former approach uses categorization schemes to focus stakeholders on developing scenarios for each required category. The latter approach uses brainstorming without any explicit categories of scenarios. It is claimed that top-down approach can result in improved quality of scenarios. However, there has been no empirical evidence on the relative effectiveness of the scenario elicitation techniques. In this paper we report on a controlled experiment with 24 subjects (postgraduate and final year undergraduate students with industry experience) in an academic context with the goal to assess the relative effectiveness of the two scenario elicitation approaches. Two groups developed scenarios to characterize quality attributes: the treatment group was given software change categories, the control group was not. The outcome variable was the quality of the scenarios produced by each participant. The average quality score for individual scenario profiles in the treatment group was significantly greater than the control group. All participants using the change categories reported that the knowledge of change categories helped them develop better quality scenarios. Our results support the claim that the provision of domainspecific software change categories helps generate better quality scenarios.
Starting Page	307
Ending Page	315
Page Count	9
File Format	PDF
ISBN	1595932186
DOI	10.1145/1159733.1159779
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2006-09-21
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Empirical software engineering Architecture evaluation Scenarios Controlled experiments Quality attributes
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The Impact of Group Size on Software Architecture Evaluation: A Controlled Experiment

Analysis of a Top-Down Bottom-Up Data Analysis Framework and Software Architecture Design (2014)

An empirical investigation of scenarios gained and lost in architecture evaluation meetings

Data from: Bottom-up vs. top-down effects on terrestrial insect herbivores: a meta-analysis (Dataset)

Top Down vs. Bottom Up

Bottom-up or top-down evaluation: is one better than the other?

Top-down and bottom-up models 1 running head: top-down and bottom-up models top-down and bottom-up models of life satisfaction judgments (2004).

Combining top-down and bottom-up accountability: evidence from a bribery experiment (2008).

Top-Down vs. Bottom-Up Revisited (1991)

Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up

Similar Documents

The Impact of Group Size on Software Architecture Evaluation: A Controlled Experiment

Analysis of a Top-Down Bottom-Up Data Analysis Framework and Software Architecture Design (2014)

An empirical investigation of scenarios gained and lost in architecture evaluation meetings

Data from: Bottom-up vs. top-down effects on terrestrial insect herbivores: a meta-analysis (Dataset)

Top Down vs. Bottom Up

Bottom-up or top-down evaluation: is one better than the other?

Top-down and bottom-up models 1 running head: top-down and bottom-up models top-down and bottom-up models of life satisfaction judgments (2004).

Combining top-down and bottom-up accountability: evidence from a bribery experiment (2008).

Top-Down vs. Bottom-Up Revisited (1991)

Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up