I recently hosted an episode of Software Engineering Radio called "Jennings Anderson and Amy Rose on Overture Maps"!

  • Home
  • Teaching
    • Overview
    • Algorithm Analysis
    • Document Engineering
  • Research
    • Overview
    • Papers
    • Presentations
  • Outreach
    • Software
    • Service
    • Blog
  • About
    • Biography
    • Schedule
    • Contact
    • Blog
    • Service
    • Papers
    • Presentations
Categories
All (86)
database testing (20)
defect prediction (1)
empirical study (57)
fault localization (3)
flaky tests (9)
human study (4)
invariant detection (1)
literature review (11)
machine learning (4)
mutation testing (24)
performance analysis (23)
program performance (2)
program repair (4)
search-based methods (12)
software development (26)
software testing (36)
software tool (15)
test coverage (2)
test execution (1)
test-data generation (1)

Papers

Code
from rich.console import Console
console = Console()
paper_count = count_research_papers()
console.print(
    f":rocket: It was super-fun to collaboratively create these {paper_count} papers!"
)
🚀 It was super-fun to collaboratively create these 86 papers!

Test flimsiness: Characterizing flakiness induced by mutation to the code under test

empirical study
flaky tests
mutation testing

Proceedings of the 48th International Conference on Software Engineering

2026
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

Beyond test flakiness: A manifesto for a holistic approach to test suite health

flaky tests
literature review
mutation testing

Proceedings of the 2nd International Flaky Tests Workshop

2025
Phil McMinn, Muhammad Firhard Roslan, Gregory M. Kapfhammer

Systemic flakiness: An empirical analysis of co-occurring flaky test failures

empirical study
flaky tests
machine learning

Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering

2025
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

Where tests fall short: Empirically analyzing oracle gaps in covered code

empirical study
mutation testing
software testing

Proceedings of the 19th International Symposium on Empirical Software Engineering and Measurement

2025
Megan Maton, Gregory M. Kapfhammer, Phil McMinn

Exploring pseudo-testedness: Empirically evaluating extreme mutation testing at the statement level

empirical study
mutation testing
performance analysis

Proceedings of the 35th International Conference on Software Maintenance and Evolution

2024
Megan Maton, Gregory M. Kapfhammer, Phil McMinn

PseudoSweep: A pseudo-tested code identifier

empirical study
mutation testing
software development

Proceedings of the 35th International Conference on Software Maintenance and Evolution – Tool Demonstrations Track

2024
Megan Maton, Gregory M. Kapfhammer, Phil McMinn

Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models

empirical study
flaky tests
machine learning

Empirical Software Engineering Journal, 28:72

2023
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

A survey of flaky tests

flaky tests
literature review
program repair

Transactions on Software Engineering and Methodology, 31:1

2022
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

Evaluating features for machine learning detection of order- and non-order-dependent flaky tests

empirical study
flaky tests
machine learning

Proceedings of the 15th International Conference on Software Testing, Verification and Validation

2022
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

Surveying the developer experience of flaky tests

empirical study
flaky tests
human study

Proceedings of the 44th International Conference on Software Engineering – Software Engineering in Practice Track

2022
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

What do developer-repaired flaky tests tell us about the effectiveness of automated flaky test detection?

empirical study
flaky tests
program repair

Proceedings of the 3rd International Conference on Automation of Software Test

2022
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

Automated repair of responsive web page layouts

human study
program repair
software testing

Proceedings of the 15th International Conference on Software Testing, Verification and Validation

2022
Ibrahim Althomali, Gregory M. Kapfhammer, Phil McMinn

Automated visual classification of DOM-based presentation failure reports for responsive web pages

empirical study
software testing
software tool

Software Testing, Verification and Reliability, 31:4

2021
Ibrahim Althomali, Gregory M. Kapfhammer, Phil McMinn

Automatically identifying potential regressions in the layout of responsive web pages

empirical study
mutation testing
software testing

Software Testing, Verification and Reliability, 30:6

2020
Thomas A. Walsh, Gregory M. Kapfhammer, Phil McMinn

Flake it till you make it: Using automated repair to induce and fix latent test flakiness

flaky tests
program repair
software testing

Proceedings of the 1st International Workshop on Automated Program Repair

2020
Owain Parry, Gregory M. Kapfhammer, Michael Hilton, Phil McMinn

STICCER: Fast and effective database test suite reduction through merging of similar test cases

database testing
mutation testing
performance analysis

Proceedings of the 13th International Conference on Software Testing, Verification and Validation

2020
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Hybrid methods for reducing database schema test suites: Experimental insights from computational and human studies

database testing
human study
software testing

Proceedings of the 1st International Conference on Automation of Software Test

2020
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Automatic detection and removal of ineffective mutants for the mutation analysis of relational database schemas

database testing
empirical study
mutation testing

Transactions on Software Engineering, 45:5

2019
Phil McMinn, Chris J. Wright, Colton McCurdy, Gregory M. Kapfhammer

Automatic visual verification of layout failures in responsively designed web pages

empirical study
software development
software testing

Proceedings of the 12th International Conference on Software Testing, Verification and Validation

2019
Ibrahim Althomali, Gregory M. Kapfhammer, Phil McMinn

An empirical study on the use of defect prediction for test case prioritization

defect prediction
empirical study
software testing

Proceedings of the 12th International Conference on Software Testing, Verification and Validation

2019
David Paterson, José Campos, Rui Abreu, Gregory M. Kapfhammer, Gordon Fraser, Phil McMinn

What factors make SQL test cases understandable for testers? A human study of automated test data generation techniques

database testing
human study
software development

Proceedings of the 35th International Conference on Software Maintenance and Evolution

2019
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Using controlled numbers of real faults and mutants to empirically evaluate coverage-based test case prioritization

empirical study
mutation testing
software testing

Proceedings of the 13th International Workshop on Automation of Software Test

2018
David Paterson, Gregory M. Kapfhammer, Gordon Fraser, Phil McMinn

DOMINO: Fast and effective test data generation for relational database schemas

database testing
empirical study
search-based methods

Proceedings of the 11th International Conference on Software Testing, Verification and Validation

2018
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Generating test suites with DOMINO

database testing
software development
software testing

Proceedings of the 11th International Conference on Software Testing, Verification and Validation – Demonstrations Track

2018
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Running experiments and performing data analysis using SchemaAnalyst and DOMINO

database testing
empirical study
mutation testing

Proceedings of the 11th International Conference on Software Testing, Verification and Validation – Artefacts Track

2018
Abdullah Alsharif, Gregory M. Kapfhammer, Phil McMinn

Automated layout failure detection for responsive web pages without an explicit oracle

empirical study
fault localization
software development

Proceedings of the International Symposium on Software Testing and Analysis

2017
Thomas A. Walsh, Gregory M. Kapfhammer, Phil McMinn

ReDeCheck: An automatic layout failure checking tool for responsively designed web pages

fault localization
software development
software testing

Proceedings of the International Symposium on Software Testing and Analysis

2017
Thomas A. Walsh, Gregory M. Kapfhammer, Phil McMinn

Empirically evaluating greedy-based test suite reduction methods at different levels of test suite complexity

empirical study
performance analysis
software testing

Science of Computer Programming

2017
Chu-Ti Lin, Kai-Wei Tang, Jiun-Shiang Wang, Gregory M. Kapfhammer

Automated search for good coverage criteria: Moving from code coverage to fault coverage through search-based software engineering

literature review
search-based methods
software testing

Proceedings of the 9th International Workshop on Search-Based Software Testing

2016
Phil McMinn, Mark Harman, Gordon Fraser, Gregory M. Kapfhammer

Virtual mutation analysis of relational database schemas

database testing
empirical study
mutation testing

Proceedings of the 11th International Workshop on Automation of Software Test

2016
Phil McMinn, Gregory M. Kapfhammer, Chris J. Wright

AVMf: An open-source framework and implementation of the alternating variable method

search-based methods
software tool

Proceedings of the 8th International Symposium on Search-Based Software Engineering

2016
Phil McMinn, Gregory M. Kapfhammer

SchemaAnalyst: Search-based test data generation for relational database schemas

database testing
search-based methods
software testing

Proceedings of the 32nd International Conference on Software Maintenance and Evolution

2016
Phil McMinn, Chris J. Wright, Cody Kinneer, Colton J. McCurdy, Michael Camara, Gregory M. Kapfhammer

Hitchhikers need free vehicles! Shared repositories for statistical analysis in SBST

empirical study
search-based methods
software testing

Proceedings of the 9th International Workshop on Search-Based Software Testing

2016
Gregory M. Kapfhammer, Phil McMinn, Chris J. Wright

mrstudyr: Retrospectively studying the effectiveness of mutant reduction techniques

mutation testing
software testing
software tool

Proceedings of the 32nd International Conference on Software Maintenance and Evolution

2016
Colton J. McCurdy, Phil McMinn, Gregory M. Kapfhammer

Automatic detection of potential layout faults following changes to responsive web pages

empirical study
software development
software testing

Proceedings of the 30th International Conference on Automated Software Engineering

2015
Thomas A. Walsh, Phil McMinn, Gregory M. Kapfhammer

The effectiveness of test coverage criteria for relational database schema integrity constraints

database testing
empirical study
literature review

Transactions on Software Engineering and Methodology, 25:1

2015
Phil McMinn, Chris J. Wright, Gregory M. Kapfhammer

Automatically evaluating the efficiency of search-based test data generation for relational database schemas

database testing
empirical study
performance analysis

Proceedings of the 27th International Conference on Software Engineering and Knowledge Engineering

2015
Cody Kinneer, Gregory M. Kapfhammer, Chris J. Wright, Phil McMinn

ExpOse: Inferring worst-case time complexity by automatic empirical study

empirical study
performance analysis
software development

Proceedings of the 27th International Conference on Software Engineering and Knowledge Engineering

2015
Cody Kinneer, Gregory M. Kapfhammer, Chris J. Wright, Phil McMinn

Test suite reduction methods that decrease regression testing costs by identifying irreplaceable tests

empirical study
performance analysis
software testing

Information and Software Technology, 56:10

2014
Chu-Ti Lin, Kai-Wei Tang, Gregory M. Kapfhammer

The impact of equivalent, redundant, and quasi mutants on database schema mutation analysis

database testing
mutation testing
software development

Proceedings of the 14th International Conference on Quality Software

2014
Chris J. Wright, Gregory M. Kapfhammer, Phil McMinn

Parameter tuning for search-based test-data generation revisited: Support for previous results

empirical study
search-based methods
software testing

Proceedings of the 14th International Conference on Quality Software

2014
Anton Kotelyanskii, Gregory M. Kapfhammer

Search-based testing of relational schema integrity constraints across multiple database management systems

database testing
empirical study
mutation testing

Proceedings of the 6th International Conference on Software Testing, Verification and Validation

2013
Gregory M. Kapfhammer, Phil McMinn, Chris J. Wright

History-based test case prioritization with software version awareness

software development
software testing
software tool

Proceedings of the 18th International Conference on Engineering of Complex Computer Systems

2013
Chu-Ti Lin, Cheng-Ding Chen, Chang-Shi Tsai, Gregory M. Kapfhammer

Efficient mutation analysis of relational database structure using mutant schemata and parallelisation

database testing
empirical study
mutation testing

Proceedings of the 8th International Workshop on Mutation Analysis

2013
Chris J. Wright, Gregory M. Kapfhammer, Phil McMinn

Do redundant mutants affect the effectiveness and efficiency of mutation analysis?

empirical study
mutation testing
software development

Proceedings of the 7th International Workshop on Mutation Analysis

2012
René Just, Gregory M. Kapfhammer, Franz Schweiggert

Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis

empirical study
mutation testing
software development

Proceedings of the 23rd International Symposium on Software Reliability Engineering

2012
René Just, Gregory M. Kapfhammer, Franz Schweiggert

An empirical comparison of Java remote communication primitives for intra-node data transmission

empirical study
performance analysis
software testing

Performance Evaluation Review, 39:4

2012
Philip F. Burdette, William F. Jones, Brian C. Blose, Gregory M. Kapfhammer

A framework to support research in and encourage industrial adoption of regression testing techniques

empirical study
literature review
software development

Proceedings of the 7th Testing: Academic and Industrial Conference – Practice and Research Techniques

2012
Jonathan Miller Kauffman, Gregory M. Kapfhammer

Towards a method for reducing the test suites of database applications

empirical study
software testing
software tool

Poster Compendium of the 5th International Conference on Software Testing, Verification and Validation

2012
Gregory M. Kapfhammer

Reducing the cost of regression testing by identifying irreplaceable test cases

empirical study
performance analysis
search-based methods

Proceedings of the 6th International Conference on Genetic and Evolutionary Computing

2012
Chu-Ti Lin, Kai-Wei Tang, Cheng-Ding Chen, Gregory M. Kapfhammer

Ask and you shall receive: Empirically evaluating declarative approaches to finding data in unstructured heaps

empirical study
performance analysis
software tool

Proceedings of the 20th International Conference on Software Engineering and Data Engineering

2011
William F. Jones, Gregory M. Kapfhammer

Localizing SQL faults in database applications

database testing
empirical study
fault localization

Proceedings of the 26th International Conference on Automated Software Engineering

2011
Sarah R. Clark, Jake Cobb, Gregory M. Kapfhammer, James A. Jones, Mary Jean Harrold

Using conditional mutation to increase the efficiency of mutation analysis

mutation testing
performance analysis
software development

Proceedings of the 6th International Workshop on Automation of Software Test

2011
René Just, Gregory M. Kapfhammer, Franz Schweiggert

MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler

mutation testing
software testing
software tool

Proceedings of the 26th International Conference on Automated Software Engineering

2011
René Just, Gregory M. Kapfhammer, Franz Schweiggert

Empirically identifying the best genetic algorithm for covering array generation

empirical study
mutation testing
search-based methods

Fast Abstract Compendium of the 3rd International Symposium on Search Based Software Engineering

2011
Liang Yalan, Changhai Nie, Jonathan M. Kauffman, Gregory M. Kapfhammer, Hareton Leung

Dynamic invariant detection for relational databases

database testing
empirical study
invariant detection

Proceedings of the 9th International Workshop on Dynamic Analysis

2011
Jake Cobb, James A. Jones, Gregory M. Kapfhammer, Mary Jean Harrold

Empirically evaluating regression testing techniques: Challenges, solutions, and a potential way forward

empirical study
software testing
software tool

Proceedings of the 1st International Workshop on Regression Testing

2011
Gregory M. Kapfhammer

Using synthetic test suites to empirically compare search-based and greedy prioritizers

empirical study
performance analysis
search-based methods

Proceedings of the 12th International Conference Companion on Genetic and Evolutionary Computation

2010
Zachary Williams, Gregory M. Kapfhammer

A genetic algorithm to improve Linux kernel performance on resource-constrained devices

performance analysis
search-based methods
software tool

Proceedings of the 12th International Conference Companion on Genetic and Evolutionary Computation

2010
James Kukunas, Robert D. Cupper, Gregory M. Kapfhammer

Regression testing

empirical study
literature review
software testing

The Encyclopedia of Software Engineering

2010
Gregory M. Kapfhammer

Empirically studying the role of selection operators during search-based test suite prioritization

empirical study
mutation testing
search-based methods

Proceedings of the 12th International Conference on Genetic and Evolutionary Computation

2010
Alexander P. Conrad, Robert S. Roos, Gregory M. Kapfhammer

An experimental study of methods for executing test suites in memory constrained environments

empirical study
software testing
test execution

Proceedings of the 4th International Workshop on the Automation of Software Test

2009
Suvarshi Bhadra, Alexander P. Conrad, Charles P. Hurkes, Brian Kirklin, Gregory M. Kapfhammer

An empirical comparison of methods for compressing test coverage reports

empirical study
performance analysis
software testing

Poster Compendium of the 3rd International Symposium on Empirical Software Engineering and Measurement

2009
Erik Ostrofsky, Gregory M. Kapfhammer

Interactive coverage effectiveness multiplots for evaluating prioritized regression test suites

literature review
software testing
test coverage

Compendium of the 15th Information Visualization Conference

2009
Adam M. Smith, Joshua J. Geiger, Gregory M. Kapfhammer, Manos Renieris, G. Elisabeta Marai

An empirical study of incorporating cost into test suite reduction and prioritization

empirical study
software testing
software tool

Proceedings of the 24th Symposium on Applied Computing

2009
Adam M. Smith, Gregory M. Kapfhammer

Prioritizing test suites by finding Hamiltonian paths: Preliminary studies and initial results

empirical study
performance analysis
software development

Fast Abstract Compendium of the 7th Testing: Academic and Industrial Conference – Practice and Research Techniques

2008
Suvarshi Bhadra, Gregory M. Kapfhammer

Database-aware test coverage monitoring

database testing
empirical study
performance analysis

Proceedings of the 1st India Software Engineering Conference

2008
Gregory M. Kapfhammer, Mary Lou Soffa

Efficient time-aware prioritization with knapsack solvers

empirical study
performance analysis
program performance

Proceedings of the International Workshop on Empirical Assessment of Software Engineering Languages and Technologies

2007
Sara Alspaugh, Kristen R. Walcott, Michael Belanich, Gregory M. Kapfhammer, Mary Lou Soffa

Using coverage effectiveness to evaluate test suite prioritizations

empirical study
software tool
test coverage

Proceedings of the International Workshop on Empirical Assessment of Software Engineering Languages and Technologies

2007
Gregory M. Kapfhammer, Mary Lou Soffa

A comprehensive framework for testing database-centric applications

database testing
empirical study
performance analysis

Department of Computer Science, University of Pittsburgh

2007
Gregory M. Kapfhammer

Test suite reduction and prioritization with call trees

empirical study
software testing
software tool

Proceedings of the 22nd International Conference on Automated Software Engineering – Demonstrations Track

2007
Adam M. Smith, Joshua J. Geiger, Gregory M. Kapfhammer, Mary Lou Soffa

Time-aware test suite prioritization

empirical study
performance analysis
program performance

Proceedings of the International Symposium on Software Testing and Analysis

2006
Kristen R. Walcott, Mary Lou Soffa, Gregory M. Kapfhammer, Robert S. Roos

Towards the prioritization of regression test suites with data flow information

empirical study
literature review
mutation testing

Proceedings of the 20th Symposium on Applied Computing

2005
Matthew J. Rummel, Gregory M. Kapfhammer, Andrew Thall

Testing in resource-constrained execution environments

empirical study
performance analysis
software testing

Proceedings of the 20th International Conference on Automated Software Engineering

2005
Gregory M. Kapfhammer, Mary Lou Soffa, Daniel Mossé

Towards the measurement of tuple space performance

empirical study
performance analysis
software development

Performance Evaluation Review, 33:3

2005
Daniel Fiedler, Kristen R. Walcott, Thomas Richardson, Gregory M. Kapfhammer, Ahmed Amer, Panos K. Chrysanthis

Software testing

literature review
software development
software testing

The Computer Science Handbook

2004
Gregory M. Kapfhammer

A family of test adequacy criteria for database-driven applications

database testing
literature review
software testing

Proceedings of the 9th European Software Engineering Conference and the 11th Symposium on the Foundations of Software Engineering

2003
Gregory M. Kapfhammer, Mary Lou Soffa

An examination of the run-time performance of GUI creation frameworks

empirical study
performance analysis
software development

Proceedings of the 2nd International Conference on the Principles and Practice of Programming in Java

2003
Christopher J. Howell, Gregory M. Kapfhammer, Robert S. Roos

An approach for understanding and testing third-party software components

mutation testing
software development
software testing

Proceedings of the 48th Reliability and Maintainability Symposium

2002
Jennifer Haddox, Gregory M. Kapfhammer, C.C. Michael

Implementation and analysis of a JavaSpace supported by a relational database

database testing
performance analysis
software development

Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications

2002
Geoffrey C. Arnold, Gregory M. Kapfhammer, Robert S. Roos

Creation and analysis of a JavaSpace-based genetic algorithm

performance analysis
search-based methods
software development

Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications

2002
Brian Zorman, Gregory M. Kapfhammer, Robert S. Roos

Creating a free, dependable software engineering environment for building Java applications

literature review
software development
software tool

Proceedings of the 1st International Workshop on Open Source Software Engineering

2001
Marcus Bittman, Robert S. Roos, Gregory M. Kapfhammer

Testing commercial-off-the-shelf components with software wrappers

software development
software testing

Proceedings of the 18th International Conference on Testing Computer Software

2001
Jennifer Haddox, Gregory M. Kapfhammer, C.C. Michael, Michael Schatz

Automatically and transparently distributing the execution of regression test suites

software development
software testing
software tool

Proceedings of the 18th International Conference on Testing Computer Software

2001
Gregory M. Kapfhammer

An approach to identifying and understanding problematic COTS components

machine learning
mutation testing
software development

Proceedings of the 2nd International Software Assurance and Certification Conference

2000
Gregory M. Kapfhammer, C.C. Michael, Jennifer Haddox, Ryan Colyer

A complex object data generator specification language to facilitate automated data creation in software component test drivers

software development
software tool
test-data generation

Department of Computer Science, Allegheny College

1999
Gregory M. Kapfhammer
No matching items

    GMK

    Top