Search For:

Displaying 1-38 out of 38 total
Software Engineering for Scientists
Found in: Computing in Science and Engineering
By Diane Kelly,Spencer Smith,Nicholas Meng
Issue Date:September 2011
pp. 7-11
At two recent workshops, participants discussed the juxtaposition of software engineering with the development of scientific computational software.
 
Scientific Software Testing: Analysis with Four Dimensions
Found in: IEEE Software
By Diane Kelly, Stefan Thorsteinson, Daniel Hook
Issue Date:May 2011
pp. 84-90
The authors describe a code testing exercise with an example of scientific software. As part of their analysis of the exercise, they examined four dimensions of testing: context, goals, technique, and adequacy. They started the exercise with approaches com...
 
Innovative Standards for Innovative Software
Found in: Computer
By Diane Kelly
Issue Date:July 2008
pp. 88-89
Developers must revise current approaches to standards for analysis software to account for its unique characteristics.
 
Mutation Sensitivity Testing
Found in: Computing in Science and Engineering
By Daniel Hook, Diane Kelly
Issue Date:November 2009
pp. 40-47
<p>Computational scientists often encounter code-testing challenges not typically faced by software engineers who develop testing techniques. Mutation sensitivity testing addresses these challenges, showing that a few well-designed tests can detect m...
 
Five Recommended Practices for Computational Scientists Who Write Software
Found in: Computing in Science and Engineering
By Diane Kelly, Daniel Hook, Rebecca Sanders
Issue Date:September 2009
pp. 48-53
<p>Few software engineering techniques and approaches are specifically useful for computational scientists, and despite recent efforts, it could be many years before a consolidated handbook is available. Meanwhile, computational scientists can look t...
 
Testing for trustworthiness in scientific software
Found in: Software Engineering for Computational Science and Engineering, ICSE Workshop on
By Daniel Hook, Diane Kelly
Issue Date:May 2009
pp. 59-64
Two factors contribute to the difficulty of testing scientific software. One is the lack of testing oracles - a means of comparing software output to expected and correct results. The second is the large number of tests required when following any standard...
 
Evaluation Challenges and Directions for Information-Seeking Support Systems
Found in: Computer
By Diane Kelly, Susan Dumais, Jan O. Pedersen
Issue Date:March 2009
pp. 60-66
ISSSs provide an exciting opportunity to extend previous information-seeking and interactive information retrieval evaluation models and create a research community that embraces diverse methods and broader participation.
 
Dealing with Risk in Scientific Software Development
Found in: IEEE Software
By Rebecca Sanders, Diane Kelly
Issue Date:July 2008
pp. 21-28
The development of scientific software involves risk in the underlying theory, its implementation, and its use. Through a series of interviews, the authors explored how research scientists at two Canadian universities developed their software. These interv...
 
A Study of Design Characteristics in Evolving Software Using Stability as a Criterion
Found in: IEEE Transactions on Software Engineering
By Diane Kelly
Issue Date:May 2006
pp. 315-329
There are many ideas in software design that are considered good practice. However, research is still needed to validate their contributions to software maintenance. This paper presents a method for examining software systems that have been actively mainta...
 
A Little Knowledge about Software
Found in: IEEE Software
By Diane Kelly, Terry Shepard
Issue Date:March 2004
pp. 46-48
<p>Software plays an important role in most organizations, but nonsoftware managers often understand too little about its production and support. Fewer yet appreciate how it contributes directly to their bottom line. Instead, when software appears on...
 
How to Do Inspections When There is No Time
Found in: Software Engineering, International Conference on
By Terry Shepard, Diane Kelly
Issue Date:May 2001
pp. 0718
Abstract: The concepts of inspection are presented, organized around the three Ms of inspection (Management, Mechanics and Metrics). Fundamentally, inspection provides a way of observing and quantifying software processes while improving software quality. ...
 
The effect of threshold priming and need for cognition on relevance calibration and assessment
Found in: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '13)
By Diane Kelly, Falk Scholer, Hanseul S. Lee, Wan-Ching Wu, William Webber
Issue Date:July 2013
pp. 623-632
Human assessments of document relevance are needed for the construction of test collections, for ad-hoc evaluation, and for training text classifiers. Showing documents to assessors in different orderings, however, may lead to different assessment outcomes...
     
How query cost affects search behavior
Found in: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '13)
By Diane Kelly, Kathy Brennan, Leif Azzopardi
Issue Date:July 2013
pp. 23-32
affects how users interact with a search system. Microeconomic theory is used to generate the cost-interaction hypothesis that states as the cost of querying increases, users will pose fewer queries and examine more documents per query. A between-subjects ...
     
Task complexity, vertical display and user interaction in aggregated search
Found in: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '12)
By Ashlee Edwards, Diane Kelly, Jaime Arguello, Wan-Ching Wu
Issue Date:August 2012
pp. 435-444
Aggregated search is the task of blending results from specialized search services or verticals into the Web search results. While many studies have focused on aggregated search techniques, few studies have tried to better understand how users interact wit...
     
User evaluation of query quality
Found in: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '12)
By Diane Kelly, Kun Huang, Wan-Ching Wu
Issue Date:August 2012
pp. 215-224
Although a great deal of research has been conducted about automatic techniques for determining query quality, there have been relatively few studies about how people judge query quality. This study investigated this topic through a laboratory experiment w...
     
Fourth international workshop on software engineering for computational science and engineering: (SE-CSE2011)
Found in: Proceeding of the 33rd international conference on Software engineering (ICSE '11)
By Diane Kelly, Ian Gorton, Jeffrey C. Carver, Judith Segal, Lorin Hochstein, Roscoe Bartlett
Issue Date:May 2011
pp. 1226-1227
Computational Science and Engineering (CSE) software supports a wide variety of domains including nuclear physics, crash simulation, satellite data processing, fluid dynamics, climate modeling, bioinformatics, and vehicle development. The increase in the i...
     
An examination of two delivery modes for interactive search system experiments: remote and laboratory
Found in: Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11)
By Diane Kelly, Karl Gyllstrom
Issue Date:May 2011
pp. 1531-1540
We compare two delivery modes for interactive search system (ISS) experiments: remote and laboratory. Our study was completed by two groups of subjects from the same population. The first group completed the study remotely and the second group completed th...
     
3rd CASCON Workshop on Software Engineering for Science
Found in: Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research (CASCON '10)
By Diane Kelly, Spencer Smith
Issue Date:November 2010
pp. 420-422
Scientific software is defined as an application that supplies data to support decisions in a field of science or engineering. Computational models of climate, geographic information systems to study bird habitats, analysis software for the safe operation ...
     
A comparison of user and system query performance predictions
Found in: Proceedings of the 19th ACM international conference on Information and knowledge management (CIKM '10)
By Claudia Hauff, Diane Kelly, Leif Azzopardi
Issue Date:October 2010
pp. 979-988
Query performance prediction methods are usually applied to estimate the retrieval effectiveness of queries, where the evaluation is largely system sided. However, little work has been conducted to understand query performance prediction from the user's pe...
     
Query quality: user ratings and system predictions
Found in: Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '10)
By Claudia Hauff, Diane Kelly, Franciska de Jong, Leif Azzopardi
Issue Date:July 2010
pp. 743-744
Numerous studies have examined the ability of query performance prediction methods to estimate a query's quality for system effectiveness measures (such as average precision). However, little work has explored the relationship between these methods and use...
     
Effects of popularity and quality on the usage of query suggestions during information search
Found in: Proceedings of the 28th international conference on Human factors in computing systems (CHI '10)
By Amber Cushing, Diane Kelly, Karl Gyllstrom, Maureen Dostert, Xi Niu
Issue Date:April 2010
pp. 45-54
Many search systems provide users with recommended queries during online information seeking. Although usage statistics are often used to recommend queries, this information is usually not displayed to the user. In this study, we investigate how the presen...
     
2nd CASCON Workshop on Software Engineering for Science
Found in: Proceedings of the 2009 Conference of the Center for Advanced Studies on Collaborative Research (CASCON '09)
By Diane Kelly, Spencer Smith
Issue Date:November 2009
pp. 345-347
Scientific software is application software that supplies data to support decisions in a field of science or engineering. Computational models of climate, geographic information systems to study bird habitats, analysis software for the safe operation of nu...
     
Users' stopping behaviors and estimates of recall
Found in: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '09)
By Diane Kelly, Maureen Dostert
Issue Date:July 2009
pp. 435-435
This paper investigates subjects' stopping behaviors and estimates of recall in an interactive information retrieval (IIR) experiment. Subjects completed four recall-oriented search tasks and were asked to estimate how many of the relevant documents they b...
     
Undergraduates' evaluations of assigned search topics
Found in: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '09)
By Diane Kelly, Earl W. Bailey, Karl Gyllstrom
Issue Date:July 2009
pp. 435-435
This paper evaluates undergraduate students' knowledge, interests and experiences with 20 topics from the TREC Robust Track collection. The goal is to characterize these topics along several dimensions to help researchers make more informed decisions about...
     
A comparison of query and term suggestion features for interactive searching
Found in: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '09)
By Diane Kelly, Earl W. Bailey, Karl Gyllstrom
Issue Date:July 2009
pp. 435-435
Query formulation is one of the most difficult and important aspects of information seeking and retrieval. Two techniques, term relevance feedback and query suggestion, provide methods to help users formulate queries, but each is limited in different ways....
     
Learning design principles for a collaborative information seeking system
Found in: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09)
By Chirag Shah, Diane Kelly, Gary Marchionini
Issue Date:April 2009
pp. 1-4
While collaboration is a natural choice in many situations, there is a lack of specialized tools for collaboratively seeking information. We present design specifications and implementation of a collaborative information seeking system. We test this system...
     
Effects of performance feedback on users' evaluations of an interactive IR system
Found in: Proceedings of the second international symposium on Information interaction in context (IIiX '08)
By Anezka Poljakova, Ann K. Irvine, Cassidy R. Sugimoto, Chirag Shah, Diane Kelly, Earl W. Bailey, Marcos A. Rodriguez, Megan G. van Noord, Nicholas A. Johnson, Rachael A. Clemens, Sanghee Oh, Weimao Ke, Yan Zhang
Issue Date:October 2008
pp. N/A
In this study, we seek to understand how providing feedback to users about their performances with an interactive information retrieval (IIR) system impacts their evaluations of that system. Sixty subjects completed three recall-based searching tasks with ...
     
Using collaborative queries to improve retrieval for difficult topics
Found in: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '07)
By Chirag Shah, Diane Kelly, Xin Fu
Issue Date:July 2007
pp. 879-880
We describe a preliminary analysis of queries created by 81 users for 4 topics from the TREC Robust Track. Our goal was to explore the potential benefits of using queries created by multiple users on retrieval performance for difficult topics. We first exa...
     
Making mind and machine meet: a study of combining cognitive and algorithmic relevance feedback
Found in: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '07)
By Chirag Shah, Diane Kelly, Xin Fu
Issue Date:July 2007
pp. 877-878
Using Saracevic's relevance types, we explore approaches to combining algorithm and cognitive relevance in a term relevance feedback scenario. Data collected from 21 users who provided relevance feedback about terms suggested by a system for 50 TREC HARD t...
     
Inspecting designs in the context of model-driven development
Found in: Proceedings of the 2006 conference of the Center for Advanced Studies on Collaborative research (CASCON '06)
By Diane Kelly, Paul Mondoux, Ron Chisholm, Ron Smith, Terry Shepard, Todd Jackson
Issue Date:October 2006
pp. 27-es
One of the potential strengths of Model Driven Development (MDD) is the ability to inspect the software sooner and with greater precision than is possible with conventional forms of expression of design. A study was conducted to explore model inspection wh...
     
Contextual relevance feedback
Found in: Proceedings of the 1st international conference on Interaction in context (IIiX)
By David J. Harper, Diane Kelly
Issue Date:October 2006
pp. 129-137
We present results of a preliminary study of a pile-based information retrieval interface that supports contextual relevance feedback. We designed two interfaces based on the pile metaphor, one which supported contextual relevance feedback and the other wh...
     
Evaluating sources of query expansion terms
Found in: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '06)
By Diane Kelly, Xin Fu
Issue Date:August 2006
pp. 647-648
This study investigates the effectiveness of retrieval systems and human users in generating terms for query expansion. We compare three sources of terms: system generated terms, terms users select from top-ranked sentences, and user generated terms. Resul...
     
Elicitation of term relevance feedback: an investigation of term source and context
Found in: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '06)
By Diane Kelly, Xin Fu
Issue Date:August 2006
pp. 453-460
Term relevance feedback has had a long history in information retrieval. However, research on interactive term relevance feedback has yielded mixed results. In this paper, we investigate several aspects related to the elicitation of term relevance feedback...
     
Evaluating personal information management behaviors and tools
Found in: Communications of the ACM
By Diane Kelly
Issue Date:January 2006
pp. 84-86
How to study and understand the idiosyncratic PIM behaviors we exhibit naturally at home, at work, and in between, in the interests of developing future PIM tools.
     
Display time as implicit feedback: understanding task effects
Found in: Proceedings of the 27th annual international conference on Research and development in information retrieval (SIGIR '04)
By Diane Kelly, Nicholas J. Belkin
Issue Date:July 2004
pp. 377-384
Recent research has had some success using the length of time a user displays a document in their web browser as implicit feedback for document preference. However, most studies have been confined to specific search domains, such as news, and have not cons...
     
Features of documents relevant to task- and fact- oriented questions
Found in: Proceedings of the eleventh international conference on Information and knowledge management (CIKM '02)
By Diane Kelly, Nicholas J. Belkin, Vanessa Murdock, W. Bruce Croft, Xiao-jun Yuan
Issue Date:November 2002
pp. 645-647
We describe results from an ongoing project that considers question types and document features and their relationship to retrieval techniques. We examine eight document features from the top 25 documents retrieved from 74 questions and find that lists and...
     
The effects of topic familiarity on information search behavior
Found in: Proceedings of the second ACM/IEEE-CS joint conference on Digital libraries (JCDL '02)
By Colleen Cool, Diane Kelly
Issue Date:July 2002
pp. 74-75
We describe results from a preliminary investigation of the relationship between topic familiarity and information search behavior. Two types of information search behaviors are considered: reading time and efficacy. Our results indicate that as one's fami...
     
Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback
Found in: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '01)
By Diane Kelly, Nicholas J. Belkin
Issue Date:September 2001
pp. 408-409
A sentence extract summary of a document is a subset of the document's sentences that contains the main ideas in the document. We present an approach to generating such summaries, a hidden Markov model that judges the likelihood that each sentence should b...
     
 1