Collaboratory


A collaboratory, as defined by William Wulf in 1989, is a “center without walls, in which the nation’s researchers can perform their research without regard to physical location, interacting with colleagues, accessing instrumentation, sharing data and computational resources, accessing information in digital libraries”.
Bly refines the definition to “a system which combines the interests of the scientific community at large with those of the computer science and engineering community to create integrated, tool-oriented computing and communication systems to support scientific collaboration”.
Rosenberg considers a collaboratory as being an experimental and empirical research environment in which scientists work and communicate with each other to design systems, participate in collaborative science, and conduct experiments to evaluate and improve systems.
A simplified form of these definitions would describe the collaboratory as being an environment where participants make use of computing and communication technologies to access shared instruments and data, as well as to communicate with others.
However, a wide-ranging definition is provided by Cogburn who states that “a collaboratory is more than an elaborate collection of information and communications technologies; it is a new networked organizational form that also includes social processes; collaboration techniques; formal and informal communication; and agreement on norms, principles, values, and rules”.
This concept has a lot in common with the notions of Interlock research, Information Routing Group and Interlock diagrams introduced in 1984.

Other meaning

The word “collaboratory” is also used to describe an open space, creative process where a group of people work together to generate solutions to complex problems.
This meaning of the word originates from the visioning work of a large group of people – including scholars, artists, consultant, students, activists, and other professionals – who worked together on the 50+20 initiative aiming at transforming management education.
In this context, by fusing two elements, “collaboration” and “laboratory”, the word “collaboratory” suggests the construction of a space where people explore collaborative innovations.
It is, as defined by Dr. Katrin Muff, “an open space for all stakeholders where action learning and action research join forces, and students, educators, and researchers work with members of all facets of society to address current dilemmas.”
The concept of the collaboratory as a creative group process and its application are further developed in the book “The Collaboratory: A co-creative stakeholder engagement process for solving complex problems”.
Examples of collaboratory events are provided on the website of the Collaboratory community as well as by Business School Lausanne- a Swiss business school that has adopted the collaboratory method to harness collective intelligence.

Background

Problems of geographic separation are especially present in large research projects. The time and cost for traveling, the difficulties in keeping contact with other scientists, the control of experimental apparatus, the distribution of information, and the large number of participants in a research project are just a few of the issues researchers are faced with.
Therefore, collaboratories have been put into operation in response to these concerns and restrictions. However, the development and implementation proves to be not so inexpensive. From 1992 to 2000 financial budgets for scientific research and development of collaboratories ranged from US$447,000 to US$10,890,000 and the total use ranged from 17 to 215 users per collaboratory. Particularly higher costs occurred when software packages were not available for purchase and direct integration into the collaboratory or when requirements and expectations were not met.
Chin and Lansing state that the research and development of scientific collaboratories had, thus far, a tool-centric approach. The main goal was to provide tools for shared access and manipulation of specific software systems or scientific instruments. Such an emphasis on tools was necessary in the early development years of scientific collaboratories due to the lack of basic collaboration tools to support rudimentary levels of communication and interaction. Today, however, such tools are available in off-the-shelf software packages such as Microsoft NetMeeting, IBM Lotus Sametime, Mbone Videoconferencing. Therefore, the design of collaboratories may now move beyond developing general communication mechanisms to evaluating and supporting the very nature of collaboration in the scientific context.

The evolution of the collaboratory

As stated in Chapter 4 of the 50+20 "Management Education for the World" book, "the term collaboratory was first introduced in the late 1980s to address problems of geographic separation in large research projects related to travel time and cost, difficulties in keeping contact with other scientists, control of experimental apparatus, distribution of information, and the large number of participants. In their first decade of use, collaboratories were seen as complex and expensive information and communication technology solutions supporting 15 to 200 users per project, with budgets ranging from 0.5 to 10 million USD. At that time, collaboratories were designed from an ICT perspective to serve the interests of the scientific community with tool-oriented computing requirements, creating an environment that enabled systems design and participation in collaborative science and experiments.
The introduction of a user-centered approach provided a first evolutionary step in the design philosophy of the collaboratory, allowing rapid prototyping and development circles. Over the past decade the concept of the collaboratory expanded beyond that of an elaborate ICT solution, evolving into a “new networked organizational form that also includes social processes, collaboration techniques, formal and informal communication, and agreement on norms, principles, values, and rules”. The collaboratory shifted from being a tool-centric to a data-centric approach, enabling data sharing beyond a common repository for storing and retrieving shared data sets. These developments have led to the evolution of the collaboratory towards a globally distributed knowledge work that produces intangible goods and services capable of being both developed and distributed around the world using traditional ICT networks.
Initially, the collaboratory was used in scientific research projects with variable degrees of success. In recent years, collaboratory models have been applied to areas beyond scientific research and the national context. The wide acceptance of collaborative technologies in many parts of the world opens promising opportunities for international cooperation in critical areas where societal stakeholders are unable to work out solutions in isolation, providing a platform for large multidisciplinary teams to work on complex global challenges.
The emergence of open-source technology transformed the collaboratory into its next evolution. The term open-source was adopted by a group of people in the free software movement in Palo Alto in 1998 in reaction to the source code release of the Netscape Navigator browser. Beyond providing a pragmatic methodology for free distribution and access to an end product's design and implementation details, open-source represents a paradigm shift in the philosophy of collaboration. The collaboratory has proven to be a viable solution for the creation of a virtual organization. Increasingly, however, there is a need to expand this virtual space into the real world. We propose another paradigm shift, moving the collaboratory beyond its existing ICT framework to a methodology of collaboration beyond the tool- and data-centric approaches, and towards an issue-centered approach that is transdisciplinary in nature."

The Collaboratory as a creative group process

Copyright 50+20 "Management Education for the World" book
"Translating the concept of the collaboratory from the virtual space into a real environment demands a number of significant adjustments, leading us to yet another evolution. While the virtual collaboratory could count on ICT solutions to create and maintain an environment of collaboration, real-life interactions require facilitation experts to create and hold a space for members of the community, jointly developing transdisciplinary solutions around issues of concern. The ability to hold a space is central to the vision of management education.
The technology involved with holding a space implies the ability to create and maintain a powerful and safe learning platform. Such a space invites the whole person into a place where the potential of a situation is fully realized. Holding a space is deeply grounded in our human heritage, and is still considered an important duty of the elders amongst many indigenous peoples. In Western society, good coaches fulfill a similar role, including the ability to be present in the moment, listening with all senses, being attuned to the invisible potential about to be expressed. As a result, what needs to happen, will happen. Facilitation and coaching experts understand the specific challenges involved in setting up an environment in which a great number of people can meet to discuss solutions that none of them could develop individually. Coaching and facilitation solutions already exist to create and hold such spaces, but are nevertheless distinctly different in a felt sense from the ICT-driven virtual collaboratories we have seen over the past two decades.
The evolution from the virtual collaboratory bears its own challenges and opportunities. In the co-creative process of the 50+20 vision, we learned to appreciate the power of the collaboratory both in real-life retreats as well as interactions between our gatherings. We propose that the next evolutionary step of the collaboratory will include both the broader community of researchers engaged in collaboratories around the world, as well as stakeholders in management education who seek to transform themselves by providing responsible leadership.
In our new definition, a collaboratory is an inclusive learning environment where action learning and action research meet. It involves the active collaboration of a diversified group of participants that bring in different perspectives on a given issue or topic. In such a space, learning and research is organized around issues rather than disciplines or theory. Such issues include: hunger, energy, water, climate change, migration, democracy, capitalism, terrorism, disease, the financial crisis, new economic models, management education that serves the world and similarly pressing matters. These issues are usually complex, messy and hard to resolve, demanding creative, systemic and divergent approaches. The collaboratory's primary aim is to foster collective creativity.
The collaboratory is a place where people can think, work, learn together, and invent their respective futures. Its facilitators are highly experienced coaches who act as lead learners and guardians of the collaboratory space. They see themselves as transient gatekeepers of a world in need of new solutions. Subject experts are responsible for providing relevant knowledge and contributing it to the discussion in a relevant and pertinent matter. Students will continue to acquire subject knowledge outside the collaboratories – both through traditional and developing channels.
As such, the faculty is challenged to develop their capacities as facilitators and coaches in order to effectively guide these collaborative learning and research processes. To do this, they must step back from their role as experts and rather serve as facilitators in an open, participative and creative process. Faculty training and development needs to include not only a broad understanding of global issues, but also the development of facilitation and coaching skills.
The circular space of the collaboratory can become the preferred meeting place for citizens to jointly question, discuss and construct new ideas and approaches to resolve environmental, societal and economic challenges on both a regional and global level. Collaboratories should always reflect a rich combination of stakeholders: coaches, business and management faculty, citizens, politicians, entrepreneurs, people from different regions and cultures, youth and elders. Together they assemble differences in perspective, expertise and personal backgrounds, thereby adding a vital creative edge to every encounter, negotiation or problem-solving session."

Characteristics and considerations

A distinctive characteristic of collaboratories is that they focus on data collection and analysis. Hence the interest to apply collaborative technologies to support data sharing as opposed to tool sharing. Chin and Lansing explore the shift of collaboratory development from traditional tool-centric approaches to more data-centric ones, to effectively support data sharing. This means more than just providing a common repository for storing and retrieving shared data sets. Collaboration, Chin and Lansing state, is driven both by the need to share data and to share knowledge about data. Shared data is only useful if sufficient context is provided about the data such that collaborators may comprehend and effectively apply it. It is therefore imperative, according to Chin and Lansing, to know and understand how data sets relate to aspects of overall data space, applications, experiments, projects, and the scientific community, identifying the critical features or properties among which we can mention:
Henline argues that communication about experimental data is another important characteristic of a collaboratory. By focusing attention on the dynamics of information exchange, the study of Zebrafish Information Network Project concluded that the key challenges in creating a collaboratory may be social rather than technical. “A successful system must respect existing social conventions while encouraging the development of analogous mechanisms within the new electronic forum”. Similar observations were made in the Computer-supported collaborative learning case study. The author is investigating a collaboratory established for researchers in education and other related domains from United States of America and southern Africa. The main finding was that there have been important intellectual contributions on both sides, although the context was that of a developed country working together with a developing one and there have been social as well as cultural barriers. He further develops the idea that a successful CSCL would need to draw the best lessons learned on both sides in computer-mediated communication and computer-supported cooperative work.
Sonnenwald conducted seventeen interviews with scientists and revealed important considerations. Scientists expect a collaboratory to “support their strategic plans; facilitate management of the scientific process; have a positive or neutral impact on scientific outcomes; provide advantages and disadvantages for scientific task execution; and provide personal conveniences when collaborating across distances”. Many scientists looked at the collaboratory as means to achieve strategic goals that were organizational and personal in nature. Other scientists anticipated that the scientific process would speed up when they had access to the collaboratory.

Design philosophy

Finholt, based on the case studies of the Upper Atmospheric Research Collaboratory and the Medical Collaboratory, establishes a design philosophy: a collaboratory project must be dedicated to a user-centered design approach. This means a commitment to develop software in programming environments that allow rapid prototyping, rapid development cycles. A consequence of the user-centered design in the collaboratory is that the system developers must be able to distinguish when a particular system or modification has positive impact on users’ work practices. An important part of obtaining this understanding is producing an accurate picture of how work is done prior to the introduction of technology. Finholt explains that behavioral scientists had the task of understanding the actual work settings for which new information technologies were developed. The goal of a user-centered design effort was to inject those observations back into the design process to provide a baseline for evaluating future changes and to illuminate productive directions for prototype development.
A similar viewpoint is expressed by Cogburn who relates the collaboratory to a globally distributed knowledge work, stating that human-computer interaction and user-centered design principles are critical for organizations to take advantage of the opportunities of globalization and the emergence of an Information society. He refers to distributed knowledge work as being a set of “economic activities that produce intangible goods and services , capable of being both developed and distributed around the world using the global information and communication networks”. Through the use of these global information and communications networks, organizations are able to take part in globally disarticulated production, which means they can locate their research and development facilities almost anywhere in the world, and engineers can collaborate across time zones, institutions and national boundaries.

Evaluation

Meeting expectations is a factor that influences adoption of innovations, including scientific collaboratories. Some of the collaboratories implemented thus far have not been entirely successful. The Mathematics and Computer Science Division of Argonne National Laboratory, Waterfall Glen collaboratory is an illustrative example. This collaboratory had its shares of problems. There have been the occasional technical and social disasters, but most importantly it did not meet all of the collaboration and interaction requirements.
The vast majority of the evaluations performed thus far are concentrating mainly on the usage statistics or on the immediate role in the production of traditional scientific outcomes. Sonnenwald, however, argues that we should rather look for longer-term and intangible measures such as new and continued relationship among scientists, and subsequent, longer-term creation of new knowledge.
Regardless of the criteria used for evaluation, we must focus on understanding the expectations and requirements defined for a collaboratory. Without such understanding a collaboratory runs the risk of not being adopted.

Success factors

Olson, Teasley, Bietz, and Cogburn ascertain some of the success factors of a collaboratory. They are: collaboration readiness, collaboration infrastructure readiness, and collaboration technology readiness.
Collaboration readiness is the most basic pre-requisite for an effective collaboratory, according to Olson, Teasley, Bietz, and Cogburn. Often the critical component to collaboration readiness is based on the concept of “working together in order to achieve a science goal”. Incentives to collaborate, shared principles of collaboration, and experience with the elements of collaboration are also crucial. Successful interaction between users requires a certain amount of common ground. Interactions require a high degree of trust or negotiation, especially when they involve areas where there is a cultural difference. “Ethical norms tend to be culturally specific, and negotiations about ethical issues require high levels of trust”.
When analyzing the collaboration infrastructure readiness Olson, Teasley, Bietz, and Cogburn state that modern collaboration tools require adequate infrastructure to operate properly. Many off-the-shelf applications will run effectively only on state-of-the-art workstations. An important piece of the infrastructure is the technical support necessary to ensure version control, to get participants registered, and to recover in case of disaster. Communications cost is another element which can be critical for collaboration infrastructure readiness. Pricing structures for network connectivity can affect the choices that users will make and therefore have an effect on the collaboratory's final design and implementation.
Collaboration technology readiness, according to Olson, Teasley, Bietz, and Cogburn, refers to the fact that collaboration does not involve only technology and infrastructure, but also requires a considerable investment in training. Thus, it is essential to assess the state of technology readiness in the community to ensure success. If the level is too primitive more training is required to bring the users’ knowledge up-to-date.

Examples

Biological Sciences Collaboratory

A comprehensively described example of a collaboratory, the Biological Sciences Collaboratory at the Pacific Northwest National Laboratory, enables the sharing and analysis of biological data through metadata capture, electronic laboratory notebooks, data organization views, data provenance tracking, analysis notes, task management, and scientific workflow management. BSC supports various data formats, has data translation capabilities, and can interact and exchange data with other sources. It offers subscription capabilities and verification of identities, establishes and manages permissions and privileges, and has data encryption capabilities as part of its security package.
BSC also provides a data provenance tool and a data organization tool. These tools allow a hierarchical tree to display the historical lineage of a data set. From this tree-view the scientist may select a particular node to access a specific version of the data set.
The task management provided by BSC allows users to define and track tasks related to a specific experiment or project. Tasks can have deadlines assigned, levels of priority, and dependencies. Tasks can also be queried and various reports produced. Related to task management, BSC provides workflow management to capture, manage, and supply standard paths of analyses. The scientific workflow may be viewed as process templates that captures and semi-automate the steps of an analysis process and its encompassing data sets and tools.
BSC provides project collaboration by allowing scientists to define and manage members of their group. Security and authentication mechanisms are therefore applied to limit access to project data and applications. Monitoring capability allows for members to identify other members that are online working on the project.
BSC offers community collaboration capabilities: scientists may publish their data sets to a larger community through the data portal. Notifications are in place for scientists interested in a particular set of data - when that data changes, the scientists get notification via email.

https://web.archive.org/web/20120806205400/https://adapt.nd.edu/ Collaboratory for Adaptation to Climate Change

The Collaboratory for Adaptation to Climate Change is an interdisciplinary project funded by a grant from the National Science Foundation’s Office of CyberInfrastructure and supported by the University of Notre Dame.
The research mission of the Collaboratory is to improve the dissemination and integration of knowledge that will inform the development of prescient adaptation strategies and policies. Goals of the Collaboratory include:
The Collaboratory is not a place for political debate, but is a place for pitching ideas and information with legitimate scientific backing that inform adaptation decisions.
The website is a resource for research, education, and collaboration in the area of adaptation and climate change. It incorporates a multitude of tools, which take several forms including biological simulation, searchable clearinghouses of legal information, and dissemination of emerging opinion from experts on the benefits and risks of adaptation. These tools can be used individually and in an integrative way to inform decision-making, research, and awareness. The site was created in April 2011 and is under continual development. Check back often for new additions and improvements.
Adaptation, together with reduction of greenhouse gas emissions, is an essential part of solving the climate change crisis. Adaptation includes all of the steps that humans might take to help reduce the effects of climate change that are projected to occur in the 21st century and beyond. The Intergovernmental Panel on Climate Change, and international body of scientists, projects that the global climate is likely to shift 2–6 °C warmer within 100 years. That amount of warming will disrupt ecosystems, raise sea levels, and perturb agriculture and human infrastructure. It also will affect human health. We can take steps now to reduce these effects in some instances and places. Adaptation includes, for example, helping species relocate to newly-suitable locations, protecting shores from rising waters and contoling pests that increase or spread under altered conditions. In 2011, Adapt is focused on adaptation for wildlife and biological resources.
We welcome scientists, natural resource managers and planners, students and the interested public to participate.Take a tour of our web site and see how you can use our infrastructure to further your own research and educational activities. Create your own account. It's free and will give you access to our online simulation tools and other features. Become a contributor by uploading your own presentations and simulation tools for others to share. Ask a question in our community forum, and let the community help you out.

Diesel Combustion Collaboratory

Pancerella, Rahn, and Yang analyzed the Diesel Combustion Collaboratory which was a problem-solving environment for combustion research. The main goal of DCC was to make the information exchange for the combustion researchers more efficient. Researchers would collaborate over the Internet using various DCC tools. These tools included “a distributed execution management system for running combustion models on widely distributed computers, including supercomputers; web accessible data archiving capabilities for sharing graphical experimental or modeling data; electronic notebooks and shared workspaces for facilitating collaboration; visualization of combustion data; and videoconferencing and data conferencing among researchers at remote sites”.
The collaboratory design team defined the requirements to be :
Each of these requirements had to be done securely and efficiently across the Internet. Resources availability was a major concern because many of the chemistry simulations could run for hours or even days on high-end workstations and produce Kilobytes to Megabytes of data sets. These data sets had to be visualized using simultaneous 2-D plots of multiple variables.
The deployment of the DCC was done in a phased approach. The first phase was based on iterative development, testing, and deployment of individual collaboratory tools. Once collaboratory team members had adequately tested each new tool, it was deployed to combustion researchers. The deployment of the infrastructure was done in parallel. The next phase was to implement full security in the collaboratory. The primary focus was on two-way synchronous and multi-way asynchronous collaborations. The challenge was to balance the increased access to data that was needed with the security requirements. The final phase was the broadening of the target research to multiple projects including a broader range of collaborators.
The collaboratory team found that the highest impact was perceived by the geographically separated scientists that truly depended on each other to achieve their goals. One of the team's major challenges was to overcome the technological and social barriers in order to meet all of the objectives. User openness and low maintenance security collaboratories are hard to achieve, therefore user feedback and evaluation are constantly required.

Other collaboratories

Other collaboratories that have been implemented and can be further investigated are:
Special consideration should be attributed to TANGO because it is a step forward in implementing collaboratories, as it has distance learning and health care as main domains of operation. Henline mentions that the collaboratory has been successfully used to implement applications for distance learning, command and control center, telemedical bridge, and a remote consulting tool suite.
To date, most collaboratories have been applied largely in scientific research projects, with various degrees of success and failure. Recently, however, collaboratory models have been applied to additional areas of scientific research in both national and international contexts. As a result, a substantial knowledge base has emerged helping us in understanding their development and application in science and industry. Extending the collaboratory concept to include both social and behavioral research as well as more scientists from the developing world could potentially strengthen the concept and provide opportunities of learning more about the social and technical factors that support a distributed knowledge network.
The use of collaborative technologies to support geographically distributed scientific research is gaining wide acceptance in many parts of the world. Such collaboratories hold great promise for international cooperation in critical areas of scientific research and not only. As the frontiers of knowledge are pushed back the problems get more and more difficult, often requiring large multidisciplinary teams to make progress. The collaboratory is emerging as a viable solution, using communication and computing technologies to relax the constraints of distance and time, creating an instance of a virtual organization. The collaboratory is both an opportunity with very useful properties, but also a challenge to human organizational practices.

Footnotes