Lessons Learned Links

Navy Center for Applied Research in Artificial Intelligence
Naval Research Laboratory, Code 5515
4555 Overlook Ave, SW
Washington, D.C. 20375-5337
(202) 404-4940 | (202) 767-3172 (FAX)

LL Organizations | References | Tools | Workshops

Lessons Learned Organizations

Canada

• Army Lessons Learned Centre
  • Lessons Learned Leadership in a Mixed-Gender Environment (Find under "Products"/"Dispatches")
• Canadian Peacebuilding Coordinating Committee

International Organizations

• American, British, Canadian, and Australian Armies' Standardization Program (ABCA)
  • Coalition Operations Lessons Learned Database (COLL)
• United Nations
  • Department of Peacekeeping Operations
    • Lessons Learned in Peacekeeping Operations
  • Office of Evaluation and Studies
    • International Fund for Agricultural Development

The Netherlands

• KALIF: A Knowledge and Learning Infrastructure (ESPRIT project)

United States

1. American Industrial Hygiene Association (AIHA)
2. Construction Industry Institute (CII)
3. Commercial Organizations
4. Defense Systems Management College (DSMC)
5. Department of Defense (DoD)
6. Deparment of Energy (DoE)
7. Federal Transit Administration (FTA)
8. NASA
9. NIST
10. NNSA
11. Private Foundations
12. SIPRNET Pointer
13. Software Program Managers Network (SPMN)

1. American Industrial Hygiene Association Laboratory Health and Safety Committee
   • Lessons Learned in Laboratory Incidents
2. Construction Industry Institute
   • Lessons Learned Products
3. Commercial Organizations
   • DCASoft
     • Makers of the BrightLight Web-based Lessons Learned Software
   • Vivisimo DOE LL DB Clustering Results
4. Defense Systems Management College
   • Lessons Learned Research
5. Department of Defense
   • Air Force
     • Air Force Center for Knowledge Sharing Lessons Learned
     • Air Force Knowledge Management
   • Army
     • Center for Army Lessons Learned (CALL)
     • Center for Engineers Lessons Learned (CELL)
     • CompanyCommand (A professional forum and ongoing conversation about leading soldiers & building combat-ready units; March 2004)
     • OMB Circular A-76 -- Commercial Activities (including Lessons Learned) (Deputy Secretary for the Army, Procurement: SARDA)
     • Medical Lessons Learned (AMEDD)
   • Coast Guard
     • Coast Guard Standard After Action Information and Lessons Learned System
     • Lessons Learned and Best Practices (PTP: Prevention Through People)
     • Outdated links
       • Coast Guard Universal Lessons Learned
   • Joint Forces
     • Joint Center for Lessons Learned (Contact: Bob Lucas)
   • Marine Corps
     • Marine Corps Center for Lessons Learned (MCCLL)
   • Navy
     • Acquisition and Business Management: Lessons Learned (empty as of 1/00)
     • NAVFAC: Naval Facilities Engineering Command Lessons Learned and Best Practices Home Page
     • NAVSEA: Test & Evaluation Lessons Learned
     • NAWCAD: Navy Combined Automated Lessons Learned (CALL; Contact: Ron French)
     • NWDC's Navy Lessons Learned System (NLLS)
     • Office of Naval Research
       • Best Manufacturing Practices (BMP) Program
6. Department of Energy
   • Lessons Learned Information Services (Main DoE site)
     • DOE Corporate Lessons Learned Collection
       • Project Hanford Lessons Learned
       • Lockheed Martin/Oak Ridge Lessons Learned
     • Lessons Learned Coordinators
     • Environmental, Safety, and Health Information Portal
     • Society for Effective Lessons Learned Sharing (SELLS)
   • Laboratories
     • Argonne National Laboratory
       • Lessons Learned Systems (Technology Transfer)
     • Idaho National Engineering and Environmental Laboratory
       • Lessons Learned
     • Lawrence Berkeley National Laboratory
       • Environment, Health and Safety Division
         • Lessons Learned
     • Oak Ridge National Laboratory
       • Packaging and Transportation Safety Program
     • Sandia National Laboratory
       • ES Operating Experience-Lessons Learned (very slow response)
   • National Environmental Policy Act (Process Info)
   • Oakland Operations Office Lessons Learned
   • Office of Environmental Management
     • Fernald Environmental Management Project
       • Lessons Learned Program (empty as of 1/00)
     • Lessons Learned Program
     • Technical Information Exchange
   • Office of Environment, Safety, and Health
     • Lawrence Livermore National Laboratory
       • Lessons Learned
     • Los Alamos National Laboratory
       • Occurrence Investigation
     • Nevada Operations
       • Lessons Learned (Bechtel, Nevada; only 4 lessons?)
     • Office of Nuclear and Facility Safety:
       • Operating Experience Weekly Summary
   • Office of Oversight
     • Accident Investigation Lessons Learned
7. Federal Transit Administration
   • Lessons Learned Program
8. NASA
   • NASA: Better Mechanisms Needed for Sharing Lessons Learned (GAO Report 02-195, January 2002)
   • Report on Lessons Learned from the Extreme Ultraviolet Explorer (EUVE) Mission
   • RECALL: Reusable Experience with Case-Based Reasoning for Automating Lessons Learned (NASA-Goddard; Contact: Tom Bagg; restricted)
   • International Space Shuttle (restricted)
     • Project Lead: Nathan Vassberg (281) 244-8389
   • Lessons Learned Information System
     • Includes links/access to the NASA International Safety LL DB
   • SOHO Mission Interruption Joint NASA/ESA Investigation Board
9. NIST
   • Best Practices Hyperlinks
10. NNSA (National Nuclear Security Administration)
    • NNSA Lessons Learned (9/02)
11. Private Foundations
    • Benton Foundation
12. SIPRNET Pointer For the complete text of ALL DOD lessons learned (unclassified and classified) and links to other knowledge sharing sites, visit the Air Combat Command Center for Lessons Learned site on the SIPRNET.
13. Software Program Managers Network

Some References on Lessons Learned Systems

• Aha, D.W., & Weber, R. (2000). Intelligent Lessons Learned Systems: Papers from the AAAI Workshop (Technical Report WS-00-??). Menlo Park, CA: AAAI Press.
• CII (1997). Modeling the lessons learned process (Technical Report Research Summary 123-1). Construction Industry Institute, Modeling Lessons Learned Research Team.
• Dingsoyr, T., Moe, N.B., & Nytro, O. (2001). Augmenting experience reports with lightweight postmortem reviews. In Proceedings of the Third International Conference on Product Focused Software Process Improvement (unknown pages). Kaiserslautern, Germany: Unknown publisher.
• Fisher, D., Deshpande, S., & Livingston, J. (1998). Modeling the lessons learned process (Research Report 123-11). Albequerque, NM: The University of New Mexico, Department of Civil Engineering.
• Heijst, G. van, Hofman, M., Kruizinga, E., & Spek, R. van der (1997). AI-Techniques and the Knowledge Pump. In B.Gaines & R.Uthursamy (Eds.) Artificial Intelligence in Knowledge Management: Proceedings of the 1997 Spring Symposium (Technical Report SS-97-01). Menlo Park, CA: AAAI Press
• Johnson, C., Birnbaum, L., Bareiss, R., & Hinrichs, T. (2000). War stories: Harnessing organizattional memories to support task performance. Intelligence: New Visions of AI in Practice, 11(1), 17-31.
• Leake, D.B., Bauer, T., Maguitman, A., & Wilson, D.C. (2000). Capture, storage, and reuse of lessons about information resources: Supporting task-based information search. To appear in (Aha & Weber, 2000).
• Moussavi, M. (2000). A dialogue-based system for sharing development knowledge. To appear in (Aha & Weber, 2000).
• Sary, C., & Mackey, W. (1995). A case-based reasoning approach for the access and reuse of lessons learned. Proceedings of the Fifth Annual International Symposium of the National Council on Systems Engineering (pp. 249-256). St. Louis, Missouri: NCOSE.
• Secchi, P. (Ed.) (1999). Workshop on alerts and lessons learned: An effective way to prevent failures and problems (Technical Report WPP-167). Noordwijk, The Netherlands: European Space Agency. [www.estec.esa.nl/CONFANNOUN/99c06]
• SELLS (1999). Proceedings of the Society for Effective Lessons Learned Sharing's Spring Meeting. Las Vegas, NV: Unpublished. [ www.tis.eh.doe.gov/ll/sells/proceedings399.htm]
• Stalhane, T., Dingsoyr, T., Moe, N.B., & Hanssen, G.K. (2001). Post mortem - An assessment of two approaches. In Proceedings of EuroSPI (pages unknown). Limerick, Ireland: Unknown publisher.
• Tautz, C., Althoff, K.-D., & Nick, M. (2000). A case-based reasoning approach for managing qualitative experience. To appear in (Aha & Weber, 2000).
• Vandeville, J.V. & Shaikh, M. A. (1999) A structured approximate reasoning-based approach for gathering "lessons learned" information from system development projects. Systems Engineering, 2(4), 242-247.
• van Heijst, G., van der Spek, R., & Kruizinga, E. (1996). Organizing Corporate Memories. Proceedings of the Tenth Banff Workshop on Knowledge Acquisition for Knowledge-Based Systems.
• Verdin, R. (1999). Elaborating an efficient experience feedback process. In (Secchi, 1999).
• Weber, R., Aha, D.W., Branting, L.K., Lucas, J.R., & Becerra-Fernandez, I. (2000). Active case-based reasoning for lessons delivery systems. To appear in Proceedings of the Thirteenth Annual Conference of the International Florida Artificial Intelligence Research Society. Orlando, FL: AAAI Press.
• Wildberger, M. (2000). Learning lessons intelligently in the electric power industry. To appear in (Aha & Weber, 2000).

Tools

• REASON (Decision Systems, Inc.)
• Operational Performance Information System (OPIS) (Concord Associates, Inc.)
  • OPIS Online

Workshops

• Society for the Effective Lessons Learned Sharing (DoE)
  • On-line Proceeedings (Spring 1999 to present)

• Alerts and Lessons Learned: An Effective Way to Prevent Failures and Problems (European Space Agency; 29-30 September 1999)

• AAAI'00 Workshop on Intelligent Lessons Learned Systems (31 July 2000; Austin, Texas)

• Learning Software Organizations (2-4 April 2003; Luzern)

Acknowledgements: Thanks to many people and organizations for supplying useful hyperlinks to relevant resources, and to the Office of Naval Research, Naval Research Laboratory, University of Wyoming, University of Maryland, and DARPA for their support of our research.