Bayesian Belief Net and Other Probabilistic Approaches
- Compilations
  - Software for Manipulating Belief Networks (Russell Almond)
  - Bayesian Belief Network Software (J. Cheng)
- Commercial
  - Analytica Influence diagram-based, visual environment for creating and analyzing probabilistic models (Win/Mac)
  - AT-Sigma Data Chopper for analysis of databases and finding causal relationships
  - BayesiaLab (a complete set of Bayesian network tools, including supervised and unsupervised learning, and analysis toolbox)
  - Bayesware Discoverer 1.0 An automated modeling tool able to extract a Bayesian network from data by searching for the most probable model
  - Data Digest Business Navigator 5 Combines Bayesian networks, graphical UI, and data preparation tools
  - DXpress Windows based tool for building and compiling Bayes Networks
  - Ergo(tm) Bayesian Network Editor and Solver (Win and Mac demos available)
  - HUGIN Full suite of Bayesian Network reasoning tools
  - KnowledgeMiner Uses self-organizing neural networks to discover problem structure (Mac platform)
  - Netica (Norsys) Bayesian network tools (Win 95/NT), demo available
  - PrecisionTree An add-in for Microsoft Excel for building decision trees and influence diagrams directly in the spreadsheet
- Free
  - BAYDA 1.0 (Henry Tirri, U. Helsinki Complex Systems Computation Group)
  - Belief Network Power Constructor (Jie Cheng)
  - BETSY: Bayesian Essay Test Scoring sYstem (Larry Rudner, University of Maryland)
  - FDEP Induces functional dependencies from a given input relation (GNU C)
  - GeNIe decision modeling environment implementing influence diagrams and Bayesian networks (Windows) (Has over 2000 users)
  - IBAL (A general purpose language for probabilistic reasoning; Avi Pfeffer; posted 23 June 2003)
  - JavaBayes
  - MSBN: Microsoft Belief Network Tools Tools for creation, assessment and evaluation of Bayesian belief networks. Free for non-commercial research users
  - Pulcinella Tool for Propagating Uncertainty through Local Computations based on the Shenoy and Shafer framework (Common Lisp)
  - SPI Probabilities, Local Expression Language Utilities, Explanation, Dynamic Models, GUI. (Common Lisp)
  - RoC (Robust Bayesian Classifier) (Marco Ramoni) v 1.0, for MS Windows 9x/NT
Clustering: See Unsupervised Learning
Collections (Varied) of Programs
- Data Mining Siftware
- MLT Toolbox (GMD)
- UCI ML programs (FOCL, Occam, etc)
- Siftware at the Knowledge Discovery Mine (Gregory Piatetsky-Shapiro)
- ML Research Software (University of Texas at Austin)
- Peter Clark - ML Software
- Prolog Library of ML Programs (Thomas Hoppe, GMD)
- TOOLDIAG (U. Lisbon & UNINOVA)
Data Generators
- Database Generator (Gabo Melli)
Data Mining
- Agent-Based Data Mining (Sal Stolfo)
- IBAI Solutions (Decision Master data mining tool; NetLog tool for mining logfiles; August 2006)
- SGI's MineSet
- Siftware at the Knowledge Discovery Mine
- DBPredictor on-line Classification System (Gabor Melli, Simon Fraser University)
- SUBDUE (U. Texas @ Arlington)
- XELOPES Data Mining Library (prudsys AG)
Decision Trees (TDIDT)
- AQnn (Michalski and colleagues): What does "AQ" denote? Answer: "AQ or Aq (q as a superscript) stands for Algorithm Quasi-optimal (as originally developed in 1969, the algorithm creates approximately or strictly optimal soluations of the general covering problem (which subsumes learning rules from examples)." - R. Michalski
- C4.5 and its extensions
  - C4.5's FTP Directory (J. Ross Quinlan)
  - Parallel C4.5 (Bin Li)
  - C5.0 info and demonstration versions (Rulequest)
  - C4.5 Patch File (for outputting classification rules as Prolog statements) (Kamran Karimi, University of Regina)
  - RFCT: An unsupervised, temporal extension of C4.5 (Kamran Karimi, University of Regina)
  - Excel Implementation (Angshuman Saha)
- Incremental Decision Trees(Paul Utgoff)
- ILA-2 (Eastern Mediterranean University)
- OC1 (Johns Hopkins University)
- SIPINA (D.A. Zighed)
Evaluation of Multiple Systems
- ROC Convex Hull for Comparing Classifiers (Tom Fawcett, Foster Provost)
- RocOn (A ROC Visualisation Tool; U. Bristol; J. Farrand)
Explanation-Based Learning
- Lazy Partial Evaluation (Peter Clark)
Feature Selection
- Feature Selection Challenge (I. Guyon, 2003)
First-Order Representations (e.g., Inductive Logic Programming)
- ACCEL (University of Texas at Austin; first-order abductive construction of explanations)
- Claudien (Luc Dehaspe, Luc De Raedt, & Wim Van Laer)
- FDEP (induces functional dependencies from relations) (Iztok Savnik)
- FOIL (J. Ross Quinlan)
- GMD's ILP Software Repository
- FORTE (University of Texas at Austin; first-order theory revision)
Genetic Algorithms
- AI FAQ/genetic (David Beasley)
- REGAL 3.0 (University of Torino)
- Automatic Design of Algorithms Through Evolution (ADATE)
- Swarm (Santa Fe Institute)
Lazy Learning
- NNVE: Robust Covariance Estimation Software via Nearest Neighbor Variance Estimation (Wang, Raftery, & Fraley; 12/03)
- PEBLS (Johns Hopkins University)
- Protos (Bruce Porter)
- TiMBL (ILK, Tilburg: a suite of tools)
  - TiMBL Reference Guide
- WHIRL (W.Cohen; can be used as a 1-NN text classifier)
Knowledge Acquisition
- Mobal (GMD)
Neural Networks
- Software & Data Analysis Services (Phil Brierley; A collection of ANN and GA software)
- Neural Networks (Scott Fahlmann)
- Bayesian Learning for Neural Networks (Radford Neal)
- A free Neural Network repository (Lutz Prechelt)
- Neural Networks for Prediction and Classification (Angshuman Saha; in Excel)
- PINN - Pseudo-inverse associative neural networks (Dmitry O. Gorodnichy)
Integrated Planning and Learning
- Prodigy (Carnegie Mellon University)
Reinforcement Learning
- Reinforcement Learning: A Tutorial (Mance E. Harmon; broken link)
- Reinforcement Learning with Selective Perception and Hidden State (dissertation, Andrew McCallum)
- A Reinforcement Learning Approach for Job-Shop Scheduling (Tom Dietterich and Wei Zhang)
Relational Learning
- Alchemy (Statistical Relational AI; Pedro Domingos; 19 December 2005)
Rule Learning
- CN2 (Peter Clark)
- CN2 Integrated with Qualitative Modelling (Peter Clark)
- PNC2 (Lars Haendel; 11/03)
- RIPPER (William Cohen)
- SLIPPER (W.Cohen)
- CBA: Classification and Association Rules (Bing Liu)
Statistical Software
- MODSTAT
- Statistical software (Warren Kovach)
- StatLib: Applied statistics algorithms (Carnegie Mellon University)
- Multiple Regression with Automatic Curve Fitting (James Widdoes)
- R (A clone of Splus; Gerhard Paass)
SVM
- SVM^light: Support Vector Machine (Thorsten Joachims, Cornell University) (9/04)
Theory Revision (propositional)
- NEITHER (University of Texas at Austin; propositional theory revision)
Unsupervised Learning
- Autoclass (NASA Ames)
  - Autoclass V3.1 C Program
- CLUTO (Software Package for Clustering High-Dimensional Datasets; 12/01)
- CViz (IBM's cluster visualization software, currently free as of 8/98)
- ECOBWEB (Yoram Reich)
- Fast Fuzzy Cluster (Michael Bickel)
- MCLUST/EMCLUST (Chris Fraley)
- Clustering using Self-Organizing Maps (Implemented by Angshuman Saha; Excel)
- Snob (Chris Wallace and David Dowe)
Workbenches
- Kepler (GMD)
- MLC++ Toolbench
  - Stanford
  - Silicon Graphics
- WEKA Toolbench (U. Waikato)
- YALE (U. Dortmund)

Special Interest Groups

SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data
American Association for Artificial Intelligence (AAAI)
Artificial Intelligence Research in Environmental Sciences (AIRIES)
British Computer Society Specialist Group on Expert Systems
Canadian Society for Computational Studies of Intelligence (CSCSI)
International Grammatical Inference Community
International Machine Learning Society (starting one)
European Network of Excellence in ML (MLnet)
IJCAI Inc.
Neural Information Processing Systems (NIPS)
Institute for Operations Research and the Management Sciences (INFORMS)
Knowledge Discovery Mine
Meteorology-AI (Eric Jones)
Robots
- AAAI 1996 Mobile Robot Competition and Exhibition
ACL Special Interest Group on Natural Language Learning (SIGNLL)
SOAR Project (University of Southern California)
Society for AI and Statistics
Classification Society of North America

Tutorials (and short notes)

Credits

None any more