Specialty Digest

Global English editionLearners’ Study Dashboard — in development
The Knowledge Library for All
Encyclopedia / Technology & Computing

Machine Learning

Specialty Knowledge entries in Machine Learning.

A shadow on a wall, an analogy for projecting a higher-dimensional object into fewer dimensions

Dimensionality Reduction

Dimensionality reduction is the process of reducing the number of input variables, called features or dimensions, in a dataset while keeping as much of the useful information as possible. A dataset with a thousand columns may really be described by a few dozen underlying factors. Reducing it makes data easier to store, faster to analyze

Dimensionality Reduction Read More »

Dimensionality reduction is the process of reducing the number of input variables in a dataset while keeping as much useful information as possible.

A large crowd, an analogy for the wisdom of crowds that ensemble learning draws on

Ensemble Learning

Ensemble learning is a machine learning approach in which several models, called base learners, are trained on the same problem and their predictions are combined into one final answer. The idea mirrors the wisdom of crowds. A group of reasonably good, diverse models will usually make fewer mistakes than any one of them alone, because

Ensemble Learning Read More »

Ensemble learning is a machine learning approach that combines the predictions of several models to get a more accurate and stable result than any single model.

An analyst working with tabular data, the typical setting for feature engineering

Feature Engineering

Feature engineering is the process of using knowledge of a problem to create, transform and select the input variables, called features, that a machine learning model learns from. Raw data rarely come in a form that algorithms use well. A timestamp is just a number until someone extracts the hour or the day of the

Feature Engineering Read More »

Feature engineering is the process of using domain knowledge to create, transform and select the input variables that a machine learning model learns from.

A magnifying glass, an analogy for pulling out the most informative details from raw data

Feature Extraction

Feature extraction is the process of transforming raw data, such as images, text, audio or sensor signals, into a smaller set of informative numerical features that a machine learning model can use. A photograph contains millions of pixel values, and a document is a long string of characters. Neither is a convenient input. Feature extraction

Feature Extraction Read More »

Feature extraction is the process of transforming raw data, such as images, text or signals, into a smaller set of informative numerical features that a model can use.

Many smartphones, the kind of devices that can train a model locally in federated learning

Federated Learning

Federated learning is a machine learning technique in which many devices or organizations train a shared model together while keeping their data where it is. Instead of collecting everyone’s data in one place, a central server sends the current model to participants, each participant improves it using local data and only the resulting model updates

Federated Learning Read More »

Federated learning is a machine learning technique in which many devices or organizations train a shared model together without sending their raw data to a central server.

A bird perched on a branch, the kind of rare category a few-shot model might learn to recognize from a few photos

Few-Shot Learning

Few-shot learning is a machine learning approach in which a model learns to perform a new task, or to recognize new categories, from only a handful of labeled examples. A typical deep learning system needs thousands or millions of examples for each category. A few-shot system works with perhaps one to ten. This matters because

Few-Shot Learning Read More »

Few-shot learning is a machine learning approach in which a model learns to perform a new task or recognize new categories from only a handful of labeled examples.

Stacked layers of rock, an analogy for the stacked layers of a neural network

Input, Hidden and Output Layers

A neural network is built from layers of simple units, and the layers fall into three kinds. The input layer receives the data, the hidden layers transform it step by step into more useful features and the output layer produces the final answer. This layered design is what allows a neural network to learn complicated

Input, Hidden and Output Layers Read More »

In a neural network, the input layer receives the data, the hidden layers transform it step by step into useful features, and the output layer produces the final prediction.

Houses along a street, an analogy for judging an item by the neighbors closest to it

K-Nearest Neighbors

K-nearest neighbors, usually shortened to KNN or k-NN, is a simple supervised machine learning algorithm that predicts the label of a new item from the labels of the k most similar items in the training data. To decide whether a new email is spam, KNN finds the k emails most like it and takes a

K-Nearest Neighbors Read More »

K-nearest neighbors is a simple supervised machine learning algorithm that predicts the label of a new item from the labels of the k most similar items in the training data.

A scatter plot with a fitted line, a simple picture of how machine learning finds patterns in data

Machine Learning Explained

Machine learning is a way of building computer systems that learn from data. Instead of a programmer writing every rule, the computer is shown examples and works out patterns by itself, then uses them to make predictions or decisions about new cases. It powers spam filters, product recommendations, voice recognition, fraud alerts and many medical

Machine Learning Explained Read More »

Machine learning explained covers how computers learn patterns from data instead of following only fixed rules, the main types of learning, common algorithms, how to train a model, and examples in healthcare, finance and education, along with how machine learning differs from artificial intelligence and deep learning.

A student studying, an analogy for a learner who gets better at learning new subjects

Meta-Learning

Meta-learning is a machine learning approach, often summed up as learning to learn, in which a model gains experience across many different tasks so that it can pick up a new task quickly from only a few examples. A conventional model learns one task, such as telling cats from dogs, from thousands of examples. A

Meta-Learning Read More »

Meta-learning is a machine learning approach, often described as learning to learn, in which a model gains experience across many tasks so that it can adapt quickly to new ones.