| keshavchan | v1.3.0Apr 30th 2023 | (-4) | ||
| Multicore | v1.2.0Sep 23rd 2020 | (+2232/-85) Merge | ||
| Multicore | v1.1.0Aug 6th 2020 | (+74/-2221) | ||
| John Maxwell | v0.0.17Dec 22nd 2019 | (+1205/-2739) This article could use more attention, but I tried to quickly fix the biggest problems | ||
| Kaj Sotala | v0.0.16Sep 13th 2012 | (+10/-10) | ||
| pedrochaves | v0.0.15Sep 13th 2012 | (+10/-9) /* Applications examples */ | ||
| pedrochaves | v0.0.14Sep 13th 2012 | (+452/-20) | ||
| pedrochaves | v0.0.13Sep 13th 2012 | (+19/-18) /* Most common algorithms */ | ||
| pedrochaves | v0.0.12Sep 13th 2012 | (+106/-48) /* Most common algorithms */ | ||
| pedrochaves | v0.0.11Sep 13th 2012 | (+43) /* Further Reading & References */ |
Machine Learning refers to the general field of study that deals with automated statistical learning and pattern detection by non-biological systems. It can be seen as a sub-domain of artificial intelligence that specifically deals with modeling and prediction through the knowledge extracted from training data. As a multi-disciplinary area, it has borrowed concepts and ideas from other areas like pure mathematics and cognitive science.
The most widely used distinction is a present day AI paradigm, generally involving artificialbetween unsupervised (e.g. k-means clustering, principal component analysis) vs supervised (e.g. Support Vector Machines, logistic regression) methods. The first approach identifies interesting patterns (e.g. clusters and latent dimensions) in unlabeled training data, whereas the second takes labeled training data and tries to predict the label for unlabeled data points from the same distribution.
Another important distinction relates to the bias/variance tradeoff -- some machine learning methods are are capable of recognizing more complex patterns, but the tradeoff is that these methods can overfit and generalize poorly if there's noise in the training data -- especially if there's not much training data available.
There are also subfields of machine learning devoted to operating on specific kinds of data. For example, Hidden Markov Models and recurrent neural networks trained by gradient descent.operate on time series data. Convolutional neural networks are commonly applied to image data.
The use of machine learning has been widespread since its formal definition in the 50’s. The ability to make predictions based on data has been extensively used in areas such as analysis of financial markets, natural language processing and even brain-computer interfaces. Amazon’s product suggestion system makes use of training data in the form of past customer purchases in order to predict what customers might want to buy in the future.
In addition to its practical usefulness, machine learning has also offered insight into human cognitive organization. It seems likely machine learning will play an important role in the development of artificial general intelligence.
Machine Learning refers to the general field of study that deals with automated statistical learning and pattern detection by non-biological systems. It can be seen asis a sub-domain ofpresent day AI paradigm, generally involving artificial intelligence that specifically deals with modeling and prediction through the knowledge extracted from training data. As a multi-disciplinary area, it has borrowed concepts and ideas from other areas like pure mathematics and cognitive science.
The most widely used distinction is between unsupervised (e.g. k-means clustering, principal component analysis) vs supervised (e.g. Support Vector Machines, logistic regression) methods. The first approach identifies interesting patterns (e.g. clusters and latent dimensions) in unlabeled training data, whereas the second takes labeled training data and tries to predict the label for unlabeled data points from the same distribution.
Another important distinction relates to the bias/variance tradeoff -- some machine learning methods are are capable of recognizing more complex patterns, but the tradeoff is that these methods can overfit and generalize poorly if there's noise in the training data -- especially if there's not much training data available.
There are also subfields of machine learning devoted to operating on specific kinds of data. For example, Hidden Markov Models and recurrent neural networks operate on time series data. Convolutional neural networks are commonly applied to image data.trained by gradient descent.
The use of machine learning has been widespread since its formal definition in the 50’s. The ability to make predictions based on data has been extensively used in areas such as analysis of financial markets, natural language processing and even brain-computer interfaces. Amazon’s product suggestion system makes use of training data in the form of past customer purchases in order to predict what customers might want to buy in the future.
In addition to its practical usefulness, machine learning has also offered insight into human cognitive organization. It seems likely machine learning will play an important role in the development of artificial general intelligence.
Machine Learning refers to the general field of study that deals with automated statistical learning and pattern detection by non-biological systems. It can be seen as a classical sub-domain of artificalartificial intelligence that specifically deals with data analysis, modeling and prediction through the knowledge extracted from the previous (training) samples.training data. As a multi-disciplinary area, it has borrowed concepts and ideas ranging from other areas like pure mathematics toand cognitive science, all the while trying to exhaustively describescience.
When considering the most used algorithms in Machine Learning, we can take on multiple approaches to describe its subdivisions. It's possible to create a simple taxonomy based on their most prominent characteristics and implementations, such as the suggested by Lotte and colleagues:
Firstly, theThe most widely used distinction is usually made between the generative or unsupervised (k-NN,(e.g. k-means clustering, …)principal component analysis) vs discriminative or supervised (Support(e.g. Support Vector Machines, Linear Discriminant Analysis, …) ones – while thelogistic regression) methods. The first is able to spontaneously generate different categories based purely on the data structure,approach identifies interesting patterns (e.g. clusters and latent dimensions) in unlabeled training data, whereas the second kind is only able of distinguishing previously learned classes (throughtakes labeled training data and tries to predict the feeding of correctly identified data). This is probablylabel for unlabeled data points from the most prominentsame distribution.
Another important distinction between Machine Learning methods.
These same algorithms can be seen as static (such as simple Neural Networks like Perceptrons), disregarding the temporal\sequential characteristics of the data, or dynamic (Hidden Markov Chains or Recurrent Neural Networks, for instance), able to account for those temporal dynamics and treating time series.
The third and last big difference refers to its sensitivityrelates to the bias/variance withintradeoff -- some machine learning methods are are capable of recognizing more complex patterns, but the data,tradeoff is that is, the algorithm’these methods can overfit and generalize poorly if there's ability to modelnoise in the training data - either very closely or more loosely (which in turn influences its ability-- especially if there's not much training data available.
There are also subfields of machine learning devoted to generalize).operating on specific kinds of data. For example, Hidden Markov Models and recurrent neural networks operate on time series data. Convolutional neural networks are commonly applied to image data.
The use of Machine Learningmachine learning has been widespread since its formal definition in the 50’s. The ability to explore the data structure and make predictions based on previous behaviordata has been extensively used in areas such as market analysis,analysis of financial markets, natural language processing orand even brain-computer interfaces. Amazon’s titles suggestion, for instance, is an exampleproduct suggestion system makes use of a deep and recursive...
The third and last big difference refers to its sensitivity to the variance within the data, that is, the algorithm’s ability to model the training data - either very closely or more loselyloosely (which in turn influences its ability to generalize).
The use of Machine Learning has been widespread since it’sits formal definition in the 50’s. The ability to explore the data structure and make predictions based on previous behavior has been extensively used in areas such as market analysis, natural language processing or even brain-computer interfaces. Amazon’s titles suggestion, for instance, is an example of a deep and recursive system for modeling previous buys and generating possible hypothesis from that data.
Besides the technological advantages of this ability to probe large amounts of data and aid in research as simple tools, the development and study of machine learning methods has also lead to substantial insights into the human cognitive organization. At the same time, although limited in its essence, it seems machine learning will give important contributions to the development of an artificalartificial general intelligence.
Machine Learning refers to the general field of study that deals with automated statistical learning and pattern detection by non-biological systems. It iscan be seen as a classical sub-domain of Artificial generalartifical intelligence that specifically deals with data analysis, modeling and prediction through the knowledge extracted from the previous (training) samples. As a multi-disciplinary area, it has borrowed concepts and ideas ranging from pure mathematics to cognitive science, all the while trying to exhaustively describe learning systems.
Besides the technological advantages of this ability to probe large amounts of data and aid in research as simple tools, the development and study of machine learning methods has also lead to substantial insights into the human cognitive organization. At the same time, although limited in its essence, it seems machine learning will give important contributions to the development of an artifical general intelligence.
Firstly, the most widely distinction is usually made between the generative or unsupervised (k-NN, k-means clustering, …) vs discriminative or supervised(Supportsupervised (Support Vector Machines, Linear Discriminant Analysis, …) ones – while the first is able to spontaneously generate different categories based purely on the data structure, the second kind is only able of distinguishing previously learned classes (through the feeding of correctly identified data). This is probably the most prominent distinction between Machine Learning methods.
Firstly, the most widely distinction is usually made between the generative or unsupervised (k-NN, k-means clustering, …) vs discriminative (Supportor supervised(Support Vector Machines, Linear Discriminant Analysis, …) ones – while the first is able to spontaneously (in a unsupervised way) generate different categories based purely on the data structure, the second kind is only able of distinguishing previously learned classes (through the feeding of correctly identified data). This is probably the most prominent distinction between Machine Learning methods.
These same algorithms can be seen as static (such as simple Neural Networks)Networks like Perceptrons), disregarding the temporal\sequential characteristics of the data, or dynamic (Hidden Markov Chains,Chains or Recurrent Neural Networks, for instance), able to account for those temporal dynamics and treating time series.
Another important distinction relates to the bias/variance tradeoff -- some machine learning methods
areare capable of recognizing more complex patterns, but the tradeoff is that these methods can overfit and generalize poorly if there's noise in the training data -- especially if there's not much training data available.