Machine Learning, etc

Consider a distribution over 6 binary random variables captured by the structure below. Red represents -1 potential, green represents +1 pot...

Ising Models are important for Machine Learning because they are well-studied physical counter-parts of binary valued undirected graphical m...

As mentioned in another post belief propagation is a an important algorithm both in probabilistic inference, and statistical thermodynamics...

Congress recently passed a bill that requires all NIH funded researchers make their papers publically available. If there's no veto, thi...

Software Libraries and Their Reuse: Entropy, Kolmogorov Complexity, and Zipf’s Law

A promising proof of universality of a 2,3 Turing machine (announced here ) seems to have stirred some controversy. Vaughan Pratt's post...

I've recently gone to Northwest Probability Seminar and one topic that came up was Thorp shuffling: Take a deck of cards, split it in 2...

There seems to be a difference in definitions of "positive-definite" between pure and applied math literature. For instance: Linea...

Here's a problem that could be solved using either analysis or information theory, which approach do you think is easier? Suppose X_1,X_...

Many people have seen a copy of this tongue-in-cheek email on proof techniques that's been circulating since the 80's. It' funn...

Looking at the papers from this summer's machine learning conferences ( AAAI , UAI , IJCAI , ICML , COLT ) it seems like there have been...

David Oranshak is using evolutionary algorithms to create aesthetically pleasing artwork Also, "human vs computer" design awards ...

The top performing system exhibited better performance than human evaluators when matching faces under varying lighting conditions in NIST l...

Suppose A,B are nxn matrices, and x is an nx1 vector. Need to compute M1M2...Mm x where each Mi is either A or B. The straightforward approa...

Looks like UCI website has been updated with some new data, including some sequential/relational datasets http://archive.ics.uci.edu/beta/da...

I've across the following question recently -- suppose you have a fully specified Markov-1 Hidden Markov Model with binary observations ...

ILP 07 had a discussion panel on next 10 years of structured learning. The video is now posted on Video Lectures Here are couple of things t...

People often fit the model to data by minimizing J(w)+w'Bw where J is the objective function and B is some matrix. Normally people use d...

Here are a few that caught my eye: Scalable Training of L1-regularized Log-linear Models The main idea is to do L-BFGS in an orthant where t...

I found a large number of machine learning related patent applications by doing a few queries on http://www.freepatentsonline.com/ Here are ...

Suppose you want to predict binary y given x. You fit a conditional probability model to data and form a classifier by thresholding on 0.5. ...

Mathematica 6.0 is out, touted "The most important advance in the 20-year history of Mathematica" Among the highly anticipated fe...

There are some counter-intuitive things happening as dimension increases. For instance consider unit sphere (radius 1) If you go from 2 dime...

Concepts of positive definite matrices and positive definite operators often come up in Machine Learning, here are some movies I made to vis...

There's often confusion as to the nature of the differences between Logistic Regression and Naive Bayes Classifier. One way to look at i...