Machine Learning, etc

I've started a new job at MyStrands.com, looking at mining financial data. I also applied to Wolfram Research at the same time, but they...

Here's a side to side comparison of 150 vs. 300 vs. 600 DPI scan viewed at 400% magnification. On a local library scanner, 600 DPI blac...

Newton once wrote to Hooke: "If I have seen further it is by standing on the shoulders of giants". It's true nowdays more than...

Pi comes up in the most unexpected places. Here's an application to walk counting that involves it. Suppose you have a chain of length n...

A few weeks ago , I brought up a Russian CAPTCHA that asks to find resistance between end-points in a version of Wheatstone bridge in order...

I was going to post this to Wolfram's Demonstrations website , but then I realized it doesn't fit some technical format limitations,...

Maximum entropy principle is the idea that we should should pick a distribution maximizing entropy subject to certain constraints. Many know...

Here's an innovative CAPTCHA I came across when trying to register for a forum at http://lib.mipt.ru/?spage=reg_user You have to enter r...

Stochastic matrices are easy to get -- just normalize the rows. Doubly stochastic matrices require more work -- simply normalizing columns/r...

Consider a distribution over 6 binary random variables captured by the structure below. Red represents -1 potential, green represents +1 pot...

Ising Models are important for Machine Learning because they are well-studied physical counter-parts of binary valued undirected graphical m...

As mentioned in another post belief propagation is a an important algorithm both in probabilistic inference, and statistical thermodynamics...

Congress recently passed a bill that requires all NIH funded researchers make their papers publically available. If there's no veto, thi...

Software Libraries and Their Reuse: Entropy, Kolmogorov Complexity, and Zipf’s Law

A promising proof of universality of a 2,3 Turing machine (announced here ) seems to have stirred some controversy. Vaughan Pratt's post...

I've recently gone to Northwest Probability Seminar and one topic that came up was Thorp shuffling: Take a deck of cards, split it in 2...

There seems to be a difference in definitions of "positive-definite" between pure and applied math literature. For instance: Linea...

Here's a problem that could be solved using either analysis or information theory, which approach do you think is easier? Suppose X_1,X_...

Many people have seen a copy of this tongue-in-cheek email on proof techniques that's been circulating since the 80's. It' funn...

Looking at the papers from this summer's machine learning conferences ( AAAI , UAI , IJCAI , ICML , COLT ) it seems like there have been...

David Oranshak is using evolutionary algorithms to create aesthetically pleasing artwork Also, "human vs computer" design awards ...

The top performing system exhibited better performance than human evaluators when matching faces under varying lighting conditions in NIST l...

Suppose A,B are nxn matrices, and x is an nx1 vector. Need to compute M1M2...Mm x where each Mi is either A or B. The straightforward approa...

Looks like UCI website has been updated with some new data, including some sequential/relational datasets http://archive.ics.uci.edu/beta/da...

I've across the following question recently -- suppose you have a fully specified Markov-1 Hidden Markov Model with binary observations ...

ILP 07 had a discussion panel on next 10 years of structured learning. The video is now posted on Video Lectures Here are couple of things t...

People often fit the model to data by minimizing J(w)+w'Bw where J is the objective function and B is some matrix. Normally people use d...

Here are a few that caught my eye: Scalable Training of L1-regularized Log-linear Models The main idea is to do L-BFGS in an orthant where t...

I found a large number of machine learning related patent applications by doing a few queries on http://www.freepatentsonline.com/ Here are ...

Suppose you want to predict binary y given x. You fit a conditional probability model to data and form a classifier by thresholding on 0.5. ...

Mathematica 6.0 is out, touted "The most important advance in the 20-year history of Mathematica" Among the highly anticipated fe...

There are some counter-intuitive things happening as dimension increases. For instance consider unit sphere (radius 1) If you go from 2 dime...