Machine Learning, etc

Today I got Google Alert today on the following pending patent -- Belief Propagation for Generalized Matching . I like to stay up on Belief...

With regular distributive law you can do things like $$\sum_{x_1,x_2,x_3} \exp(x_1 + x_2 + x_3)=\sum_{x_1} \exp x_1 \sum_{x_2} \exp x_2 \sum...

Suppose we want to count the number of independent sets in a graph below. There are 9 independent sets. Because the graphs are disjoint we c...

There's a neat connection between Cholesky factorization and graph triangulations -- graph corresponding to Cholesky factorization of a ...

Here's a 367 vertex Apollonian Network and its Junction Tree (aka Tree Decomposition) A Junction Tree provides an efficient data struct...

Here's a page linking 65 attempts of resolving P vs NP problem. A couple of papers were published in peer-reviewed journals or conferen...

First programmers wrote in machine code and assemblers simplified this task significantly by letting them give algorithms at a higher level....

Here's a tool (in Mathematica) to help visualize the process of constructing a Junction Tree. wrong link fixed Clicking on vertices cor...

Here are some links to start the new year on a light note Hinged tesselation Statistics-related Cartoons on stats.SE Memorable math pap...

Suppose we'd like to visualize a set of joint probabilities realizable by distributions of 3 binary variables. It is a 7 dimensional reg...

One approach to solving hard problems is to break them into computationally efficient parts. For instance, Globerson/Jaakkola do approximat...

A few "connection to other fields" papers I found interesting Variational Inference over Combinatorial Spaces. Alexandre Bouchard...

Most graphics and formulas that appear in this blog were created with help of Mathematica. I'll keep a separate blog with Mathematica t...

Common complaint about current publishing model is that sometimes good papers get rejected. A striking example is that David Lowe's SIFT...

In order to do exact probabilistic inference on real life network efficiently, one must find a good Tree Decomposition of the network. This ...

Link here . If you never heard of the journal "Machine Learning", it used to be number 1 ranked journal in ML, until board of edit...

I just came across kaggle.com which is a platform for "s a platform for data prediction competitions." From brief glance, it seem...

Ulrich Bodenhofer has made some nifty SVM visualization code . One is Mathematica notebooks that takes libSVM model files and visualizes the...

Searching for "NIPS" in google blog-search mainly produces posts about nipples, my "CRF" subscription on delicious rece...

In 1993, R.Holte noted that "Very simple classification rules perform well on most commonly used datasets" . His very simple rules...

Suresh points out that at this year's FOCS , not a single person wanted printed proceedings, whereas few years ago, a third of the audi...

David Mimno fit a Dirichlet-multinomial to ICML papers 2004-2008. Seems like "real world" problems are going strong, while boosti...

A comment on previous post asked why we need integrals for computer science. One reason is that combinatorial expressions often have represe...

Thanks to John Cook for pointing it out Theoretical CS cheat sheet

Terry Tao's article on universality. Stephen Wolfram's speech on future special functions. They give opposing perspective -- in th...

Suppose I have an invertible function $f(x)$. In a perfect world, the following holds $$x=f(f^{-1}(x))=f^{-1}(f(x))$$ To see what happens in...

I recently raked the blogosphere for interesting new Machine Learning/math blogs and got a high recall, low precision list of 87, here .

Suppose X is distributed as n-dimensional Gaussian with 0 mean and concentration matrix $A$ and you need conditional distribution of $P(\mat...

Foundations of probabilistic inference is often a subject of much disagreement, with some leading Bayesian sometimes going as far as to say ...

Suppose we throw a fair coin n times and estimate it's bias by averaging the number of heads observed. What is the squared error of this...

By Frank Nielsen, with focus on information geometry, http://blog.informationgeometry.org/

After following some discussions on overflow sites, I re-read Shannon/Cover's coverage of method of types, and want to summarize it he...

As I discovered recently, stack exchanges can be pretty fun, informative (and time consuming!) way to discuss issues related to machine lea...

I used the "Robust OCR dataset" below to make a system for reading runner bibs in video. Standard ML techniques give fairly good r...