Friday, December 16, 2005

Trends in Machine Learning according to Google Scholar

In a previous post I brought up the 1983 Machine Learning workshop which featured "33 papers", and it was the follow up to the 1980 Machine Learning workshop. By contrast, NIPS 2005 had 28 workshops and is just one of several international annual Machine Learning Conferences. You can see how the field grew by looking at the distribution of publication dates for articles containing phrase "machine learning" indexed by Google Scholar (normalized by total Scholar content for each year)
You can see there's a blip at 1983 when the workshop was held.

Yann LeCun quipped at NIPS closing banquet that people who joined the field in the last 5 years probably never heard of the word "Neural Network". Similar search (normalized by results for "machine learning") reveals a recent downward trend.

You can see a major upward trend starting around 1985 (that's when Yann LeCun and several others independently rediscovered backpropagation algorithm), peaking in 1992, and going downwards from then.

An even greater downward trend is seen when searching for "Expert System",


"Genetic algorithms" seem to have taken off in the 90's, and leveled off somewhat in recent years


On other hand, search for "support vector machine" shows no sign of slowing down

(1995 is when Vapnik and Cortez proposed the algorithm)

Also, "Naive Bayes" seems to be growing without bound

If I were to trust this, I would say that Naive Bayes research the hottest machine learning area right now

"HMM"'s seem to have been losing in share since 1981

(or perhaps people are becoming less likely to write things like "hmm, this result was unexpected"?)

What was the catastrophic even of 1981 that forced such a rapid extinction of HMM's (or hmm's) in scientific literature?

Finally a worrying trend is seen in the search for "artificial stupidity" divided by corresponding hits for "artificial intelligence". The 2000 through 2004 graph shows a definite updward direction.

51 comments:

Anonymous said...

Do the results for HMMs include both "HMM" and "Hidden Markov Model"?

Yaroslav Bulatov said...

No, just HMM. I didn't spend much time thinking about the queries, but here are the scripts I used to get the graphs (the two .py files) http://web.engr.oregonstate.edu/~bulatov/research/reports/trends/

Anonymous said...

You'll get slightly different results if you search for conditional frequencies, that is, for example, F("HMM", "machine learning")/F("machine learning").

In this case you'll get an increasing trend for HMM-s for example.

A slightly cleaned-up version of your script is available here:
http://ats.cs.ut.ee/u/kt/stuff/scholartrend/scholar_trend.py

Anonymous said...

Very interesting diagrams! (: I enjoyed them.

Yaroslav Bulatov said...

Thanks! As you can see from Konstantin's post, you probably shouldn't read too much into them though. Except for the very first graph. It's clear machine learning is growing exponentially. But if machine learning algorithms can ever design machine learning algorithms, then the rate of growth will also be growing exponentially. Therefore the graph will hit a singularity

Anonymous said...

I don't understand how Google allowed you to do this. From their terms of use, they don't allow any automated queries which I find very dissapointing.

I have a "friend" who wrote a script to download every post from the Python newsgroup and after about 10 pages, it blocks you with a captcha.

Anonymous said...

Very entertaining. Especially the last graph.

Anonymous said...

ohoho, Maybe should I stop my research about genetic algorithms for expert systems based HMMs ;-).... Nice job !

Matt Demon said...

The employment on the grounds that in summer somebody sits tight for the occasions, somebody sits tight for go swimming and somebody hold up to appreciate this http://www.sopwriting.org/visa-statement-of-purpose/ and mid year after the exhausting and dull days of the winter and snow.

akhilapriya404 said...

This concept is a good way to enhance the knowledge.thanks for sharing. please keep it up machine learning online training

Charles Kee said...

Those who always keep an eye on the japanease magazine,they know the Crayon Shin-chan and the character all about. It is good to find a biography about him too. the website you'll be find some helpful information about the academic writing service.

Charles Kee said...

New writers are always interested in learn something new from people. If there has some tips for writing , they will gather that place to know more on it, like here too. look here for your help and hope you'll love it.

bollings said...

In recent time machine learning is really going as a trend as everyone tends to do this course and they want to know specify things. on this page to check the recent guide and tips about the academic writing.

naina said...

Hi I am here to know more about Google Scholar. I see your are tried lot of info. today I read 4 article site but you are the best on in my study. do you have any video presentation?

visit the website said...

Finally, I got this. Oh, wow! So happy I'm. You are the hero for me. my role model. From now I follow you regularly. What a topic you share for us. just awesome.

draj said...



Excellent machine learning blog,thanks for sharing...
Seo Internship in Bangalore
Smo Internship in Bangalore
Digital Marketing Internship Program in Bangalore

Kanye Co Jamila said...


Great Article
IEEE final year projects on machine learning


JavaScript Training in Chennai

Final Year Project Centers in Chennai



JavaScript Training in Chennai

brayne said...

buy adderall online

buy adderall

adderall for sale

buy vyvanse online

xanax use

buy xanax

buy vyvanse pill

buy adderall xr online

buy oxycodone online

order oxycodone online

buy oxycodone

buy oxycodone online

dihydrocodeine dosage

buy dihydrodeine online

tramadol doses

buy oxycontin

buy oxycontin online

oxycontin for sale

Nisha said...

4S IT Solutions offers a full range of IT services to support your business infrastructure outside of your data center, too. From networking to hardware to applications, our team of certified experts will monitor, manage and maintain your IT environment.
This is our site please visit for further details...
https://4sitsolutions.com/

Brukkevin said...

It was not first article by this author as I always found him as a talented author. Reverse Flash Jacket

Brukkevin said...

Fantastic blog i have never ever read this type of amazing information. Cassian Andor Jacket

Jobi said...

I read this article. I think You put a lot of effort to create this article. I appreciate your work.
freestyle love supreme hoodie

pranay said...

Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. This article inspired me to read more. keep it up.
best machine learning course online!

andrewjackson said...

Our the purpose is to share the reviews about the latest Jackets,Coats and Vests also share the related Movies,Gaming, Casual,Faux Leather and Leather materials available Baywatch Jacket

Pankaj Singh said...

Very descriptive post, I really like this blog very much. For a professional website designing services visit OGEN Infosystem at the best price.
Web Designing Company in Delhi

Unknown said...

Water bodies are the main source of transportation for international freight forwarding. Due to this, sea freight company

in Delhi,
Freight Forwarder in Vietnam
Sea Freight Company in Delhi
Best freight forwarders in india

Unknown said...

visit here
iso certification in delhi

Unknown said...

Thanks for sharing this blog.

Bis Consultant in delhi

Sofia Jone said...

Thank You For Sharing Such type Of Nice Blog joseph seed

mrbobystone said...

Nice Blog !
Here We are Specialist in Manufacturing of Movies, Gaming, Casual, Faux Leather Jackets, Coats And Vests See Dutton Ranch Vest

Jobi Johnson said...

The great website and information shared are also very appreciable. Usmle Step 1 2020

Hollywood Fashion said...

Excellent article. The writing style which you have used in this article is very good and it made the article of better quality. organization 13 coat

jhonny said...

Thanking you for your bloging. The Equalizer 2021 Outfits

SEO Personal said...

Exactly, the very information that I was looking for. I was looking for such kind of article on the Internet and finally ended up here. Thanks for the help!
Wedding hall in Meerut
Top 10 CBSE School in Meerut
SEO Expert in Meerut
Software Development Company In Delhi NCR
Digital Marketing Company in Hapur
Web Development Meerut

Maria Chin said...

Wow such an amazing content keep it up. I have bookmarked your page to check out more informative content here. Check this out Devil May Cry 5 Nero Blue Coat for yourself or to gift someone you may love.

Rahul Sharma said...

Nice Post. You are Share great post and keep posting.
Dietitian in Meerut
Google 360 Virtual Tour Services
top 10 cbse schools in Meerut
software development company in Noida
SEO Services Hapur
Website Designer
Meerut Boy
SEO Solution India
Digital Marketing Services
SEO Company in Meerut

Image Restoration Center said...

Wow such an amazing content I really like it. Are you looking to develop a website then Check this WordPress Developer i am giving you services in low price just check this.

Salena Gibbz said...

Are you looking to promote business then visit this Classified ads Posting | Rank Your Website - Off Page SEO i am providing my service in $5.

jhonny said...

Thanks for sharing this nice blog. I have read the full blog and it’s really helpful for us.Thank you for all of your effort on this website.
devin booker kobe hoodie

Danish said...

Thanks for sharing an amazing content
damn near kilt em
got kilt
pipers dojo
the celtic croft
21st century kilts
house of henderson kilts
murray bagpipes
james begg bagpipes

Hit Jacket said...

interesting blog thanks for sharing Marty Mcfly Denim Jacket

Cyborg Jacket said...

Buy this Wool Blend Justice League Cyborg Jacket SHOP NOW......

Jose Hale said...

Thanks for these valuable machine learning trend charts. I think they will be useful to those who are just thinking of studying this direction of science for them or not. By the way, about the trends, I would like to add that, first of all, experts highlight the sphere of corporate analytics, decision-making and project management. Thus, augmented analytics will automate data preparation, detection of hidden relationships and compilation of visual analytical reports with clear visualization. Predictive analytics, built on the processing of massive amounts of corporate data with the help of AI, will enable leaders to make smarter, better decisions and reduce the business risks of enterprises. In project management, new opportunities will arise for the automatic optimization of resource allocation, control of the work schedules of related departments, and adjustment of the task execution process. I managed to gather this information from the posts on Instagram in which the authors talk about machine learning, I can find there quite a lot of posts on this topic and almost always they are published by accounts with at least 10 thousand subscribers! Uvreden this is because the owners of such accounts are often buy instagram followers to increase their number.

SEO Personal said...

Your articles always have been very precious to me. Those are very cognitive and prudently explained. I urge you to update us always without fail.
Desawar Result Chart
Banquet hall in Meerut
SEO Expert Meerut
Web Developer in Meerut
SEO Company in Hapur
SEO Company in Ghaziabad
Non Availability of Birth Certificate in Hyderabad
Website designing company in Meerut
Siwaya Jamalullapur Meerut


التسويق الالكتوني said...

شركة تنظيف منازل بتبوك تعتبر من افضل شركات تنظيف المنازل في تبوك والتي تقد بخصم 30% للعملاء في تبوك حيث أن شركة تنظيف بتبوك تقدم لكم الكثير من خدمات النظافة سواء أكانت شركة تنظيف فلل بتبوك أو شركة تنظيف شقق بتبوك كما أن شركة نظافة بيوت وعمائر بتبوك متخصصة بالعمل علي تنظيف أي مبنى مهما كانت مساحته تنظيف شامل باسعار مميزة ورخيصة
تقوم شركة تنظيف منازل بتبوك بالعمل علي تقديم خدمات تنظيف المنازل وخدمات تنظيف الفلل وخدمات تنظيف الشقق بطرق وأساليب متميزة فهي شركة متميزة في تقديم جميع خدمات النظافة بالمنازل والشقق والفلل ومن تلك الخدمات التي تعمل الشركة علي تقديمها لكم ما يلي
تقوم شركة تنظيف منازل بتبوك بالقيام بتنظيف المكان سواء كان المنزل فاضي ( جديد قبل الفرش والسكن ) او كان المنزل مفروش ومسكون
كما أن شركة تنظيف شقق بتبوك تقوم بترتيب العمل بين افراد طاقم التنظيف فمنهم من هو مختص بتنظيف وتلميع الشبابيك ومنهم من هو متخصص بالحمامات والمطبخ والباقي متخصص في الأرضيات
هذا بالإضافة إلي كون شركة تنظيف بتبوك تعمل علي استخدام المنظفات المتميزة والمضمونة في أداء عملية النظافة
شركة عزل خزانات بتبوك
شركة عزل مسابح بتبوك
شركة عزل فوم بتبوك
شركة عزل اسطح بتبوك
حل ارتفاع فاتورة المياه بتبوك
شركة عزل مائي بتبوك
شركة عزل فوم بتبوك

Best Services said...

Thanks for sharing this articles this is really helpful for me. Check this amazing Wrinkled Leather Jacket For Men available in special discount and with free shipping as well.

cheap assignment writing services said...

I love this. It is soo informative. Are you also searching for cheap assignment writing services we are the best solution for you. We are best known for delivering the best services to students without having to break the bank

dissertation writing help said...

I love it here. Keep sharing your good vibes. I love them Are you also searching for dissertation writing help? we are the best solution for you. We are best known for delivering cheap assignments to students without having to break the bank

Essay Help said...

Your blogs are authentic. I love them .Are you also searching for essay help? we are the best solution for you. We are best known for delivering quality essay help.

Greyson Harper said...

Do you want to lead a blog on instagram about machine learning? I see you know a lot about it. On this site https://zephyrnet.com/why-social-media-promotion-is-important-and-why-you-should-develop-your-brand-on-instagram/ you can read how to get followers for your profile

Unknown said...

Thanks for sharing this article i really appreciate you for this you can now get discounted coupon on many categories available here https://couponsjournal.com/ just check this and make yourself happy by using discounted coupon