Friday, December 16, 2005

Trends in Machine Learning according to Google Scholar

In a previous post I brought up the 1983 Machine Learning workshop which featured "33 papers", and it was the follow up to the 1980 Machine Learning workshop. By contrast, NIPS 2005 had 28 workshops and is just one of several international annual Machine Learning Conferences. You can see how the field grew by looking at the distribution of publication dates for articles containing phrase "machine learning" indexed by Google Scholar (normalized by total Scholar content for each year)
You can see there's a blip at 1983 when the workshop was held.

Yann LeCun quipped at NIPS closing banquet that people who joined the field in the last 5 years probably never heard of the word "Neural Network". Similar search (normalized by results for "machine learning") reveals a recent downward trend.

You can see a major upward trend starting around 1985 (that's when Yann LeCun and several others independently rediscovered backpropagation algorithm), peaking in 1992, and going downwards from then.

An even greater downward trend is seen when searching for "Expert System",


"Genetic algorithms" seem to have taken off in the 90's, and leveled off somewhat in recent years


On other hand, search for "support vector machine" shows no sign of slowing down

(1995 is when Vapnik and Cortez proposed the algorithm)

Also, "Naive Bayes" seems to be growing without bound

If I were to trust this, I would say that Naive Bayes research the hottest machine learning area right now

"HMM"'s seem to have been losing in share since 1981

(or perhaps people are becoming less likely to write things like "hmm, this result was unexpected"?)

What was the catastrophic even of 1981 that forced such a rapid extinction of HMM's (or hmm's) in scientific literature?

Finally a worrying trend is seen in the search for "artificial stupidity" divided by corresponding hits for "artificial intelligence". The 2000 through 2004 graph shows a definite updward direction.

88 comments:

Anonymous said...

Do the results for HMMs include both "HMM" and "Hidden Markov Model"?

Yaroslav Bulatov said...

No, just HMM. I didn't spend much time thinking about the queries, but here are the scripts I used to get the graphs (the two .py files) http://web.engr.oregonstate.edu/~bulatov/research/reports/trends/

Anonymous said...

You'll get slightly different results if you search for conditional frequencies, that is, for example, F("HMM", "machine learning")/F("machine learning").

In this case you'll get an increasing trend for HMM-s for example.

A slightly cleaned-up version of your script is available here:
http://ats.cs.ut.ee/u/kt/stuff/scholartrend/scholar_trend.py

Anonymous said...

Very interesting diagrams! (: I enjoyed them.

Yaroslav Bulatov said...

Thanks! As you can see from Konstantin's post, you probably shouldn't read too much into them though. Except for the very first graph. It's clear machine learning is growing exponentially. But if machine learning algorithms can ever design machine learning algorithms, then the rate of growth will also be growing exponentially. Therefore the graph will hit a singularity

Anonymous said...

I don't understand how Google allowed you to do this. From their terms of use, they don't allow any automated queries which I find very dissapointing.

I have a "friend" who wrote a script to download every post from the Python newsgroup and after about 10 pages, it blocks you with a captcha.

Anonymous said...

Very entertaining. Especially the last graph.

Anonymous said...

ohoho, Maybe should I stop my research about genetic algorithms for expert systems based HMMs ;-).... Nice job !

Matt Demon said...

The employment on the grounds that in summer somebody sits tight for the occasions, somebody sits tight for go swimming and somebody hold up to appreciate this http://www.sopwriting.org/visa-statement-of-purpose/ and mid year after the exhausting and dull days of the winter and snow.

akhilapriya404 said...

This concept is a good way to enhance the knowledge.thanks for sharing. please keep it up machine learning online training

Charles Kee said...

Those who always keep an eye on the japanease magazine,they know the Crayon Shin-chan and the character all about. It is good to find a biography about him too. the website you'll be find some helpful information about the academic writing service.

Charles Kee said...

New writers are always interested in learn something new from people. If there has some tips for writing , they will gather that place to know more on it, like here too. look here for your help and hope you'll love it.

bollings said...

In recent time machine learning is really going as a trend as everyone tends to do this course and they want to know specify things. on this page to check the recent guide and tips about the academic writing.

naina said...

Hi I am here to know more about Google Scholar. I see your are tried lot of info. today I read 4 article site but you are the best on in my study. do you have any video presentation?

visit the website said...

Finally, I got this. Oh, wow! So happy I'm. You are the hero for me. my role model. From now I follow you regularly. What a topic you share for us. just awesome.

draj said...



Excellent machine learning blog,thanks for sharing...
Seo Internship in Bangalore
Smo Internship in Bangalore
Digital Marketing Internship Program in Bangalore

Kanye Co Jamila said...


Great Article
IEEE final year projects on machine learning


JavaScript Training in Chennai

Final Year Project Centers in Chennai



JavaScript Training in Chennai

brayne said...

buy adderall online

buy adderall

adderall for sale

buy vyvanse online

xanax use

buy xanax

buy vyvanse pill

buy adderall xr online

buy oxycodone online

order oxycodone online

buy oxycodone

buy oxycodone online

dihydrocodeine dosage

buy dihydrodeine online

tramadol doses

buy oxycontin

buy oxycontin online

oxycontin for sale

Nisha said...

4S IT Solutions offers a full range of IT services to support your business infrastructure outside of your data center, too. From networking to hardware to applications, our team of certified experts will monitor, manage and maintain your IT environment.
This is our site please visit for further details...
https://4sitsolutions.com/

Brukkevin said...

It was not first article by this author as I always found him as a talented author. Reverse Flash Jacket

Brukkevin said...

Fantastic blog i have never ever read this type of amazing information. Cassian Andor Jacket

Jobi said...

I read this article. I think You put a lot of effort to create this article. I appreciate your work.
freestyle love supreme hoodie

pranay said...

Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. This article inspired me to read more. keep it up.
best machine learning course online!

andrewjackson said...

Our the purpose is to share the reviews about the latest Jackets,Coats and Vests also share the related Movies,Gaming, Casual,Faux Leather and Leather materials available Baywatch Jacket

OGEN Infosystem (P) Limited said...

Very descriptive post, I really like this blog very much. For a professional website designing services visit OGEN Infosystem at the best price.
Web Designing Company in Delhi

Unknown said...

Water bodies are the main source of transportation for international freight forwarding. Due to this, sea freight company

in Delhi,
Freight Forwarder in Vietnam
Sea Freight Company in Delhi
Best freight forwarders in india

Unknown said...

visit here
iso certification in delhi

Unknown said...

Thanks for sharing this blog.

Bis Consultant in delhi

Sofia Jone said...

Thank You For Sharing Such type Of Nice Blog joseph seed

mrbobystone said...

Nice Blog !
Here We are Specialist in Manufacturing of Movies, Gaming, Casual, Faux Leather Jackets, Coats And Vests See Dutton Ranch Vest

Jobi Johnson said...

The great website and information shared are also very appreciable. Usmle Step 1 2020

Hollywood Fashion said...

Excellent article. The writing style which you have used in this article is very good and it made the article of better quality. organization 13 coat

jhonny said...

Thanking you for your bloging. The Equalizer 2021 Outfits

SEO Personal said...

Exactly, the very information that I was looking for. I was looking for such kind of article on the Internet and finally ended up here. Thanks for the help!
Wedding hall in Meerut
Top 10 CBSE School in Meerut
SEO Expert in Meerut
Software Development Company In Delhi NCR
Digital Marketing Company in Hapur
Web Development Meerut

Maria Chin said...

Wow such an amazing content keep it up. I have bookmarked your page to check out more informative content here. Check this out Devil May Cry 5 Nero Blue Coat for yourself or to gift someone you may love.

Rahul Sharma said...

Nice Post. You are Share great post and keep posting.
Dietitian in Meerut
Google 360 Virtual Tour Services
top 10 cbse schools in Meerut
software development company in Noida
SEO Services Hapur
Website Designer
Meerut Boy
SEO Solution India
Digital Marketing Services
SEO Company in Meerut

Image Restoration Center said...

Wow such an amazing content I really like it. Are you looking to develop a website then Check this WordPress Developer i am giving you services in low price just check this.

Salena Gibbz said...

Are you looking to promote business then visit this Classified ads Posting | Rank Your Website - Off Page SEO i am providing my service in $5.

jhonny said...

Thanks for sharing this nice blog. I have read the full blog and it’s really helpful for us.Thank you for all of your effort on this website.
devin booker kobe hoodie

Danish said...

Thanks for sharing an amazing content
damn near kilt em
got kilt
pipers dojo
the celtic croft
21st century kilts
house of henderson kilts
murray bagpipes
james begg bagpipes

Hit Jacket said...

interesting blog thanks for sharing Marty Mcfly Denim Jacket

Cyborg Jacket said...

Buy this Wool Blend Justice League Cyborg Jacket SHOP NOW......

Jose Hale said...

Thanks for these valuable machine learning trend charts. I think they will be useful to those who are just thinking of studying this direction of science for them or not. By the way, about the trends, I would like to add that, first of all, experts highlight the sphere of corporate analytics, decision-making and project management. Thus, augmented analytics will automate data preparation, detection of hidden relationships and compilation of visual analytical reports with clear visualization. Predictive analytics, built on the processing of massive amounts of corporate data with the help of AI, will enable leaders to make smarter, better decisions and reduce the business risks of enterprises. In project management, new opportunities will arise for the automatic optimization of resource allocation, control of the work schedules of related departments, and adjustment of the task execution process. I managed to gather this information from the posts on Instagram in which the authors talk about machine learning, I can find there quite a lot of posts on this topic and almost always they are published by accounts with at least 10 thousand subscribers! Uvreden this is because the owners of such accounts are often buy instagram followers to increase their number.

SEO Personal said...

Your articles always have been very precious to me. Those are very cognitive and prudently explained. I urge you to update us always without fail.
Desawar Result Chart
Banquet hall in Meerut
SEO Expert Meerut
Web Developer in Meerut
SEO Company in Hapur
SEO Company in Ghaziabad
Non Availability of Birth Certificate in Hyderabad
Website designing company in Meerut
Siwaya Jamalullapur Meerut


مركز الاختيار للطب النفسي said...

شركة تنظيف منازل بتبوك تعتبر من افضل شركات تنظيف المنازل في تبوك والتي تقد بخصم 30% للعملاء في تبوك حيث أن شركة تنظيف بتبوك تقدم لكم الكثير من خدمات النظافة سواء أكانت شركة تنظيف فلل بتبوك أو شركة تنظيف شقق بتبوك كما أن شركة نظافة بيوت وعمائر بتبوك متخصصة بالعمل علي تنظيف أي مبنى مهما كانت مساحته تنظيف شامل باسعار مميزة ورخيصة
تقوم شركة تنظيف منازل بتبوك بالعمل علي تقديم خدمات تنظيف المنازل وخدمات تنظيف الفلل وخدمات تنظيف الشقق بطرق وأساليب متميزة فهي شركة متميزة في تقديم جميع خدمات النظافة بالمنازل والشقق والفلل ومن تلك الخدمات التي تعمل الشركة علي تقديمها لكم ما يلي
تقوم شركة تنظيف منازل بتبوك بالقيام بتنظيف المكان سواء كان المنزل فاضي ( جديد قبل الفرش والسكن ) او كان المنزل مفروش ومسكون
كما أن شركة تنظيف شقق بتبوك تقوم بترتيب العمل بين افراد طاقم التنظيف فمنهم من هو مختص بتنظيف وتلميع الشبابيك ومنهم من هو متخصص بالحمامات والمطبخ والباقي متخصص في الأرضيات
هذا بالإضافة إلي كون شركة تنظيف بتبوك تعمل علي استخدام المنظفات المتميزة والمضمونة في أداء عملية النظافة
شركة عزل خزانات بتبوك
شركة عزل مسابح بتبوك
شركة عزل فوم بتبوك
شركة عزل اسطح بتبوك
حل ارتفاع فاتورة المياه بتبوك
شركة عزل مائي بتبوك
شركة عزل فوم بتبوك

Best Services said...

Thanks for sharing this articles this is really helpful for me. Check this amazing Wrinkled Leather Jacket For Men available in special discount and with free shipping as well.

cheap assignment writing services said...

I love this. It is soo informative. Are you also searching for cheap assignment writing services we are the best solution for you. We are best known for delivering the best services to students without having to break the bank

dissertation writing help said...

I love it here. Keep sharing your good vibes. I love them Are you also searching for dissertation writing help? we are the best solution for you. We are best known for delivering cheap assignments to students without having to break the bank

Essay Help said...

Your blogs are authentic. I love them .Are you also searching for essay help? we are the best solution for you. We are best known for delivering quality essay help.

Greyson Harper said...

Do you want to lead a blog on instagram about machine learning? I see you know a lot about it. On this site https://zephyrnet.com/why-social-media-promotion-is-important-and-why-you-should-develop-your-brand-on-instagram/ you can read how to get followers for your profile

Barbara Lee said...

Thanks for sharing this article i really appreciate you for this you can now get discounted coupon on many categories available here https://couponsjournal.com/ just check this and make yourself happy by using discounted coupon

Anonymous said...

When you have commercial or residential work that needs to be done quickly and with an eye for quality, look no further than Roadbridge Services Ltd. When you hire us, you’re hiring professionals who are trained and skilled.
puma cali noir

Anonymous said...

I obliged to say that I benefit as much as possible from your article with such a great deal of clear data for someone to apply. I hardly read long articles to finish, in any case, I read the whole of this.
diadora scarpe antinfortunistiche

Anonymous said...

This is a really nice post. I agree with this post. Thank you for sharing this. I am pretty much pleased with your good work

simpsons vans

Vihan Malick said...

Great Article.Thanks for the remarkable information. Please keep updating us.

IT Company in Meerut
Website Designing Company in Delhi
Hoarding company
News in hindi
Magazine in india

Unknown said...
This comment has been removed by the author.
Unknown said...

Your post was amazing. I love it to recommend Leather Store to the users. Where they can crawl Exciting Products Super Star Jackets Platform is providing 100% Geniune Leather Products All products are available in Feasible Prices The best seller SuperStar is offering amazing Leather Jackets to its customers. You can Click Here to get exciting Leather Products Offers

eddielydon said...

Such an interesting article here.I was searching for something like that for quite a long time and at last I have found it here.
Tekkadan Jacket

Anonymous said...

I'm Software engineer and machine learning is my best subject ever News From Pakistan.

George Mark said...

You can do very creative work in a particular field. Exceptional concept That was incredible share. Phoenix Valorant Jacket

EnglishJackets said...

Hy i'm designer for Customize leather jackets. Please visit our website. X Men Gambit Faux Leather Coat

Merry Smith said...

Saving Cents Together provide different voucher for brands of all categories you can avail them and save your money on items

Anonymous said...

Mobile app developer in Meerut
Meet the best android app developer in Meerut

Anonymous said...

Mobile app developer in Meerut
Android app developer in Meerut
Meet the best android app developer in Meerut

Dollar Jackets said...

This jacket is trendy and iconic. These jackets are made for men & women made with a cropped cardigan with a real leather section used in the front of the jacket. Visit Our Site. Cruella de Vil Emma Stone Jacket

Aaron jhonson said...

Thank you for sharing such a useful article. It will be useful to those who are looking for knowledge. Continue to share your knowledge with others through posts like these, and keep posting on
Big Data Solutions 
Advanced Data Analytics Services

Anonymous said...

business news publication agency Hi thanks to share, Keep doing and writing about It.

Right Jackets said...

RightJackets is the best place for you to get the most original custom made products and more.We have the biggest range of a variety of products.

WWE Sasha Banks Retro Fanimation Jacket
Chicago Bears Nike Bomber Leather Jacket
Giddy Up Blue Bomber Satin Jacket
Secord Bill Rocketeer Cliff Campbell Pilot Flight Leather Jacket
Kiss Chacey Venice Patriot Blue Bomber Cotton Jacket

rockstarjackets said...

RockStar Jackets is incredibly pleased to announce ourselves as the most dependable manufacturers and exporters of a variety of products comprising of Leather Garments.

Rainbow Lady Gaga NYC Pride Leather Jacket
Singer Justin Bieber ‘Believe Tour’ at The Valley View Casino Center Leather Jacket
Girl Comme Des Garçons Patent Bomber Leather Jacket
Alice Olivia Fashion Black Leather Jacket
Acne Studios Womens Biker Leather Jacket

Unknown said...

HARDCORE CYCLES was started in the Greater Philadelphia area by a group of tight friends with a passion for V-Twin performance aftermarket parts.Visit our Website Thanks

S&S Passenger Peg Relocation Kit

Aussie Jackets said...

Aussie Jackets not only offers you the readymade collection but take custom bulk orders and Free Delivery. Visit My Website To Order. Thanks

Marlboro Vintage Racing Leather Jacket
Chris Hemsworth Thor Love and Thunder 2022 Thor Leather Vest
Lucy Hale Pretty Little Liars Aria Montgomery Cheetah Sleeves Leather Jacket
Pelle Pelle Make It Rain Brown Bomber Leather Jacket
Cyberpunk 2077 Wolf School Witcher Gear Brown Leather Jacket

Panthar Jackets said...

Hi i,am Custom Leather Jacket Seller For Mens & Womens Online Custom leather Jackets With Free Shipping.

Rooney Mara Song To Song Faye Black Biker Leather Jacket
Patina Classic Black Motorcycle Leather Jacket
Goldwing Black Biker Leather Jacket
Michael Jackson Bad Black Biker Leather Jacket
Dwayne Johnson Red Notice Brown Leather Jacket

Anonymous said...

codeflare blogging tips and trick for SEO, blogger guide, tutorial google rank first page, blogger news, blogger tutorial, blogger widget, download blogger template, landing page blogger and blogger backlink.

MichelAnthony said...

I am a professional leather jackets providers all over the worlds. we have professional Custom Leather Jackets maker for your requirement which you need. Fortune jackets is a best leathers jackets service for other leather service and get also discount,with free shipping.
Lego Masters Australia Hamish Blake Jacket
Never Have I Ever Paxton Jacket
Never Have I Ever Paxton Jacket
Detroit Become Human Markus Cotton Coat

Dark Knight Rises Coat said...

There are a few tailors that offer clothing modification administrations, they are frequently appended to some clothing shops, and whatever administrations leave their contact data with some physical clothing stores in their area.

Freddie Mercury Yellow Jacket said...

My sister used to wear my clothes whenever she wanted & we used to fight over it. she looks great whenever she wears my clothes. If someone is looking for something spicy:

Sons Of Anarchy Vest said...

Observe your children most loved shading, images,and animation characters prior to picking new clothes.

Cameron Diaz Coat said...

Wow this amazing I am glad for seeing these best designs, I will show people these clothes and I like also this. Cameron Diaz Coat

Spider-Man No Way Home Wong Parka Jacket said...

Shop this best quality Spider-Man No Way Home Wong Parka Jacket For men SHOP NOW

Spider-Man No Way Home Wong Parka Jacket said...

Shop this best Super quality Spider-Man No Way Home Wong Parka Jacket For men SHOP NOW

Anonymous said...

it is great to see that some people still put in an effort into managing their websites. I'll be sure to check back again real soon. its really amazing adidas schuhen

Anonymous said...

Is there a way you are able to remove me from that service? Thank you! After i take a look at your weblog web site in opera, it seems quality however whilst establishing in internet explorer, it has some overlapping. ray ban cockpit

Anonymous said...

Best Digital Marketing Company in Meerut
Top Digital Marketing Company in Meerut

Jackets In Leather said...

We are looking for an informative post it is very helpful thanks for sharing it. We are offering all types of leather jackets with worldwide free shipping.
LEATHER MOTORCYCLE JACKETS
MOTOGP LEATHER JACKETS
MOTOGP LEATHER SUITS
HARLEY DAVIDSON JACKETS
STUDDED LEATHER JACKET

Cade said...

Thanks for writing this great article. I’ve been using some of these techniques on by blog. But I didn’t know the phrase “Social Proof”. Thanks for sharing. I was sick and fall behind in my assignments, but DoMyExamNow.com helped me get caught up in time for my finals. Take My Final Exam For Me.

Flying Leather Jacket said...

I am very impressed to read this blog. I hope you will continue to upload similar blogs. Thank you very much. I have an online store with the name FLYING LEATHER JACKET please visit for an awesome collection.
MEN AVIATOR LEATHER JACKETS
B3 BOMBER JACKETS
MOTOGP LEATHER SUIT
MOTOGP LEATHER JACKETS

Victor said...

Your Blog is very nice.
Wish to see much more like this. Thanks for sharing your information Such an underrated and incredible website. DoMyExamNow.com has saved me from a complete embarrassment. I was due three assignments and my deadline was just 3 days. They assured me that there was nothing to worry about, and that they would do it. I received my three assignments on time. 10/10 so I suggest you come on this site. Online Class Helper.

Real Jackets said...

Hey. Very nice web site!! Man .. Excellent .. Wonderful .. I’ll bookmark this web site and take the feeds also…I am happy to locate so much helpful information here within the article. Thanks for sharing… Witcher 3 leather jacket