Is There a Formula For a Hit Song? 243
moveoverrover writes "What happens when two Rutgers grad students analyze 50 years of Billboard Top 10 hits with MIT offshoot Echo Nest's API and turn the data into visualizations for an assignment? Great looking visualizations for one, and a fascinating look at 50 years of Pop music at the data level. Posing the question, 'Is there a formula for a hit song?' the students write, 'What if we knew, for example, that 80% of the Billboard Hot 100 number one singles from 1960-2010 are sung in a major key with an average of 135 beats per minute, that they all follow a I-III-IV chord progression in 4/4 time signature, and that they all follow a "verse-verse-chorus-verse-chorus-bridge-chorus" sequence structure?' Using data extracted by Echo Nest on tempo, duration, time signature, musical key, as well as subjective criteria like "energy" and "danceability," the pair generated a number of visualizations with Google Motion Charts (warning: slow) and '(some) Tableau Results' for everyone to see and investigate. Curious about tempo and song duration trends in Pop music over 50 years? Correlation between record label and song tempo? Download the core data, the Tableau reader and look at it any way you want."
Is it the 1970s again? (Score:3)
Re: (Score:3)
Most of Rush's back catalogue.
Everyone knows Geddy Lee is a robot
Re: (Score:3)
Re: (Score:2)
I'm not picking on Rush. Rush is awesome. Geddy Lee is an awesome robot. He can write fricking songs!
Re: (Score:2)
Let us not forget that Rush is not stuck in the 70's. That's jsut the perception of people who have either lost touch/moved on from the band. Or never really liked them in the first place.
In a rock format, these guys are still cutting edge. And play with more precision and overall talent than they did in the 70's.
It'll be a sad day when they finally do get tired of touring, and just hang it up.
Re: (Score:2)
I heard a podcast on this recently -- it might have been RadioLab but I can't find it right now.
Anyhow, they tried to use all the collected knowledge to produce a "hit", and had some human (as opposed to programs) composers write a tune. As you might expect, it sounded too familiar, not adventurous, didn't have a decent hook, and was kind of boring all around.
On the other hand, they also collected information on what kind of music people did NOT like, which included things like children's choirs, opera, ba
Re: (Score:2)
On the other hand, they also collected information on what kind of music people did NOT like, which included things like children's choirs, opera, bagpipes, and so on, in an effort to make the world's "worst" song. And again as you might expect, the "worst" song ended up being far more fascinating and creative. Imagine the efforts the human composers went to in order to make all these things mesh. I remember hearing a clip and it was interesting, for sure.
Tunes that catch your imagination are often like that. Think of The Smith's How Soon Is Now, Tom Tom Club's Genius of Love, etc.
Re: (Score:2)
So they experimented with offbeat stuff and sounds, and came up with something fascinating.
This my friend, is called Progressive Rock.
Re:Is it the 1970s again? (Score:4, Insightful)
I heard a similar account from a buddy of mine who was in the recording industry back in the mid 70's. Someone did a bunch of metrics to determine the characteristics of a hit song and came up with some average: x% singing, y% cellos, z% electric guitars, a tempo between t1 and t2, etc. And then they made a song that had exactly all of that stuff.... and it sucked.
A brief skim of TFA leads me to conclude that it's rife with half-thought-out research. The question they pose, "What if we knew, for example, that 80% of the Billboard Hot 100 number one singles from 1960-2010 are sung in a major key..." is completely meaningless if 80% of the entire population of songs, hits and non-hits alike, are in a major key... with a 4/4 time signature, etc. It's like determining that 100% of all coffee drinkers have faces. 100% of people have faces, so you haven't discovered anything different about the coffee-drinking subset.
What you're looking for is what sets the "hit" population apart from the "non-hit" population. And, from what little I looked at, they don't address that at all.
They also try to slap a linear regression onto everything. They assert that song duration is increasing. Umm, no... it was increasing during the 70's, and then it stabilized. And that probably had a bit to do with the formats that the music was available in (ie, 78-rpm records vs. 33.3-rpm...). But, again, we would only know that if these jokers looked at the average duration of *non*-hit songs.
Re: (Score:3)
R&B Hit Generator (Score:5, Funny)
R&B has a clearly worked out hit formula:
http://img8.imageshack.us/img8/4185/rnbcreator2tf9.jpg
Might be applicable to other styles such as pop, trance, rock...
Re:R&B Hit Generator (Score:5, Funny)
Some time back I wrote a lyrics generator inspired by Destiny's Child. It didn't have nearly enough strings to draw from, and I never got around to setting up proper weighting for the various phrases, but it was definitely producing authentic Destiny's child gibberish. Here's an example:
I gon' trippin'!
I gon' frontin'?
you's actin' and you's actin'!
Nine out of ten cat owners are trippin' as You been doing playin'!
Why I see you movin'.
you's trippin' 'n' I gon' actin'?
Girls be like knowin'?
I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?
I gon' playin'.
I gon' frontin' but Keynesian Theory makin' me think Why you thinkin' 'bout playin'.
I trippin'.
U frontin'?
I trippin'.
you's trippin' 'n' I gon' actin'?
Girls be like knowin'?
I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?
better da street if he be actin'?
Thems knowin'!
I gon' actin'!
I actin'.
I be knowin' U be braggin'!
you's trippin' 'n' I gon' actin'?
Girls be like knowin'?
I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?
Re: (Score:2)
Re: (Score:2)
All popular music has had a formula since at least the 1920s, and probably long before that.
Put in sex/love and/or a rhythm to move along with.
Every pop song of all time has followed that formula with the possible exception of The Ballad of the Green Beret which was an inexplicable No 1 hit in 1966.
Re: (Score:2)
That's not quite fair. In 1966 [wikipedia.org] alone: The Sound of Silence, Paint it Black, and Paperback Writer are not really about love or sex, in addition to The Ballad of the Green Berets (the success of which in 1966 is very explicable). And if "a rhythm to move along with" is a sufficient qualification, then the Ballad itself fits well enough as the quintessential "move along with" style of music: a march.
That said, the interesting thing isn't how to write hit subject matter. It's how we have so many hits that ar
Re: (Score:2)
Re: (Score:2)
First song! (Score:2)
Hot Song Science is old news (Score:4, Informative)
So is that what we want, or the other way around? (Score:3)
There are 2 ways to look at these results. One is that out of all the music produced this formula is what the majority of people want to listen to, or it could be that this is what the record companies flog us because it's what they think we want to hear. Either way this is all that bands will be producing from now on, meaning less variety in music. It's a case of data driven choices gone mad.
My next album title's going to be I-III-IV, should make me a million.
Re:So is that what we want, or the other way aroun (Score:4, Informative)
Pretty much any genre of creation based upon personal taste is going to have some sort of a formula that's pure lowest common denominator. The more likely explanation is that it's what record execs think will sell and consequently it's what they push. Way too often the songs that get popular get popular because they're frequently played, not because they're good.
It used to be extremely unusual for songs on the radio to break out of a standard format and going beyond 2 minutes wasn't typically done.
Re: (Score:2)
Yes, it's lowest common denominator. There's no way you could have widespread common ground among millions of different people, for something as hugely diverse and personal as individual taste in music, without recourse to the lowest common denominator. It's a race to the bottom of sophistication and variety in order to superficially appeal to the largest number of peo
Re: (Score:2)
That is "lowest common denominator".
Just because it's "lowest" doesn't necessarily mean it's particularly "low", just that going any "higher" destroys the commonality. If you're talking about widespread common ground among millions of different people, then
Re: (Score:2)
That is "lowest common denominator".
Just because it's "lowest" doesn't necessarily mean it's particularly "low", just that going any "higher" destroys the commonality. If you're talking about widespread common ground among millions of different people, then you're talking about lowest common denominator.
1. Decide that a term I used bothers you.
2. Miss the point being made.
3. Find a way to insert your offense at my term into the conversation.
4. Uh, profit?
Ever listen to much recent popular music? It's at around an 8th grade emotional level, usually about a failed relationship. That puts the low in lowest common denominator. I'm sorry if the correct way of naming things offends you.
This isn't like taking a survey of 5 million men and asking if they enjoy getting hit in the testicles. Ther
Re: (Score:2)
Hm, I suspect I actually misunderstood you.
See, this is Slashdot. When you said
There's no way you could have widespread common ground among millions of different people, for something as hugely diverse and personal as individual taste in music, without recourse to the lowest common denominator.
, I took for granted that you were being sarcastic, and were attempting to argue exactly the opposite of what you were saying, and were expressing anger at the use of "lowest".
That's what I was reacting to.
(And no, I have not ever listened to much recent popular music. Not sure what I might discover if I did. I haven't yet heard a single song by "Lady GaGa" or "Justin Bieber" or ... heck, that's all I can name.)
Re: (Score:2)
Believe me, you aren't missing anything worthwhile. There's only so many different ways a singer can whine about their inability to mature into an adult person with the self-knowledge to confidently select a life partner who's actually good for them to be with, and then invest the effort and patience
Re: (Score:2)
Exactly, it's circular. People like what they hear so execs give us more of it to the point that's all we ever get. The same thing's happening with hollywood, nobody is willing to go off formula so we are getting the same movie formulas all the time.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Then again I play blues and country which tend to be different variations of I-IV-V.
Axis of Awesome (Score:5, Funny)
Here is the entertaining version of this important discovery:
http://www.youtube.com/watch?v=5pidokakU4I [youtube.com]
Re:Axis of Awesome (Score:5, Funny)
As a cellist, I have to point out that this is all a refinement of the Original 1 hit wonder [youtube.com].
Some of the same songs even ;)
Technically this is 5 chords, but the 6th is often "skipped" by using a turn.
Re: (Score:2)
Re: (Score:3)
Slashdot has completely fucked up its interface to the point where links don't even open when you click on them. Right-clicking a link doesn't open up a menu, either. I had to look at the link through FireBug to grab the URL and paste it into a new window.
If using Firefox, you can drag a link to the tab bar and it opens a new tab using the URL of the dragged link.
Re: (Score:2)
Re: (Score:2)
Scum (Score:2, Informative)
Re: (Score:2)
How do you know the music you like isn't already generated by some computer?
Re: (Score:2)
Re: (Score:2)
What about a genetic algorithm?
Re: (Score:2)
Re: (Score:3)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Who is using algorithms to write their music? Well of course big labels are writing songs to make sure they sell, what do you expect? Are they using an algorithm? I doubt it, they're probably just writing songs around a time tested and proven formula and apparently spans generations and genres. This isn't surprising at all.
If you think about it, songwriters use a subconscious algorithm when writing music. There are certain time signatures, chord progressions, tempos, that equate to popular music. Also consi
Re: (Score:2)
Larry Fast, but not in the sense you mean.
Larry Fast's solo project, "Synergy", was an early innovation in electronic music. (Not as early as Wendy Carlos, but we're still talking about the 1970s.) For the most part, the albums consist of performances programmed in ahead of time, either via MIDI or via assembly language, and then performed on electronic instruments.
But he had an experimental album years ago, "Computer Experiments Volume 1", in which he programm
Re: (Score:2)
Anyone who "writes" music based on algorithms, market research, and what a computer tells them will be a "hit", needs to be deposited in the bottom of the ocean.
I believe anyone who's a fan of the Aphex Twin [wikipedia.org], might respectfully disagree there. It's all in how you use the "tools" whether they're instruments, computers, voices, etc.
Re: (Score:2)
In a previous life, you were the one saying,
"Anyone who 'designs' a bridge based on algorithms, public demand, and what a computer tells them will be 'desirable to drive on', needs to be deposited in the bottom of the ocean."
Correlation and causation (Score:5, Insightful)
Re:Correlation and causation (Score:4, Insightful)
Indeed, the trends they spotted over the years may also apply to all the songs that never quite made it to the top, or even into the charts.
Re: (Score:2)
Did they only look at the hits or also at the misses? There are bound to be enough songs that abide the "formula" but lack enough musicality to become a hit.
I initially made the assumption that any analysis like this would be supervised by someone who understood such things... but maybe that's not the way the kids do things these days.
Re:Correlation and causation (Score:4, Informative)
Re: (Score:2)
Re:Correlation and causation (Score:5, Informative)
Hey there, I'm one of the authors of this study... the media picked this up and is sensationalizing the study. You are absolutely correct that we need to look at the misses too (in the form of a control group) to make any statistical correlations, which is what we are currently working on. What we did was simply make some observations of descriptive metadata using visualization tools. They have blown this way out of proportion by mistaking our hypothetical opening paragraph as the results of the study.
Re: (Score:3, Interesting)
Re: (Score:2)
Yes there is... (Score:3, Informative)
... and it was written ages ago
http://en.wikipedia.org/wiki/The_Manual [wikipedia.org]
Re: (Score:3)
They're Justified, and they're Ancient, and they drive an ice cream van....
Female artists who don't wear underwear is key (Score:2)
There may be historical patterns which can be followed, but there are many elements of success which have little to do with talent, style or proficiency. Just as in Japan, pop stars do not need to sing well -- they just have to be hot. You can follow that pattern all day long but if the performers are obese or have skin problems, they aren't going anywhere. (Wilson-Phillips anyone?)
So if you want to be on top and stay on top, you have to be able to do some kind of music, but it doesn't have to be great.
Re: (Score:2)
They sold 10 million of their debut album and had 3 number one singles.Their second album went platinum as well. I'd call that going somewhere.
commerce vs. art (Score:2)
Of course you can create a commercial hit this way.
Whether you can create Art this way is another question altogether.
let me guess, use the same four chords? (Score:3)
Axis of Awesome, NSFW if on speakers
http://youtu.be/5pidokakU4I [youtu.be]
Of course (Score:2, Interesting)
Popular music has always been formulaic. Good music, on the other hand, is not.
Re: (Score:3)
It's not exactly formulaic when you invent the formula.
Pop Is Getting Louder (Score:3)
Now get off my lawn.
Re: (Score:2)
Re: (Score:2)
Welcome to the current limiting and mastering preferences that take much of the dynamics out of a recording. This is done out of fear that a quieter song, or one with varying dynamics, won't grab the attention of listeners on the radio. However, in tests it's been shown that the lack of dynamics produces "listener fatigue", following which the listener stops really paying attention to what they're hearing.
That is not why it is done. Compression of the dynamic range makes the song listenable in a car or on an ipod in a noisy environment. That is where MOST people listen to MOST of their music.
Yes yes, I realize that the acoustics are excellent in your mother's basement... but have you ever tried to listen to a song with a large dynamic range while driving a car? Or listen to an ipod on earbuds while shopping? You have to turn the volume up in order to heart the quiet parts, and then you get your ears bla
Re: (Score:2)
OK, I accept what you've said - that compression makes music listenable in sub-standard environments.
However, why in the bloody hell have music-makers decided that's it's OK to destroy the source material to achieve this?
Instead of compressing the songs, why didn't the industry get together with the hardware folks and implement compression in the playback devices? My car, for example, has radio settings that automatically turn the volume up when driving faster, then lower the volume when driving slower. (
Trends (Score:2)
I do find it interesting: Hit songs got progressively longer, more "dancable", and louder.
Aside from what appears to be a very clear divide in key up to vs. after 1980, key doesn't play much role.
I find the "weeks on" interesting as well... The music in the 90's stayed on a lot longer than the more modern stuff. That doesn't surprise me, really, some of the recent hits do strike me as pretty disposable.
Re: (Score:2)
That doesn't surprise me, really, some of the recent hits do strike me as pretty disposable.
Hint: Pop music has always been disposable. The fact that you're only noticing it about recent hits just means you're getting old.
Re: (Score:2)
That's just it though... The numbers demonstrate that it's more than just me being old: The evidence suggests that pop music ~really is~ more disposable than before.
Now get off my lawn.
Flintstones (Score:2)
Re: (Score:2)
Familiarity Breeds Intent (Score:2)
formula for a hit pop song (Score:2)
bad math (Score:2)
The formula for a hit song is 20cents per play on local radio stations. It's called payola, and they've been doing it since the invention of radio.
Size Doesn't Matter (Score:2)
It isn't the size of your chords that matters; it's what you do with them.
Where is the "market budget" variable? (Score:2)
formula is simple (Score:2)
T+A
Hit? Formula? (Score:2)
Depending on how you shoose to interpret it, this is either a very deep question - or a daft and superficial one.
If we take the extremely superficial line and look back over just the last 50 years, then perhaps, yes, there is a "hit formula", but I am not sure that the poster get close to it. Each decade has had its own style, and I think the most important common trait has been the alternation between a "revolution phase", where a new style has found resonance with something in the time: Rock'n'Roll and th
From the Authors (Score:4, Informative)
No more Friday? (Score:2)
Complexity of Songs (Score:2)
http://en.wikipedia.org/wiki/The_Complexity_of_Songs
Isn't this slashdot?
"Bananas" (Score:2)
Harry Chapin touched on that subject in his song "Bananas". It was a formula for a hit country-western song. In it it said you had to mention motherhood, infidelity (hurting songs), and trucks. He also said that you needed a fiddle, steel guitar and it also helped to have a choir ( the audience - aka he Mormon Tubercular Choir ). The resulting song was rather funny.
"Harry, IT SUCKS!"
Done before ... (Score:2)
They more or less mention the same things. If you want to read it, google is your friend
Prophetic TV (Score:2)
I-III-IV? (Score:5, Informative)
Something from the summary really irked me: I doubt they'd find that the best songs use a I-III-IV progression. Pop songs practically all start with a I-IV-V progression. (Remember the lyrics to Hallelujah? "It goes like this, the fourth, the fifth...")
When the III is used, it's usually minor, though the minor vi is more common ("The minor fall.."). The I-vi-IV-V sequence has been the basis of rock and pop since the 50s. Learn those four chords, and you can play practically any top 40 hit. (You know the guy complaining about Pachelbel's Canon? Most of them are really just using the I-vi-IV-V, which happens to mesh nicely with Pachelbel's real progression: I-V-vi-iii-IV-I-IV-V.)
So I checked their data and discovered... nothing. Nowhere in their data do they talk about chord progressions. That's not really surprising, since figuring out the chord progressions is much trickier than figuring out the tempo. But they mention it in the summary. Why?
Because that progression is so universal, of course you'd see it in the top 40 hits. You're also going to see it in the songs you've never heard of. If they really had found that I-III-IV was a frequent hit, they'd actually have learned something.
This wasn't really intended as news. It's old stuff with new visualization applied. It's a student exercise passed off as research by people who don't actually know the state of the art, like the stories about "Students build 9,000 mpg car; why can't Detroit do that?"
It just irks me that they're talking a little music theory and betraying their lack of understanding of music theory in the process. What I've just talked about is something every, EVERY musician knows.
Yes, there is (Score:3, Informative)
http://en.wikipedia.org/wiki/The_Manual [wikipedia.org]
Re: (Score:2)
Re: (Score:2)
Happens all the time. Some students do a class project and post it on a blog and eventually word gets around. Because it's MIT (or harvard) then the press that picks it up thinks that it maybe something new and trendy.
A lot of times the news media just wants to fill air time with assorted stories that may be interesting to someone. Then it's the audience that believes that if its MIT or Harvard students doing it then it must be something that no one ever attempted before.
Re: (Score:2)
Rutgers....
Also they need some basic statistics analysis. While they force a linear "trend" some of those graphs clearly are crying out for something other than a straight line approximation.
Re: (Score:2)
Considering the course was in "Information Visualization" yes, yes they did, and entirely appropriately at that.
Why not more lawsuits (Score:3)
All music currently in the hit parades are (at least partially) copied from songs popular years ago.
If so many songs are being copied [pineight.com], why aren't there more plagiarism* lawsuits like the one over "My Sweet Lord"?
* Plagiarism here means infringement with unattribution.
Re:Why not more lawsuits (Score:4, Informative)
Or the new artists got permission, but the original artist didn't want to be associated with that crap, but needed to get paid.
Or the "original" and the copy both are using a well known ancient riff. (See Red Hot Chili Peppers' "Dani California" and Tom Petty's "Mary Jane's Last Dance"
Robert Heinlein said, "Steal from the best, and file off the serial numbers".
Re: (Score:2)
I think it is generally accepted among musicians that you borrow from each other, play each others' songs, add your own twists, etc. I think people need to give up on this idea that all music should be totally original.
Re: (Score:2)
Almost all music is at least partially copied from songs years ago. Don't fool yourself. There's not really much new in music unless you go out to the very fringes, and then it just starts to sound like random noise (to my ears anyway). I think you just have to embrace it. Music has constraints. Music in certain genres sound very similar. They sound even more similar the less familiar you are with the genre. That's just the way it is.
As far as doing a s study, I think it is valuable to quantify exactly wh
Re: (Score:2)
Of course there's Pachabel's Canon [youtube.com]
And who doesn't know how to make a techno song [youtube.com]
Re: (Score:2)
Re: (Score:2)
Please mod AC parent up - I - IV - V (not I - III - IV) is and has been the standard pop/rock harmony progression since the 1950s, with roots that go back to turn of the 20th century 12 bar blues from the Mississippi delta.
I - III - IV is practically unknown among pop songs (though I - III - IV- IVminor is a common enough phrase in some songs, but rarely if ever the main progression)
Re: (Score:3, Insightful)