Subscription VoD platforms Netflix and Amazon have emerged as two of the most important players in the scripted TV business. But they are notorious for playing their cards close to their chest. While they are happy to make carefully choreographed appearances at TV industry events and provide subscriber information during their quarterly results presentations, they are not easy to interview and refuse to provide data about the audiences their shows attract.
This, of course, is their prerogative – but it does make it difficult to judge how original commissions are doing. How do we know, for example, that Netflix flagship House of Cards is the hit show that we all seem to assume it is? And what evidence is there that Amazon’s critically acclaimed transgender drama Transparent is anything other than a global media village talking point?
In the absence of ratings data, the most obvious measurement of success on SVoD is whether a show gets recommissioned. Viewed from this perspective, House of Cards is clearly doing a good job, because Netflix has just greenlit a fourth season for 2014. We also have to assume that Orange is the New Black and Hemlock Grove are algorithmically acceptable because they both have third seasons coming up. (Orange’s debuts on June 12, and it actually also has a fourth lined up.) By a similar token, Amazon’s decision to recommission both Bosch and Transparent suggests it is also happy with the impact these shows are having on its business.
Using recommissions as a benchmark for ratings success has its limitations however. For a start, it’s possible that the decision to renew these shows is more about creating a positive PR bubble than rewarding strong ratings. If the SVoD platforms can secure positive notices among critics and reviewers for their shows – plus the occasional Emmy or Golden Globe – they can drive new subscriptions without necessarily winning big audiences.
In other words, raw audience size isn’t an issue for the SVoD platforms as long as they feel like they are achieving ROI with their dramas. But it’s more of a concern for traditional broadcasters thinking of acquiring the rights to a show, because they need metrics to work out a show’s appeal to advertisers.
Furthermore, international channel buyers often have to make decisions about whether to acquire a show before the decision to recommission has taken place. So they may find themselves having to acquire a show without any ratings or audience demographic data. In this scenario, they won’t know whether the decision to recommission was for PR purposes or due to a commercial commitment to the producer or distributor of the show, which may only have signed up with the SVoD platforms on the understanding that it would get at least a second/third run.
The TV industry has tried to get round the ratings issues in various away. Variety magazine, for example, recently published some insights from Luth Research, a San Diego-based company that surveyed 2,500 Netflix subscribers to analyse their viewing habits. Although there were some methodological limitations to the research, it showed that Marvel show Daredevil has been the platform’s most popular series of the year so far, with 10.7% of subscribers watching at least one episode in the first 11 days. With Netflix’s US subscriber base currently at around 41 million, this means the show drew around 4.5 million viewers. The same research showed a more modest audience for House of Cards season three (6.5% over the first 30 days) and a pretty lacklustre performance for Bloodline (2.4% over 30 days – around one million).
Aside from this kind of bespoke research study, the industry is forced to fall back on audience feedback as a gauge for how a show is performing. So if we stick with Daredevil for a moment, Goscoop.tv was quick to spot the fact that the show secured 4.6 out of five stars on Netflix’s audience review chart, higher than House of Cards. Daredevil also scores well on sites such as IMDb and Rotten Tomatoes. IMDb is particularly useful because you get to see a rating (9.1/10) and the number of users who have voted (79,169 at last count). This is important, because high volume hints at high ratings – and also allows us to build a picture of how the mainstream audience has responded to a show. A low volume of reviews will inevitably skew more towards fanboys or haters.
IMDb gets pretty interesting when you start exploring how other dramas stack up against these scores. We can see, for example, that House of Cards has a 9.1 rating from 212,263 users, Orange is the New Black has 8.4 from 129,964 users, Bloodline has 8.4 from 8,833 users, Bosch has 8.4 from 8,745 users, Marco Polo has 8.2 from 21,666 users, Transparent has 8.1 from 7,256 users and Hemlock Grove is trailing the pack with 7.3 from 24,091 users.
This isn’t an ideal way to analyse shows but it does throw up some interesting points. Firstly, it underlines how strong Daredevil is. Not only are its rating high, but it has stimulated high levels of audience engagement in a very short time. With season two already commissioned this is a hit for Netflix and will undoubtedly prove a popular pick up when it moves into distribution.
Hemlock Grove’s performance also suggests that the audience’s assessment of a show is broadly in line with the critics, who have not liked the show. Variety’s comment coming into series two was: “While a loyal contingent was inclined to give Hemlock Grove the benefit of the doubt in a ‘so bad it’s good’ way, watching the opening of the second go-round still tips the scales toward so bad — and boring — that it’s just plain bad. Efforts to improve the show, or just make sense out of it, have largely foundered.”
Continuing with this deeply unscientific but mildly entertaining analysis, what happens when we compare the above IMDb ratings with high-profile shows on cable TV (I’ve limited it to cable because these shows are most similar to what is on offer from Netflix and Amazon)? Well, Game of Thrones has a 9.5 rating from 772, 837 users, Breaking Bad has 9.5 from 680,964, The Sopranos has 9.3 from 153,972, Better Call Saul has 9.1 from 69,893, The Walking Dead has 8.7 from 511,536, Mad Men has 8.7 from 121,003, Vikings has 8.6 from 126,260, Wayward Pines has 8.4 from 3,497 and The Returned has 7.3 from 3,473.
If you look at these results through squinty eyes, this isn’t actually a bad reflection of the quality and popularity of these shows (Game of Thrones – notwithstanding recent controversy – and Breaking Bad spectacular, The Returned a disappointment). There’s even a kind of correlation to US platform penetration figures. With cable in 100 million-plus homes and Netflix in 41 million, there’s a proportionality in Breaking Bad and House of Cards user totals.
There are all kinds of health warnings you could apply to these numbers, connected to the time they’ve been on air, who their core audience is, whether they are the kind of shows that polarise people and whether the shows’ creators have tried to artificially hype positive reviews. But the overall scorecard seems to suggest that Netflix has had two slam dunk hits (Daredevil and House of Cards) and one that is dividing audiences a bit (Orange Is The New Black). If Daredevil keeps up its momentum, then you’d have to say that Netflix’s four-series deal with Marvel is a masterstroke.
Amazon has had a reasonable start with detective series Bosch, though its numbers are probably skewed upwards by pent-up demand from fans of the book series. This ‘jury’s out’ feel would align with The Guardian’s assessment that Bosch is a paint-by-numbers cop show that leaves “no cop-show cliché unturned.” Arguably, Transparent’s 8.1 rating is one of the most interesting scores. In an era obsessed with transgender TV, Transparent is of its time. And it did win a Golden Globe for best comedy. But if we take 8.7 as a benchmark of high quality (see above), a rating of 8.1 suggests the show is polarising audiences to some extent.
The overall assessment has to be that Amazon is yet to get its scripted strategy quite right. So a lot will be riding on upcoming projects like The Man in the High Castle, Mad Dogs and Hand of God. Amazon, of course, is still playing catch-up to Netflix – but at some point it will probably need its own Marvel moment.