Review - Pay As You Play by Tomkins, Riley and FulcherFull disclosureIt's only right to disclose that I had a small involvement in this book, contributing a few pages' worth to end the section on Liverpool FC. My bit's listed above, so feel free to tear it to shreds. All feedback is good feedback.
To the ReviewAs Liverpool fans, we all know who Paul Tomkins is. There's a thread on here where week in, week out, we to and fro over the merits, demerits and alleged subtext of his standard fayre - or a great part of it - his regular blogs. But as even the most committed detractor would concede, the man is as prolific as he is talented. As well as a mammoth online output, Tomkins has since 2005 published a series of books almost unprecedented in their attention to detail and depth of analysis. Having also been the key columnist on the official club site for several years, it's fair to say we all know who Paul Tomkins is.
But three questions:
- Do you know who Graeme Riley is?
- Do you know who Gary Fulcher is?
- Do you think fans of other clubs know who any of these three are?
The Three Wise MenI'd suggest that, not too long from now, the answer to all three of those questions will increasingly be 'Yes'. At least amongst a certain cadre of football fan, that is. The reason? They're at the forefront of a movement, and that movement is as inclusive as it is intriguing.
Last month, Tomkins, Riley and Fulcher published "Pay As You Play" after a six-month project led by Tomkins. You might think that's a natural gestation for any standard book project, particularly one where several people are collaborating. But the term "standard book project" doesn't apply - this isn't a standard book. When the postie pops your cardboard package through your letterbox, you'll hear a thunderous crash, because this is a work of almost unprecedented weight. Flick through its pages, and you'll gain access to a repository of data so rich that you wonder how a monster like this could have been borne within those six months. It's a veritable beast.
The PremiseThe premise of Pay As You Play (PAYP) is simple - it's been hitherto impossible to achieve genuine like-for-like comparison between clubs, managers, and players. That's true of a static analysis based on the present moment alone, let alone comparison between managers, clubs, and players of different eras. The tools we've thus far used haven't been fit for purpose in that regard. So why not invent better tools?
That's what Tomkins, Riley, Fulcher et al have made a start on here. PAYP represents something fundamentally different to tools like the Guardian Chalkboards, or heat maps, or the various statistical corpora provided by companies like Opta or Actim. These are tools used to provide rudimentary match analyis and assess the microcosmos of a football match. PAYP instead thinks of football clubs and their managers as market operators. Clubs, and the managers at their helm, buy and sell things in what's essentially an open market. Sure, it's an unregulated market plagued with sharks and sheisters, but for the most part clubs are subject to the same advantages and disadvantages faced by companies generally when trading in any market. Some have bigger bargaining power and greater resources to allocate. But what's key is that all of those companies are subjected, either internally or externally, to constant scrutiny of their performance in their chosen markets. The tools developed to perform that scrutiny objectively have, over centuries, become incredibly sophisticated.
In football, on the other hand, we get Messrs Merson, Redknapp and Lawrenson schooling the average football fan on what being 'effective' means in the football transfer market. That is to say, we had no insight into what 'effective' means whatsoever.
In light of that fact, PAYP should have football fans rejoicing the world over. While it's restricted to the English game, and for the moment only to the Premier League and those who have participated in it since its inception in 1992 (they only had six months mind), the principles applied here would apply in exactly the same way in any league, and in any country.
The Transfer Price IndexSo - to the tools of their trade. Those who read Tomkins' earlier works "Dynasty" and "Red Race" will be familiar with his "Transfer Price Index". Simply put, this applies a Retail Price Index-type analysis to prices in the football transfer market. As Tomkins himself says:
"In everyday life, most people are familiar with the concept of the Retail Price Index (RPI) as a measure of inflation. A basket of goods is identified and every month the same items are checked to see what the value would be if these were to be purchased. The difference between the current value and that from the previous month is calculated and termed the RPI. By comparing the value this month with the corresponding value for the same month last year, we obtain the RPI.
The same methodology applies to the TPI, except that the "basket" contains every single footballer bought and sold each season, rather than grocery produce (although a few rotten eggs remain)."
Dynasty used this approach to try and assess Liverpool managers, sides and players from different eras on a fair footing, taking their financial and competitive context into account along the way. Red Race took this a step further, comparing Liverpool's market performance in recent seasons against what were then its direct rivals at the top of the table.
PAYP is the next logical extension of this approach. It's the Transfer Price Index approach writ a little larger.
So How Effective Is The Analysis?It's important in any review not to give too much away, so I won't. All I'll say is that, like any good analysis, it's nice and transparent. It's the underlying data that shines through, and it isn't clouded by spin or agenda. I'll expand on why that's crucial below.
The authors acknowledge that their approach is not without its flaws, and it's that overall acceptance and openness that rings true with the statistical tradition for me. It's split into four parts as follows.
Part 1: introduces the methods used, and identifies the key trends and points of debate from 1992 to the present day.
Part 2: delves into the detail for each of the clubs involved in the Premier League since 1992.
Part 3: switches focus to each of the 18 seasons in turn.
Part 4: assesses the performance of the big managerial names involved.
How effective it is will ultimately be judged by each reader themselves, so all I can do is offer my personal take on things. For me, while there are obvious areas you'd like to see explored further, the book clearly demonstrates both the correlation between financial muscle and success, and the value of this kind of data in comparative assessment. It's a big step in the right direction.
Is It Balanced?There will inevitably be those who disagree - that always seems to be the case when it comes to Paul Tomkins' work - but for me, balance is baked into this book, and to the entire movement that it's built upon. What would be the point otherwise? Central to the development of this book, (and you would hope of many later books) were Graeme Riley and Dan Kennett, both experts in commercial data analysis. Their expertise enabled constant tweaking to the underlying database, and to the number crunching methods used to read the overall trends. Being experts in what constitutes competitive balance, their reputations depend on their objectivity. How can you make informed decisisons if any kind of agenda skews your representation of your data of the analysis that flows from it?
It's likely that many others talented in these fields will get involved with later developments. That bodes well for us, if not for Messrs Merson, Redknapp and Lawrenson.
A Better Mousetrap?In comparing the relative merits of analysis based on transfer fees versus analysis based on wages, the book's introduction states: "Neither method is perfect... but as we will outline in this book, we feel that we've found the strongest-ever link between transfer spending and success."
I think that's a fair assertion. The data presented is compelling in itself. But the book's about more than that for me. What's possibly more important is that a. these guys have developed a way to produce and self-publish a book of phenomenal quality in only six months, and b. they've demonstrated a commitment to openness, transparency, challenge, and constant refinement, and that commitment is built into the very fabric of their approach.
It's that spirit that will, you hope, eventually help build the kind of mousetrap we need.
Hopes For The FutureOne thing that's clear about Paul Tomkins is that he's a man who responds positively to a challenge. So it's with that spirit in mind that I hope he truly pushes the power of this idea and helps reinforce and build on the genuinely enlightened thinking that currently goes into our analysis of the game. Ex players and media hacks serve us up the same old nonsense week in and week out, and have done for years. In the process we never really get much insight into what makes the game tick. And while this isn't the only front on which fans need to take the game back, it's one front where we can really make inroads into 'enemy' lines. All we need is access to the data, a few clever heads to knock together, and a few more with the ability to present the insight it creates in a way that's accessible to the day-to-day fan.
People are excited about the idea. Only three weeks ago I spoke to an illustrator for a well-known children's comic and he started to wonder how you could make this kind of information accessible to school kids. It's quite a challenge when you think about it like that. But ultimately it should be the aim if this movement's really going to change things.
PAYP makes an excellent start in that direction. The writing is clear and direct, making a subject that could be dry and intractable both engaging and intuitive to understand. The use of standard graphs and infographics is intriguing to me, as it's an area I'm fascinated in. I remember suggesting a few months ago that by applying the principles of
Edward Tufte, Tomkins and his compadres could really bring the findings of this work home to your average fan. Taking one look at the
heat map graphic from PAYP, which plots the trends in competitive balance since 1992, you realise that this spirit is central to the group's work. To be honest, it makes you want to throw yourself in there and get involved.
Along with developing better tools for genuinely insighful and objective analysis, you can only hope as much effort goes into keeping the information engaging for users. On that front, I'll be reporting for duty - but then it's my hobby anyway.
I guess the best way to sum up my hopes is this: I'll meet you all for a pint at the close of the 15th annual International TPI Convention in 2028.