What the university system needs now, entering the second quarter of the twenty first century, is very much the same as the Tang dynasty needed – and introduced – in imperial China in what we would call the Dark Ages. I mean the jinshi, the system of public examinations that were used to recruit the imperial civil service. The problem which the jinshi was designed to solve was that the existing system of recruitment, based on recommendations by local notables, was wide open to nepotism and corruption. The jinshi was intended to select candidates on merit, which in this case meant knowledge and understanding of the Confucian texts. Let’s accept that what counts as merit is always going to be at least partially contested, but that doesn’t mean we shouldn’t be seeking out merit.
The problem I am addressing is, in a sense, grade inflation, but more accurately certain other problems which occur because of grade inflation. And the solution I am recommending is independent national examinations. In my generation about 4% of the population went to university and about 4% of those were awarded first class honours degrees. If you were one of those 0.16% of the population you were a “high flyer”, offered the “fast track” (specifically in public service) and the world was your lobster as Arthur Daley used to put it. Now around half the relevant age cohort go to university and around a third get first class degrees it is inevitable that the system of awarding degrees cannot play the sort of role in the labour market which it used to play.
The more specific problem for universities and other employers is that if you can’t pick out high flyers at a young age all you can offer by way of a career route is a long and winding road which many people are going to find unattractive. Long ago I was a (surprisingly well remunerated) university teacher at twenty one and had a “tenure-tracked” job at twenty two. Towards the end of my career a good student who wanted to become an academic would normally have to go through a masters’ degree, a doctorate , research and/or teaching assistantships and temporary academic posts if they were ever to get a permanent academic job. If you stop and think about what human beings have achieved intellectually before the age of thirty in recorded history the idea that you might have to slog it out beyond thirty just to get a worthwhile job is simply ridiculous. In the later years of my career I failed time after time to persuade the better students I taught to contemplate an academic career and, for that matter, all of my own children might have considered it back in the day, but eschewed it as presented.
It is worth asking the question when you give someone a degree, including a mark or classification, what exactly are you claiming about them. When I was first on examining boards there was a kind of vehement orthodoxy among those a generation above me that it was all about “terminal velocity”. They had no interest, they said, in what an 18-year-old might have learned and now forgotten, but only in what was retained and related on graduating. Thus there was opposition to any kind of exams early in student life and to anything (such as essays) other than genuinely final exams counting for more than a tiny fraction of a degree. There were also subsidiary arguments about tutors not examining their own students and about it being a good thing that exams were stressful. Thinking and reacting quickly under pressure: why wouldn’t it be good to measure the ability to do that? Degrees marked by your own tutor? Or based on essays in the age of AI and the internet? You could not possibly be serious.
They/we lost all those battles. By the standards of the original orthodoxy there was a relapse towards an American-style system which saw a degree as something which could be banked as a set of credits, no longer a measure of your abilities to assemble thought at the end of your undergraduate career. More, in fact, of a certificate of willingness to go through prescribed motions. At best, a certificate of competence. And I am not suggesting we could ever go back to the old system; it would be politically impossible. People going to university now pay money and have expectations. Many employers want a certificate of competence and need people who are prepared to go through prescribed motions.
But it would be possible to complement the current system with an additional alternative of traditional exams the results of which might be of considerable interest to certain employers, including academic employers. These would be public examinations held under traditional conditions. They would be timed, unseen and impossible to prepare for. They would measure what you know about history or physics rather than the content of particular courses in those subjects. They would be very much for the off-piste thinker. The resulting stress should be relished rather than mitigated. They should seek to test breadth of knowledge, but also a wide range of ways of thinking. In some ways they would stand to existing degrees as the old “S” levels did to “A” levels. “S” originally stood for “scholarship” because they were used for the award of state scholarships, but they continued as “special” papers, of particular interest to Oxford and Cambridge colleges, until 2001. I took them in the early 1960s in history and economics. In the latter cases, for example, the “A” level would require you, for example, to show knowledge of the text book theory of oligopoly, but the “S” level might ask you to consider something much broader such as the circumstances under which you would recommend protectionism to a newly independent state. (There were a lot of those at the time.)
I can muster a lot of experiences which tell me that marking systems often do the opposite of rewarding broad and/or original thought. Actually, I go back to “O” level autobiographically: we did a very modern English literature syllabus – poems by Hardy, a play by O’Casey and “travel” writing by Van Der Post. I had read the books thoroughly and formed clear opinions which I expressed in the exam. I failed; that compared with maths in which I received the highest possible mark and I would have considered myself better at literature than maths. I can’t say it has rankled ever since because I honestly couldn’t care less then or now, but it has informed my opinion about marking. A quarter of a century later I was involved in a kind of control experiment when we decided to re-mark the papers of our exchange students from a fairly prestigious American university. Our marks diverged widely from theirs: we were looking for bold and clear lines of argument, they were rewarding demonstrations of knowledge of the set texts. I was scornful; after all, in the long term who gives a teeny damn about whether you know what these obscure and mediocre textbooks said? Whereas the issues (urban planning and politics in the case of the papers I was marking) are important.
There are plenty of examples of the sort of exams I have in mind. The All Souls’ exam – where four papers can win you a seven year fellowship – is a small but famous example. The civil service exam – where a candidate I knew was asked to place N items in a supermarket, a question he’d never given ordered thought to before – is perhaps the most important. Some elements of Oxbridge entrance are like this and, in the days when you put a lot of effort into admissions, we examined applicants for philosophy and politics on subjects they had never been taught. The “A” levels in those subjects were almost non-existent and other “A” levels were a poor guide to whether a person could think philosophically. And there is actually an amusing fictional extension in W.S.Gilbert’s libretto for Iolanthe (first produced 1882) where the half-fairy Strephon, possessed of superpowers as we should say now, threatens the House of Lords that he will replace them with a chamber selected by competitive examination. (I’ve heard worse ideas.)
Strephon’s plan is a key to an important part of the argument. Open, competitive examinations were intended to be – and still can be – the alternative to privilege. Their use in the universities and professions enabled a level of social mobility far higher than is now the case. Exams are of much less value if you can be precisely schooled to do well in them and the good schooling is likely to be done in the good schools. In the days when we ran our own entrance exams we uncovered (and accepted) applicants with barely an “O” level, mostly “mature” students who had read and thought about philosophy and politics more than some of the well qualified candidates were ever going to. Of course, there are such people also in expensive schools, but there are also those who compartmentalise learning as a limited part of their lives and just learn what they are told to learn. Thus my proposal is intended to benefit a broader category of people rather than a narrower one though advantages will always be advantages. It goes almost without saying that the exams should be unpredictable and that those setting and marking them should have no interest in whether the results are good or bad.
So, you register online with the National Independent Board for Higher Examinations and turn up at the appointed hall with a sufficiency of pens. This is entirely voluntary and confidential. Over two days you do two to four papers in your chosen field, which can be selected from most major academic non-vocational subjects. Who are you? Well you might be anybody, including a foreign tourist having a shot at these famous examinations on the same trip that you take in an RSC production at Stratford and a Premier League game at Fulham. You might be a retired professional who never went to university but has nurtured their love of history or literature. But you are most likely to be a recent graduate who thought that the courses and examiners did not do you justice or that your knowledge and understanding of your subject was actually rather superior to that of some of your fellow students who were also awarded first class degrees. What you know is that your efforts will be marked by at least two different markers – probably late-career or retired academics – who have no idea who you are and that you will later be told whether you have a pass, a fail, a merit or a distinction. Nobody but yourself need know your result, but it can be independently verified and publicised if you wish. A pass would be a real achievement, the higher grades even better.
I would also include – probably as a separate qualification – a general knowledge stream. As with the predecessor models one element of this would include essays on themes which cross disciplines (try “Time”, “Risk”, “Sport”) but also a fact test. A thousand questions ranging over all academic subjects in three hours, multiple choice, four options, structured to require knowledge of several subjects. Nobody could do the lot, but it would be interesting to see what the best competitors could achieve. I am a quizzer – a winner of the Whitbread national pub quiz championships and a participant in Brain of Britain (came second) – and I get heartily sick of people who don’t know anything and don’t want to. If you don’t know you can’t make connections (and you can’t properly use the vast resources now available online).
The most common complaints I ever hear from experienced academics are connected: they are that grade inflation means that the examinations system is no longer fit for purpose and that students are no longer taught or encouraged to think for themselves. A third complaint is that many degrees are in very narrow slices and involve very particular conceptions of what constitutes “history” or “sociology” or “theology”, but I think that complaint would always have been valid in many cases. I don’t think that radical reform of existing university practice, in a world of mass and costly higher education, is politically possible. But I do think a complementary independent examination system looking for breadth and vision in knowledge a is both possible and necessary.
Lincoln Allison November 2023
(An edited version of this article was published in Times Higher Education in March-April 2024.)