Last week I joined 80 or 90 other economists and people from related disciplines, drawn from the public sector, universities, consultancies, and think tanks, together with a few commentators, at an event organised by The Treasury. It was billed as “Wealth and wellbeing: High quality economics in the twenty-first century”. They were looking for input.
The symposium began with a presentation by The Treasury’s chief economist, Tim Ng, based around a paper he and a couple of colleagues had written, “Improving economic policy advice”. That paper, in turn, built on the Living Standards Framework that Treasury has devoted a lot of effort to building and promoting over the last half dozen years or so (and which you can read all about here).
The Living Standards Framework has troubled me from the first, and despite the numerous refinements, and attempts to articulate how it is used, and how government policymaking benefits, I remain sceptical. I’m not the only one: the New Zealand Initiative’s Bryce Wilkinson published a critique last year (pages 7 and 8). Bryce made a number of good points, including the merits of a traditional cost-benefit analysis approach, and the tendency of the Living Standards Framework to assume the benevolence (and knowledge) of officials and politicians, in a way that simply ignores much of the economic literature around incentives, information, and the possibilities of the sort of government failure we see all the time.
The Treasury has for some years now proclaimed a vision for itself
Driving what we do is our vision to be a world-class Treasury working toward higher living standards for New Zealanders.
Like Bryce, I’m also uneasy about that
Personally, I am not a fan of vision statements for government agencies. Public servants are paid to serve their elected ministers in the wider public interest and perform their delegated authorities impartially.
Either Treasury’s vision has content – in which case it has no more legitimacy than the personal preferences of a group of senior officials – or it is little more than vacuous waffle (“we want to do well”).
There is much the same lack of clarity around the Living Standards Framework, the centrepiece of which now appears to be this smart new picture.
Good things flow from these “four capitals”.
There is an accessible, relatively recent, guide to using the Living Standards Framework(LSF). But it is still not clear whether there is very much substance to it at all, or whether it ever means anything more than “when you do policy advice, there are lots of dimensions it can be important to think about”. As if anyone ever doubted it. Treasury talk about a list of six ways they have used the framework. The first was for brainstorming, but then surely the whole point of brainstorming is not to be tied into an artificial organising framework? They also show an example of analysing defence policy using the LSF, but (despite the pretty picture, page 10) it is not clear at all how analysing defence policy as a contribution to “social cohesion: abroad” is particularly helpful to anyone. And their final use is “to measure progress”, featuring a heroic attempt to illustrate change across each of the dimensions since 1870. An exercise of that sort might be useful for economic and social historians – with all the inevitable caveats – but it isn’t clear how it helps today’s ministers. In fact, it would still be interesting to know whether any major decisions during the term of the previous goverment were made differently because of the advent of the LSF.
Perhaps it will be different under the new government? My observation at the time Treasury first came up with the LSF was that they seemed to be preparing for a Labour/Greens government.
There is also still the tone of a “grab bag” of the latest trendy ideas to it. This line appeared in the paper presented to the Symposium
To be relevant, wellbeing measurement and cost-benefit analysis need to be sensitive to changing technological, ecological and social trends, such as digitalisation, globalisation, the rise of China, environmental limits, and an increasing policy focus on inequality.
And anything else ministers, citizens, or bureaucrats happen to find “relevant” at the time? It doesn’t sound like much of a basis for rigorous, detached, free and frank advice.
One of the many problems is that there is little robust basis for aggregating all these issues, concerns and indicators. But that doesn’t stop The Treasury, who have apparently decided to use the OECD’s Better Life Index, another theory-free ad hoc summary measure (on which New Zealand happens to score well).
Conveniently perhaps, the OECD index doesn’t even include either GDP per capita or related productivity measures (although there are some other income measures). For some of the variables, it isn’t even clear whether, or why, something counts as good or bad. The employment rate is in the index, but employment is mostly an input (inputs are costly), not an output – and yet I presume the OECD counts a high employment rate as “a good thing”. New Zealand score on ‘years of education’ will presumably lift now that we are going to have free tertiary education, but there is no assurance that the policy will lift average national wellbeing (as distinct from transfering it from one group to another). Labour market insecurity appears in the index, in a measure in which a country is penalised for having low unemployment benefits relative to market wages – but what basis is there for the OECD’s implicit judgement that one system is better than the other in the longer-term? The share of expenditure devoted to housing also appears in the index: it will tend to be higher in a country with larger houses, but what basis is there for any sort of welfare interpretation of the numbers. (And, on the other hand, the share of the native-born population living abroad – a reasonable relative-welfare indicator, taken from revealed preferences – doesn’t appear in the index at all.)
These indices, and the Treasury’s Living Standards Framework, often seem to be developed in reaction to some sort of caricatured view that GDP (even per capita GDP) is everything. But the problem with the caricature is that it is view that no one has ever held. Every economic policy adviser recognises (for example) that GDP includes the spending/activity to replace depreciated physical capital. A measure of net domestic product is a little more useful for welfare purposes, and a measure of net national income (distinguishing the income generated that accrues to residents) better still. Measures of consumption per capita might be better again, if the purpose of economic activity is conceived as supporting consumption over time. And it is not as if the concepts of externalities, or the depletion or degradation of natural resources, are exactly new phenomena. And if some government were crazy enough (and powerful enough) to simply set out to maximise GDP per capita, they’d conscript us all, prohibiting retirement, individualised childcare, or even any leisure beyond what the maintenance of productive capacity might require. It doesn’t happen in free societies (although it came close in wartime). It is a straw man. (As incidentally would a similar articulation about GDP per hour worked: if a government were crazy enough to seek to unconditionally maximise that variable they would simply ban all but the most productive people from working at all.)
So the issue about productivity, or GDP per capita, isn’t that the goal of policy has ever been to maximise either. After almost 70 years of underperformance (productivity growth less than in other countries), one doesn’t have to get into debates about “maximising productivity” to want Treasury to be able to offer good answers about why we are in this situation, and how we might out of it. Officials and advisers might concentrate on identifying roadblocks – government policies that impede firms and households making choices they would otherwise take – the removal of which might result in GDP/productivity outcomes more in line with those in other, apparently more successful, countries. Of course, each of those interventions needs to be evaluated on its own merits. There are good reasons to make schooling compulsory, or not have lump sum taxes or whatever, but many regulatory interventions won’t pass any sort of decent test (as, in its day, rules that led to the assembly of TVs didn’t). I’d argue that our immigration policy doesn’t.
And if I can’t fully put my finger on what I don’t like about the “four capitals approach” it is a sense – not stated, perhaps not even believed, but implicit nonetheless – that these are resources of the government, to be marshalled and managed by governments in what they judge to be some sort of “national interest”. And all too little of a sense that governments more often corrode these so-called capitals than foster them.
And in the New Zealand specific context, a focus on the Living Standards Framework can come to provide cover for the failure to grapple with New Zealand’s long-term economic underperformance and (in this specific context) the failure of The Treasury – the government’s principal economic advisers – to be able to offer compelling advice, built on compelling analysis and narrative, for what has gone wrong, and what might be done to fix it. Perhaps we’ll see some startling new insight on that problem when the Treasury’s Briefing for the Incoming Minister is finally released, but I’m not expecting it – there have been no new ideas tested in working papers or speeches or anything of the sort. In the paper presented at last week’s Symposium there was more on macroeconomic stabilisation issues (which New Zealand does relatively well) than on productivity, and no obvious policy ideas (on productivity) beyond changing the tax treatment of housing and land use laws (there might be elements of use in that, but no one seriously believes those changes alone would close the 60 per cent gap between, say, productivity levels in New Zealand and those in places like France, Germany, the Netherlands or the United States).
Much of the focus on the Symposium seemed to be on building links between Treasury and the academics. I’m not sure they got far on the day, although the forum did provide a good opportunity for the academics to remind Treasury that (a) research costs money, (b) research takes time, and (c) the PBRF university ranking and funding scheme strongly discourages academics from doing any research, however well-remunerated, that doesn’t lead to publication to international journals or books published by university presses.
Treasury also used the occasion to launch something called the Community for Policy Research as part of strengthening relationships with researchers working on New Zealand issues. As part of that, they have released a Research Interests document, a list of research interests which is
“our assessment of where additional research with a New Zealand focus could be useful. It reflects a number of judgements, including our sense of gaps in the evidence base, where we believe polciy development is being hampered by lack of evidence and emerging medium to long term issues. Often we are looking for research that will help us make a step change, where wider debate will be necessary over the medium to long term”.
Which sounds fine, until one actually turns to the list.
On fiscal policy, for example, there is an item
“Should New Zealand have an Independent Fiscal Council?”
Perhaps it should, perhaps it shouldn’t, but it is explicit Labour and Greens policy that we should. Presumably the outstanding issues are around the form, and responsibilities, that Council should take?
There are 13 macroeconomic topics – many of them rather technical (output gap estimation, time-varying NAIRU estimation – and not a single one of those topics relates to any sort of timeframe beyond the cyclical. Thus, they are interested in “different approaches to population/immigration projections (eg Bayesian)” but apparently there are no outstanding issues around the longer-term term impact of immigration policy (whether on productivity, or those social and environmental capitals).
In fact, the word “productivity” doesn’t appear at all (or any cognates). Does Treasury have all the answers already, or have they more or less given up? The productivity issues seem like classic New Zealand-specific longer-term issues that The Treasury – principal economic advisers to the government – really should be looking for answers to, and associated research on. But, apparently, topics like “What is the relationship between volunteer work, social and human capital?” count as more pressing.
Several people at the symposium took the opportunity to push back in reaction to Treasury’s recent boast that this year it had hired no one with just a straight economics degree. As one public servant put it, they wouldn’t want to go to a mechanic for brain surgery, and as another former public servant noted, Treasury needs to be really excellent in its economic advice – and tacking a few short day-release economics courses on to a degree in a quite different subject isn’t really likely to be enough. One might be less bothered if there was a sense that Treasury’s analysis and advice was consistently excellent, and the only obstacle to first-rate policy was the politicians (of whatever stripe). That just isn’t so these days.
Finally, it was interesting to observe the numbers of Treasury speakers and of panellists attempting to use Maori phrases, or introductions, or talking about the need to incorporate Maori perspectives into thinking about wellbeing. As it went on, I started looking round the room trying to spot anyone who might themselves be Maori (noting that there were at least four adult migrants at my table – of 10 – alone). Finally, my curiosity was satisfied when one of the panellists, clearly with the same sort of reaction, asked for a show of hands. In a room of at least 80 people, two responded that they identified as Maori. I hope it left the organisers just a little uncomfortable.
I’ve been reasonably critical of Treasury’s work in this (excessively long) post. But I would commend them on the aspiration behind the occasion, and on going to the effort of openly engaging with a wider group of policy and research people, openly articulating issues they are interested in seeing research on. There is a place for confidential policy advice and for the free and frank exchange of views between ministers and officials, but our understanding of the issues is only likely to be advanced by open, two way, dialogue and debate at earlier stages of the process. Some of the challenges New Zealand faces are substantial, and the pool of able, interested and available people isn’t large, or necessarily restricted only to the public service.
croaking cassandra 
The clarion call from all – including from The Treasury – should be for absolute public transparency on a granular basis for all governmental activities, both actual and proposed – do you see that call anywhere?
LikeLike
No.
The new government does have a Minister responsible for Open Government (someone who used to beat the drum on the issue in Opposition) and the Greens/Labour deal does contain this commitment “strengthen NZ’s democracy by increasing public participation, openness and transparency around official information”. Those are small, hopeful, straws in the wind, but I saw the other day a comment from the govt that they were no envisaging a full scale review of the OIA.
Time will tell.
LikeLike
strengthen and increasing and openness and transparency “around” official information – how elastic and rubbery are those words – that word “around” can be construed so many ways – oops that’s not what I meant
LikeLike
I want to see how much every skilled migrant and investment migrant earned (contributed) by way of taxable income in New Zealand from the date of their arrival until the completion of their first 5 years. UK has moved in that direction in that new arrivals cannot stay after 2 years if they are earning less than 50,000 pounds pa
LikeLike
I started with zero income and $200 in savings and currently with a wage of $200k with a 9 million property portfolio.
LikeLike
Assuming you mean permanent residency not the working-holiday visas it ought to be a trivial database search just linking IRD No and immigration approval. [Obviously it would need some very high level clearance to access this data but it is quite straight forward for a database administrator to restrict searches to cumulative data only].
Your figures for skilled and investment migrants is essential if you want to know whether the intended purpose of these visas is being achieved.
These skilled and investment migrants are basic but they are still less than a third of permanent resident approvals; the success of family members of working age needs to be considered too.
There does seem to be some confusion about this information with many claiming immigrants are on balance a great success and others a total disaster. For example last week’s Herald opinion piece claimed that our schools social studies course have pupils fed data that every refugee in Europe pays back double after five years what they cost in the first year. I have read that a NZ refugee costs taxpayers about $100,000 in the first year (comprising immigration admin costs, air-fares, English language and NZ orientation courses, housing and benefits) so can we deduce that five years later they will be paying income tax and GST of over $200,000 so on a salary of about $600,000? If you take a typical immigrant family with stay at home wife and two children then a salary of about $2,000,000 is needed. Even Auckland council doesn’t mange those kind of salaries. If our academics believe refugees are an economic bonus for a country (they certainly should NOT be – if they were then NZ are not selecting the most needy) then they are probably just as confused about skilled immigration for and against. Some facts would trump opinions.
BTW: I do wish I had been as successful as GGS – I arrived with almost $1m of savings and a job paying $50,000 but with visiting my parents in their final illnesses and the slow demise of the software packages I was supporting my career gently petered away until I retired. My property has been an accidental gain mainly created by the national and international enthusiasm for living in Auckland. Now contentedly retired and supported by a working wife.
LikeLike
Bob: you are right onto it
Some ten years ago the Australian Productivity Commission did a full investigation into the benefits of large scale immigration and published its conclusion that migrants themselves captured all the benefits while the locals gained nothing. What is apparent is New Zealand has not done a comparable investigation, and the Political Elites have ignored the Australian study and continued with its mass migration strategy – in spite of evidence to the contrary
On the matter of strategic planning I have commented previously (as follows) on the subject without any effect. Simply put, if you set a goal and implement a plan you need to monitor its progress and if it isn’t producing the expected results then the plan has to be re-assessed and revised if necessary. The NZ immigration scheme amounts to smoking “hopium”
15 September 2017
–https://croakingcassandra.com/2017/09/15/scattered-thoughts-on-tax-and-fiscal-policy/#comment-18431
21 September 2017
–https://croakingcassandra.com/2017/09/21/immigration-the-election-and-shelf-stackers/#comment-18648
One must also ask where are the university academics – why so silent?
LikeLiked by 1 person
Looks like Tim Ng has been floating in and out of the RBNZ since 1992 when he started as an student intern. He even had a stint in the Federal Reserve Bank of New York in 2001, worked in the ANZ bank and has been in the NZ Treasury since 2014. Completed a conjoint undergraduate degree in Biochemistry/Economics in the University of Auckland and finished off a honors degree in Economics in Wellington University.
I guess thats what they meant when they refer to hiring staff with multiple disciplines.Clearly a smart chap and does look like he is pretty much strictly an economist by profession rather than multidisciplined.
LikeLike
TIm is a good guy ( i worked with him off and on for years, and he tells me he worked for me as a student intern), but yes he is largely a macro economist, with a sideline in banking regulation.
Their multiple disciplines point is more about the new grad recruitment now. In decades past, Treasury would often recruit really smart people with top degrees in non-econ subject, and then would often send them back to university to get a proper econ qualifications (eg an honours/masters). In my own honours class, there were 3 Tsy people in that category.
LikeLike
It will be interesting to see Treasury costings of Labours Budget. Wonder what projects that Labour will defer now.
1. Kiwibuild deferred. Now called Kiwibuy. Build 1000 and buy 9000.
2. Pike River Mine Re-entry deferred. No idea when, it is all up to the experts. Oh I thought that was Nationals stance?
3. Monorail? Leave it with Auckland Council with their $300 million 10c Fuel tax to fund a $5 to $15 billion monorail or perhaps just to fund Len Brown’s intercity cost overrun.
4. Len Browns intercity rail cost overrun? $2 billion
5. NZFirst Tree planting? 100 million trees a year 1 billion trees in 10 years?
6. NZFirst $1 billion regional development fund
7. 2000 Refugees a year intake
8. 150 Manus Island refugees
9. Social housing? Housing NZ building budget?
10. Emergency housing? Buy more motels?
11. Child poverty reduction
12. Increase Universal super?
13. Free University education
14. Maori programmes?
15. Clean up rivers and lakes
16. Americas Cup Challenge
17. 1800 Police Officers
18. Paid parental leave extended and include Dads
etc
LikeLike
You say “Of course, each of those interventions needs to be evaluated on its own merits”.
But earlier you dismiss the comment that “wellbeing measurement and cost-benefit analysis need to be sensitive to changing technological, ecological and social trends, such as digitalisation, globalisation, the rise of China, environmental limits, and an increasing policy focus on inequality … and anything else ministers, citizens, or bureaucrats happen to find “relevant” at the time” as “[not] much of a basis for rigorous, detached, free and frank advice”.
Okay. How then would you operationalize the requirement for each proposed intervention to “be evaluated on its own merits”?
For example, an intervention intended to reduce child poverty rates should of course be evaluated in terms of its likely impact on child poverty rates. But it may also have unintended consequences in other areas, for example on labour force participation or housing pressures, and so those ought to be considered as well. It probably wouldn’t have much of an impact on national security or water quality so those factors probably don’t need to be analysed in depth in this case. But those would be important factors in consideration of a proposed intervention on, respectively, immigration settings or revisions to the Resource Management Act.
In other words, evaluating an intervention “on its own merits” requires taking into account different factors in each case.
What basis, other than “anything ministers, citizens or bureaucrats happen to find relevant at the time” do you propose for making the judgement as to what “on its own merits” actually means in each case?
LikeLike
I think my point is mostly that the Living Standards Framework adds nothing obvious to a traditional approach to evaluating policy options. Implicit in it – although often in practice backed away from – is a belief in some sort of aggregation, which I think is mostly impossible (and eg the Better Life Index) isn’t a great advert for.
So, of course, Treasury has to take account of whatever ministers want to account for on the day – and advise on the implication of that – but a framework that says “we have to take account of whatever is new and trendy” is really no framework at all: it doesn’t help us think about policy, help politicians think about priorities, and so on.
I’m also worried that the framework seems rather instrumental (social engineering) in nature. as I used to point out to Girol, there was no independent value placed on “freedom” for example, and many of the “social cohesion” things are values important in their own right, not because of what flows from them (even if one can dress them up in that way).
On your child poverty example, why wouldn’t the approach you describe have been done in a traditional cost-benefit analysis and associated advice? I’m sure it would have been. But neither the traditional approach nor the LSF helps anyone with the hard values-laden questions about what the appropriate role of the state is, nor even whether and if so to what extent “child poverty” is even something govts should target.
My bottom line is still that I’m torn: not sure if there is anything of substance to the framework or not. If not, perhaps it does little harm, and is just marketing to a certain soft-left types of government (and thus it didn’t go down well with the previous govt). If so, then it isn’t quite clear what that “substance” is – partly why I’d be genuinely interested in cases where people think decisions – or even major policy advice – were materially different because of the LSF (and different not just in the sense that the LSF operationalises the biases, preferences and pre-dispositions of the pretty interventionist/left group who were leading Tsy in the last half dozen years).
LikeLike
Thanks for this post Michael. Do you have anything more to add to this:
(c) the PBRF university ranking and funding scheme strongly discourages academics from doing any research, however well-remunerated, that doesn’t lead to publication to international journals or books published by university presses.
This is a severe limitation IMO. Any signs of progress?
LikeLike
I was interested in the implications of that :-
Had a look at the list of Rhodes Scholars from NZ – surprisingly 2 of them were NZ Rugby Union All Blacks – and surprised at the list itself is not as large as one would have imagined – the other surprise was 3 of Australia’s recent Prime Ministers have been Rhodes Scholars while none in NZ
https://en.wikipedia.org/wiki/List_of_Rhodes_Scholars
What noticeable is the total silence emanating from academe on a range of matters of importance
LikeLiked by 1 person
That list has lots of gaps (whether from NZ, where i think there are 2 or 3 scholarships a year, let alone the US where i think it is close to one a state.)
I guess David Kirk might well have made it to PM if the Tamaki 1992 selection had gone the other way. And we did have Simon Upton as a senior minister. But, yes, the contrast with Australia is interesting (altho i think Canada might be more like us, and i think it is a while since a really top tier academic achiever was UK Prime Minister – perhaps Harold Wilson?). As for Bill Clinton, he might have been a Rhodes Scholar, but better he’d never been President.
LikeLike
Didn’t help Aussie much. Most of ours have been a bit hopeless.
LikeLike
There wasn’t any reaction from Treasury people on the day, so one can only hope they went away to reflect.
My own story in this area is that about 7 or 8 years ago, Treasury and the RB were organising a big event to look at macro imbalances and economic underperformance in NZ. We were offering pretty generous (so we were told) fees for papers that might shed light on the issues, but we couldn’t get a single taker (not even a proposal) from within a NZ university. Why? Because we couldn’t guarantee publication in a top tier journal and (intractable as the problems then seemed) there was no guarantee something journal-publishable would even emerge. We ended up with some interesting papers from prominent overseas people (operating to diferent constraints), but the story stayed with me. And, as I say, Treasury was fully involved in that episode as well, so the issue will be well known to them already.
LikeLike
How big were these grants? Comparable to Marsden?
LikeLike
No, but we were offering (from memory) $30000 for a conference paper. We didn’t have problems getting Sebastian Edwards and Phillip Lane (and NZ specific papers- and time in NZ – from them) for what we were offering.
LikeLike
That is a big chuck of cash. But after university overheads are taken into account, that might only provide buy out for 1/2 to 2/3 of a course. Not sure what overheads are like overseas.
LikeLike
For all the emphasis on sustainability that typically accompanies discussions of well-being, I was disappointed to observe a lack of representation of young people on the panel. You said 80 to 90 people attended; were our youth better represented in terms of the attendees?
LikeLike
Probably not. There were a lot of my peers/contemporaries, but my impression – possibly erroneous, but I think not – was that there were few people under 40.
LikeLike
Here’s a piece from Edge.org on coalition forming and evolution:
https://www.edge.org/conversation/john_tooby-coalitional-instincts
LikeLike