3. APPROACH TO EFFICIENCY AT THE 1994 PERIODIC
REVIEW
3.1 Overview
In 1994 the Director considered separately the issues of operating and capital efficiencies. For each he made an assessment of the general scope for savings across the industry and an assessment of the different relative efficiencies of companies within the industry.
This section contains an outline of the key elements of the approach the Director took, showing how it achieved a balance of incentives. The strategy was subject to detailed scrutiny by the Monopolies and Mergers Commission (MMC) in the South West Water and Portsmouth Water referrals on the Director's determinations. The MMC endorsed the strategy used by Ofwat. The current framework has evolved from this base.
3.2 How the overall scope for efficiency savings was assessed
The Director's assessments of the overall scope for savings across the companies formed the basis for annual efficiency targets that were built into price limits. This gave companies incentives to outperform targets, but companies could not raise prices through failure to meet these targets.
3.2.1 Operating expenditure efficiency
The Director assessed the overall scope for efficiency savings on operating expenditure in the water industry as 2% per annum for 1995–2000 and 1% per annum for the subsequent five years. The Director commissioned a report on general efficiency trends from Bosworth, Stoneman & Roe. They calculated that the reduction in real unit operating cost in productive and manufacturing industries over the period 1979 to 1989 was around 1–1.25% a year.
Quantification was difficult, but the evidence was consistent with a judgement that real reductions in unit operating costs in the wider economy were 1% a year greater than measured, after taking into account known biases in the data and unaccounted for quality improvements. This would lead to a central estimate for manufacturing industry over the period 1980–90 of 2–2.25% per annum.
The Director noted that quality enhancements in the water industry were accounted for separately. Companies reported to the Director the extra spending they considered necessary to meet new quality obligations and this was scrutinised by the Director separately (see 3.2.2 and 3.3). Other industries would not make the same distinction. The limited evidence available suggested that this distinction between the water industry and others might be significant. It was therefore assumed that the overall scope for efficiency savings in opex would be 2% and that all companies would be able to achieve at least a 1% efficiency saving.
Appendix 5 provides a summary of the Bosworth, Stoneman & Roe report. A full copy of this report has been placed in the Ofwat Library.
3.2.2 Capital efficiencies across the industry
An assessment was made of an industry-wide target for continuing capital productivity efficiency arising from technological progress, following two separate studies of the scope for widescale introduction of new innovations. A conservative judgement was made, owing to uncertainties in the timing and take up of newer and emerging technologies, and it was assumed, when price limits were set, that there would be scope for continuing reductions of 1% per year in capital expenditure. As a result, companies had incentives for early adoption of lower cost technologies and practices.
The 1% per annum target was applied to both capital maintenance and capital enhancement expenditure, in addition to the reduction implied by comparative analysis of capital unit costs in the cost base exercise. The additional adjustments arising from the cost base ranged between 0-7.5% in total over the five year period. This resulted in the expectation that there would be an average reduction in total capital costs across the industry of 2-2.5% per annum.
3.3 Assessing relative efficiency between companies
Within the overall framework of incentives to improve efficiency, Ofwat recognised that the scope for improvement was not the same for all companies, because of differences in starting levels of efficiency. To take this into account in price limits, Ofwat assessed relative efficiency for each company, for operating expenditure and for capital expenditure.
3.3.1 Assessing relative operating expenditure efficiency
Companies' relative operating expenditure efficiency was assessed using a combination of econometric techniques, as described in Appendix 1, and adjustments for non-econometric effects, such as significant differences in levels of service or particular circumstances of single companies.
Econometric models were developed for the water service as a whole, resources and treatment, distribution and business activities. Each company was given an efficiency ranking for each activity and an overall assessment was reached.
For the sewerage service, econometric models were developed for operation of the sewer network and for large sewage treatment works. Assessments of the comparative costs of small sewage treatment works and sludge treatment used unit costs but took into account works size, load and treatment levels. For sludge disposal, unit costs were used, taking into account the various disposal methods. Business activity performance was assessed using costs per property billed.
The operating expenditures predicted by each sub-service model were summed for each company. The average of these sums with the results of the overall service models was calculated — it was considered that both approaches had equal validity. These averaged predicted expenditures were compared with actual reported expenditures, less local authority rates, third party costs and National Rivers Authority charges, none of which were modelled. Companies were ranked on percentage differences. The ranked companies were each allocated a provisional expenditure band. The bands were determined so that companies with similar reported expenditure relative to predicted expenditure were allocated to the same band.
Converting from provisional expenditure bands to final efficiency bands required individual company circumstances to be taken into account, either quantitatively, to accommodate a specific cost, or qualitatively, based on an assessment of quality of service, trends in expenditure or other specific factors.
It was recognised that the differences between predicted and actual expenditure, even after adjustment for specific factors, did not translate directly to differences in efficiency. Some of the differences were the result of errors in the data used to model expenditure and especially in the models themselves, as simple models could not take all factors into account.
The approach adopted was to set company specific efficiency targets that would move individual company expenditure towards those of the best performers, over a five year period. The amount of movement was taken to be around 25% – 35% of the difference in predicted cost. In addition to the company specific targets, all companies had a target of 1% per year for reducing costs, resulting from the overall scope for efficiency as discussed earlier. For the best performers, only the 1% overall target was set but, for those with the highest expenditure, the combined target was a 3.5% expenditure reduction per year.
3.3.2 Assessing relative capital maintenance efficiency
During the Review Ofwat developed a range of analytical tools to interpret the information submitted by companies in their Strategic Business Plans. These were used to form a view of the levels of capital maintenance expenditure that would need to be required by companies over the ten year period 1995–2005.
The main tool used to assess comparative efficiency for both capital maintenance expenditure and enhancements was the comparative capital unit cost approach — the cost base. This was developed so that the Director could compare capital expenditure across the industry and identify those companies that appeared to be more efficient at procuring capital assets than others. Companies with higher capital unit costs were considered to have more scope for savings in their expenditure projections than companies with lower capital unit costs.
4.RECENT RESULTS IN COMPARATIVE EXPENDITURE
4.1 Expenditure trends since the 1994 Periodic Review
The majority of companies have, so far, been successful in reducing operating expenditure by a significant amount. Total opex decreased by 6% between 1992–93 and 1996–97, in spite of the new costs of operating additional water and sewage treatment plants to meet European Union directives. Without these new costs, companies report that expenditure would have decreased by 12% in the same period. Ofwat published comparisons of 1992–93 and 1996–97 operating expenditure in the 1996–97 Report on water and sewerage company operating costs and efficiency (December 1997).
The trends in capital maintenance expenditure are less clear. Large variations in capital maintenance expenditure can occur on an annual basis, as it becomes necessary to renovate or replace major assets. In recent years, reported capital maintenance expenditure has generally been in line with the amounts assumed in price limits. However, a number of companies are reporting savings in unit costs of up to 10%. This would suggest that the reductions in capital unit costs that have been claimed have been offset by higher overall levels of capital maintenance activity.
For capital enhancement expenditure, comparisons can be made between the actual expenditure of the companies and the amount assumed in price limits. The main component of the capital enhancement programme for both water and sewerage services is expenditure to meet new quality standards. Companies are currently reporting that they have made considerable savings in capital enhancement expenditure compared with the amounts that were assumed in price limits. At the end of 1996–97, there was a considerable cumulative difference between the expenditure that was assumed in price limits and actual expenditure by the companies. However, companies are reporting that a substantial part of this difference will be spent later in the quinquennium and that the overall difference on the quality programme by the end of the five years to 2000 is likely to be of the order of 15%.
The sources of these efficiency savings in capital expenditure vary between companies. A large proportion of the savings are reported by companies to be due to uptake of new construction techniques. Examples of this have been: more sophisticated measurement of flows at sewage treatment works, use of Granular Activated Carbon sandwich techniques for water treatment, greater use of no-dig techniques for mains and sewer renewal and general better management of contracts and resources. In addition, companies with relatively high capital unit costs, as measured by the cost base, may have approached the 1994 yardsticks at a faster rate than was assumed when price limits were set.
The industry cost base submission in June 1998 will enable Ofwat to measure the progress made by individual companies in reducing their capital unit costs during the current price review period.
4.2 Results of the econometric analysis
4.2.1 Water and sewerage services
There are important differences between the water and sewerage services that affect how comparative performance is assessed. For the water service, it is generally possible to derive robust econometric models for explaining expenditure, because there are 28 separate companies, a sufficient number of comparators. In contrast, there are only ten separate sewerage companies. For these, Ofwat uses disaggregated data, for example for several sub-areas of each company or for individual large treatment works. With disaggregated data it is not usually possible to assess the role of economies of scale. However, the range of sizes of the sewerage companies is much less than that of the water companies.
It is important that expenditure is allocated reliably between the water and sewerage services because misallocations can affect assessments of economies of scale which, in turn, could affect how efficiency is assessed for the smaller water only companies.
4.2.2 Operating expenditure econometric models
The econometric models used at the 1994 Periodic Review were published in the 1993–94 Report on the cost of water delivered and sewage collected (December 1994). The models resulted from extensive research and consultation with the industry. Some of the early research was published as research papers in 1993 and 1994 (copies available in the Ofwat Library).
For the water service, the econometric models have been re-estimated each year since the 1994 Review. The form of the resources and treatment and business activities models have not changed, only the coefficients have altered. The water distribution model has been reformulated (see Appendix 2). An econometric model for power expenditure has replaced the previous unit cost approach. This was found necessary because of apparent economies of scale on power expenditure.
The combined sub-service models are now judged to be more robust than the overall water service models. This is mainly because expenditure is now allocated more reliably than in 1992–93. It is intended to use an overall model only as a check on the results of the sub-service models.
Data was collected for sewerage areas and individual large sewage treatment works for 1996–97, the first such data collection since 1992–93. The sewer network model and large treatment works model have been revised and improved. For other parts of the sewerage service a unit cost approach is retained, using similar calculations to those used in the 1994 Periodic Review.
Ofwat is aware of the potential for new explanatory factors to become material, for example with the increase in domestic metering and new requirements for water treatment, and will be examining 1997–98 data for evidence of this. Some factors are suspected but prove difficult or impossible to measure consistently, for example the split between urban and rural areas within companies. Where companies can demonstrate that a particular explanatory factor is a material cost driver across the industry and can be measured consistently, Ofwat will consider its use, if its inclusion leads to a better model on engineering and statistical grounds.
4.2.3 Capital maintenance expenditure econometric models
Companies must renew their assets to ensure continuity of services for current and future customers. Ideally, an asset should only be renewed when the present value of additional operating expenditure required to maintain serviceability becomes greater than the capital cost of renewal. To achieve the optimum level of capital maintenance, companies must carry out the right capital maintenance activity at the right cost on the right assets at the right time.
The approach to capital maintenance at the 1999 Periodic Review starts with serviceability to customers. Before making any assessment of comparative efficiency based on historic expenditure, Ofwat will assess whether the trend in serviceability to customers has deteriorated. Declining serviceability may be indicative that the company has failed to carry out sufficient capital maintenance — its activity may be too low, ineffective, or a combination of both. The company will be challenged to explain its position. Stable trends in serviceability will be indicative that recent capital maintenance activity has been adequate.
Companies will also be submitting an update of their asset inventory in August 1998. This will enable the changes in the condition and operational performance of their assets from 1992–93 to 1997–98 to be identified. Account of capital enhancement expenditure during this period will need to be taken so that the state of the underlying asset base can be assessed. Where there is evidence that assets have deteriorated companies will be challenged to explain why this is so. This may indicate that recent levels of capital maintenance expenditure have not been sufficient.
Unless serviceability is deteriorating, current levels of capital maintenance expenditure can be taken to be a reasonable reflection of the requirement for capital maintenance activity over the period of the next price limits.
There is a wide range of unit capital maintenance costs across the industry, suggesting that some companies are more effective at maintaining serviceability to customers than others. This range of unit costs may be attributable to variations in the effectiveness with which companies target their capital maintenance expenditure leading to inappropriately high levels of activity. Companies' capital maintenance strategy and unit costs have been assessed using the same statistical techniques as those used in the approach to operating expenditure. In common with the opex models, the capital maintenance econometric models inform judgements about how far individual companies are from the best in the industry.
An important difference between the capital maintenance and opex econometrics is that opex models take annual data for both expenditure and explanatory factors. The capital maintenance models currently take an average of the capital maintenance expenditure over the four year period 1993–94 to 1996–97, and explanatory factors that relate to 1992–93. This is in order to take account of annual variations in capital maintenance expenditure and ensures that the explanatory factors are not affected by modelled expenditure.
The capital maintenance econometric models developed from company data are set down in Appendix 3. This data has been derived from the Capital maintenance return (November 1997). A copy of the datasets used to develop the econometric models presented in this report is available from the Ofwat library. In common with the opex models, the capital maintenance models have also been developed using the principles outlined in Appendix 1.
4.2.4 Robustness of the econometric models
The econometric models for both opex and capital maintenance predict a level of cost for a particular company based on the performance of the other companies in the industry. These predicted costs can be compared with companies' actual costs and companies can then be grouped into cost variation bands according to the size of the difference between actual and predicted costs. Some of the difference may be the result of shortcomings in the models as well as comparative cost performance.
Whilst accepting this limitation, the econometric modelling of reported company expenditure, their outputs and statistically significant explanatory factors, reveals wide ranges of cost performance.
High cost companies will need to be able to demonstrate why their costs are higher than other companies in similar situations.
Table 7 summarises the results of the econometrics using a consistent banding convention linked to the gap between reported expenditure and the central estimate of predicted expenditure from the relevant model. Bandings for both operating expenditure and capital maintenance expenditure are shown in the table. The banding convention is:
Band A: well below predicted expenditure (less than 85% of C)
Band B: below predicted expenditure (85–95% of C)
Band C: around predicted expenditure (within 5% of modelled expenditure)
Band D: above predicted expenditure (105–115% of C)
Band E: well above predicted expenditure (more than 115% of C)
The results presented compare predicted expenditure with reported expenditure. They do not take account of legitimate, company specific factors that may affect expenditure. The bands, therefore, are not definitive statements of the relative efficiency of individual companies.
It should be noted that opex accounts for between 50% and 80% of the combined total of opex and capital maintenance.
Appendix 4 sets out the results for each of the econometric models developed for the water and sewerage services. These are presented in matrix form, showing comparisons between operating expenditure bandings and capital maintenance expenditure bandings.
Table 7: Results of the econometric modelling summarised for the water and sewerage services
| | Water service | Sewerage service |
| Company | Operating
expenditure
banding | Capital maintenance expenditure
banding | Operating
expenditure banding | Capital maintenance
expenditure banding |
| Water and sewerage companies |
| Anglian | C | E | C | A |
| Dwr Cymru | E | D | D | A |
| North West | B | C | C | D |
| Northumbrian | C | D | C | C |
| Severn Trent | C | E | C | E |
| South West | D | C | E | E |
| Southern | D | A | E | C |
| Thames | C | E | C | E |
| Wessex | B | E | B | E |
| Yorkshire | C | E | B | A |
| Water only companies |
| Bournemouth & West Hampshire | B | E | | |
| Bristol | E | B | | |
| Cambridge | B | A | | |
| Chester | C | C | | |
| Essex & Suffolk | E | B | | |
| Folkestone & Dover | D | D | | |
| Hartlepool | D | E | | |
| Mid Kent | C | D | | |
| Mid Southern | B | B | | |
| North Surrey | D | A | | |
| Portsmouth | A | E | | |
| South East | E | E | | |
| South Staffordshire | C | C | | |
| Sutton & East Surrey | C | E | | |
| Tendring Hundred | E | B | | |
| Three Valleys | C | C | | |
| Wrexham | A | B | | |
| York | A | A | | |
4.3 Limitations of the analysis
The analysis and results in this report are preliminary. Much more analysis remains to be done, to take into account, for example: - suggestions from companies;
- additional data, for 1997–98, which companies will report in July 1998; and
- company specific factors not covered by the models.
4.4 Total efficiency and interactions between operating expenditure and capital maintenance expenditure
As shown in the matrices in Chapter 2 and Appendix 4, there are a number of cases where companies appear efficient on opex and inefficient on capital maintenance, or vice versa. This raises the wider question of whether it is appropriate to consider different categories of expenditure separately and whether the system of analysis sets up perverse incentives to companies.
For example, companies may have the scope to make investments that reduce operating costs. Such investments may be classified as capital maintenance. Some companies might adopt strategies where they spend extra on capital maintenance in order to reduce operating expenditure. An active policy of leakage detection and repair is an example of this. Overlap also occurs because of accounting practices which affect how costs, such as leakage control, are allocated between operating expenditure and capital maintenance.
It is essential that the overall framework for judging comparative efficiency maintains the incentive to undertake cost saving investments as these become viable in net present value terms. It is also important that different practices in allocation do not affect the overall adjustments resulting from the structure proposed above.
It is, therefore, considered appropriate to assess efficiency on operating expenditure and capital maintenance together. This approach helps to ensure that companies are not unduly penalised, or rewarded, because of the way they choose to minimise expenditure, or the way in which they allocate expenditure. In practice, it means that a company's band for operating efficiency could be adjusted if it is an outlier on capital maintenance efficiency and vice versa. Such adjustments would take into account the actual expenditure involved.
An alternative to this framework would be an aggregate approach to efficiency involving total efficiency measures. Companies and others commented to the Director in response to his paper The proposed framework and approach to the 1999 Periodic Review (June 1997) that total efficiency, or at least the interaction between operating and capital efficiencies, needed to be examined. There were concerns about the incentives provided to companies by treating them separately.
The Director considered the issue of total efficiency in 1996 to see if the difficulties with this method could be overcome. Bosworth, Stoneman & Thanassoulis conducted a study into the feasibility of assessing total efficiency through production functions. This concluded that capital expenditure should be considered in assessing efficiency, but that defining appropriate inputs and outputs for the industry was problematic and that defining data requirements and collecting such data was very difficult. There are a considerable number of factors beyond management control, for example geographic areas and the inherited capital stock, that would need to be adjusted for.
Although the research concluded that some data envelopment analysis might be possible, there are practical difficulties in collecting sufficient data of good quality to an appropriate degree of detail. This leads the Director to conclude that separate efficiency comparisons using operating expenditure and capital maintenance expenditure are likely to lead to more robust conclusions than analysis undermined by patchy and unreliable data. He will, therefore, assess these separately but base his judgements on the total of opex and capital maintenance analyses.
Furthermore, having considered these comments and the research, the Director considers that the best way to identify any interaction of capital maintenance and operating efficiencies is to assess comparative efficiency in both areas using similar econometric techniques. The relationship between the two assessments will then be reviewed and an allowance for any significant interaction, where it can be identified, would be made when future efficiency targets are set.
A summary of the study is given in Appendix 6. A copy of the full report is available in the Ofwat Library. |