Tougher entry to universities opens ranking can of worms

The application of free market principles to tertiary education in New Zealand has died with a whimper.

Since the 1990s tertiary institutions have competed with each other for "customers". Their funding was based on the number of students they attracted. This led to a proliferation of dodgy degrees and dubious diplomas as various institutions competed to attract students and funding.

In the past few years, this funding formula has changed. Student numbers and funding at various tertiary institutions has been capped. The recent announcement universities will be tightening entry requirements for courses is a result of this change. Quality, rather than quantity, is now the driver of admissions.

Here lies a peculiar problem relating to assessment in our schools. Assessment under NCEA is standards-based. Student attainment is measured against objective standards rather than against each other.

The change in the funding model for tertiary institutions means universities are now left to cobble together some way of ranking students against each other.

Comparability of results between students under NCEA is set to become a major issue, as students compete for limited places in tertiary courses.

For those of us who teach NCEA, it is obvious there are major anomalies in the results generated under this system. The pass rates for work marked internally are usually much higher than for external assessments, usually done under exam conditions. There are also significant discrepancies in pass rates for different subjects and for different units within a subject.

It is ridiculous to try to equate a unit of knowledge in physics with a unit of knowledge in economics or graphics, in terms of difficulty. Yet the results this system generates are going to become very important in determining whether a student gains entry to a tertiary course.

The qualifications authority, NZQA, has tried to fix this problem of comparability of results between and within subjects by marking to profiles. What this means is there is a certain proportion of pupils who are expected to achieve at each level in a subject.

The marking of exams is adjusted to ensure these rough profiles are met. This is to ensure pupils don't end up with the impression it is harder to pass economics than physics.

To compound the problem of how to rank pupils for admission to tertiary courses, there is a move for more assessments to be marked internally, i.e. within schools, rather than by external markers. This appears to be a move by NZQA to reduce the huge expense involved in marking and administering NCEA in trying to get some semblance of comparability of results.