Methodology
Methodology
The Achieving E-government project used five approaches to measure progress towards the Strategy's outcomes and to determine the progress of e-government in New Zealand:
- analysis of recent e-government surveys to measure the demand for e-government
- an assessment of agency websites
- an appraisal of the quality of agency metadata records used on the government portal
- extensive consultation with agencies
- a review of the EGU's contribution to the Strategy's outcomes and targets.
Scope
The following agencies were included in the assessment:
Website assessments
I to I Solutions Ltd assessed the agencies' websites to determine whether they had achieved the Strategy's target for June 2004 that: the Internet will be the dominant means of enabling ready access to government.
Expert assessors used an adaptation of the e-Gov Watch methodology [For more information: www.e-govwatch.org.nz] (originally developed to help improve government websites by providing an effective performance assessment) to focus on the information and services that agencies provide on their websites.
Assessment period
As government agencies' websites are constantly improved and updated, the website assessment was a 'snapshot' of websites between April and June 2004. Many agencies are now working on improvements to their websites or planning these for the near future.
Websites included
All agencies were included in the assessment, except for the Parliamentary Service and Office of the Clerk as they were extensively redeveloping their websites during the assessment period.
The assessment included main (corporate) and selected subsidiary websites to evaluate the extent to which there is ready access to information and services. Some subsidiary websites were not assessed, including those with government-only or specialist audiences and portals.
Website assessments
The assessments took into account individual agency roles, such as the size of the agency, the number of websites it operates, and whether the agency is policy-focused, operationally-focused or a mixture of both. Budget allocations were also considered for agencies with multiple websites. The Achieving E-government project provided each agency with the results of their websites' assessments.
Assessment criteria
Criteria areas were considered according to importance, with the greatest emphasis on information delivery. Information areas (subject areas) and e-services (interactive, two-way transactions) were assessed against a set of criteria that measured the quality of the information or service, how easy it is to find, and for whom and what the information is provided. [E-services may involve data entry, reporting, interactive maps, calculators or purchases]
Websites were assessed against the Government Web Guidelines, using required government content and accessibility criteria. Assessors evaluated websites by considering a sample of pages likely to be relevant and representative of the criteria being assessed. They used automated testing tools, judgement, and best practice usability principles to determine how well people could understand and operate each website to achieve their objectives [The criteria included a subset of the e-Gov Watch usability criteria, intended to represent best practice in usability for government websites] .
Metadata assessments
Metadata provides consistent terminology so search engines can more easily locate resources that match the search terms people use. As the Public Service is required to provide easy access to its information and services through the government portal, the Achieving E-government project looked at the quality of the agencies' metadata records for the portal, as a measure of ready access to government information and services.
Example of some of the information contained in a metadata record
|
Apply for a visa or permit to work in New Zealand |
|
| Description |
If you wish to come to New Zealand to work, you will need a work permit from the New Zealand Immigration Service. You may also apply for your work visa to have single or multiple entries so that you can leave and return without reapplying. |
| Subject | Employment Visas |
| Function | Border control |
| Special conditions | If you are already in New Zealand as a visitor you may apply for a work permit for a total stay of nine months from the date of your arrival as a visitor |
The Achieving E-government project assessed metadata quality including its accuracy, completeness, granularity (how general or specific a record was, and whether this was appropriate), usability and consistency. It checked the coverage of each agency's metadata by comparing it with their Statement of Intent and websites. The comparison helped identify any gaps in major subject areas, and agencies were advised of these. The project checked for offline services that could be made available online (such as brochures), and checked each agency's metadata records for broken links through the portal.
Alignment with the E-government Strategy
The Achieving E-government project considered what agencies have achieved using the Internet and technologies up to June 2004, and how agencies are intending to use the Internet and technologies in future. Information was collected in several ways including:
- a review of E-awareness survey information about agencies' e-government initiatives
- a review of agency documents
- consultation with agency representatives.
Agency alignment with the Strategy also included initiatives to improve staff access to information and systems, and data integration with other agencies. Improved internal information systems enable agencies to provide information and services for the public more effectively.
Agencies were compared directly against the Strategy's goals for the three outcomes and the target for 2004. Their progress and plans were compared with the Strategy's future targets, especially for June 2007.
Survey review
In October 2003, the EGU carried out a survey of agencies called E-awareness. Information gathered from agencies identified e-government initiatives, changes to agency strategy documents to incorporate e-government, metadata maintenance, agency need for online authentication, the use of the e-GIF, and compliance with the Government Web Guidelines. The Achievement E-government project used the survey results to help to assess agencies' progress towards the Strategy's targets.
Document review
The EGU reviewed agency documents, including Statements of Intent, Annual Reports and information strategy strategic plans to establish their long-term plans and objectives for the Internet and networks, and how these fit with the objectives of the Strategy.
The document review helped to determine how well agencies are prepared and able to meet the Strategy's long-term objectives. The EGU expected documentation to show how an agency's Internet and network strategies correspond to wider sector initiatives and their long-term plans and objectives, including alignment with the Strategy's targets.
Agency consultation
The Achieving E-government team met with each agency to discuss their use of the Internet and networks. Meetings provided an opportunity for agency representatives to share information about e-government in their agency. It was also an opportunity to revisit agency feedback to the E-awareness survey.
Agency e-government profiles
The Achieving E-government team provided agencies with a three-week period to comment on their agency profile. Agencies had the opportunity to suggest changes to their profile. These were only accepted if it improved the accuracy of the profile.
[ Previous | Next ]
