Interactive statistical pocketbook
Federal ministry of science and research
Austria

The Problem

Since the 1970s, Austrian universities have been providing data, published in the Statistical Pocketbook, to the Ministry in charge of universities. This data serves as the immediate basis for decisions in the area of university policy made by politicians and administrative entities and as a main fact pool for all other stakeholders involved in university policy.

The Statistical Pocketbook has been published in print irregularly since 1975 and was then published annually from 1981 by the Department of University Statistics at the Ministry in charge of public universities. The data base was already out of date on the day of publication and could not be updated until the next issue.

When interacting directly with university representatives and when studying the international reporting system, it became also evident that oftentimes indicators and results that were not comparable were used. This was caused by the use of different data sets and differing ways of counting.

The implementation of the new University Act in 2002, which linked budget allowances to performance agreements, and the provision of "extended autonomy" to Austrian universities led to new challenges for the universities’ administration, as it changed the nature and strategic frameworks of internal control processes. Direct control elements had to be replaced with strategic frameworks, responsible monitoring and new public management. Ministry-imposed university management had to be shifted towards a modern university management.

A quantitative guidance framework for performance agreements, transparency of university performance and goals set by university policy, and the monitoring of the quantitative aspects of decision-making processes in the area of university management (goal and performance agreements) became therefore essential.

The data basis that was originally not always comparable, now evolved into the major control component for the definition of objectives and performance goals between universities and the Federal Ministry of Science and Research. For this purpose, a valid and publicly accessible data basis was indispensable.
Processes to increase the data quality of university statistics and to avoid result asymmetries between universities and the Austrian Ministry of Education and Research as well as optimized working processes at the Department of University Statistics and the Ministry became necessary.
Further requirements were an enhanced need to justify the use of public funds and transparency vis-à-vis the public.

Beside the Austrian related changes in university policy, as well international and societal developments like the implementation of the Bologna process or the gender perspective required a tool to monitor objectives set by university policy and the Austrian Ministry of Education and Research. In addition to that, the entire tertiary education sector became subject to Europe-wide competition.

Finally the needs of users of the Statistical Pocketbook have changed enormously over the past ten years, which is reflected in their request for more interpretation and higher data availability. Target groups and stakeholder groups range from the universities' management to the administration and participants in Austria's knowledge society, e.g. the Austrian Students' Union, advisory institutions such as the Science Board and science journalism.

Solution and Key Benefits

 What is the initiative about? (the solution)
The Interactive Statistical Pocketbook was implemented on the unidata website www.bmwf.gv.at/unidata in 2008. The project's main management achievement initiated and implemented processes to increase the data quality of university statistics and to avoid result asymmetries between universities and the Austrian Ministry of Education and Research.
To reach this, the main focus lay on the provision of up-to-date numbers and facts about higher education in Austria.

In order to increase and ensure the necessary data quality and indicators' validity, numerous measures were taken to allow for a data set whose quality is undisputed before the project even started:
The implementation and the data synchronization process went hand in hand with statutory processes, which optimized the indicators' validity. A further component is an electronic platform used to synchronize data sources between universities and the Austrian Federal Ministry of Science and Research. These harmonized data sets ensure that the stored information is reliable and reduce result asymmetries.

The developed tool provides a valid data base for efficient control tools in university management made available at the touch of a button via an online portal. The published data serves as the basis for evidence-based decision-making processes in the field of university policy made by politicians and administrative departments to deduct strategic management functions for the major stakeholders.

The universities' performance is backed with quantitative facts, which facilitates comparisons between universities. The Pocketbook makes university performance transparent, shows changes in the university system and is the basis for the compilation of intellectual capital statements. Therefore it is a major tool to monitor goals set by university policy.

The information system includes pre-prepared indicators about students, graduates, staff, international education, etc. Monitoring processes regarding the level of implementation of the Bologna process or the advancement of women at Austrian universities are now just a few clicks away. It is a resource of facts for all target groups, span from the universities' management, the administration, student unions, advisory institutions, participants in Austria's knowledge society to the media.

The platform unidata is also used for customer screening by companies or education advice, leads to a better informed higher education policy and allows individual citizens to follow the allocation of public funds.

Its information is available free of charge and accessible twenty-four-seven to the general public. Was the printed Statistical Pocketbook already antiquated on the publication day, allows the electronical platform now the non-stop access to up-to-date data and facts via the unidata data warehouse landing page. After choosing „Public Access“ the selected option „Publications“ leads to the link „Statistical Pocketbook“, which activates the download of the interactive Statistical Pocketbook.
Users can access the latest information themselves as desired without having to wait for a clerk while benefiting from a broad range of reports and from the additional advantage of adapting the pre-prepared indicators to their needs. The high user friendliness allows anybody to access customized information.

Electronic data entry and updating also increases administrative efficiency. The system reduces the amount of work for the administration and helps to minimize administrative costs.

On the basis of subjective feedback a first estimation is possible. It shows contented beneficiaries (staff as well as external users). The collateral effects will be measured quantitatively and qualitatively in 2010 within a professional evaluation.

Actors and Stakeholders

 Who proposed the solution, who implemented it and who were the stakeholders?
The electronic implementation of the interactive Statistical Pocketbook was initiated and managed within the framework of the unidata platform as a project of the specialist department University Statistics at the Austrian Federal Ministry of Science and Research, commissioned by the Ministry.

A principal aspect is that the implementation was, to a very large extent, performed by the employees of the Federal Ministry of Science and Research with their own resources and it relied to a large extent on existing infrastructure. In addition, the input and the resources of specific universities and departments of the Ministry who input data themselves were also utilized.

The conception phase was headed by three project managers, who defined the assignment, objectives and necessary project structures and made a budgeting forecast. In the elaboration phase a data warehouse core team worked out the technical details. 50 persons were surveyed to optimize the solution design. The implementation was performed by a development team created specifically for this purpose. Depending on the respective phase, not only the department coordinating the project, but also the IT department, future users as well as external employees were involved.

FAW Software Engineering GmbH was used as an external partner. The company provides consulting services in the areas of database technology, software and Web engineering, information management and innovation and technology promotion services.

Technical problems were solved in interaction between all involved parties (database administrators, application managers, users).

(a) Strategies

 Describe how and when the initiative was implemented by answering these questions
 a.      What were the strategies used to implement the initiative? In no more than 500 words, provide a summary of the main objectives and strategies of the initiative, how they were established and by whom.
The Interactive Statistical Pocketbook was assigned by the Federal Ministry in charge of universities as an inherent part of the Austrian e-government strategy.
The strategy´s goals are to establish information and communication technology to strengthen quality and efficiency in the Civil Service in order to lower costs and to accelerate internal operations as well as to make all processes electronically accessible to all citizens quickly and without requiring them to have specific knowledge about responsibilities and technical expertise.

Communication processes with citizens were adapted to the new media electronic. Internal and external operations had to be improved and partly remodeled.
So the interactively Statistical Pocketbook on the unidata portal contributes to the modernization of administration and to customer orientation and moreover obtained the following objectives:

> Improving data validity by implementing a data clearing process.

A main element is an electronic platform used to synchronize data sources between universities and the Ministry. Data collection and synchronization processes were established by law.

> Providing a quantitative guidance framework for performance agreements and/or monitoring the quantitative aspects of decision-making processes in the area of university management (goal and performance agreements).

The project's main focus was the provision of up-to-date facts about higher education in Austria. Universities' performance is now backed with quantitative facts. The implemented free electronic platform adds transparency to goals and performances of the universities, offers a basis for decision-making processes and facilitates comparisons between universities.

To achieve a comparable data basis, several processes were created during the project's implementation phase, such as the electronic platform used to synchronize data sources or statutory processes about data collection and harmonization.

> Integrating gender monitoring indicator systems and Bologna monitoring to serve as an exact focus of objectives defined by politicians.

Pre-prepared indicators and the possibility to export the valid data provide to monitor objectives set by university policy, as changes related to the gender perspective and the implementation of the Bologna process.

> Optimizing work processes at the Department of University Statistics as well as at the Federal Ministry of Science and Research and shifting the focus of work towards analytical statistics and activities for the further improvement of data quality.

Electronic data entry and updating increases administrative efficiency and provides the opportunity for sophisticated handling of aggregated data in the Department of University Statistics. This allows to optimize its periodically repetitive processes. As a consequence the department is able to shift its focus of activity.

> Improving and facilitating access to up-to-date information in the area of higher studies for the general public.

The data is available free of charge and with high user friendliness accessible 24/7 to the public. Users benefit from the fact that they access the latest information themselves as desired without having to wait for a clerk while benefiting from a broad range of reports made available at the touch of a button via online portal.

(b) Implementation

 b.      What were the key development and implementation steps and the chronology? No more than 500 words
Not only the implementation of the new University Act in 2002, which linked budget allowances to performance agreements, made a more valid data set a crucial thing to have. Therefore unidata was commissioned by the previous Federal Ministry of Education, Science and Culture in 2004, finally the Interactive Statistical Pocketbook was implemented in December 2008. In order to achieve a comparable data basis and to ensure data quality, numerous measures were taken to allow for a data set whose quality is undisputed before the project even started. Prior to the start of the project the data synchronization process was established by law.

During the implementation phase never-before-seen data quality was achieved as a result of the implementation of standardized quality assurance processes. The implementation went hand in hand with statutory processes about data collection, which highly increased the indicators' validity.

The conception phase and the definition phase had been in place since 2004.
In the conception phase, the project managers defined the assignment, objectives and necessary project structures and a budgeting forecast was made. In the definition phase, all human resource and technical requirements were created to allow for the elaboration and the implementation of the project.

In the elaboration phase the technical details were worked out. This included a reflection on the project requirements during the actual process as a consequence of a survey whose results were incorporated into the solution design.
In the implementation phase in 2006 the user interface was put in place http://www.bmwf.gv.at/unidata.

All results of the project development phase were documented with products. Project plans, the specification of subjects to be discussed in joint working sessions and the ensuing time and activity plans were a major component of the project organization.

(c) Overcoming Obstacles

 c.      What were the main obstacles encountered? How were they overcome? No more than 500 words
The project management of the interactive Statistical Pocketbook had to face and negotiate usual obstacles related to changes of the inner organisation, such as scepticism adverse changes of the system and of the organisational culture, or habitual work routine. Obstacles were overcome by embedding, mobilising and convincing staff members.

(d) Use of Resources

 d.      What resources were used for the initiative and what were its key benefits? In no more than 500 words, specify what were the financial, technical and human resources’ costs associated with this initiative. Describe how resources were mobilized
The electronic implementation of the Statistical Pocketbook was initiated and managed within the framework of the unidata platform as a project of the specialist department University Statistics at the Federal Ministry of Science and Research.
Extraordinary efforts were made by a small core team to implement this project. An ideal combination of input and allocation of resources favored the best possible result.

Regarding the use of resources, a major aspect is that the implementation was mainly performed by the employees of the Federal Ministry of Science and Research with their own resources and that it also relied to a large extent on existing infrastructure.

The conception phase and the definition phase were headed by the project managers (a team of 3). For the elaboration phase, a data warehouse core team (team of 8) was created, which was eventually expanded in the process. This included a reflection on the project requirements during the actual process as a consequence of a 50-person survey whose results were incorporated into the solution design. The implementation was performed by a development team created specifically for this purpose (team of 7).

Depending on the phase, not only the department coordinating the project, but also the IT department, future users as well as external employees were involved.
In addition, the resources of other departments of the Ministry who can input data themselves can also be utilized.

To a relatively small extent, FAW Software Engineering GmbH was used as an external partner. This company provides consulting services in the areas of database technology, software and Web engineering, information management as well as innovation and technology promotion services.

In total, EUR 274,300 was budgeted for the overall implementation running from December 2004 to December 2008. The funds were secured by a yearly objective agreement and paid out of the regular data warehouse-budget allocated by the ministry. Expenses included product costs, product customization, adapting the application to the requirements of the Higher Education data warehouse, implementation of database interfaces, trainings as well as the ongoing operation.
Personnel costs and expenses for technical resources were paid out of the current budget of the Federal Ministry.

Sustainability and Transferability

  Is the initiative sustainable and transferable?
The data quality of university statistics is an essential condition for successful university policy and competitive autonomous universities. Not only for this reason the continuance of the interactive Statistic Pocketbook is indispensable.

The initiative is transferable on institutions that must achieve objectives in the sense of Evidence based Policy. Data warehouse could be assembled in all federal ministries, where strategic decisions are made on basis of figures and benchmarks (e.g. education department, school statistics).

The interactive Statistical Pocketbook is in the process design as well as regarding to the technical solution and implementation transferable to different fields of politics. Therefor it is already considered as a reference project for the public domain.

The use of electronic systems on the Internet reduces the amount of work for the administration as well as of the printed materials drastically. So the printing and transportation expenses decreased significantly. Working processes could be optimized. The measure explicitly helps save money and to reach environmental goals.

Now, users are also able to interactively link information and export this data. This approach allows for comparisons that had until today been difficult to perform, e.g. in the area of gender monitoring. In 2010 main parts of unidata will be available in English in order to meet the increasing international demands and to amplify its coverage.

The model of easy availability of data on higher education data is a Europe-wide best practice model.

Lessons Learned

 What are the impact of your initiative and the lessons learned?
With is functionality and accessibility, the interactive Statistical Pocketbook has turned the world of European university statistics information systems upside down. It unites a product with a 30 years' success story with the possibilities of the 21st century. In addition to many other possibilities for users, this tool also provides a valid data base for efficient control tools in university management.

The Austrian Federal Ministry of Science and Research and Austrian universities are now able to base their budget negotiations exclusively on relevant impact factors that rely on this improved data. The Ministry is now in a position to assume its strategic control function as defined by evidence-based policy.

The data clearing process caused changes at universities. The interactive Pocketbook makes university performance transparent, allows for comparisons at the university level, to monitor objectives set by university policy and for efficient benchmarking. It is also used for the compilation of intellectual capital statements by universities.

The President of the Austrian Science Board, Jürgen Mittelstraß, said that "the information in unidata is (...) an indispensable part of the reform process at Austrian universities. This information adds transparency to the process and will in the long term lead to a better informed higher education policy in the best sense of the word, especially when it comes to performance agreements.” Christoph Badelt, President of Universities Austria comments: „The importance of the information system unidata for the members of Universities Austria shows the fact that we link our website to the unidata landing page. So our users get valid information at first hand – a service with best practice.“

The electronically available Statistical Pocketbook made it possible that the work processes at the Department for University Statistics as well as at the Federal Ministry of Science and Research could be optimized. The department was able to shift the focus of work towards analytical statistics and activities for the further improvement of data quality. The system reduces the amount of work for the administration and minimizes administrative costs.
The Pocketbook is also a valuable tool for statistical comparisons in Europe.

Because of the continuous exchange processes between universities and the electronic platform, the data is updated on a continuous basis and can be retrieved depending on personal needs. Users have up-to-date access to the latest data, which they can filter and export as desired. The data is available free of charge, non-stop and with a high user friendliness accessible to the public, which allows anybody to access customized information and to calculate data. This significantly increases the functionalities and the usability for all target audiences.

The main lesson learned was that to achieve project objectives, well-grounded planning and elaboration have to go hand in hand with a high degree of flexibility and creativity at the technical reengineering. So users can easily handle the tool.

Contact Information

Institution Name:   Federal ministry of science and research
Institution Type:   Government Department  
Contact Person:   Harald TITZ
Title:   Head of unit  
Telephone/ Fax:   +43 1 53120 5897
Institution's / Project's Website:   +43 1 53120 81 5897
E-mail:   harald.titz@bmwf.gv.at  
Address:   Bankgasse 1
Postal Code:   1014
City:   Vienna
State/Province:  
Country:   Austria

          Go Back

Print friendly Page