Small Basic Project | Development of the model for monitoring and evaluation of development programmes and projects in public sector

Small Basic Project | Development of the model for monitoring and evaluation of development programmes and projects in public sector | Project leader: Professor Mirko Vintar

 

Contracting Authority:   

Slovenian Research Agency

Member of the University of Ljubljana:   

UL Faculty of Administration

Code:   

J5-7557

Project:

Development of the model for monitoring and evaluation of development programmes and projects in public sector

Period:  

1/3/201628/2/2019

Range on year:

0,78 FTE (2016)

Head:

Professor Mirko Vintar

Research activity:

Social sciences

Research organizations:

link on SICRIS

Financing:   

The project is being financed with 1600 yearly hours (B price category) for 3 years.

Citations for bibliographic records:

link on SICRIS

 

Abstract of the project:   

The proposed study is based on the conclusion that the institutional and administrative aspects of the public policies, programmes, and projects (PPPP) implementation are one of the weakest points of the operation of Slovene government and its public administration. The theoretical part of the study draws from established theories, such as institutional theory, system theory, theory of rational choice, and good governance theory. Public governance, regardless of the content of individual policies, refers to two levels, (1) a politicalinstitutional level and (2) the level of administrativeimplementation, i.e. the instrumental level. The two level operate in fundamentally different ways. The first level is mostly in the domain of politics, which implements its goals through government and parliament. The proposed project is focused on the second level, the administrative implementation level, which uses the administrative apparatus (public administration bodies) to realise the politically and institutionally defined goals and priorities in the field of PPPP. We are missing the comprehensive analysis of the situation and of the weaknesses in the domain of implementation and evaluation of PPPP impacts. Neither can we find any attempts in Slovenia to unify the approaches or develop unified methodology of monitoring and evaluating the effects of the PPPP. The indicators of PPPP success are rarely used and IT support of the PPPP implementation processes is weak. The existing instruments allow us to only partially assess the state of public policies. The issue is markedly interdisciplinary. The existing tools are not appropriate for the competent preparation and even less for the monitoring and evaluation of the PPPP. We need interdisciplinary, systematic solutions that would allow the integration of all key aspects to the preparation and implementation of PPPP, especially the institutional, normative, economic/financial and organisational/informational aspect. The aim of this project is to analyse the current situation in Slovenia and comparatively in selected EU countries to develop a unified methodology and generic integrated model to support the implementation and evaluation of impacts of PPPP. The model will be supported by a catalogue of indicators and a prototype of an IT solution for a unified monitoring and implementation of PPPP in any domain. The model will be tested in real environment of Slovene ministries on at least three selected PPPP. The main added value of the suggested model is the integration of different aspects of PPPP implementation (process, economic/financial and normative/regulatory). The model will be backed by a consistent system of interconnected and vertically compatible quantitative indicators, which will allow realtime evaluation of the effects and a feedback loop in the PPPP implementation cycle. The study will be conducted in three phases. The first phase of the study will include an analysis of the PPPP implementation within the public administration authorities in Slovenia and a comparative study of selected countries. The second phase will involve the development of a generic model of PPPP implementation and evaluation, based on its own catalogue of indicators. The third phase will be extension of the KRONOS catalogue of indicators, which will allow the use of the model in any PPPP domain. An IT solution will be constructed to allow the use of the model and the catalogue of indicators, which will be tested on three selected PPPP implementation domains.

The study is designed to lead us to new theoretical findings about the key PPPP implementation aspects as well as to results and solutions which will contribute significantly to strengthening the PPPP implementation competences of the top hierarchical levels of ministries and directorates (and on the local level). The catalogue of indicators will be published online as a public expert database (in two languages).

 

Members of the research group and links to the SICRIS portal

 

The group consists of researchers from the two participating organizations: University of Ljubljana, Faculty of Administration and consultancy company IPMIT Ltd.

 

University of Ljubljana, Faculty of Administration:

Professor Mirko Vintar (leader)

Associate Professor Aleksander Aristovnik

Professor Ljupčo Todorovski

Professor Polona Kovač

Professsor Maja Klun

Associate Professor Janez Stare

Assistant Professor Tina Jukić

Assistant Professor Mitja Durnik

Assistant Professor Lan Umek

Assistant Žiga Kotnik

Miha Lebič, mag. upr. ved, professional associate

 

IPMIT Institute for Project Management and Information Technology Ltd.:

mag. Aleksander Novaković

Mitja Kožman

The study will be conducted in three phases. The first phase of the study will include an analysis of the PPPP implementation within the public administration authorities in Slovenia and a comparative study of selected countries. The second phase will involve the development of a generic model of PPPP implementation and evaluation, based on its own catalogue of indicators. The third phase will be extension of the KRONOS catalogue of indicators, which will allow the use of the model in any PPPP domain. An IT solution will be constructed to allow the use of the model and the catalogue of indicators, which will be tested on three selected PPPP implementation domains.

The study is designed to lead us to new theoretical findings about the key PPPP implementation aspects as well as to results and solutions which will contribute significantly to strengthening the PPPP implementation competences of the top hierarchical levels of ministries and directorates (and on the local level). The catalogue of indicators will be published online as a public expert database (in two languages).

The realisation of the study is planned in three phases. In the first phase, we will focus on WPs 1, 2 and 3, which are complementary. In the scope of WP 1, we will undertake a thorough comparative analysis of the field in question in other EU countries. We will define the key phases of the implementation of developmental programmes, their key activities, the main stakeholders and their competences and responsibilities. While studying the approaches and solution of other countries, we will focus on the placement and organisation of specialised business functions that deal with the analysis and implementation of the PPPP. In the scope of WP 2, we will analyse the approaches, organisational solutions, practices and competences in the field of PPPP implementation in the ministries and public institutions in Slovenia, questions related to the placement of analytical and developmental functions (policy making units) in the structure of the executive authorities, i.e. the structure of the ministries and directorates, their organisation (if it exists), the number of employees, responsibilities, tasks, activities, etc. We will determine the extent that the ministries systematically deal with the longterm development of their domains, the extent that they develop strategic management, the state of strategic documents and the extent of their implementation. Special attention will be paid to the role of the normative regulation of the field (division of competences and responsibilities) and to the importance of dependable financial and HR sources for the success of the programmes and projects. We will analyse the extent that the process of implementation is influenced by the established structures within the institutions that implement the projects (isomorphism). WP3 – The object of the case study is to carefully analyse the PPPP implementation in a selected domain. In contrast to WP 2, where we focused on the general characteristics of the PPPP implementation, WP 3 will focus on the process aspects, which are very important for the development of our own model. Three studies will be released as a result of Phase 1, which will be of interest to the wider scientific and professional public. Their findings will serve as the basis for Phase 2. The first step of the second phase, will be the organisation of an international workshop, where we will present our theoretical and practical findings to the scientific and professional public and check our starting point for the development of our own solutions. All this will serve as the good basis for the development of our own methodology and model to support the processes of the preparation, implementation and evaluation of PPPP. The results of the development of model for monitoring and evaluating PPPP in the public sector will contribute to the goaloriented management of developmental policy and indirectly to the programoriented funding of the suggested programmes. In the scope of the conception and development of this model, we will analyse strategic documents (in accordance with the chosen methodology and considering the goals of the strategy, priorities and content). This will be the basis for the evaluation of individual programmes (from the point of view of priorities, the achievement of goals, legal requirements and financial conditions). In the third phase, the KRONOS catalogue of indicators will be extended to cover all indicators, which will allow the use of the designed model and its testing within different PPPP fields. In the final research phase, the entire platform will be tested on two selected fields and optimised through empirical examination. An overview and analysis of the existing conceptual and methodological solutions connected to measurement of efficiency and success of the government expenses on the national level will be of key importance for the optimisation of the model using the example of Slovenia.