1、C N A O Agenda Characteristics in evaluation of government-invested IT projects I Construction of government-invested IT projects performance evaluation index system III Principle in evaluation index configuration of government-invested IT projects II C N A O background performance audit of GI-IT-P:
2、-to supervise legality of the investment process-to offer feedback to the public-to evaluate government-invested decision and investment performance C N A O VS VS satisfy public needs and offer public services focus on improving the enterprises economic performance I.Characteristics in evaluation of
3、 GI-IT-PC N A O Continuity Evaluation is a continuous process,not to be terminated with the completion of a particular project I.Characteristics in evaluation of GI-IT-PComplexity invisible benefits continuous improvement process deficiency of rigorous project supervision mechanismC N A O Integrity
4、covers all the factors of IT projects and the governments public service functions-Service offers consultation to and experience for the governments future IT investment I.Characteristics in evaluation of GI-IT-PC N A O II.Principle in evaluation index configuration of GI-IT-PEvaluation focuses upon
5、 the advanced and effective technical support and service capability of the system the sharing and service capability potential social benefits develop an evaluation indicator system EIS C N A O II.Principle in evaluation index configuration of GI-IT-PPrinciple of system integrity -Principle of oper
6、ability -Principle of combination of qualitative and quantitative evaluation -Principle of combination of economic efficiency and social benefits -Dynamic principle The selected evaluation indicators must be systematic and complete,with emphasis not only upon the internal relations of the overall EI
7、S,but also upon the functions and objectives of the entire system C N A O II.Principle in evaluation index configuration of GI-IT-PPrinciple of system integrity -Principle of operability -Principle of combination of qualitative and quantitative evaluation -Principle of combination of economic effici
8、ency and social benefits -Dynamic principle The EIS must be designed to be operational,with consideration to the feasibility of index value measurement and data collection,hence arises the necessity to solve the contradiction between theoretical importance and practical feasibility.C N A O II.Princi
9、ple in evaluation index configuration of GI-IT-PPrinciple of system integrity -Principle of operability -Principle of combination of qualitative and quantitative evaluation -Principle of combination of economic efficiency and social benefits -Dynamic principle Quantitative assessment must be made on
10、 the basis of qualitative analysis,since only through quantitative analysis can the nature and essence of any phenomenon be accurately described.C N A O II.Principle in evaluation index configuration of GI-IT-PPrinciple of system integrity -Principle of operability -Principle of combination of quali
11、tative and quantitative evaluation -Principle of combination of economic efficiency and social benefits -Dynamic principle In order to utilize public finances in line with the principle of“from the people,to the people,”there must be strict harmony and unity between economic efficiency and social be
12、nefits.C N A O II.Principle in evaluation index configuration of GI-IT-PPrinciple of system integrity -Principle of operability -Principle of combination of qualitative and quantitative evaluation -Principle of combination of economic efficiency and social benefits -Dynamic principle Indicators must
13、 be dynamically adaptable in parameters in line with the specific situation of an IT project,and also dynamically adjustable in weighing factors in order to describe the dynamic benefits of information technology.C N A O III Construction of GI-IT-P performance EISThere are four popular methods in th
14、eories and practices currently.-The financial evaluation method -The multi-indicator comprehensive evaluation method -The mathematical method -The computer-based technology approachC N A O On the basis of the hierarchy analysis method,a desirable GI-IT-P EIS should-combine financial indicators and n
15、on-financial indicators-combine the system quality and customer satisfaction-combine internal performance and social impact III Construction of GI-IT-P performance EISC N A O The EIS is divided into four dimensions -IT user satisfaction -IT value and contribution -IT internal process -IT learning an
16、d innovation III Construction of GI-IT-P performance EISC N A O Objectives to be achieved in the four dimensions are connected in a cause-effect way III Construction of GI-IT-P performance EISC N A O The EIS is divided into four dimensions-IT user satisfaction-IT value and contribution-IT internal p
17、rocess-IT learning and innovation III Construction of GI-IT-P performance EISC N A O IT customer satisfaction A CustomerParticipation A1i)Percentage of staff accessible to IT systems in government agenciesii)Percentage of new internet usersiii)Percentage of internet users among local residents iv)Ap
18、plication system coverage Public satisfaction A2a)Customer satisfaction with the products deliveryb)Customer satisfaction with problem-solvingc)Customer support to IT managementd)Customer support to IT traininge)Impact upon image of the Governmentf)Impact upon life quality and lifestyleg)Impact upon
19、 community welfare,social security,and interpersonal relationshipsh)Local governmental and public attitudes towards the projecti)Sensitivity to promote departmental or regional economic development j)Ability to timely provide assistance and help to the public in problem-solving C N A O The EIS is di
20、vided into four dimensions-IT user satisfaction-IT value and contribution-IT internal process-IT learning and innovation III Construction of GI-IT-P performance EISC N A O IT value&contribution BFinancial InvestmentPerformance B1a)Percentage of IT budget among the gross budget in a departmentb)The s
21、aving ratio between actual government IT costs and budget c)Capital compliance rated)whether the project helps increase government revenuee)Saving ratio of service and management fee Utilization Of IT resources B2i)Percentage of inter-departmental resources utilizationii)Percentage of inter-departme
22、ntal database sharing and application iii)Comparison of realized IT income with expected performance iv)Reusability of nucleus application modules v)The project benefit to environmental protectionvi)The project benefit to the surrounding community residents.C N A O The EIS is divided into four dimen
23、sions-IT user satisfaction-IT value and contribution-IT internal process-IT learning and innovation III Construction of GI-IT-P performance EISC N A O IT internal Process CApplication,development&maintenance C1a)Function points delivered per person per hourb)Number of defects as received by the user
24、 per 100 function points c)Number of critical failure per 100 function points d)Average time in solution of critical defectse)System throughputf)Average response time in IT servicesg)Percentage of IT system maintenance among the gross service activitiesProject performance C2i)Percentage of the proje
25、cts completed as required in terms of time and functions ii)Percentage of function and needs as achieved C N A O The EIS is divided into four dimensions IT user satisfaction IT value and contribution IT internal process IT learning and innovation III Construction of GI-IT-P performance EISC N A O IT
26、 learning/innovation DWork team capability&development D1a)Percentage of staff who have received training in application of new technologies b)Proportion of professionalsc)Percentage of IT staff who have received management trainingd)Percentage of IT training budget among the gross budgetApplication
27、 of new technologies D2i)Whether the staff are adopting the latest application approachesii)Percentage of staff well informed of advanced technology application and development iii)Percentage of projects in adoption of approved methods and tools Customer satisfaction&Reservation D3a)Percentage of st
28、aff satisfaction with existing technologies and operating environmentb)Percentage of users satisfaction with existing technologies and operating environmentc)Percentage of new users able to use the IT applications after preparatory training C N A O C N A O III Construction of GI-IT-P performance EIS
29、C N A O AHP can be adopted to make system performance evaluation roughly in four steps:(a)AHP modeling;(b)determination of comparison structural matrix;(c)calculation of the relative weighing of the factors under comparison;and(d)calculation of the combination weight of factors in each hierarchy finally.III Construction of GI-IT-P performance EISC N A O What is next?In our viewpoints,-in audit practice,there is necessity to make further in-depth research of EIS,-and combine pre-audit investigation result into the EIS design and specific indicator weighing.
