Metrics for Evaluation of the Chief Information Officer
The IT Steering Committee will evaluate the state Chief Information Officer (CIO) based on the metrics below, organized under seven priority areas. The evaluation summary will be included in the CIO’s annual report, due 20 days prior to the start of the 2018 Legislature.
IT Governance Metrics (2017)
IT Workforce Development Metrics (2017)
| Metric Description | Measurement | Deadline | Status | Grade |
| Reduced vacancies within ETS | Percentage; 2017 goal: vacancies less than 10 percent | 12/1/17 | ETS currently has 22 vacancies (two of which will be filled after ETS’ proposed reorganizational structure is approved, as these positions will be redescribed) and five anticipated retirements at the end of the year. ETS also anticipates filling between two and four more positions before the end of the year. | C |
| Facilitate programs designed to establish, expand and/or promote career path opportunities within the State for IT workers: | | | |
| 1) Completed LinkedIn Pilot Project and demonstrated progress toward vacancy goal | Number of positions filled via LinkedIn; pilot project goal: 10 | 04/1/17 | ETS was able to hire or assign start dates for 13 new employees (42% of its vacancies) during the LinkedIn pilot project (October 2016 - April 2017), compared to 6 (17%) during the same timeframe a year prior. Furthermore, four additional candidates sourced through LinkedIn during the pilot have been identified for hire but are pending final approval. ETS has since executed a year-long agreement with LinkedIn to support the office’s ongoing recruitment efforts and highly recommends that other departments and agencies pursue similar agreements if their budgets allow. | A |
| 2) Achieved employee participation in Civil Service IT Broadbanding Pilot Project | Number of ETS employees participating in program; goal: 10 percent of applicable civil service IT employees | 12/1/17 | 9% of eligible ETS employees have participated in IT Broadbanding, applying for a Professional Growth adjustment or Internal Alignment. This has remained a steady number of participation since it was opened to employees. 5% of those who applied were awarded an IT Broadband Adjustment, a 2% increase from prior submittals. ETS has also used the salary matrix for at least two IT hires in 2017. | B |
| 3) Continued and expanded Hawaii Annual Code Challenge program | Held second annual event (yes or no) and quality of event compared to previous; goal: greater than 250 participants | 12/1/17 | ETS held the second HACC in partnership with the Hawaii Technology Development Corporation, nonprofit Hawaii Open Data, and DevLeague to engage the local tech community in government modernization and expose individuals within Hawaii’s IT workforce to State career opportunities. Approximately 300 attended the kickoff for the month-long competition on Aug. 26, 2017, answering the call to apply their collective creativity to improving state government. This is a significant increase over 220 in 2016. In addition, a number of proofs of concept from last year’s competition are in development and scheduled for launch this year. For example, the Hawaii Agriculture & Food Products Database, unveiled at the Hawaii Agriculture Conference in August 2017, was developed collaboratively by the Hawaii Department of Agriculture and ETS, incorporating input from several 2016 HACC solutions as well as past Transformation Internship Program cohorts. | A |
| Average Grade | | | | B |
Cybersecurity Metrics (2017)
Enterprise Projects & Programs Metrics (2017)
| Metric Description | Measurement | Deadline | Status | Grade |
| Issued RFP for State Web Portal Program | Yes or no | 12/1/17 | A Request for Information (RFI) for an Internet Portal Manager and Service Provider was issued on July 12, 2017. Issuance of a Request for Proposals (RFP) is pending. | I |
| Demonstrate successful implementation of the following enterprise initiatives: | | | |
| 1) Tax System Modernization Project, Phases 2 & 3 | IV&V assessment as of date | 12/1/17 | In August 2017, the Tax System Modernization program completed the third of five “Rollouts,” which enhances online services for Corporate Income, Franchise, Public Service Company, and Withholding taxpayers. New features include improved web interface and added video tutorials. While the August 2017 launch requires no immediate action by tax-filers, it lays the necessary groundwork for phasing out the aforementioned tax group services from the legacy website by January 2018. ETS is also identifying any opportunities for further improvement before the project proceeds to its next major phase, Rollout 4, which will begin to address individual income filing and other areas. | A |
| 2) Enterprise Payroll and Time & Attendance Modernization, Payroll Phase | On track, on budget | 12/1/17 | The HawaiiPay project is being implemented in two phases: Payroll (2016-2018), followed by Time & Attendance. As part of the Payroll Phase, the first two departments are scheduled to “go live” on the new system in second quarter 2018, with remaining departments to begin transitioning in third quarter 2018. Project team efforts are currently focused on system configuration and departmental IT readiness to ensure that the required hardware, software and network bandwidth are in place when the system goes live. | A |
| 3) Kauhale On-Line Eligibility Assistance (KOLEA), Phases 1 & 2 | On track, on budget | 12/1/17 | In progress | F |
| Demonstrate sustainability and integration (with other ERP modules) of: | | | |
| 1) Human Resources Management System | Quality of sustainability and integration | 12/1/17 | In May 2017, ETS migrated the existing executive branch Human Resource Management System (HRMS), maintained and operated by DHRD, to primary and secondary Cloud-enabled data centers hosted by project partner CherryRoad Technologies. | A |
| Average Grade | | | | B |
Services-Oriented Infrastructure Metrics (2017)
| Metric Description | Measurement | Deadline | Status | Grade |
| Increased capability to provide tech support to departments as enterprise service | Job tickets received and closed | 12/1/17 | 7229 of 7280 job tickets were closed in fiscal year 2017. | B |
| Demonstrate progress and success of: | | | |
| 1) Office 365 Project | Quality of departmental participation and sustainability | 07/1/17 | ETS has completed migration of the executive branch to Office 365, excluding the Department of Taxation (pending its migration, which it elected to defer), Department of Education, University of Hawaii and Hawaii Health Systems Corporation. ETS has also formally identified Office 365 as the state’s platform for email, online storage and other Office applications and services, and has negotiated a new 3-year enterprise license agreement (ELA), effective June 1, 2017, that provides for the continued use of these applications and services by approximately 12,000 users, while further leveraging economies of scale in favor of the state. | B |
| 2) eSign Service | Number of transactions and quality of departmental participation; year-end goal: 200,000 transactions | 12/1/17 | As of Nov. 16, 2017, there has been more than 263,410 total eSign transactions. The average number of eSign transactions per month is 9,931, with the record month reaching 19,310. The median time to complete a transaction is 238.2 minutes. | D |
| 3) Government Private Cloud / Cloud Services | Migration completed (yes or no) | 12/1/17 | Pending | F |
| 4) Network Operations & Maintenance | Reliability and sustainability; goal for core Next Generation Network: 99.99% availability, excluding planned maintenance | 12/1/17 | Calculation underway. Added network redundancy to Hawai‘i Emergency Management Agency (HI-EMA) statewide network to support both HI-EMA and O‘ahu INET users, performed network topology changes to increase the reliability of the State’s network, established a dedicated connection (express route) to the Microsoft Azure Cloud, and provided a high-speed fiber optic connection to the ‘Ewa District Court. Also, established new statewide price list through the State Procurement Office for Centrex Telephone and Cabling Services, and consolidated and significantly increased network bandwidth (200-fold) for tenants of the Kona State Office Building and the Molokai State Office Building. | B |
| 5) Telecommunications | Successful 99.99% availability, excluding planned maintenance | 12/1/17 | Calculation underway. | B |
| Average Grade | | | | B |
Open Data Metrics (2017)
Cost-Transparency Metrics (2017)
