APAC CIOOutlook

Advertise

with us

  • Technologies
      • Artificial Intelligence
      • Big Data
      • Blockchain
      • Cloud
      • Digital Transformation
      • Internet of Things
      • Low Code No Code
      • MarTech
      • Mobile Application
      • Security
      • Software Testing
      • Wireless
  • Industries
      • E-Commerce
      • Education
      • Logistics
      • Retail
      • Supply Chain
      • Travel and Hospitality
  • Platforms
      • Microsoft
      • Salesforce
      • SAP
  • Solutions
      • Business Intelligence
      • Cognitive
      • Contact Center
      • CRM
      • Cyber Security
      • Data Center
      • Gamification
      • Procurement
      • Smart City
      • Workflow
  • Home
  • CXO Insights
  • CIO Views
  • Vendors
  • News
  • Conferences
  • Whitepapers
  • Newsletter
  • Awards
Apac
  • Artificial Intelligence

    Big Data

    Blockchain

    Cloud

    Digital Transformation

    Internet of Things

    Low Code No Code

    MarTech

    Mobile Application

    Security

    Software Testing

    Wireless

  • E-Commerce

    Education

    Logistics

    Retail

    Supply Chain

    Travel and Hospitality

  • Microsoft

    Salesforce

    SAP

  • Business Intelligence

    Cognitive

    Contact Center

    CRM

    Cyber Security

    Data Center

    Gamification

    Procurement

    Smart City

    Workflow

Menu
    • DevOps
    • Cyber Security
    • Hotel Management
    • Workflow
    • E-Commerce
    • Business Intelligence
    • MORE
    #

    Apac CIOOutlook Weekly Brief

    ×

    Be first to read the latest tech news, Industry Leader's Insights, and CIO interviews of medium and large enterprises exclusively from Apac CIOOutlook

    Subscribe

    loading

    THANK YOU FOR SUBSCRIBING

    • Home
    Editor's Pick (1 - 4 of 8)
    left
    Service Management in the Age of Digitization

    Douglas Duncan, CIO, Columbia Insurance Group

    Devops- 'Aligning the Future of Software Deployment'

    Herry Wiputra, CTO

    Compliance @ The Speed of Thought

    Patrick S. Kelso, Head of Devops Consulting - Anz Region, UST Global

    On the Evolution of Agile to DevOps

    Carmen DeArdo, DevOps Speaker, Consultant, Author and DevOps Leader, Nationwide

    Building the New Paradigm of Next-Gen DevOps Management

    Marc Priolo, VP, City National Bank

    A Crash Course in Low-Code Software: What it is, What it Does, Why it Matters

    Karen Astley, Vice President Asia-Pacific, Appian

    Meeting the Intelligent Data Management needs of 2019

    Shaun McLagan, Senior Vice President, Asia Pacific and Japan, Veeam Software

    Bridging the T&E Compliance Gap in a New Era of Business Travelers

    Madanjit Singh, Managing Director, South East Asia, SAP Concur

    right

    Measuring DevOps - Where are you on the cheat scale?

    Peter Waterhouse, Senior Strategist, CA Technologies

    Tweet
    content-image

    Peter Waterhouse, Senior Strategist, CA Technologies

    Much has been written on the subject of DevOps metrics. Especially how many organizations are using manufacturing-like KPI’s such as lead/cycle times and defect counts to assess IT performance. Of course these metrics are worth scrutinizing, since the fast delivery of high-quality apps from our software factories has become a major imperative in an application-driven economy.

    When we adopt these metrics, we understand that they’re influenced by many others. For example, a Net Promoter Score or customer satisfaction index will depend on a combo of elements – like how fast you deploy valuable widgets and how quickly you can fix them when things go south. Similarly, customer conversions through mobile channels, will be influenced by factors within and beyond our control – like app deployment frequency rates and ease-of-use/design, but also by device and network reliability.

    This is all great and well understood, but often in the quest for metrics nirvana we forget to include the basic and obvious. In fact ignoring one basic element can derail a DevOps initiative faster than a sneeze disappearing in a snowstorm.

    It’s called cheating.

    Now this doesn’t involve teams of agile developers juicing up the code-base with illegal substances, or operations participating in elicit cloud gambling activities. Nope, it’s more about any individual or team taking advantage of existing conditions and loopholes to circumvent processes or remove constraints. Cheating might seem harsh because the act isn’t necessarily dishonest. However, if the individual is incentivized to do it, or the act puts the organization at risk, then the business has been cheated – it’s that simple.

    Cheating manifests itself in many ways across the software pipeline. For example:

    Ace up the sleeve – a mobile app developer who needs infrastructure for some critical A/B testing. Frustrated at the amount of time it takes operations to release systems needed for testing and with the cajoling of a business unit manager, he procures some cloud services and starts mocking up some test patterns – easy peasy.

    There’s a limit to how often you can use that extra card –

    it doesn’t scale. When unavailable systems, lack of test data and performance information cause people to take short cuts in design, coding and testing there’ll eventually be quality and cost problems.

    Runner in the crowd – a web developer is assigned some refactoring or documentation work, but doesn’t want to be distracted from working on a cool new project. She knows that the release process is usually delayed, so decides to hold off on the updates; intending to slip them back into the next release at the last possible moment – it never happens.

    Some marathon runners have been cheated by casually slipping into the race from the crowd just before the finish line. This example is no different – release bottlenecks are causing bad behaviors, resulting in unnecessary technical debt and apps that are hard to support.

    Nobbling the ‘competition’ – a new autonomous agile development group ignores advice from the Enterprise Architecture (EA) team. In their minds the current architecture is too rigid and cumbersome, making it completely impractical to implement. By excluding EA they gain some immediate wins, but over time they start to encounter problems integrating and scaling applications; with many new reliability and security problems surfacing.

    People will duck, weave when processes and architecture are complex, inflexible and overgoverned. It happens when you have rigid change advisory boards, standardization dictates and many other procedural roadblocks, which while not necessarily wrong, are often out of step with agile and DevOps practices. In the short term these dodges and workarounds might seem fine, but watch out when they’re accepted as “normal behavior” and start compromising the quality of applications.

    What’s your Cheat Score?

    To start addressing these issues build what’s called a cheat index – a scale from the ridiculous to the sublime measuring our tendency to introduce practices that circumvent established procedure or sub-optimal technologies. Doing so requires taking a Gemba Walk leaf out of the Lean book; traversing your software pipeline and observing all your poor practices, elements of waste and people behaviors - up, close and personal so to speak.

    Next up begin linking and correlating this metric/score to your key indicators of performance – lead times, deployment frequency, and customer conversions and so on; gaining a warts-and-all picture of the business outcomes from cheating. Be prepared for some surprises because you never know - some cheats might actually be beneficial. “Most people don’t want to do the wrong thing, but they will when process and procedure works against them”

    Now enact a series of initiatives designed to improve your cheat profile. These could be as simple (or difficult depending on your perspective) as education and training, but most likely involve automation to remove any constraints, bottlenecks and waste that cause people to cheat. Then it’s a case of ‘rinse and repeat’ – assessing the impact of initiatives, adjusting your goals/targets, and finding more opportunities for improvement.

    Most people don’t want to do the wrong thing, but they will when process and procedure works against them. Often the behavior isn’t seen as wrong; it’s just a “white cheat” needed to get a good job done. Any DevOps initiative should take this into account; examining the people factor at all times. Always consider that a culture is governed by behaviors – anything you can do to improve these will go a long way to increasing employee satisfaction and value.

    Weekly Brief

    loading
    Top 10 DevOps Solution Companies - 2019
    Top 10 DevOps Consulting/Services Companies -2019
    ON THE DECK

    DevOps 2019

    I agree We use cookies on this website to enhance your user experience. By clicking any link on this page you are giving your consent for us to set cookies. More info

    Read Also

    Reimagining Pension Services Through Responsible Innovation

    Reimagining Pension Services Through Responsible Innovation

    Maz Mirza, Chief Digital Officer, KWAP Malaysia
    Maritime: Beyond Systems, Beyond Seas

    Maritime: Beyond Systems, Beyond Seas

    Ron Fong, Cio, Station Satcom
    Human-Centered Innovation in the GenAI Era

    Human-Centered Innovation in the GenAI Era

    CJ Meadows, Head of Innovation-Asia, Executive Education Designer, Professor & Head of Mbaconsulting, S P Jain School Of Global Management
    The Art and Science of Selling

    The Art and Science of Selling

    Scott White, Senior Manager Sales and Marketing Operations, Airbus
    Responsible Data Leadership in an AI-Driven World

    Responsible Data Leadership in an AI-Driven World

    Gemma Dias, Head of Data Governance, Tyro Payments
    Driving Guest-Centric IT Innovation in Integrated Resorts

    Driving Guest-Centric IT Innovation in Integrated Resorts

    Ching Yip, Vice President of Information Technology, Hoiana Resort & Golf
    Microsoft-Covering People 360 Degrees...

    Microsoft-Covering People 360 Degrees...

    Khalid Nizami , Heads The Digital Transformation Center Of Excellence For Asia Pacific, Ecolab
    How Insurers Can Lead Digital Ecosystems and Better Meet Customer Needs Platforms Such as Microsoft Azure Can Help Companies Become Network Orchestrators

    How Insurers Can Lead Digital Ecosystems and Better Meet Customer Needs Platforms Such as Microsoft Azure Can Help Companies Become Network Orchestrators

    Chris Henderson, EY Asia-Pacific Data & Analytics Advisory, Partner
    Loading...
    Copyright © 2025 APAC CIOOutlook. All rights reserved. Registration on or use of this site constitutes acceptance of our Terms of Use and Privacy and Anti Spam Policy 

    Home |  CXO Insights |   Whitepapers |   Subscribe |   Conferences |   Sitemaps |   About us |   Advertise with us |   Editorial Policy |   Feedback Policy |  

    follow on linkedinfollow on twitter follow on rss
    This content is copyright protected

    However, if you would like to share the information in this article, you may use the link below:

    https://devops.apacciooutlook.com/cxoinsights/measuring-devops-where-are-you-on-the-cheat-scale-nwid-1890.html