Incenting Success in Technology Organizations
Tuesday, July 8th, 2008As we’ve discussed before in articles like Be A Leader!, the primary job of a CTO is to help the executive team maximize shareholder value. Notice our choice of verb in the last sentence, “maximize”. It is a much stronger word than what an average performing company would select – that word typically being “create”. Maximizing shareholder value is the goal of a high performing team – a team which desires to say that “no other team in our position could provide the type of shareholder return that we do”.
The CTO however cannot maximize shareholder value and potentially can’t even prove that he or she is creating shareholder value without a set of aggressive goals along with the metrics and measurements that help define success or failure enroute to achieving those goals.

We prefer to group our goals thematically, making it easier to determine how the goals impact the maximization of shareholder value. Our themes include the reduction of cost, availability, the efficiency of engineering spend, the effectiveness of our product selection process, quality, and time to market.
Cost
No list of aggressive goals is complete without finding a set of goals to minimize the cost of operating a SaaS site. In our experience, the best cost metrics are those normalized by transaction (cost per transaction) or normalized by cost of transaction type (cost per checkout, cost per signup, etc). The associated goal is to reduce the cost by some relative value over time or to reduce the cost to an absolute value thereby increasing profit and shareholder returns.
Availability
No SaaS site can realistically operate in this day and age without considering the impact of availability on revenue. Our desire here is to identify the lost opportunity (in most cases lost revenue) associated with outages rather than just the amount of downtime a site has. While measuring absolute downtime is valuable and should be tracked if possible, the measurement of revenue loss as a percentage calculation is more easily associated with shareholder value maximization (less revenue loss the better) and further takes into consideration that most sites don’t produce as much revenue in the middle of the night as they do during the middle of the day.
Engineering Efficiency and Productivity
You can’t be maximizing shareholder value if you aren’t measuring and improving your engineering team. These measurements are arguably difficult, but we try to break them into two component parts:
1) Efficiency - How many engineering days are you getting out of the theoretical maximum? This is a measurement of how many engineering days you lose due to environment issues, training problems, tool issues, etc. Most organizations that don’t measure this are surprised that their engineers spend well over 33% of their time on things other than designing systems and writing code.
2) Productivity - How much do you produce per engineering day? This one is tougher and there are lots of metrics out there from which you can select, KLOC, stories, function points, etc. All of them have issues, but that’s no excuse not to select the be