{"id":21216,"date":"2018-11-01T08:09:55","date_gmt":"2018-11-01T13:09:55","guid":{"rendered":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/"},"modified":"2018-11-01T08:09:55","modified_gmt":"2018-11-01T13:09:55","slug":"mining-the-ground-truth-of-enterprise-toolchains","status":"publish","type":"post","link":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/","title":{"rendered":"Project to Product: Mining the Ground Truth of Enterprise Toolchains"},"content":{"rendered":"<figure>\n<div class=\"feature-image\"><img decoding=\"async\" class=\"aligncenter size-full\" src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png\" alt=\"Project to Product: Mining the Ground Truth of Enterprise Toolchains\"><\/div>\n<\/figure>\n<p><span style=\"font-weight: 400\">To learn more<\/span> <span style=\"font-weight: 400\">about what works and what doesn&#x2019;t in large-scale DevOps and agile deployments, we need data. The problem is, that data is notoriously difficult to get ahold of because much of it lies hidden across numerous private repositories.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Efforts such as <\/span><a href=\"http:\/\/puppet.com\/resources\/whitepaper\/state-of-devops-report\"><span style=\"font-weight: 400\">The State of DevOps reports<\/span><\/a><span style=\"font-weight: 400\"> have helped us gain some understanding by using survey data to answer questions about practices such as the frequency of deployments in a team or organization. However, survey data has its limitations, as Nicole Forsgren and I described in &#x201C;DevOps Metrics,&#x201D; which we wrote to clarify the trade-offs of system and survey data collection.<\/span><span style=\"font-weight: 400\"><sup>1&#xA0;<\/sup>Today, our understanding of DevOps practices is based largely on this survey data and on anecdotal evidence. Is there a way to expand our view of DevOps to include studies of system data of DevOps at work?<\/span><\/p>\n<p><span style=\"font-weight: 400\">One approach is to examine publicly available repositories, such as those hosted by GitHub or the Eclipse and Apache foundations. However, the conclusions from this research are limited to how open source projects work. Large-scale and enterprise software delivery differs considerably from open source delivery in terms of the scale, scope, and type of work.<\/span><\/p>\n<p><span style=\"font-weight: 400\">In my PhD research, I initially studied open source developers.<sup>2&#xA0;<\/sup><\/span><span style=\"font-weight: 400\">Gail Murphy, my supervisor, pushed me to expand my study to professional developers in enterprise settings. Having spent most of my career doing open source development, I was shocked at how different the work was. The most interesting thing I learned was the additional complexity with which the professional developers worked on a daily basis. The number of applications, systems, processes, and requirements dwarfed anything I encountered in the much more elegant world of open source.<\/span><\/p>\n<p><span style=\"font-weight: 400\">In my article &#x201C;<a href=\"\/end-manufacturing-line-analogy\">The End of the Manufacturing Line Analogy<\/a>&#x201C;, I discussed how advanced car manufacturing relates to software production.<\/span><span style=\"font-weight: 400\"><sup>3&#xA0;<\/sup>One of the amazing things about car manufacturing is that the &#x201C;ground truth&#x201D; of production is visible on the factory floor. Walking the assembly line provides an instant view of the workflow. Where can we find the ground truth of enterprise software delivery? How might that ground truth change our understanding of what works and what fails in software delivery at scale?<\/span><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#Exploiting_the_Cambrian_Explosion_of_Tools\" >Exploiting the Cambrian Explosion of Tools<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#Value_Stream_Integration_Diagrams\" >Value Stream Integration Diagrams<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"Exploiting_the_Cambrian_Explosion_of_Tools\"><\/span><b>Exploiting the Cambrian Explosion of Tools<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400\"><a href=\"\/a-cambrian-explosion-of-devops-tools\">In my last post<\/a>, I summarized how a &#x201C;Cambrian explosion&#x201D; has led to the proliferation of hundreds of DevOps tools.<\/span><span style=\"font-weight: 400\"><sup>4&#xA0;<\/sup>One key reason for this explosion is how specialized the tools have become for various stakeholder needs. For example, a large enterprise might have a dozen different specialists involved in software delivery, such as Java experts, AWS (Amazon Web Services) experts, design experts, or support staff. There&#x2019;s now a specialized tool for each role.<\/span><\/p>\n<p><span style=\"font-weight: 400\">That presents an interesting opportunity. The more that these tools are used, the more those particular practitioners&#x2019; work is captured within them. If only we could get at that data, we would have a unique chance to better understand how DevOps, and software delivery in general, works in practice.<\/span><\/p>\n<p><span style=\"font-weight: 400\">The challenge is that such end-to-end system data is inaccessible. It&#x2019;s hidden behind organizations&#x2019; firewalls or locked in private repositories. Occasionally, a vendor will have a slice accessible&#x2014;for example, a software-as-a-service support desk tool vendor might have cross-company information on support tickets. However, that&#x2019;s only one slice of the value stream; it misses all the development and other upstream data and does not provide an end-to-end view.<\/span><\/p>\n<p><span style=\"font-weight: 400\">In my study of open source and professional developers, the trick was to use the developers&#x2019; access to tool repositories as a proxy for what was happening in those repositories. But, again, that was just a slice of the value stream. However, through that experiment, I realized I had access to exactly the people who had visibility into the end-to-end set of repositories: the enterprise IT tool administrators.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Value_Stream_Integration_Diagrams\"><\/span><b>Value Stream Integration Diagrams<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400\">My company Tasktop works closely with many enterprise IT tool administrators responsible for the agile and DevOps toolchain. Each engagement that our solutions architects undertake results in the creation of a <\/span><i><span style=\"font-weight: 400\">value stream integration diagram<\/span><\/i><span style=\"font-weight: 400\">. The first time I looked at these diagrams in aggregate, I realized I had a data-set that was as interesting as the one Gail and I collected during my PhD studies. These diagrams depict each of the tool repositories in the value stream, each artifact type stored in those repositories, and, most important, how the artifact types are related. These diagrams were collected not through an academic study but through a data collection process put in place for working with the enterprise IT tool administrators and their tools. The data is biased toward Tasktop&#x2019;s customers and prospects, who tend to be <\/span><i><span style=\"font-weight: 400\">Fortune<\/span><\/i><span style=\"font-weight: 400\"> 500 enterprise IT organizations seeking integration across one or more tools.<\/span><\/p>\n<figure id=\"attachment_9892\" aria-describedby=\"caption-attachment-9892\" style=\"width: 731px\" class=\"wp-caption alignnone\"><img class=\"lazyload\" alt height=\"1314\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/11\/tasktop-value-stream-architecture-diagrams.png\"><figcaption id=\"caption-attachment-9892\" class=\"wp-caption-text\">FIGURE &#xA0;1. &#xA0;Value-stream-integration &#xA0;diagrams. These diagrams &#xA0;depict an organization&#x2019;s tool &#xA0;repositories, each artifact type &#xA0;stored in the repositories, and how &#xA0;the artifact types are currently related &#xA0;or are planned to be related.<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400\">Tasktop has collected 308 of these diagrams. Figure 1 shows some of them. They&#x2019;re a fascinating window into the ground truth of enterprise toolchains. As such, they might inform future efforts in the collection of software delivery data in interesting ways. Here, I provide a very high-level overview of what we learned from them. A more detailed analysis will appear in my upcoming book&#xA0;<\/span><a href=\"http:\/\/projecttoproduct.org\/\"><i><span style=\"font-weight: 400\">Project to Product<\/span><\/i><\/a><span style=\"font-weight: 400\">.&#xA0;<\/span><\/p>\n<p><span style=\"font-weight: 400\">The diagrams provide a moment-in-time summary of each tool in the value stream and information on what the key artifacts captured in each tool are, as well as how they are or should be connected. The diagrams do not exhaustively list all the tool repositories in an organization or all the artifact types. Nor do they provide information about the data in those tools&#x2014;for example, the number and types of defects. But they do provide the ground truth about the composition of these organizations&#x2019; enterprise IT toolchains.<\/span><\/p>\n<p><span style=\"font-weight: 400\">There could be relevant tools outside this set. For example, these organizations have only recently been reporting vulnerability tracking tools as part of their DevOps tool-chains. A tool&#x2019;s absence from the results doesn&#x2019;t mean that it wasn&#x2019;t present, just that it wasn&#x2019;t considered for inclusion in the organization&#x2019;s view of the connected value stream at that time.<\/span><\/p>\n<p><b>What the Data Revealed<\/b><\/p>\n<p><span style=\"font-weight: 400\">The diagrams were sourced from Tasktop customers and prospects defining what tools and artifacts they wanted to connect. The majority of the diagrams came from enterprise IT organizations in the Fortune 1000. Table 1 shows the industry breakdown.<\/span><\/p>\n<p><img class=\"lazyload\" alt height=\"822\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/11\/tasktop-table-1-industry.png\"><\/p>\n<p><span style=\"font-weight: 400\">Table 2 lists the types of tools used. As expected, agile-planning and application lifecycle management (ALM) tools dominated, but IT service management, project portfolio management, and requirements management also formed a key part of the toolchains. Requirements management tools continued to see significant use, even in the age of agile and DevOps. In contrast, initiatives to connect customer relationship management (CRM) and security tools were still rare. Al-together, the dataset included the use of 55 tools.<\/span><\/p>\n<p><img class=\"lazyload\" alt height=\"814\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/11\/tasktop-table-2-tool-type.png\"><\/p>\n<p><span style=\"font-weight: 400\">Even more interesting is what information was tracked in the tools. Table 3 provides insight into the artifacts created and thus the types of work. At a high level, imagine these artifacts corresponding to the widgets that flow through the various tools that perform software delivery. In an upcoming article, I&#x2019;ll discuss the relevance of these various types of artifacts.<\/span><\/p>\n<p><img class=\"lazyload\" alt height=\"1094\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/11\/tasktop-table-3-artifacts.png\"><\/p>\n<p><span style=\"font-weight: 400\">Combining the data from Tables 2 and 3, we observed that the artifacts spanned multiple tools. For example, features were tracked across agile, ALM, requirements management, and sometimes IT service management tools. We interpreted this as another indication that the number of tools and their specialization in large-scale agile and DevOps environments are growing. However, the types of artifacts being stored in those tools (see Table 3) is considerably smaller, and the artifacts tend to span multiple tools. For example, a single defect can span agile, ALM, requirements management, and IT service management tools.<\/span><\/p>\n<p><img class=\"lazyload\" alt height=\"668\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/11\/tasktop-table-4-tool-usage.png\"><\/p>\n<p><span style=\"font-weight: 400\">Some of the most interesting findings are in Table 4. We see that only 1.3 percent of organizations used a single tool. More interestingly, 69.3 percent of the organizations were connecting artifacts across three or more tools. The more surprising finding was that more than 42 percent of the organizations needed to integrate four or more tools, indicating the complexity involved in developing large-scale enterprise software. It also supports the notion that specialization of roles in software development is common.<\/span><\/p>\n<p><span style=\"font-weight: 400\">What&#x2019;s clear from this dataset is that in these organizations, heterogeneous agile and DevOps toolchains are the norm. Also, the Cambrian explosion of DevOps I mentioned correlates with the breadth of tool usage this dataset revealed. However, the organizations&#x2019; value streams consist of a more common set of artifacts, many of which span multiple tools. This raises a range of questions on how these artifacts flow, how they interrelate, and what it means for them to span tools and stakeholders. For more on this data, and key lessons learned, see the full learnings summarized in <\/span><i><span style=\"font-weight: 400\">Project to Product<\/span><\/i><span style=\"font-weight: 400\"> by clicking on the front cover below:<\/span><\/p>\n<figure id=\"attachment_9890\" aria-describedby=\"caption-attachment-9890\" style=\"width: 257px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/projecttoproduct.org\/\"><img class=\"lazyload\" alt height=\"366\" data-src=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/p2p-1st-ed-cover-hr.jpg\"><\/a><figcaption id=\"caption-attachment-9890\" class=\"wp-caption-text\">Click image to pre-order a copy!<\/figcaption><\/figure>\n<p><b>Sign up to the Product To Project newsletter<\/b><\/p>\n<p><span style=\"font-weight: 400\">This is the fifth blog in a series promoting the genesis of my book <\/span><a href=\"https:\/\/www.amazon.com\/gp\/product\/1942788398\/ref=as_li_qf_asin_il_tl?ie=UTF8&amp;tag=itrevpre-20&amp;creative=9325&amp;linkCode=as2&amp;creativeASIN=1942788398&amp;linkId=ffdc9afd5d2bc7ae3d2336db701fd0c0\"><i><span style=\"font-weight: 400\">Project To Product<\/span><\/i><\/a><i><span style=\"font-weight: 400\">. <\/span><\/i><span style=\"font-weight: 400\">If you missed the previous blogs,&#xA0;<\/span><a href=\"\/mik-kersten\"><span style=\"font-weight: 400\">click here<\/span><\/a><span style=\"font-weight: 400\">. To ensure you don&#x2019;t miss any further content, you can receive future articles and other insights delivered directly to your inbox by signing up to the <\/span><a href=\"https:\/\/go.tasktop.com\/Mik-Kersten-List-Signup.html\"><span style=\"font-weight: 400\"><em>Project To Product<\/em> newsletter<\/span><\/a><span style=\"font-weight: 400\">.<\/span><\/p>\n<p><b>References<\/b><\/p>\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">N. Forsgren and M. Kersten, &#x201C;DevOps Metrics,&#x201D; <\/span><i><span style=\"font-weight: 400\">ACM Queue<\/span><\/i><span style=\"font-weight: 400\">, vol. 15, no. 6, 2018; queue.acm.org\/detail.cfm?id53182626.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">M. Kersten and G.C. Murphy, &#x201C;Using Task Context to Improve Programmer Productivity,&#x201D; <\/span><i><span style=\"font-weight: 400\">Proc. 14th ACM SIGSOFT Int&#x2019;l Symp. Foundations of Software Eng.<\/span><\/i><span style=\"font-weight: 400\"> (SIGSOFT\/FSE 06), 2006, pp. 1&#x2013;11; dl.acm.org\/citation.cfm?id51181777.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">M. Kersten, &#x201C;The End of the Manufacturing-Line Analogy,&#x201D; <\/span><i><span style=\"font-weight: 400\">IEEE Software<\/span><\/i><span style=\"font-weight: 400\">, vol. 34, no. 6, pp. 89&#x2013;93.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">M. Kersten, &#x201C;A Cambrian Explosion of DevOps Tools,&#x201D; <\/span><i><span style=\"font-weight: 400\">IEEE Software<\/span><\/i><span style=\"font-weight: 400\">, vol. 35, no. 2, pp. 14&#x2013;17.<\/span><\/li>\n<\/ol>\n<p><b><i>A version of this article was originally published in the May\/June 2018 issue of IEEE Software<\/i><\/b><b>: M. Kersten, &#x201C;Mining the Ground Truth of Enterprise Toolchains,&#x201D; &#xA0;<\/b><b><i>IEEE Software<\/i><\/b><b>, vol. 35, no. 3, pp. 12-17,&#xA0;<\/b><b>&#xA9;2018 IEEE&#xA0;<\/b><b>doi:&#xA0;10.1109\/MS.2018.2141029<\/b><b>&#xA0;&#x2013;&#xA0;<\/b><a href=\"https:\/\/ieeexplore.ieee.org\/document\/8354424\"><b>Original article<\/b><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>To learn more about what works and what doesn&#x2019;t in large-scale DevOps and agile deployments, we need data. The problem is, that data is notoriously difficult to get ahold of because much of it lies hidden across numerous private repositories. Efforts such as The State of DevOps reports have helped us gain some understanding by&#8230;<\/p>\n","protected":false},"author":222,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","footnotes":""},"categories":[9547,521,9544,9543],"tags":[],"class_list":["post-21216","post","type-post","status-publish","format-standard","hentry","category-devops-teams","category-lean-agile","category-project-to-product-shift","category-value-stream-management"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.4 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Project to Product: Mining the Ground Truth of Enterprise Toolchains | Tasktop Blog<\/title>\n<meta name=\"description\" content=\"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Project to Product: Mining the Ground Truth of Enterprise Toolchains\" \/>\n<meta property=\"og:description\" content=\"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/\" \/>\n<meta property=\"og:site_name\" content=\"Planview Blog\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/pages\/Planview-Inc\/89422974772\" \/>\n<meta property=\"article:published_time\" content=\"2018-11-01T13:09:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png\" \/>\n<meta name=\"author\" content=\"Mik Kersten\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Planview\" \/>\n<meta name=\"twitter:site\" content=\"@Planview\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mik Kersten\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/\"},\"author\":{\"name\":\"Mik Kersten\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#\\\/schema\\\/person\\\/6be5164e0beb8c6fe553a8baed3610c1\"},\"headline\":\"Project to Product: Mining the Ground Truth of Enterprise Toolchains\",\"datePublished\":\"2018-11-01T13:09:55+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/\"},\"wordCount\":1756,\"publisher\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/media.planview.com\\\/tasktop_blog\\\/wp-content\\\/uploads\\\/2018\\\/10\\\/mik-kersten-project-to-product-blog-series-850x357.png\",\"articleSection\":[\"DevOps Teams\",\"Enterprise Agile Planning\",\"Project to Product Shift\",\"Value Stream Management\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/\",\"url\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/\",\"name\":\"Project to Product: Mining the Ground Truth of Enterprise Toolchains | Tasktop Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/media.planview.com\\\/tasktop_blog\\\/wp-content\\\/uploads\\\/2018\\\/10\\\/mik-kersten-project-to-product-blog-series-850x357.png\",\"datePublished\":\"2018-11-01T13:09:55+00:00\",\"description\":\"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#primaryimage\",\"url\":\"https:\\\/\\\/media.planview.com\\\/tasktop_blog\\\/wp-content\\\/uploads\\\/2018\\\/10\\\/mik-kersten-project-to-product-blog-series-850x357.png\",\"contentUrl\":\"https:\\\/\\\/media.planview.com\\\/tasktop_blog\\\/wp-content\\\/uploads\\\/2018\\\/10\\\/mik-kersten-project-to-product-blog-series-850x357.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/mining-the-ground-truth-of-enterprise-toolchains\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blog.planview.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Project to Product: Mining the Ground Truth of Enterprise Toolchains\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#website\",\"url\":\"https:\\\/\\\/blog.planview.com\\\/\",\"name\":\"Planview Blog\",\"description\":\"Leading the conversation on digital connected work\",\"publisher\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blog.planview.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#organization\",\"name\":\"Planview\",\"url\":\"https:\\\/\\\/blog.planview.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blog.planview.com\\\/wp-content\\\/uploads\\\/2015\\\/06\\\/planview-logo-black.png\",\"contentUrl\":\"https:\\\/\\\/blog.planview.com\\\/wp-content\\\/uploads\\\/2015\\\/06\\\/planview-logo-black.png\",\"width\":280,\"height\":66,\"caption\":\"Planview\"},\"image\":{\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"http:\\\/\\\/www.facebook.com\\\/pages\\\/Planview-Inc\\\/89422974772\",\"https:\\\/\\\/x.com\\\/Planview\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blog.planview.com\\\/#\\\/schema\\\/person\\\/6be5164e0beb8c6fe553a8baed3610c1\",\"name\":\"Mik Kersten\",\"description\":\"Dr. Mik Kersten started his career as a Research Scientist at Xerox PARC where he created the first aspect-oriented development environment. He then pioneered the integration of development tools with Agile and DevOps as part of his Computer Science PhD at the University of British Columbia. Founding Tasktop out of that research, Mik has written over one million lines of open source code that are still in use today, and he has brought seven successful open-source and commercial products to market. Mik\u2019s experiences working with some of the largest digital transformations in the world has led him to identify the critical disconnect between business leaders and technologists. Since then, Mik has been working on creating new tools and a new framework - the Flow Framework\u2122 - for connecting software value stream networks and enabling the shift from project to product. Mik lives with his family in Vancouver, Canada, and travels globally, sharing his vision for transforming how software is built, and is the author of Project To Product, a book that helps IT organizations survive and thrive in the Age of Software.\",\"url\":\"https:\\\/\\\/blog.planview.com\\\/author\\\/mik-kersten\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Project to Product: Mining the Ground Truth of Enterprise Toolchains | Tasktop Blog","description":"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/","og_locale":"en_US","og_type":"article","og_title":"Project to Product: Mining the Ground Truth of Enterprise Toolchains","og_description":"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?","og_url":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/","og_site_name":"Planview Blog","article_publisher":"http:\/\/www.facebook.com\/pages\/Planview-Inc\/89422974772","article_published_time":"2018-11-01T13:09:55+00:00","og_image":[{"url":"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png","type":"","width":"","height":""}],"author":"Mik Kersten","twitter_card":"summary_large_image","twitter_creator":"@Planview","twitter_site":"@Planview","twitter_misc":{"Written by":"Mik Kersten","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#article","isPartOf":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/"},"author":{"name":"Mik Kersten","@id":"https:\/\/blog.planview.com\/#\/schema\/person\/6be5164e0beb8c6fe553a8baed3610c1"},"headline":"Project to Product: Mining the Ground Truth of Enterprise Toolchains","datePublished":"2018-11-01T13:09:55+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/"},"wordCount":1756,"publisher":{"@id":"https:\/\/blog.planview.com\/#organization"},"image":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#primaryimage"},"thumbnailUrl":"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png","articleSection":["DevOps Teams","Enterprise Agile Planning","Project to Product Shift","Value Stream Management"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/","url":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/","name":"Project to Product: Mining the Ground Truth of Enterprise Toolchains | Tasktop Blog","isPartOf":{"@id":"https:\/\/blog.planview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#primaryimage"},"image":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#primaryimage"},"thumbnailUrl":"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png","datePublished":"2018-11-01T13:09:55+00:00","description":"How do we find the ground truth of enterprise toolchains to understand what works and what fails in software delivery at scale?","breadcrumb":{"@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#primaryimage","url":"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png","contentUrl":"https:\/\/media.planview.com\/tasktop_blog\/wp-content\/uploads\/2018\/10\/mik-kersten-project-to-product-blog-series-850x357.png"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.planview.com\/mining-the-ground-truth-of-enterprise-toolchains\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.planview.com\/"},{"@type":"ListItem","position":2,"name":"Project to Product: Mining the Ground Truth of Enterprise Toolchains"}]},{"@type":"WebSite","@id":"https:\/\/blog.planview.com\/#website","url":"https:\/\/blog.planview.com\/","name":"Planview Blog","description":"Leading the conversation on digital connected work","publisher":{"@id":"https:\/\/blog.planview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.planview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blog.planview.com\/#organization","name":"Planview","url":"https:\/\/blog.planview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.planview.com\/#\/schema\/logo\/image\/","url":"https:\/\/blog.planview.com\/wp-content\/uploads\/2015\/06\/planview-logo-black.png","contentUrl":"https:\/\/blog.planview.com\/wp-content\/uploads\/2015\/06\/planview-logo-black.png","width":280,"height":66,"caption":"Planview"},"image":{"@id":"https:\/\/blog.planview.com\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/pages\/Planview-Inc\/89422974772","https:\/\/x.com\/Planview"]},{"@type":"Person","@id":"https:\/\/blog.planview.com\/#\/schema\/person\/6be5164e0beb8c6fe553a8baed3610c1","name":"Mik Kersten","description":"Dr. Mik Kersten started his career as a Research Scientist at Xerox PARC where he created the first aspect-oriented development environment. He then pioneered the integration of development tools with Agile and DevOps as part of his Computer Science PhD at the University of British Columbia. Founding Tasktop out of that research, Mik has written over one million lines of open source code that are still in use today, and he has brought seven successful open-source and commercial products to market. Mik\u2019s experiences working with some of the largest digital transformations in the world has led him to identify the critical disconnect between business leaders and technologists. Since then, Mik has been working on creating new tools and a new framework - the Flow Framework\u2122 - for connecting software value stream networks and enabling the shift from project to product. Mik lives with his family in Vancouver, Canada, and travels globally, sharing his vision for transforming how software is built, and is the author of Project To Product, a book that helps IT organizations survive and thrive in the Age of Software.","url":"https:\/\/blog.planview.com\/author\/mik-kersten\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/posts\/21216","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/users\/222"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/comments?post=21216"}],"version-history":[{"count":0,"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/posts\/21216\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/media?parent=21216"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/categories?post=21216"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.planview.com\/wp-json\/wp\/v2\/tags?post=21216"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}