{"id":2153,"date":"2017-02-04T14:52:33","date_gmt":"2017-02-04T20:52:33","guid":{"rendered":"http:\/\/www.designandexecute.com\/designs\/?p=2153"},"modified":"2022-09-15T00:03:05","modified_gmt":"2022-09-15T06:03:05","slug":"the-biggest-reason-why-reporting-fails-for-many-applications","status":"publish","type":"post","link":"https:\/\/www.designandexecute.com\/designs\/the-biggest-reason-why-reporting-fails-for-many-applications\/","title":{"rendered":"The Biggest Reason Why Data Science, Machine Learning and Business Intelligence Fails For Many Applications"},"content":{"rendered":"<div class=\"wp-playlist wp-audio-playlist wp-playlist-light\">\n\t\t\t<div class=\"wp-playlist-current-item\"><\/div>\n\t\t<audio controls=\"controls\" preload=\"none\" width=\"674\"\n\t\t\t><\/audio>\n\t<div class=\"wp-playlist-next\"><\/div>\n\t<div class=\"wp-playlist-prev\"><\/div>\n\t<noscript>\n\t<ol>\n\t\t<li><a href='https:\/\/www.designandexecute.com\/designs\/wp-content\/uploads\/2017\/02\/Biggest-Reason-Why-Business-Intelligence-Fails.mp3'>Biggest Reason Why Business Intelligence Fails<\/a><\/li>\t<\/ol>\n\t<\/noscript>\n\t<script type=\"application\/json\" class=\"wp-playlist-script\">{\"type\":\"audio\",\"tracklist\":true,\"tracknumbers\":true,\"images\":true,\"artists\":true,\"tracks\":[{\"src\":\"https:\/\/www.designandexecute.com\/designs\/wp-content\/uploads\/2017\/02\/Biggest-Reason-Why-Business-Intelligence-Fails.mp3\",\"type\":\"audio\/mpeg\",\"title\":\"Biggest Reason Why Business Intelligence Fails\",\"caption\":\"\",\"description\":\"\\\"Biggest Reason Why Business Intelligence Fails\\\".\",\"meta\":{\"artist\":\"Stephen Choo Quan\",\"album\":\"Design and Execute\",\"length_formatted\":\"2:25\"},\"image\":{\"src\":\"https:\/\/www.designandexecute.com\/designs\/wp-includes\/images\/media\/audio.svg\",\"width\":48,\"height\":64},\"thumb\":{\"src\":\"https:\/\/www.designandexecute.com\/designs\/wp-includes\/images\/media\/audio.svg\",\"width\":48,\"height\":64}}]}<\/script>\n<\/div>\n\t\n<p><span data-preserver-spaces=\"true\">Many Projects spend many resources in terms of time, effort, and money to collect and process business data. The developers spent 80% of the project time developing the software with little thought into reporting and analytics. The real question is, if the developer captures the data, then why are reporting and analytics still failing? Why is it so hard to get the data back out and tell valuable business stories?<\/span><\/p>\n<p><span data-preserver-spaces=\"true\">Using Domain-Driven Design (DDD) techniques, a good developer&#8217;s mindset starts coding at the business services layer. DDD means they are thinking about the business process and how to wrap the code around that flow. The end-user sees the UX, so that also gets lots of upfront attention. The user sends immediate feedback on using the application and how easy it is to use. Instant feedback will slant the development of awareness in favor of the UX and business process.<\/span><\/p>\n<p><span data-preserver-spaces=\"true\">&#8220;BEGIN WITH THE END IN MIND&#8221; \u2013 BILL INMAN<\/span><\/p>\n<p><span data-preserver-spaces=\"true\">Working code is only the first step in development but is shortsighted. The end game is extendable and maintainable code, where we spend 60% of our time in the software lifespan. There is minimal strategy given to the persistent data model or the database model. <\/span><\/p>\n<p><span data-preserver-spaces=\"true\">The end-user never sees the data store, and who cares how it is stored as long as the application can easily read and write to the database. The BI engine is then asked to report on, in most cases, a very normalized and silo data model.<\/span><\/p>\n<p><span data-preserver-spaces=\"true\">The only way to fix this issue is to have a data architect who thinks about both development and BI to design the model that the developer must use. <\/span><\/p>\n<p>The developer should read and write to a 3rd Normal Form designed database. Reporting should be on a star schema or snowflake design specific to reporting, ad-hoc queries, and machine learning. It is a small price to pay for getting on the BI&#8217;s superhighway once it becomes big data.<\/p>\n<h2><span data-preserver-spaces=\"true\">The most common pitfalls when Designing Data Models<\/span><\/h2>\n<ol>\n<li><strong><em>We do not need an analytics data model<\/em><\/strong><span data-preserver-spaces=\"true\">; we will copy the source system tables.<\/span><\/li>\n<li><span data-preserver-spaces=\"true\"><strong>We do not have a data modeler<\/strong>, so we do without and enjoy cost savings.<\/span><\/li>\n<li><strong><em>We built the data model already<\/em><\/strong><span data-preserver-spaces=\"true\">; we need reports now (if the data model does not reflect the report specifications and the general business requirements, then you did not design a model for your reporting)<\/span><\/li>\n<li><strong><em>We will use stored procedures<\/em><\/strong><span data-preserver-spaces=\"true\">; this is extremely limited and brittle, leading to more significant costs over time.<\/span><\/li>\n<li><span data-preserver-spaces=\"true\"><strong>We can get a talented new hire<\/strong>, who knows the technology tools, but this will rarely work unless the designer is a data modeler and a business analyst.<\/span><\/li>\n<\/ol>\n<p><strong><span data-preserver-spaces=\"true\">Thanks for reading and sharing \u2764<\/span><\/strong><\/p>\n<p><strong><span data-preserver-spaces=\"true\">Follow me on\u00a0<\/span><\/strong><a class=\"editor-rtfLink\" href=\"https:\/\/www.linkedin.com\/in\/stephenchooquan\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><span data-preserver-spaces=\"true\">LinkedIn<\/span><\/strong><\/a><strong><span data-preserver-spaces=\"true\">\u00a0|\u00a0<\/span><\/strong><a class=\"editor-rtfLink\" href=\"https:\/\/www.instagram.com\/taylorchooquan\/\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><span data-preserver-spaces=\"true\">Instagram<\/span><\/strong><\/a><strong><span data-preserver-spaces=\"true\">\u00a0|\u00a0<\/span><\/strong><a class=\"editor-rtfLink\" href=\"https:\/\/www.facebook.com\/stephen.chooquan\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><span data-preserver-spaces=\"true\">Facebook<\/span><\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Many Projects spend many resources in terms of time, effort, and money to collect and process business data. The developers spent 80% of the project time developing the software with little thought into reporting and analytics. The real question is, if the developer captures the data, then why are reporting and analytics still failing? Why [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2169,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32,31,7],"tags":[],"class_list":["post-2153","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bi-dashboards-analytics","category-bi-data-warehouse","category-faq"],"jetpack_featured_media_url":"https:\/\/www.designandexecute.com\/designs\/wp-content\/uploads\/2017\/02\/Corporate-Information-Factory.jpg","_links":{"self":[{"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/posts\/2153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/comments?post=2153"}],"version-history":[{"count":5,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/posts\/2153\/revisions"}],"predecessor-version":[{"id":15724,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/posts\/2153\/revisions\/15724"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/media\/2169"}],"wp:attachment":[{"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/media?parent=2153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/categories?post=2153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.designandexecute.com\/designs\/wp-json\/wp\/v2\/tags?post=2153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}