Blog: William McKnight Subscribe to this blog's RSS feed!

William McKnight

Hello and welcome to my blog!

I will periodically be sharing my thoughts and observations on information management here in the blog. I am passionate about the effective creation, management and distribution of information for the benefit of company goals, and I'm thrilled to be a part of my clients' growth plans and connect what the industry provides to those goals. I have played many roles, but the perspective I come from is benefit to the end client. I hope the entries can be of some modest benefit to that goal. Please share your thoughts and input to the topics.

About the author >

William is the president of McKnight Consulting Group, a firm focused on delivering business value and solving business challenges utilizing proven, streamlined approaches in data warehousing, master data management and business intelligence, all with a focus on data quality and scalable architectures. William functions as strategist, information architect and program manager for complex, high-volume, full life-cycle implementations worldwide. William is a Southwest Entrepreneur of the Year finalist, a frequent best-practices judge, has authored hundreds of articles and white papers, and given hundreds of international keynotes and public seminars. His team's implementations from both IT and consultant positions have won Best Practices awards. He is a former IT Vice President of a Fortune company, a former software engineer, and holds an MBA. William is author of the book 90 Days to Success in Consulting. Contact William at

Editor's Note: More articles and resources are available in William's BeyeNETWORK Expert Channel. Be sure to visit today!

Recently in Real-Time Category

I have noticed a pattern of repeated recommendation recently towards a more real-time information architecture for my clients. This is not a “push” recommendation. It’s a pull. End clients are becoming much more astute at being able to deal with real-time information and are demanding more of it. After years of knowing what to do with clean information once it is accessed, competitive pressures are forcing companies to try to access the information earlier in its cycle.

For some enterprise data warehouse oriented shops, the EDW is the first consideration in a real-time strategy. That is, moving some of the ETL selectively from batch to real-time. This is certainly a viable strategy, especially when data access investment has most predominantly occurred in the data warehouse environment, real-time feeds are feasible and data access in the operational environment, with EII for example, is not just really a better option.

In order to even consider the real-time EDW option for real-time information needs, there are key requirements that must be considered. Each side of the equation (operational environment and data warehouse) must be co-conspirators in the success of real-time sourcing. This mainly affects the operational environments, which are often old, fragile, expensive to upkeep and lacking in-house expertise. Ironically, these are often the reasons data is extracted from these systems to begin with, yet it also can be prohibitive to doing the sourcing in real-time. By the same token, I have also experienced real-time attempts with underpowered data warehouses where the data warehouse could not manage both loading and high query activity simultaneously. Sometimes partitioning strategies alleviate this concern, but not always.

There is no standard way of achieving real-time data warehouses. Some reschedule their “batch” ETL to run more frequently. This is feasible when the ETL has been designed well in the first place to “pick up where it left off” with the operational extracts, regardless of wall clock time. Others utilize EAI and EII technologies and are able to perform the extracts in the operational infrastructure with these.

Technorati tags: EDW, Real Time, data+warehouse, EII

Posted February 8, 2007 1:15 PM
Permalink | No Comments |

Search this blog
Categories ›
Archives ›
Recent Entries ›