tdwi world conference - day 4
Today I was in new territories. I took both sessions on Data Requirements Analysis and Data Profiling for Reengineering, Knowledge Discovery, and Information Quality, both given by David Loshin. We spent the morning discussing (well, not me!) data discovery, data assessment, and data requirements. We went deep and in all details into David’s methodology. It felt like speaking a foreign language at an upper-intermediate level: I cold understand all we talked about, but missed several of the subtleties.
I was very impressed with the level of scrutiny data warehouse and BI people put in their assessment of the data quality. I think we should pay a little more attention about that in Web Analytics. Of course, we are talking here (BI) about a way more complex world. Still, I think we should do a better job at questioning our data. Looking at all that can and should be done with data assessment, I even wonder now how the ASP model is good for us, if we can’t have immediate and full access to the data/logs. I mean, when you stop thinking about it, what validates the accuracy of the results in Google Analytics? Yes, the brand. That’s it! No access to the data; got to trust Google that the numbers are good. Not acceptable to a professional web analyst I think. This means that the Omniture and WebTrends (OnDemand version) of this world should make it very easy to access the logs.
The afternoon session was basically focusing on what can go wrong with data. Wow! a lot, as you can imagine. I can’t go through the details of all that. It would be too long and I haven’t digest everything yet (if I ever will!). I was just extremely happy to be exposed to all that.
In early evening, I listen to a vendor panel featuring SAS, Business Objects, Oracle, MicroStrategy, IBI, and Cognos. Besides the very deep technical stuff their customers in the room asked them, they all agreed that text/verbatim analysis was very hot. Most of them are choosing to acquire vendors in that field instead of developing that capacity.
OK, that’s it for today. Tomorrow is going to be even deeper in the data. I wonder if I will emerge from this week in one piece…
Jacques Warren on May 14th 2008 in Business Intelligence, BI Applications, Events
Marketing Productivity Blog » Blog Archive » Jacques Warren @ TDWI responded on 15 May 2008 at 1:54 pm #
[…] of what happened, more like a model. At least from a Marketing perspective. A dose of reality like Jacques received can put this in […]
Chris G responded on 16 May 2008 at 9:14 am #
Jacques, this series of posts is excellent.
I want to call out what you said about having logs available for ASP WA solutions. There is nothing, absolutely nothing, more valuable than being able to look at the raw data. This is true when starting to set up analytics and later on when trying to understand something in the reports. WebTrends On Demand has an option for delivering logs to you (for a fee, unfortunately). Google Analytics definitely does NOT. I wonder about the others.
Of course, I’m really only speaking for people who care about accuracy …
Jacques Warren responded on 16 May 2008 at 9:38 am #
Hi Chris,
Yes, WebTrends will do it for a fee. I don’t know about Omniture and Coremetrics.