Adobe Analytics, Analytics Strategy, Conferences/Community

Great news from Web Analytics Wednesday!

Wow, once and awhile in life you get involved in something that turns out differently than you had planned. I’ve written about this in the past, but for me Web Analytics Wednesday is one of those things

Web Analytics Wednesday was started by my good friend (and soon-to-be-new-mom!) June Dershewitz and I back in 2005 with little expectation of success. Our goal? To give web analytics professionals around the world the means and motivation to gather locally and get to know each other.

Now, in 2009, by every measure we have succeeded and even exceeded expectations, having helped create regular Web Analytics Wednesday events in places like New York, San Francisco, Boston, London, Toronto, Paris, Madrid, Copenhagen, Stockholm, Sao Paulo, Sydney and smaller cities like Austin, Texas, Columbus, Ohio, and Nashville, Tennessee. These events were attended by over 4,500 web analytics professionals around the world in 2008 alone and 2009 is off to a great start with over 600 total attendees in January alone.

In 2008 we decided to do more to help Web Analytics Wednesday events get off the ground in more cities and to provide more financial support to as many groups as possible. We were able to do this with the generous support of Coremetrics and SiteSpect, the Web Analytics Wednesday Global Sponsors. Both of these companies had already been hosting events around the world, and senior management from both turned out to be enthusiastically supportive of Web Analytics Wednesday.

Today I am incredibly pleased to announce that the Web Analytics Wednesday Global Sponsors have joined Analytics Demystified in making a donation to Operation USA. This donation of roughly $1 per Web Analytics Wednesday participant was made in recognition of the relative success many in the web analytics industry have enjoyed in the context of the challenges faced by our fellow man, woman, and child across the globe.

Personally I have been blessed with a healthy family, a rich life, and moderate success in business, and thus have frequently been able to make charitable contributions. But as we all know, as the economy worsens, charities are often the first to feel the pinch despite the fact that an increasing number of people around the world need the support of groups like Operation USA. Because of this, I am incredibly grateful to Joe Davis, CEO of Coremetrics, and Eric Hansen, CEO of SiteSpect for their willingness to match my $1,500 contribution on behalf of both of their companies.

I hope everyone who hosts, sponsors, and participates in Web Analytics Wednesday will take the time to thank Coremetrics and SiteSpect for their generosity, either by commenting on this post or by emailing the companies directly.

On behalf of Analytics Demystified, June, our Global Sponsors, and all the Web Analytics Wednesday hosts we wish you all the best in 2009 and hope you’re able to make it out to an event near you soon!

Analytics Strategy, Conferences/Community

Thoughts on the proposed IAB Guidelines

UPDATE ON JANUARY 19, 2009: Peter Black from BPA Worldwide who was also on the IAB working group with Josh Chasin, wrote in and disagrees with Chasin’s characterization of who the “Unique User” language is targeting. I have email into the IAB and MRC’s George Ivie to clarify the situation. Watch this blog!

UPDATE ON JANUARY 18, 2009: Josh Chasin from comScore, who was a member of the IAB working group that defined the guidelines described in this post, wrote in to point out that I misinterpreted the IAB’s intent. While their web site clearly says …

“The IAB believes that all companies involved in audience measurement should be audited for their processes.  These audits are intended to establish the source of any measurement discrepancies and to find potential solutions.

All measurement companies that report audience metrics have a material impact on interactive marketing and decision-making. Therefore, transparency into these methodologies is critical to maintaining advertisers’ confidence in interactive, particularly now, as marketers allocate more budget to the platform.”

… according to Chasin the IAB is excluding web analytics vendors from “all companies involved in audience measurement” and the type of companies  that have a material impact on interactive marketing and decision-making. Since this doesn’t sound right to me at all I will warn the reader that some of the questions I raise in the following post may, in fact, be totally irrelevant (at least in the context of the IAB Proposed Measurement Guidelines.

If nothing else, with two days left in the open comment period, the IAB may want to use my confusion as an example and clarify the target for the recommendations made in the document.

Reader beware!

As long as we’re talking about web analytics standards I figured I would take the opportunity to offer up a few thoughts on the Interactive Advertising Bureau’s Audience Reach Measurement Guidelines that are open for public comment until January 20th. If you haven’t had a chance to read these proposed guidelines you should, especially if you have an interest in how we collectively communicate about data.

At 34 pages the document is certainly a slog to read–and I say this knowing full well that I have a tendency to write 50 page white papers! Since you’re all bright folks I’m just going to address some of the proposed language that stood out to me.  And, as always, if you have any thoughts or positions on the proposed guidelines I’d love to hear from you!

Starting in Section 1.2 the IAB clarifies the relationship between “Unique Cookies”, “Unique Browsers”, “Unique Devices” and “Unique Users / Visitors”.  The discussion about “Unique Devices” is interesting because this is a clear indication of the impact that mobile devices like the iPhone are having on audience measurement.  Things start to get really interesting, however, in Section 1.2.4 where the IAB says (emphasis mine):

“However, in order to report a Unique User, the measurement organization must utilize in its identification and attribution processes underlying data that is, at least in a reasonable proportion,, attributed directly to a person. For instance, data collected from registrants is one possible source that can be utilized in creating a Unique Users measure by a census-based measurement organization, if registrants represent a reasonable proportion of the total user-base and when appropriate scientific projection methods are used for non-registrrants (sic).  In no instance may a census measurement organization report Unique Users purely through algorithms or modeling that is not at least partially traceable to information obtained directly from people, as opposed to browsers, computers, or any other non-human element.

Did you get that? Keep in mind that while at JupiterResearch I was among the first to publicize the decline in accuracy of visitor counting due to cookie deletion. In fact the report was subtitled “Addressing the Decline in Accuracy of Cookie-Based Measurement.” At the time people called me crazy and Seth Godin even accused me of living in an echo chamber (I have since forgiven Seth.)

Now, three years later, the IAB is expressly telling measurement vendors to stop reporting a metric called “Unique Visitors” or “Unique Users” unless they have a research-based strategy for determining the correct proportion of cookies to “real people” and have applied that calculation in a transparent way.

Whoa.

Think about this for a minute. Every one of the fine census measurement packages (nee web analytics) out there is reporting a Unique Visitor number, but I’ll go out on a limb here and propose that none of them are even vaguely adhering to the IAB proposed definition of a “Unique Visitor.”  I’ll go a step further and postulate that, at least in the base offerings, these vendors don’t currently have the technical capability required to report an estimated/algorithmically derived “Unique Visitor” count based on scientific projection methods.

If I’m wrong about this I suspect I’ll hear about it, but I don’t think I’m wrong when it comes to the base offerings like SiteCatalyst, WebTrends Web Analyics, Coremetrics 2009, etc.  And yes, I’m aware that end-users can use higher-end products like Discover on Premise and the data warehousing tools to apply a correction factor to UV counts, but that is not what the IAB is saying. This guideline is saying that correcting for cookie, browser, and device-related over-counting of unique visitors is the responsibility of the measurement vendor.

Again, whoa.

And as if that’s not a radical enough move, the document goes on to state in Section 2.2 that the vendors need to actually break out these correction factors across three components: first-cookie acceptance, deletion, and browser denial (again, emphasis mine):

Cookie deletion rates, calibration methods and sources or estimation methods used to account for first-use, deletion, and non-accepting cookie groups should be disclosed by the audience measurement organization. The audience measurement organization should disclose census-based unique cookie counts and the estimated unique activity from first-use, deletion and non-accepting cookie groups separately and in aggregate. If the measurement organization relies on a unified model that makes reporting among these separate groups impossible, it may report these counts in aggregate only, but should be prepared to demonstrate in an audit the ability of its unified model to address each type of cookie completely.”

The IAB goes on in Section 2.4 to start to push web analytics into what is an uncomfortable position for some people, the use of algorithms and data models, to better report on unique visitors:

“As noted above, Publishers and Ad-servers will generally need to rely on algorithms (data models) to estimate the number of users attributable to the counts of Unique Cookies they develop. The underlying basis for this algorithm should be a study of actual users (i.e, people).  Ideally, such a study would be based on direct contact and/or observation of people using the browser at the time of accessing web-site content or ads with the unique cookie, as well as observation of the number of browsers in use by these users.  Additionally, inferences will need to be made about advertising activity of users with non-cookied browsers, so these types of users should also be contacted and observed.  Also, the activity of users who access content from multiple locations (home, work, school) on different browsers should be factored into these algorithms.”

Finally, the IAB is telling the vendors they need to report the results of their research to their customers, essentially exposing flaws in their technology for all to see:

“The resulting study should be representative of, and projectable to, the users of the web-site or property, and periodically re-performed to reflect gradual changes in audience.  Known weaknesses in the projection processes should be disclosed to users of Audience Reach Measurements.

If  you’re keeping track, the IAB is telling the vendors A) to completely change their definition of “Unique Visitors”, B) to start to actively research sources of inaccuracy on behalf of their customers, and C) pro-actively report known weaknesses in their system to their customers. Anyone want to place any bets on when the vendor community will adopt these recommendations? I’m going to be a little snarky here and put my money on “never in a million years.”

Seriously you have to love the IAB for putting this out there.  Unlike the Web Analytics Association’s Standards which I believe are an excellent start but are a little soft in areas, the IAB is basically telling the measurement vendor community that they are doing the entire world a disservice by reporting unique visitor counts that are complete bollocks and they need to stop doing that post-haste! Okay, maybe I’m over-reading the document but the scope of changes required for any vendor to become IAB-compliant is dramatic, both technically and psychologically.

I’m not sure if Brandt Dainow had seen the IAB proposal when he besmirtched the fine work of the Web Analytics Association’s Standards Committee, but if you compare the two proposal documents (the WAA’s proposal can be found here in PDF form) you will detect a noticable difference.  Personally I’m glad that my good friend Judah Phillips bridged the gap between the IAB and WAA and I find myself wondering, at least a little bit, whether the IAB+WAA relationship should be even deeper.

This all brings me to an excellent point that Bryan Robertson made on my last post on standards regarding how standards are defined and moved into common use. Bryan’s thesis is based on the W3C’s move from HTML 1.0 to XHTML and his point is that this transition to the XHTML standard came about because of A) a powerful standards body, B) a vocal community, and C) passionate thought leaders.  Regarding a powerful standards body, Bryan specifically make a point that other folks have made, usually behind closed doors:

“Is the WAA powerful enough at this point in time, or do we need to continue to build momentum before the standards can be more bold? For example, is the WAA hand wringing too much over the polite “we’ll share with you if you share with us” arrangement with the IAB over standards definitions? Is the WAA in a tough position in trying to bring practitioners and vendors together at the same table?”

Bonus points to Bryan for willing to be direct on the conflict of interests arising from having two masters, vendor and practitioner.  Again, I have nothing but profound respect for Angie and all of the other members of the WAA Standards Committee, but since I do know that vendors participated in the definition process I wonder a little bit how much impact they really had.

Anyway, I’m doing all the talking here and it’s a beautiful day so I will ask what you all think — either about the IAB proposal, Brandt Dainow’s assertion, Bryan’s thesis about the strength of the WAA, or anything else that strikes your fancy. Do you think the IAB standard for “Unique Users” has a snowball’s chance of being widely implemented? Do you think Brandt Dainow makes a good point (even if he does it in a lousy way)? Do you think the WAA may be better off working more closely with the IAB on Standards, given the IAB’s relative might?

My site host assures me that my comments table will not crash again so I look forward to hearing from you all.

Analytics Strategy, Conferences/Community

Sad to say, I partially agree with Brandt Dainow

Readers who are enthusiastic members of the web analytics community are by now familiar with Brandt Dainow and his sometimes antagonistic missives published at iMediaConnection. While I try pretty hard to follow the old “if you can’t say something nice” rule I occasionally fail in my efforts. Perhaps the best evidence of my failing was my calling Brandt Daniow insane when he suggested that Google Analytics version 2.0 was “simply a quantum leap above any other analytics product on the planet.”

While I firmly believe that Google Analytics is a great, valuable, and appropriate application for a wide range of needs, I think that Dainow’s “quantum leap” claim and statements like “What Google has done is simply take every feature in every product on the market and put them all into one system, and then make it available for free” are so obviously hyperbolic that they beg criticism (which Mr. Dainow got in spades from many within the analytics community.)

Dainow has since turned on Google Analytics, more recently pointing out what he describes as “disturbing inaccuracies behind Google Analytics” and again getting our  attention with irresponsible statements like “Google Analytics is different from other products in that it has been intentionally designed by Google to be inaccurate over and above the normal inaccuracies that are inevitable.

Oddly enough, his rant about Google Analytics included some statements that rubbed members of the Web Analytics Association the wrong way.  When folks like Jodi McDermott commented on the article and questioned some of Dainow’s assertions, Brandt did what any normal person would do …

… he wrote a nasty follow-up piece critical of the Web Analytics Association and the WAA Standards Committee!

I will let you read his piece yourself, but the two-sentence summary of Dainow’s opinion is that “the work of the WAA standards committee is a disaster for the web analytics community. It will take years to undo the damage and create proper precise standards that can be implemented in software. The WAA “standard” is not a standard, it’s just second-rate muttering.

Clearly Dainow is not worried about making friends in the web analytics industry.

I personally am a big fan of the Web Analytics Association.  I am pretty loyal to some of the current Board of Directors, I’ve done a bunch in the past to support the WAA and am about to announce more of the same, and I’ve even gone out of my way to help promote the work of the Web Analytics Association Standards Committee.  So it is was with great trepidation I wrote this article’s title … but I find myself agreeing with one small part of Dainow’s otherwise unnecessary rant.

Towards the end of his article, right before he declares that some pretty nice people’s work has been little more than time wasted, he says this:

The WAA should be setting the agenda, not following the crowd. The task of the WAA standards committee should be to determine how web analytics metrics should be calculated in order to achieve the highest degree of precision possible. The WAA should be laying out the roadmap for the way things should be. It then falls to the vendors to bring their software into line.”

I more or less made this same comment, although I like to believe I used a great deal more tact, when I commented on the original Web Analytics Association Standards published under the direction of former Director Avinash Kaushik back in August 2007.

At the time I preferred to focus on the reality of the situation–the fact that the WAA had proposed a set of standard definitions that, for good or ill, were better than anything else out there.  Instead of being openly critical of the definitions as written, I preferred to ask the question, “Now that we have these definitions, what are we going to do with them?”

While my call for a web analytics standards compliance matrix has since been answered by all of the major vendors except for Omniture, I personally don’t believe that the Standards process is serving the needs of our community as best possible.  We all continue to be vexed by a lack of standard definitions, a situation that will likely get worse with the decline of the web analytics economy.

Not having participated in the process of drafting the WAA Standards I can only express gratitude towards those members of the community who have volunteered  their valuable time for this work.  In my humble opinion, people like Jason Burby and Angie Brown are to be congratulated for their efforts, not denigrated and accused of having set our industry back into the dark ages.

But, in the spirit of having an open mind and building consensus, I would be interested in hearing my reader’s collective thoughts on Dainow’s point that the WAA should be setting standards without regard to their practicality today. Put another way, should the Association have written definitions that would be robust and useful in an analytics context and then presented that guidance to the entire community–vendor, consultant, and practitioner alike–saying “this is the result we should all be working towards.”

For example, should the WAA have been more explicit in their definition of a “visit” and proclaim that a visit is terminated after 30 minutes of inactivity, instead of saying “if an individual has not taken another action (typically additional page views) on the site within a specified time period, the visit will terminate by timing out.”  Being explicit about the timeout duration would make a clear statement about our collective expectation for the definition of a visit, and any technology or analysis that choses to use a timeout other than 30 minutes would also need to justify their decision to eschew the WAA Standard for another value.

I know that the WAA is doing the best they can, and I am enthusiastic about the work Angie, Judith and their fellow volunteers have all been doing.  But I do think Dainow’s assertion that standards should be set based on overall value to the community in the long run, not necessarily the near-term practicality, is worth exploring.  Taking this approach would definitely penalize some vendors and reduce their self-generated “compliance score” but it does kind of make sense to be working collectively towards a more precise set of definitions we can all work from.

Doesn’t it?

These are the kinds of conversations that aren’t just magically resolved and so I’m sure we’ll have to add this to the list of issues worthy of discussion the next time we all meet.  I’m sure it will come up at some of the upcoming vendor events, in San Jose at Emetrics, and likely at our own web analytics conference, the X Change (where last year Forrester analyst John Lovett led a conversation on the topic.)

As always I welcome your thoughts, feedback, open disagreement, pointing out flaws in my logic, etc.  I consider myself fortunate to have such thoughtful and experienced analytics practitioners among my most loyal readers and sincerely hope Dainow’s otherwise disturbing rant will lead to something of value for our community.

Conferences/Community, General

Interview with Corry Prohens of IQ Workforce

If there was once clear statement made this past Tuesday with the election and overwhelming mandate given to President-elect Barack Obama it was that people around the world are concerned about the economy. In fact, it feels as if we’ve gone well beyond President Clinton’s “It’s the economy, stupid” statement back in the early 90’s and have arrived at “It’s the economy, period.”

Given the number of conversations I have had with web analytics professionals lately about layoffs, offered severance packages, buying slowdowns and the like I wanted to check with a friend who works directly on the front lines of the web analytics economy: Corry Prohens from IQ Workforce.

Corry is giving a presentation at Judah Phillip’s Web Analytics Wednesday event in Cambridge on November 12th and in since I can’t make it to Boston for the event I recently asked Corry a handful of questions about web analytics, the practitioner market, and IQ Workforce’s new Contractor Exchange. Corry is a great guy and I’m sure he’d be happy to answer any questions about his responses if you want to pose them in the comments section following this post.

My questions are posed in bold and Corry’s responses follow:

Corry, one thing on people’s minds is how investment and use of web analytics is being affected by the economic downturn. What are you seeing out there?

We are seeing a shift in the market away from hiring and toward contract / interim talent.  Many companies have official or unofficial hiring freezes in place.  Those that don’t have added steps to the approval process for new hires, making recruiting processes much longer than a year ago.  In the meantime, the work has to get done and there is a pretty consistent drum beat out there for more measurement, accountability and improved ROI.  The result has been an explosion in the contract / freelance market.

At the same time, supply is increasing.  The web analytics community is maturing, so there are more and more practitioners that have reached the point in their career development where they are qualified to “go independent”.  Even people that are gainfully and “permanently” employed are looking for part-time freelance gigs on the side in this economy.

This is creating a perfect storm of both supply and demand.  It is tying up more than 50% of my team’s time these days, whereas contract work used to be about 15% of our business.

On the perm side things are steady and unspectacular.  Demand is still strong, but there are snags and delays and fits and starts with almost all of our jobs as our clients reevaluate and redefine their needs repeatedly before making hiring decisions.  I don’t think you would find a huge drop in the number of web analytics jobs out there, but there is no doubt that the average time-to-hire has skyrocketed.

Do you have any bold predictions about how the market will change in 2009 for A) experienced web analytics practitioners looking for new jobs, B) web analytics consultants and C) companies looking to hire experienced web analytics talent?

I don’t think these are very bold, but here goes…

  1. The market for interim talent will likely continue to grow and thrive;
  2. The permanent market will likely stay relatively strong.  It will not be anything like the mania that was out there for the last few years, but make no mistake about it – web analytics is still a hot skill set.  Demand will far outpace the rest of the job market;
  3. Remote / virtual office positions will continue to grow more popular;
  4. Convergence between site analytics, optimization and offline analytics (and mobile analytics??) will continue in jobs and practitioners’ skill sets.

The rest will depend on how quickly and how sharply the rest of the economy improves.

Speaking of practitioners, there is an odd conversation going on in the Yahoo! group about qualifications for web analytics practitioners.  What are the top five things YOU are looking for when you get resumes?

I can understand why this is a major debate because there is a lot of variation in web analyst jobs. Depending on where web analytics resides in the organization, the structure, the size of the company, the culture, the tools, etc. the top 5 will shift quite a bit.  There are not that many vanilla web analyst jobs – many of them are tied in with testing & optimization, offline & customer data analysis, search marketing, ad serving, database skills, etc.  In general, the smaller the company the bigger the job (the more things skills they are looking for / hats the candidate will wear).

Companies also look for specific vertical market expertise, or experience in their “type” of site (subscriber, free media, ad driven, Internet retail, lead generation, etc.)

Unrealistic expectations are common.  Many companies still don’t get web analytics.  If they are relatively new (as a company or as individuals) to web analytics, there is a tendency to lump hard-to-find skills together into a mountain and create impossible-to-fill positions.  We try to be good consultants on this issue, but sometimes a job has to stay open for 6-months before a company reevaluates their requirements.  HR people, in particular, seem to have a hard time distinguishing between requirements and wish lists.

In general we look for someone that has tool expertise, communication / interpersonal skills (these jobs are increasingly front-office), analysis & presentation skills and some complimentary kicker (testing, SAS, SQL, search marketing, development skills, search marketing skills, etc.) based on what our clients need at the moment.  One of our biggest gaps to bridge is location – not skills.  There are lots of great people out there and we are often working out ways to get them relocated or set up in virtual office jobs.

If you had to pick only two criteria likely to help practitioners land great jobs in this economy, what would those criteria be?

If I were a web analyst I would learn how to use SAS to manipulate data & models.  I would also try to pick up experience in  testing/optimization.  Having one (or both) of these would open a lot more doors than a straight WA skill set.

I keep getting email about rates for consultants out there.  I know what I charge, but what are you seeing in the market on an hourly and daily basis?  Does that change by geography or experience?  Or if you blog are you able to charge more?

If blogging enabled me to charge more I wouldn’t have to work anymore.

There is a big difference between consultants and contractors.  What you do and what we do should not be compared.  In fact, we are  careful not compare ourselves with any web analytics consultancy.  If you look companies like Stratigent, Technology Leaders, or the interactive agencies, they are approaching the client’s problems in a very different way.

If a client knows what they need and they have somewhat of a plan for how to get it done, they can hire a contractor / freelancer that has the expertise to execute.  This person will work on a time & materials basis and there will not be any guarantee for deliverables.

If a client doesn’t know what they don’t know and they need a company to perform a broader range of services, such as:  conducting an assessment, creating a roadmap and a strategy, specking out a project, etc. They should use a full-service consulting company and pay the freight.  Their resources are theoretically backed-up by expertise in the rest of the firm and they provide some kind of a guarantee around deliverables.

The contractors that we currently have on billing range from $55/hour to $110/hour.  From what I have seen, the full service consultancies and pro services groups charge anywhere from $125 – $300/hour for equivalent expertise along with all of the value-add that I mentioned above.

You just launched a contractor’s exchange at IQ Workforce.  Tell me about that?

We had to do something to streamline our contracting business.  The volume of candidates and requirements that we were getting was becoming unmanageable.  The Contractor Exchange is basically our way of more efficiently marketing our inventory of interim talent to the community.

We ask our contractors to post their credentials on our website.  Our team approves the postings and then we market the profiles to the marketing and analytics executives in our network.

One of the biggest problems for contractors is staying billable – it is very hard to sell and deliver at the same time.  The Contractor Exchange is a free way for contractors and freelancers to gain visibility to an extremely relevant audience so that we can generate opportunities for them.


Thanks to Corry for taking the time to answer my questions. Please check out the IQ Workforce web site if you’re looking for help hiring web analytics talent (IQ Workforce sponsors the Analytics Demystified Job Board and we’re mighty grateful for that!)

Analytics Strategy, Conferences/Community

WAA Standards Update: Thursday, November 6th

ANOTHER UPDATE: WebTrends just posted their own WAA Standard’s compatibility matrix at the new WebTrends blog. I have to say that when I first suggested that we needed a vendor-by-vendor assessment of Standards compliance back in August of last year I didn’t think it would take this long for the information to materialize. That said, despite the wait I’m glad to see most of the vendors stepping up!  I suppose I expect to have to update this post again when Omniture and Nedstat publish their information.

UPDATE: Coremetrics just posted a press release that describes their application’s WAA Standards compatibility at their web site. With Coremetrics participating in the creation of a global standards compliance matrix the only remaining vendors that need to provide this type of documentation are Omniture, WebTrends, and Nedstat.

One of the key challenges we face as an industry is without a doubt the lack of standard terms and definitions applied across different vendor solutions. John Lovett from Forrester led a huddle for us at the X Change conference this past August and the subject just keeps coming up.

The fine folks at the Web Analytics Association are actively trying to do something about this situation and have recently published a draft update of the WAA Standard Definitions.  When the definitions were first published back in August of last year I offered hearty congratulations but also commented that standards without any kind of transparency or enforcement are unlikely to be applied in any meaningful way.

Since that post three companies have publicly offered up any kind of documentation regarding their level of standards compliance — IndexTools (now Yahoo Web Analytics), Google Analytics (via Justin Cutroni at EpikOne), and most recently Unica (thanks Akin!) — but I am hopeful that this is about to change.  I am hopeful because of a conversation I had at Emetrics with Angie Brown, the head of the Standards Committee.

Angie and the Standards Committee will be presenting the updated definitions on Thursday, November 6th at noon Eastern / 9:00 AM Pacific.  I think this call is open to everyone (Angie, correct me if I’m wrong) but to help build awareness for this call and the Standards Committee in general I was lucky enough to interview Angie.  My questions (in bold) and Angie’s answers follow.

Tell me a little bit about the recent update to the standards document?

We took the feedback we received from last year — emails, blog postings, rumors, etc. — and revisited each of our original 26 definitions. This review caused us to drop one term (the distinction between “single page visits” and “single page view visits”, too confusing and not useful), we added four terms (frequency, recency, conversion rate, and impressions), and we spent the majority of the last year comparing our definitions with the tools we use in our everyday jobs.

As a result of the review, we’ve included a list of “ask your vendor” questions where we’ve been able to identify different methodologies used by different tools.

Who are some of the key people working on this project with you?

There are so many wonderful contributors on the Standards Committee. Most meetings have 8-12 participants, and they change over time based on employment status, workload, travel schedules, etc. But we do have a core group of people who joined way back in 2006 — Judith Pascual (my co-chair extraordinaire), Aseem Patel, Anna Long, and Bob Russotti — who are still active in the committee today. We have many newer members that contributed tons to this document as well, but having some continuity as we move from version to version to version has been critical.

We are also fortunate to have had outstanding guidance, enthusiasm, and representation on the WAA Board while we worked on this document, first from Avinash Kaushik and now from our current Director, Robbin Steif.

Which of the web analytics vendors are participating in the project?

Both Coremetrics and Unica are regular participants: Coremetrics since early 2006, and Unica since early 2007. A representative from Omniture came to our last meeting, and we’re looking forward to more participation from him in the future. I had a chance to talk with some of our other WA vendors at eMetrics last week, and hope we can get them interested.

Can you describe some of the ways the definitions/this work have been adopted so far?

I have heard from several vendor contacts that people are asking about compliance with the WAA definitions when sending out web analytics RFPs. We’ve also heard from people who have distributed the definitions throughout their company so everyone has a common terminology when discussing analytics.

Even more gratifying is the response from the international web analytics community, especially in Europe. Their WA market is much more fragmented than it is here in the US, with a larger variety of tools, so having common terminology is even more meaningful. One of our vendor members has a customer who translated the document into French on their own so they could share it with their coworkers! A high priority for next year is to work with the International Committee to get our document translated into other languages.

Awhile back I congratulated you on the work but complained that there needed to be teeth behind the document.  Since that time only IndexTools (who’s CTO is now a WAW Board member) and Google Analytics (via Justin Cutroni from Epik) have produced any kind of documentation describing their application’s compliance with WAA definitions.  Why do you think the other vendors are slow to respond?

I applaud both Dennis and Justin for taking that initiative without any prodding, and I think it says volumes about both men and the companies they represent. To be fair, I should mention that both Unica and Coremetrics also presented comparisons to the committee as part of their regular participation, although neither has published their results publicly. (NOTE: Unica has since published their comparison via Akin Arikan’s Multichannel Marketing Metrics blog.)

I’m merely speculating on why there hasn’t been more public response, but I suppose it’s because we haven’t asked them point blank to do so. However, this will change. Part of the feedback we’re soliciting from the industry this year will include a letter to each of our WAA member vendors asking them for comparisons, and we intend to publish the responses through the committee. The only reason we haven’t done this yet is because we’re putting the finishing touches on some scenarios (more detail later) that we also want our vendors to address.

Do you support the idea I proposed of a “Percent Standards Compliant” rating for every web analytics application/vendor?  If so, why?  If not, why not?

For now, the committee’s focus is on transparency over compliance. When the “ask your vendor” questions are answered, and the scenarios addressed, we will be able to include methodologies in the definitions in such a way that an overall percent compliance will be more meaningful. I’m not opposed to the idea, nor would I try to discourage anyone else from doing so; I just think it’s premature. Here’s why:

Our current definitions are broad, and we know that vendors use different calculations. In fact, that’s the whole reason we created the “ask your vendor” questions. There are also cases where the metrics described are not exposed in “standard” reports, but can be easily configured by the analyst in some tools. Or situations where a concept exists, but is called something else or simply isn’t exposed in the tool. Because of that broadness, I don’t think percentages calculated today will be different enough from vendor to vendor to provide much differentiation. Or worse yet, “compliance” for specific metrics will be open to interpretation.

For example, look at both Dennis’ and Justin’s responses to our “Return Visitor” definition. Dennis says IndexTools does not comply, while Justin says Google Analytics does. Because they’ve given good explanations (yay transparency!), it’s clear that both tools treat this concept in a similar manner: neither exposes the “return visitor” in the tool, but rather the visits made by returning visitors. If that’s the prevailing way this concept is exposed in the other tools, then it’s not so much a matter of compliance/non-compliance (an argument can be made either way, and indeed both interpreted compliance differently), but perhaps we on the Standards Committee should be defining Return Visits instead of Return Visitors.

So while I want the vendors to publicly tell the web analytics community how their tools stack up to our definitions, it will be as much about informing our Standards as about compliance.

What’s next for the standards document and standards committee?

1) Finish scenarios (more info below) and submit to vendors
2) Keep soliciting industry and vendor feedback on our 9/22 document (download it here)
3) Once feedback has been incorporated, work with the WAA International Committee to translate the final document into other languages

One of the more interesting things we’re doing right now is creating scenarios to find out how situations are handled in different tools. Not only will this provide critical information for practitioners who are transitioning from one tool to another (yes, we’ll publish the replies), but it will form the basis for more specific methodology-based standards.

For example, if the only activity a visitor performs on a site is a non-page event, do our tools count this activity as a visit, and what are the properties of this visit (entry/exit/duration)? Another example concerns average time on site: does the tool include bounced visits, and if so what value is used for these visits (zero? an estimate based on non-bounced views?)?

These are just two of the many situations where tools make different calculations that ultimately affect the numbers you use in your analysis, and why running multiple tools on the same site can lead an analyst to drink. But before we address how we should calculate, it will be beneficial to know the different ways we do calculate.

We’ll talk more about the scenarios during our upcoming WAA Webcast on Thursday, November 6, “Web Analytics Standards Update.” You can sign up on the WAA Site.

How can my readers help the WAA and the standards committee out?

Your readers can help us by giving us feedback. If the document is useful, please tell us. If not, what can we do better? Feedback can be broad or it can be specific to a certain metric. Ultimately, standards need to help the web analytics practitioner, and if we’re not on the right track we need to know.

Download the latest document from our WAA Standards Committee Page. If you attended eMetrics Stockholm or DC, you received a paper copy in your bag. We’ve started a blog post soliciting public comments on the WAA site. Other ways to provide feedback are by email (standards at webanalyticsassociation dot org), participating in our webcast, or starting a discussion about a specific term on the Web Analytics Forum.

There are so many bloggers in our space right now that if feedback consists solely of a post on one’s own blog or a comment on someone else’s, we may not find it so please drop us a line or post a comment on the WAA Blog to let us know.

Anything I forgot to ask you?

I want to expand a bit on the issue of standards with “teeth.” Above, I mentioned that we are more interested in transparency than compliance right now, but I don’t want to mislead anyone and make them think compliance isn’t important. It is, and compliance is our ultimate goal.

However, our industry is still young. There are any number of industry reports that will tell us most of the major tools provide similar basic functionality. A competent analyst can get valuable business insights out of any of them. And compliance to standards most certainly carries a cost, not just to vendors who will have to rewrite scripts and database queries, but to practitioners who will have to explain to their stakeholders why a number they’ve been reporting for years as 11.5 is suddenly 9.2.

Not having that happen any more is one of the best arguments for standards, but in order to get there we’re all going to have to get through the transition. The Committee wants to make sure that the standards are well-vetted, reasonable, and that they ultimately benefit the practitioners of our trade and confer a competitive advantage on vendors who comply. After all, if nobody complies, then why bother with standards?

As I discussed above with my Return Visitors vs. Return Visits example, if we find that the industry is already used to seeing a concept expressed a certain way, we’re not interested in forcing the entire industry to change their mind if both metrics are equally valuable. In that case, we want to standardize on the metric that people already find useful. We can’t do that without your feedback. And we can’t be sensitive to changes we’re asking from vendors if they don’t tell us how they do things right now. We have tried to figure it out for ourselves, but honestly? Most vendor documentation sucks.


Again, you can register to attend the WAA Standard’s Committee webcast on Thursday, November 6th by going to the Web Analytics Association web site.  Thanks again to Angie for taking the time to answer my questions!

Adobe Analytics, Conferences/Community, General

I am honored to be speaking at Emetrics

Those of you following me on Twitter and Facebook have probably noticed that I’m spending much of October on the road.  After delivering the keynote address at ForeSee Results excellent Digital Citizen 2008 conference for the public sector I hopped on a flight to London to deliver the keynote at Coremetrics European client summit.

While in London I was able to join over 170 bright, motivated, and extremely nice web analysts from Europe at what turned out to be the biggest non-Emetrics Web Analytics Wednesday event ever.  This event was everything that I have ever hoped that Web Analytics Wednesday would be — extremely well organized by the kind folks at SCL Analytics, featuring great  talks from senior folks from the vendor, practitioner, and consulting community, held in a fantastic location thanks to the generosity of Coremetrics.  An absolutely perfect evening!

Thanks again to Chris and the team at SCL, Renata and the team at Coremetrics Europe, and everyone who participated in the event.

I have one more private event on Friday but what I’m really, really excited about is getting to present (again) at Jim Sterne’s Emetrics Marketing Optimization Summit in Washington, D.C.  I am proud to say that, aside from Jim, I may be the only person in the world who has attended every single North American Emetrics.

Despite having heard it all and seen it all and started helping Semphonic promote and produce the X Change, I would never consider for a moment skipping this great event.  This year Jim was kind enough to allow me to present to a combined track in the big room on Tuesday so I will be delivering a brand new presentation titled “Competing on Web Analytics.”  Drawing on Tom Davenport’s great work in HBR and his own book, this presentation more than any I have given in the past brings our practice together and presents a clear, concise roadmap for success.

If you’re coming to Emetrics I hope you’ll join me Tuesday at 11:10 AM in Room Plaza ABC.

When I was describing my travel schedule to a friend last night he asked me point blank “Why do you do it? Why do you travel to so many Web Analytics Wednesdays and conferences, spending hundreds of days a year on the road to evangelize for web analytics and support the web analytics community?”

Easy. I love what I do!

Because I love what I do, it would never occur to me to skip an Emetrics. Sure, I’d love Jim to pay my speaker’s fee and yeah, I’d love a keynote speaker’s slot now and again. But after 10 years in this industry I’m clear that the web analytics sector is bigger than me, Jim, or any vendor, consultant, practitioner, author, or blogger.  Emetrics provides a twice-a-year touchpoint for a large part of our community, and Emetrics is the event that gave me, Avinash Kaushik, Bryan Eisenberg, Jason Burby, Jennifer Veesenmeyer and many more the opportunity to establish our personal and professional brands.

So for me, and I think this is true for most of my peers, it’s not a question of whether we’ll be at Emetrics, it’s only a question of what we’ll talk about.

Because of the things I’ve learned at Emetrics, I promote and support Web Analytics Wednesday to give back to the larger community.  By facilitating the Global Sponsorship, by supporting emerging events around the planet, by helping local hosts plan more engaging events, and by attending as many WAW events as humanly possible I am able to take much of what I’ve learned at Emetrics and put it into action on a larger scale.

The support of my friends, partners, and co-sponsors is allowing Analytics Demystified help to keep the web analytics community together when we’re not at Emetrics.  In 2008 we are going to beat our goal of 5,000 attendee, making Web Analytics Wednesday the largest gathering of web analytics professionals worldwide. Web Analytics Wednesday works because everyone’s intentions are pure — hosts want to have a nice event, participants want to network, and the sponsors want to support the WAW community.

Simple.

So I hope you’ll come see me at Emetrics next week, or at least join June, Jim and I at what will likely be the biggest Web Analytics Wednesday ever next Wednesday at the conference hotel.  Emetrics is the conference for everyone, so I look forward to seeing all of you there.

Conferences/Community

Recap on the X Change

This week’s X Change conference in San Francisco was very successful, at least by my measure, and I wanted to briefly summarize some of what I saw and heard for those of you who couldn’t join us.

  • Before the event, Bill Gassman from Gartner commented to me “the more things change,  the more things stay the same.”  While the technology has become more sophisticated and the practitioner base (at least the sample represented at X Change which clearly skewed towards expert status) become more experienced, internal process and organizational challenges continue to dominate the conversation and negatively influence our ability to get the job done.
  • For sophisticated companies, there are still many questions but far fewer answers.  Campaign attribution, data privacy, reconciling panel-based and census-based methodologies, data sharing and integration, and I’m sure hundreds more topics are on our minds but in many cases some critical connection cannot/has not been made
  • Points #1 and #2 aside, some of us are doing amazing things with web data!  I was amazed at some of what I heard regarding how companies are evolving their use of web analytic data.  Despite the difficulty associated with many aspects of doing our jobs, some members of the larger web analytics community are definitely Competing on Web Analytics and will undoubtedly raise the bar higher and higher.
  • All in all, the expert analytics community appears to be a pretty happy bunch.  Nobody was complaining about layoffs or lack-of-budget, at least not that I heard.  The complaints I did hear were typical: “our vendor promised this but has not delivered”, “we simply cannot find qualified people”, and “this stuff is a lot harder than some people make it out to be.”

We will be publishing a document in the next few months providing a much more detailed look at what was discussed at the X Change (watch my blog for details) but if any of you participated in the event and have other insights please feel free to leave them below in comments.

I am tremendously honored to be a partner in the X Change conference and look forward to helping produce the conference for years to come.  If you missed the event this year, don’t make the same mistake twice.  Keep watching my and Gary Angel’s blog for details about X Change 2009!

Adobe Analytics, Conferences/Community

The X Change is nearly sold out!

I was surprised to learn this morning that there are fewer than 10 open registrations left at the 2008 X Change conference in San Francisco August 17, 18, and 19.  We set the limit for the conference at 100 paid attendees to ensure an intimate setting and for the ten of you who are able to complete your registration in the next few days I can assure you that decision will pay off in a big way.  This year’s conference has attracted some of the best companies and most experienced practitioners working in the field today, and despite the generally lousy economic climate, has folks coming from as far away as Sydney, Australia to participate in the conversation.

If you’re already registered for the event, don’t forget to return your huddle selection forms, your tete-a-tete requests, and the list of questions that you’d like to ask our distinguished analyst keynote panel!

If you’ve been considering the event, don’t delay: Register now and join us at the 2008 X Change!

Adobe Analytics, Conferences/Community

Additional networking events at the X Change

Since we’re about two weeks away from X Change 2008 I wanted to bring a few networking events that will be happening around the conference, one for participants only and the other for anyone in the Bay Area who wants to join us!

For X Change conference attendees we’ve added a networking reception on Monday afternoon that will occur concurrent to the “Expert Tete-a-Tete” event already planned.  Gary Angel, the CTO of Semphonic and our partner in the X Change has a great write up in his blog about the tete-a-tete.   When conference participants are done chatting with the great expert vendors and consultants who will be in attendence they’ll be able to join their peers in a private networking event designed to promote additional idea sharing and communication over wine and cheese or similar goodies.

For those you in the Bay Area unable to join us at the X Change, June Dershewitz is throwing another gala Web Analytics Wednesday event in conjunction with the conference but that is open to all web analytics practitioners.  Last time we had a conference-associated WAW in San Francisco it was crazy with over 400 attendees.  Hopefully this time things will be a little more subdued … you can sign up to join us at the official Web Analytics Wednesday web site.

Hopefully I will see some of you reading my blog at one or the other of these events, or both!

Analytics Strategy, Conferences/Community, General

Forrester acquires JupiterResearch

I wanted to say congratulations to David Schatsky and the team at JupiterResearch, as well as the fine folks at Forrester Research, on the news of FORR’s acquisition of JupiterResearch announced this morning.  Forrester has acquired a great asset and a great group of analysts, researchers, and operational staff, and it was very encouraging to read David Schatsky’s post on the subject, especially:

“Jupiter’s employees are also going to benefit from the combination with Forrester. Forrester execs have enthusiastically expressed to me their respect for the quality of our staff and are eager for us to become part of the expanded company. Jupiter folks will reap the benefits of being part of a larger organization, with its rich resources, track record of effective execution, and commitment to employee growth and career development.”

Somewhat ironic that FORR has been actively looking for someone to cover web analytics since Megan Burns (who will be at the upcoming X Change conference) has transitioned to cover customer experience more broadly.  John Lovett, in my humble opinion, will make a great Forrester analyst and was almost certainly the best candidate for the job … <grin>not that Mr. Colony should have paid a $23M bonus to his current employer.</grin>

While I am excited for all involved, this combination of companies does raise one specific concern within the web analytics sector: Instead of three independent voices in the community providing an objective assessment of the competitive landscape that can be compared and contrasted over time, now there will be only two, Forrester’s view and Gartner’s view.

Don’t get me wrong, I have a tremendous respect for all involved here — otherwise I would never have advocated for inviting Megan, John, and Bill to keynote the upcoming X Change 2008 conference I’m a partner in.  But I do have some small concern that the market’s view of the vendor landscape will soon be defined by one fewer data points, especially since Gartner has not done a formal Magic Quadrant on the sector recently (although Bill did publish a market note on web analytics on July 3rd that I assume is available to Gartner clients.)

I suppose my fears may be unfounded, but given the unusual (and perhaps unreasonable) amount of weight vendors, consultants, and companies alike seem to put on these constellations, waves, and magic quadrants, the loss of one-third of the available information may have implications that won’t manifest for quite some time.  In the context of the consolidation our industry has gone through in the last 24 months, I think technology buyers are even more likely to look for that “objective” viewpoint and rely on published research.

Wait and see, I guess, but I have a few new questions to ask Megan, John, and Bill in a few weeks at the X Change!

Regardless, I’m excited for the folks at Forrester and JupiterResearch and sincerely hope the acquisition proves fruitful for all involved.

Adobe Analytics, Analytics Strategy, Conferences/Community

John Payne is running for WAA Board of Directors

Those of you in the WAA are hopefully aware that due to Avinash Kaushik’s untimely resignation the Web Analytics Association is currently having a special election.  While the entire organization without a doubt misses Avinash’s charisma, spirit, and great passion for measurement, a great slate of folks have been nominated to replace Mr. Kaushik.  While I don’t know all the candidates personally, I have had the great pleasure to work with one for several years now: John Payne from Coremetrics.

I first met John years ago while he was at IBM SurfAid and I was at WebSideStory.  I was privileged to work directly with John and his team while I was an analyst at JupiterResearch, as I am again privileged to work with John on occasion now that I have started my own company.  And while I have tremendous respect for Akin Arikan, Dennis Mortensen, and Mark Wachen based on my past interactions with each, I can think of few people who would add more value to the current WAA Board of Directors than John Payne.

John was gracious enough to answer a few questions I had about his candidacy and qualifications despite being on a well-deserved vacation in Alaska.

EP: Tell us briefly about your work in the web analytics industry?

JP: Well I am probably the one with the most tenure in web analytics … note I avoided saying the oldest, which is also true 😉 I co-founded IBM’s Web analytics solution (SurfAid) in 1996.  In that role I have been involved in all aspects of delivering web analytics.  I am intimately familiar with the data and the challenges associated with performing meaningful, actionable analysis.  I am currently responsible for Product Management at Coremetrics.

EP: Why are you running for the WAA Board of Directors?

JP: Because of my experience in working with the data and how to build a viable solution around this data, I bring a unique and seasoned perspective to WAA. I am at a point where I want to help the larger web analytics community become more productive and effective.

EP: What three things do you believe make you the one candidate to vote for in this election?

JP: I am hands on … I know the data, the challenges,  the level of effort required to make the reports meaningful.  While I have been doing this a long time, I also see a vision for how this can evolve in the future, to capabilities such as analytics across domains that result in targeted content and predictive modeling for more effective content delivery.  Thirdly, my experience will help guide WAA to deliverable that will hopefully have higher value to its members and the larger web analytics community.

EP:  How do you feel about term limits for WAA Board members?

JP: Term limits are a great idea because a regular infusion of new energy and talent will keep the WAA more vital and relevant.

EP: Some have accused the WAA of being somewhat close-minded and having a “not invented here” attitude, something that has the potential to negatively impact the community as a whole. Can you tell me if you encounter this how you might approach the problem?

JP: Each idea needs to be assessed on its own merit. I would encourage full review and dialogue of all new ideas before any rendered decision.

EP: What is your favorite thing about web analytics?

JP: I really enjoy “playing” with the data and “torturing it until it confesses!”  Really, web site visitor behavior does not lie, and I enjoy finding the story that causes the web marketing team to grim with excitement as they lay out a strategy and measure their success.

EP: What is your least favorite thing about web analytics?

JP: I am always disappointed by some portion of the community who just wants answers without being willing to “bond” with their data and the tools that they need top use.  I guess my disappointment stems from the fact that I enjoy doing “deep data dives” so much!

EP: Thanks a ton John, now back to your vacation and best of luck in the election!

Those of you in the WAA should have an email from the association titled “Re: WAA Board of Directors Special Election – Voting Period Now Open” with your ballot ID.  Hopefully all of you will take the time to vote in this special election and show your support for John, Akin, Dennis, Nicholas, or whichever candidate you choose.

VOTE NOW IN THE WAA SPECIAL ELECTION (you will need your ballot ID and to log in to the WAA extranet)

Analytics Strategy, Conferences/Community, General

Jim Sterne, the Godfather of Web Analytics

In 2007 when Eric Enge asked Google’s Avinash Kaushik about me I was humbled when Avinash responded, “You know that Eric is obviously a leader in the industry. We are all following the trail that Eric has blazed. He is just an awesome guy and a really great thinker.”  But while I appreciate the sentiment, I think that Avinash got one part of this wrong: We are all following the trail that Jim Sterne blazed.

Jim, for the three of you who don’t know him already, is an accomplished author, an internationally known public speaker, the founder of the hand’s-down most popular conference on web analytics and marketing optimization, and a co-founder of the Web Analytics Association.  And did I mention that he is without a doubt the nicest guy in the entire industry.

Yep.

Jim is one of my personal heroes and he has had a greater influence on my career than anyone I know.  Jim was among the first to learn I was leaving Visual Sciences for greener pastures and has provided me invaluable advice over the past year.  So imagine my glee when, after his inviting me to participate in his conference for six years, I was finally able to repay the favor by inviting Jim to join us at the 2008 X Change conference in San Francisco!

He accepted.  Ecstasy!

In preparation for the X Change event I have been interviewing some of the great people who will be joining us.  While those interviews are being shared with other bloggers, I decided to keep the Jim Sterne interview all to myself.  Read on and learn a little more about “the Godfather of Web Analytics” …

EP: For the three people who ** don’t ** know you, tell me a little about yourself and how you got involved in the web analytics industry?

JS: My first life was in sales – business computers to companies that had never used one before. This was pre-PC and they were expensive, confusing, and confounding. It was great fun explaining to people just what they could accomplish with one. I love watching people’s eyes light up. That led to a life in marketing – software development tools mostly. Print ads, brochures, trade show booths, direct mail. That was pre-PowerPoint so we produced overhead transparencies on a copy machine.

In 1993 I saw my first website (Sun Microsystems) and got wildly excited. I kept asking webmasters from large companies for examples of good online marketing strategy and they kept asking me for my opinion. My opinion ended up coming out in the form of books, PowerPoint presentations and corporate workshops.

In 2000, after presenting at Matt Cutler’s NetGenesis user group meetings and a couple of national tours, we decided a white paper was needed to explain this stuff from soup to nuts. That led to the book which led to the eMetrics Marketing Optimization Summit which led to the Web Analytics Association which…. Oh – you asked for a “little” about myself. Sorry – got carried away.

EP: Honestly, did you think that the Emetrics white paper you did with Matt Cutler would have the impact it did?

JS: I love being at the leading edge, banging the drum to get people to understand what’s just over the horizon. I wrote five books about online marketing but they were just part of the noise. I had no idea that E-Metrics Business Metrics For The New Economy would be the only thing out there for so long and attract such attention.

EP: What made you decide to start a conference for web analytics folks? Had you done conferences before that?

JS: I got most of my consulting business from public speaking but the conference industry was very slow in 2000 and 2001. This was the “Dot-Bomb” era after all, I decided to produce my own conference in the winter of 2001 but pushed it off until 2002 due to September 11. Web analytics was the most interesting subject to me and so few people were paying attention. It was something that needed a drum and a flag and a parade.

EP: Which of your books are you most proud of? What other author’s book do you wish you had written yourself?

JS: Nobody ever forgets the first time – even if it takes three editions to get it right. Being introduced as “author of” for the first time is a head rush that is only equaled by handing a copy of the first edition to my father. But the most fun I had was writing a little volume for Lyris – the email company – called Advanced Email Marketing. It’s a work of fiction about a guy hired into a bicycle company to get them into email marketing. He has to explain how the numbers are of value to each of the different managers and executives in the company. Good story, not much of a plot but there’s a happy ending with a twist.

Which other authors’ books do I wish I had written? The usual suspects spring to mind: Yours, Avinash’s, Jason and Shame’s, and anything on Amazon’s Top Ten list.

EP: Corry Prohens from IQ Workforce recently asked me about “the Eric Peterson brand.” How much do you work to manage the “Jim Sterne” brand?

JS: I believe branding is the result of everything you say and do. Think whatever you like, but every time you make a statement, an appearance, or a product you are expressing your brand to the world. Form is as important as function. The means are as important as the ends. Therefore the answer to your question is; All the time.

EP: Which of the Web Analytics Association’s accomplishments in the past few years are you most proud of?

JS: I am ridiculously proud of approximately 300 people who are actively working all around the world to create value for other WAA members. I helped raise the flag, but all these people are energetically and enthusiastically building something to help the next generation of web analysts. I posted a list of WAA accomplishments as a Letter from the Chairman but it’s really the fact that so many people are donating their time and talent to the cause that has me beaming.

EP: Tell me, when you’re not making things happen in the marketing optimization industry, what do you do to relax?

JS: I love to travel – sick I know, given the frequent flier miles I’ve racked up. I collect meerschaum pipes, play Mah Jongg, edit church sermons, design jewelry and monitor some 4,500 Komodo dragons in the wild through a network of webcams and RFID tags from my iPhone.

EP: If you could change ** one thing ** about web analytics, what would that be?

JS: The same thing I’ve been trying to change all along: Get everybody to recognize the astonishing power and value of this information for improving customer experience.

EP: Given that your “Emetrics: Business Metrics for the New Economy” really got the ball moving in 2000, where do you see the web analytics industry in 2010?

JS: There will be more consolidation as larger web analytics companies buy smaller ones, business intelligence companies acquire web analytics companies and smaller firms drop off the radar in the wake of free tools. Some new tools and methods will come about but the Big Problem will continue to be growing awareness, in order to increase investment, in order to train more analysts. The people problem will be with us for some time to come because you can’t automate insight.

EP: Speed round: Short answers to the following questions …

Favorite food? Popcorn
Favorite hotel? Santa Barbara Biltmore
Favorite book? Cryptonomicon by Bruce Sterling Neal Stephenson
Favorite non-web analytics public speaker? Randy Pausch
Favorite professional athlete? Willie Mays
Favorite airline? United
Favorite saying? “Eighty percent of success is showing up.” – Woody Allen coupled with “Genius is one percent inspiration and ninety-nine percent perspiration.” – Thomas Edison

I hope many of you will be able to join Jim and I at the 2008 X Change in San Francisco, August 17, 18, and 19th. Learn more about the conference at the official web site.

Adobe Analytics, Analytics Strategy, Conferences/Community

Are you still wondering about X Change?

My good friends at Semphonic just published a bunch of video vignettes collected at last year’s X Change event in Napa Valley that are definitely worth checking out if you’re thinking about joining us in August.  Or, even if you’re already registered for the event, check out these videos and start getting pumped up for what promises to be a fantastic event!

As an example of the kind of content published at YouTube, here is my good friend and Web Analytics Assocation Board member June Dershewitz and some of her thoughts about the conference. Cool, huh?

There are 15 different videos at YouTube from brilliant folks like Anil Batra, Dan Shields, Manoj Jassra, Marshall Sponder, June, Phil Kemelor, Gary Angel, and even yours truly who has never been known to shy away from the camera (although perhaps I should have that day, what the heck was up with my hair!)

Don’t know what the X Change is? Read all about it at the official conference web site.

Analytics Strategy, Conferences/Community

X Change: Experts in Attendance!

You may have already seen the press release this morning about some of the industry experts that we have coming to the X Change conference in San Francisco, August 17, 18, and 19.  If not, you should check it out!  Some highlights:

  • Jim Sterne, yes … that JIM STERNE, will be joining us as a participant!  I’m not sure if I have seen Jim at an event where he is not the absolute Master of Ceremony and running the show so it will be nice to see my old friend (hopefully) relax and have the time to share his own experiences in our industry
  • Many of the most influential vendors in the digital measurement ecosystem are coming, including Aaron Gray (WebTrends), John Squire (Coremetrics), John Dawes (Tealeaf), Eric Hansen (SiteSpect), Mark Treschl (OpinionLab), Eric Head (ForeSee Results), and more I am surely forgetting.
  • We’ve also invited some of the best and brightest consultants in the business including Josh Manion and Bill Bruno (Stratigent), Jacques Warren (WAO Marketing), Aurelie Pols (OX2), Andy Fisher (Avenue A/Razorfish), Matt Jacobs (Digitas), Dan Sheilds (Wicked Science), Craig Danuloff (Commerce360), and of course the team from Semphonic!

By design, the X Change conference will be about 1/5 expert practitioners (the huddle leaders, who are amazing), 1/5 experts from the vendor, agency, and consulting community, and 3/5 practitioner attendees.  Given that the huddle leaders are practitioners themselves, we feel that we have a pretty solid (and extremely rare) ratio of experts to attendees, and that this arrangement will provide amazing value to attendees.

It doesn’t hurt that the experts we selected are among the best in the business.

Yeah, there are some folks that are missing, to be sure.  It would have been great if someone from Google Analytics could have come, and the guys from ZAAZ, and folks like Steve Jackson from SATAMA and others across the U.S.  But there is always next year, right!

Anyway, if you’re thinking about joining us in San Francisco the time to register is now.  Check out the official web site at Semphonic and get signed up today.

Conferences/Community, General

Guest Post: Benchmarking Web Analytics

Now that the X Change conference is just over a month out several of the experts and huddle leaders that will be in attendance have offered to talk a little bit about what they’re going to be talking about in August.  Jared Waxman leads the Data Insights Group at Intuit’s Mountain View headquarters and is a very bright and outgoing member of the web analytics community.  Jared is launching a survey designed to help us all better understand how effectively we’re doing web analytics and will be talking about the results in his huddles at X Change.

Please read what Jared has to say and please take 10 minutes to complete his survey!

————————————————————————

Shortly after Eric Peterson invited me to lead a few of the X Change conference huddles this year, I realized something slightly ironic … We collect tons of data about our customers, but we still have far less cold, hard data when it comes to ourselves. In other words, what are the KPIs by which we can benchmark our own analytics practices against similar organizations?

If you’re not sure why this should concern you, ask yourself the following questions:

  • When is the last time you received special recognition from your boss for how cutting-edge your analytics program is?
  • How much of your last analytics budget proposal got approved?
  • If resources were constrained, do you know which one analytics project would give your org the biggest leg-up?

The missing puzzle piece behind all these questions is: the right benchmarking data.

Chances are your boss wants to give you praise, but isn’t sure just which of things you’ve accomplished merits awarding you that mounted, singing Bass fish trophy (stuffed with cash, of course). And the budget? Management never wants to hear they’re about as cutting-edge as an animated gif. Armed with the right data, you can lay out for them what it’s going to take to catch-up, or take the lead.

If you really knew how your programs and capabilities compared to other companies in your space, you’d have the foundation for a pretty solid case for both the praise you deserve, and also the resources to beef up areas you’ve been slower to ramp on. This isn’t news, of course, and Tom Davenport and Jeanne Harris’ book, “Competing on Analytics: The New Science of Winning” stresses the point that it’s not just about what you are doing on your island, but it’s about being faster and smarter that your competition in leveraging data and analytics.

So how do you know how you stack up? For a start, fill-out this 10-Minute Benchmarking Survey that I assembled to help your organization get a read on where you stand. It was challenging to come up with every use-case or application of web analytics in practice today and still have it be short enough that you can complete the survey while on-hold with your mortgage company. Ok, it was impossible. So I settled on a sampling of valuable activities that are components of many successful analytics practices. I hope you’ll agree it is sufficient for a strong directional read within key areas: Tracking, Competitive, Testing, & Predicting.

So I humbly present you with the Benchmarking Survey, and will reveal the results at X Change, and of course share your score back with you for your participation, once the results are compiled:

Start the Web Analytics Benchmark Survey

I hope to see you at the X Change conference. I’ll be leading a huddle on Testing Strategies alongside Dylan Lewis. At Intuit we have a sort of competition going for who’s group can take testing the furthest. We each have such different organizations and challenges, and that has led to very divergent strategies. Yet we are constantly learning from one another and looking forward to learning from the participants about what their challenges and strategies have been.

I’ll also be leading a huddle on Using Real-Time Surveys to Improve the Customer Experience. By building our own Voice of Customer apps, we’ve been able to provide an immediately tailored site experience for the customer and equally as important, effect more lasting improvements by orchestrating the right influence within the broader marketing organization.

Finally, I’ll be leading a huddle on Competitive Intelligence Tools & Methodologies. Sounds clandestine and exciting, huh? Truth is, I’d tell you more about this huddle if I could, but then I’d have to make you sign three different NDAs and learn the Intuit secret handshake … So just sign up and I’ll see you in person.

Analytics Strategy, Conferences/Community, General

Larry Freed and Lars Johannson interview me about X Change

If you’re considering coming to San Francisco for the X Change conference on August 17, 18, and 19 but are still wondering what the conference has to offer you may want to check out these interviews I did with Lars Johannson last week and Larry Freed this week.

Both guys asked good questions — my favorites were Lars asking “If someone only has the money and time to attend one conference, how should she choose between industry “default” event eMetrics and challenger X Change?” and Larry’s “With a “total absence of sales messaging and sponsored talks”, who will pick up the bar tab?”  Larry’s question reminded me that June, David, and I should probably start planning some kind of conference-associated Web Analytics Wednesday event since we had such a great turnout last time we were in San Francisco!

Check both posts out when you have a chance:

If you’re interested in the conference, check out the official web site at Semphonic.

Conferences/Community, General

Great jobs at Intuit; Our job board is now GLOBAL

Two job related items worth noting, just in case you are either in the market for a new job or, perhaps more likely, are seeking smart folks to help you get your web analytics house in order.

First, the fine folks at Intuit in San Diego are looking for a Senior Manager for Web Analytics.  From a web analytics perspective Intuit is perhaps best known as the former home of web analytics super-star Avinash Kaushik and as a company that clearly understands the 10/20/70 rule for achievable web analytics success. While Avinash has moved on to Google, bright folks like my friend Dylan Lewis (who will be leading two great conversations at the X Change conference in San Francisco on August 17, 18, and 19!) and Jared Waxman (also leading huddles at the X Change!) are still making things happen at Intuit.

I traded email with Seth Greenberg at Intuit about the job and here’s what I learned:

Why apply for this position at Intuit?
The Senior Manager of Web Analytics position in the TurboTax division of Intuit is an amazing opportunity to help develop, optimize  and influence a multi-channel marketing mix backed by a substantial advertising budget.  The position will require the most qualified applicant to build on an already great process, and develop a methodology for incorporating multi-channel measurement into online advertising analytics.  In addition, the applicant will need to build a successful online advertising testing program that combines both website and offsite factors to optimize results.  Yes, this a lot, but if you are still reading then maybe this is for you.

Why make the move to San Diego?
Did you see the U.S. Open?  Do you like sunshine and paradise?  If so, then there is a lot of that in San Diego.  If you are a fan of outdoor activities, don’t like snow, and are not a big fan of rain, then maybe this is the best climate for you.  The cost of living is relatively high here on the coast, but many are willing to pay the sunshine tax.  It is as good as it looks on TV, and it can only be better if you are here.  We’ll also make your move easy with a nice relocation package.

What makes Intuit so special?
Intuit is a data driven company.  Intuit is also year-after-year one of the “Top 100  Best Places to Work”  There are many benefits to working here, including the ability to have a very focused tactical tax season, followed by a strategic period evaluating all the results and deciding what to do the next tax season.  It brings about some really great year over year improvements and lets you build on and prepare for success each year.

Having lived in paradiseSan Diego for three years while at WebSideStory and JupiterResearch I can vouch for what a great place San Diego is.  And as far as Intuit, from my perspective the high-quality people they are able to attract is testament enough to the opportunity.  If you have more questions about this job drop me a line and I’ll get you in touch with Seth or Dylan, or just review the job description and apply online today!

Second, and I feel a little bad for putting this below the fold, but international companies are now able to advertise on our job board!  Previously we weren’t able to offer listings to companies with non-U.S. addresses but our technology provider has given us a passable workaround that allows us to better serve the International job seeking and employee-seeking community.

If you’re outside of the U.S. and are interested in advertising on our job board, please drop me an email and I’ll explain the very easy process.

Analytics Strategy, Conferences/Community, General, Social Media

X Change conference conversation leaders announced

As usual, Gary Angel has beaten me to the punch, this time with his great post about the conversation leaders we’ve announced for the 2008 X Change conference. The full line-up is included further down in this post, and you can read the press release in PDF format from the Semphonic site or download this PDF invitation to the conference more suitable for printing.

Since folks have been asking me via email what is really different about X Change, primarily to help make the case to management to attend the conference, and at the risk of sounding redundant, here are three great reasons to consider attending the conference:

  1. X Change is an “expert user” conference, and we’re doing everything we can to create tremendous value for expert users. Everyone coming to the event — the conversation leader’s we’ve invited, the consulting and thought-leaders we’re bringing to the event, and the select list of senior people from the vendors — has years of experience in web analytics. Their experience, combined with those of the 100 attendees, is designed to help those of you working on the cutting edge in web analytics get your concerns addressed and your questions answered.
  2. The conversational format is designed to allow every attendee share their ideas and ask their questions, making X Change a very participatory “Web 2.0” conference. There is nothing wrong with sitting and listening — when you want to sit and listen. But the explosion of web analytics blogs, the growth of the Web Analytics Forum, and the number of web analytics folks on Twitter suggest that a bunch of us actually want to participate. X Change is the conference for the participants.
  3. We have a plan to allow you to share the insights you gain with your team back home. One of the chief complaints at last year’s conference was “I wanted to attend every session!” To help share the insights gleaned in each conversation, and help paint a picture of the industry today and where it is heading, after the event we will be publishing the “Proceedings of the Second Annual X Change Conference” document, free to all conference attendees.

If you’re still wondering about the value of the conference, or need more ideas to sell a luxurious stay at San Francisco’s Ritz Carlton to your manager, please don’t hesitate to reach out to me directly and we can chat.

The conference theme this year is “People, Process, and Technology” — the three-legged stool that all of our web analytics efforts rest upon — and we’ve broken the conversations down into similar groupings. We will have full descriptions of the conversations available online very soon but here are the leaders, their companies, and the general topics they will be discussion.

PEOPLE

  • Steve Bernstein (PayPal): Getting Analysts to Produce Analysis and Getting the Business to Listen
  • Megan Burns (Forrester Research): Building the Business Case for Change
  • Bill Gassman (Gartner): Evolving Your Use of Analytics
  • John Lovett (JupiterResearch): Industry Standards or a Lack Thereof
  • Bob Page (Yahoo!): Web Analytics and Data Privacy

PROCESS

  • Steve Bernstein (PayPal): Driving Visitors Up the Value Chain
  • Dennis Bradley (Charles Schwab): Bridging the Gap from Web Analytics to Marketing
  • Marston Gould (Classmates.com): Where Does Web Analytics Stop and Customer Analytics Start?
  • Linda Hetcher (Avaya): Searching for Success with SEO and SEM
  • Dylan Lewis (Intuit): Campaign Analysis and Attribution Modeling: Dangerous Assumptions
  • Dylan Lewis (Intuit): Establishing a Web Analytics Center of Excellence
  • John Lovett (JupiterResearch): Data Integration: Myths and Realities
  • John Rosato (IBM): B2B Analytics: Challenges and Opportunities
  • Rachel Scotto (Sony Pictures Imageworks Interactive): Integrating Online and Offline (Market Research) Data
  • Michael Wexler (Yahoo!): Web Analytics for Brand Marketers

TECHNOLOGY

  • Dennis Bradley (Charles Schwab): Justifying the Need for Advanced Visualization Tools
  • David Cronshaw (MSN/Microsoft): Emerging Trends in Online Video: Measurement, Monetization, and Mobilization
  • David Cronshaw (MSN/Microsoft): The Metrics of Video: Cost per Engagement and Beyond!
  • Jim Hassert (AOL): Analytics Across the Enterprise
  • Jim Hassert (AOL): Managing Expectations: Panel-Based and Census-Based Methodologies
  • Seth Holladay (Rodale Publishing): Slicing and Dicing Visitors: Segmentation Strategies
  • Seth Holladay (Rodale Publishing): Tracking Non-Traditional Conversion Events
  • Judah Phillips (Reed Business Interactive): Building a Successful Web Analytics Team
  • Judah Phillips (Reed Business Interactive): Knowing When You’ve Outgrown Your Current Web Analytics Solution
  • Ron Pinsky (AIG): Data Collection: Implementation, Utility, and Ongoing Integrity
  • Ron Pinsky (AIG): Integrating Customer Experience and Marketing Data with Web Analytics
  • Bob Schukai (Turner Broadcasting): The Mobile Landscape: Challenges and Opportunities
  • Bob Schuka (Turner Broadcasting)i: Mobile Technology: Development, Deployment, and Measurement
  • Rachel Scotto (Sony Pictures Imageworks Interactive): Measuring Web 2.0: Widgets, Gadgets, and Social Networks
  • Jared Waxman (Intuit): Using Real-time Survey to Improve the Customer Experience
  • Jared Waxman (Intuit): Competitive Intelligence Tools and Methodologies
  • Michael Wexler (Yahoo!): Mobile Marketing, Mobile Measurement
  • David Yoakum (The Gap): Measuring Web 2.0: Interactions, Events, and Consumer Generated Content
  • David Yoakum (The Gap): Using Web Analytics to Inform Personalization and Remarketing Efforts

If you’re a long-time reader of my blog and you’re really interested in web analytics I would very much encourage you to consider the conference: read Gary’s post, download this PDF invitation to the conference, or email me directly so we can talk about how the conference might benefit you and your organization.

Analytics Strategy, Conferences/Community

EUWAA Update from the WAA Board of Directors

Since summer is nearly here and since I am trying to be more European in my approach towards business (read: wanting to take long holidays during the summer) I have been somewhat lazy in my regular blogging (as opposed to my lazy-blogging on Twitter, where I have also been somewhat lazy …) But thinking about being more European brought my mind around to my idea of a European Web Analytics Association (EUWAA) that I proposed before the Emetrics Summit in San Francisco last month.

Since that post a few things have happened:

  1. My good friend Mr. Jim Sterne, Chairman of the Board at the WAA held a nice meeting over drinks in London to discuss the idea with Europeans in attendance. You can read Jim’s summary of the meeting and some interesting notes about the WAA Board of Directors over at Jim’s blog.
  2. The WAA held a more formal meeting on May 22nd with some very high-profile Europeans in attendance including Neil Mason (England), Jim Williams (Scotland), Marianina Chaplin (England), Vicky Brock (Scotland), Zeljka Stojanovic (England), Tim Leighton Boyce (England), Rene Dechamps Otamendi (Belgium), Oliver Schiffers (Germany), Julien Coquet (France), Miles Bennet (England)

I certainly wish I could have been at the meeting since it sounds like it was pretty productive. Still, I have one concern as I read the summary document provided by Board Member Vicky Brock — it sound like the pro-EUWAA conversation revolved around multiple local WAA chapters in Europe as opposed to a single, pan-European organization able to respond to the needs of “chapters” across the continent.

Perhaps I’m just reading the document incorrectly, and hopefully if I am one of the participants will write me and clarify the point. But if I am interpreting this correctly, I think this is a dangerous idea and one very likely to fail.

I suspect that the organizational process and volunteer commitment to create and maintain multiple local WAAs would be far greater than is reasonable. Were this not the case, I suspect the WAA would have a local presence here in the U.S., instead of ceding most local web analytics efforts to Web Analytics Wednesday. Web Analytics Wednesday works because it is A) low effort and B) high value. I suspect the establishment of several mini-WAA’s across Europe would be the exact opposite, at least in the short- to mid-term.

Instead, I would encourage those European’s taking the lead on this issue (Neil, Vicky, Rene Dechamps Otamendi from OX2) to focus on first creating a single, pan-European organization able to provide reasonable organizational structure for all Europeans. A single organization should be able to:

  • Provide focus for Europeans working in the web analytics arena
  • Create critical mass for EU-focused networking events, conferences, etc.
  • Publish in more languages to accommodate non-English speakers
  • Develop EU-focused content via blogs, social networks, etc.
  • Streamline organizational processes like reimbursement
  • Schedule meetings at a reasonable time of day locally

Fundamentally the idea of a single EUWAA was put forth to reflect the need for more value and more opportunities for European members of our global community. And while I have tremendous faith in Rene, Neil, and Vicky, I suspect that many more people will be necessary to provide the level of value I think the WAA is capable of providing.

According to the document, the WAA is planning to have a vote of Europeans in the next few weeks designed to gauge member (and potential member) response, theoretically to the idea of a separate EUWAA. It will be very interesting to see how the questions in this survey are worded and how the response is managed, but I suspect this process is in good hands.

Vicky concluded her letter with the following statement:

“Every action item in this report needs volunteers to step forward. If you would like to see any or all of the above come to fruition, please find something (research, identify, explore, review) and raise your hand.”

Nothing could be more true. Any association like the WAA or EUWAA depends on volunteer action for its lifeblood. Hopefully all of you who commented on my last post, and all of you who wrote me directly in support of the idea of a EUWAA, will take Vicky’s point to heart and step up when the time is right.

Since I’m not European I suspect my involvement from this point on will be tangential at best, although I’m not opposed to volunteering my own time, but I welcome your comments and critique of the ideas I put forth in this post. Also, if you’d like to know when the pan-European vote on this subject is, and if you’re not a WAA member, please don’t hesitate to comment or write me directly and I will make sure your email address is passed along.

I must say I am tremendously encouraged by the work that Jim, Seth, Neil, Vicky, Rene, and many others have already contributed to the general idea of providing more member value in Europe, especially in such a short period of time. I only hope the momentum will continue towards a product that everyone involved can be as proud of as Rand, Greg, Jim, Bryan, Seth, and the rest of the WAA founders surely are of their work.

Adobe Analytics, Conferences/Community, General

Forrester, Gartner, and JupiterResearch analysts to participate in X Change keynote

Things are starting to heat up for the X Change conference in August (17, 18, 19 in San Francisco … more details here) with two announcements made this week and last.

First, we’ve announced the X Change Scholarship program which will allow us to encourage and promote the innovative use of web analytics for improving web site performance. Our goal with the scholarship is to help one deserving web analytics practitioner join us at the X Change free of charge; all we’re asking is for a well written essay describing a great use of web analytics. You can read the details here and I’m happy to answer questions directly as well if you’re interested in applying for the Scholarship funding.

Second, we’re starting to announce more about the content of the 2008 X Change beginning with the news that the conference keynote will be a “Town Hall” type event with three of the most respected industry analysts in the business today: Megan Burns from Forrester, Bill Gassman from Gartner, and John Lovett from JupiterResearch. Gary and I will be facilitating a discussion between X Change attendees and these three analytics insiders to help get to the bottom of the relationship between people, process, and technology.

As I’ve said before, X Change is like no web analytics conference you’ve ever attended (unless you went to X Change last year …) If you’re really interested in web analytics, I hope you’ll come to San Francisco and join us in August!

Conferences/Community

Web Analytics Wednesday, SAS style

As part of my worldwide Web Analytics Wednesday tour I will be in Cary, North Carolina on the SAS campus next Wednesday, May 21st enjoying the good graces of Richard Foley who has just finished his term as President of the Web Analytics Association.  The fine folks at SAS have offered to spring for food and drinks so I have gladly agreed to present my “Future of Web Analytics” presentation (which I have had to revise twice already, sheesh!)

If you’re anywhere Cary we’d love to have you join us for this small party.  I say small in comparison to last week’s Web Analytics Wednesday super event which is unlikely to be duplicated anytime soon.

I have a bunch of other stuff I want to write about — the new WAA Executive Board, the EUWAA, measures of engagement, my consulting business, and some really amazingly cool technology I have seen recently but that will have to wait.  Forty games in forty nights and the Cavs are down by 11 (on my TIVO, please don’t write in and tell me who won the game!)

Adobe Analytics, Analytics Strategy, Conferences/Community, Reporting

Web Analytics Wednesday San Francisco Metrics and KPIs

Web Analytics Wednesday in San Francisco this week was an amazing success by every conceivable measure. But don’t take my word for it, here are the metrics and key performance indicators:

  • Budget for the event: $10,000.00
  • Actual amount spent: $14,500.00
  • Percent over budget: 31%
  • Percent extra expenses graciously covered by ForeSee Results and Tealeaf: 100%
  • Planned number of sponsors: 4
  • Actual number of sponsors: 5
  • Percent sponsors interested in this event: 120%
  • Estimated satisfaction of sponsors based on feedback sample: 100%
  • Projected number of attendees: 200
  • Projected expenditure per attendee: $50.00
  • Actual number of attendees: 400
  • Actual expenditure per attendee: $36.25
  • Percent of actual budget spent on drinks: 50%
  • Estimated number of drinks served: 1,450
  • Estimated number of drinks consumed per attendee: 3.6
  • Number of hours spent serving drinks: 1.5
  • Estimated number of drinks consumed per hour:996
  • Estimated number of drinks consumed per hour per person: 2.4

I think the key measure of success is really satisfaction but I totally forgot to ask Larry Freed’s folks at ForeSee Results to conduct a survey during the event, we weren’t tagged with Coremetrics tags, and SiteSpect wasn’t able to test due to incredibly cramped conditions so we’ll have to rely on your comments and June’s pictures for the time being to make that determination. Maybe someone will post Tealeaf-esque replay video so we can estimate satisfaction based on qualitative data…

Speaking of the sponsors, I really want to thank all five sponsors of the event for their participation, willingness to help out, and excellent attitude … especially when the crowd volume prevented them from getting a word in edgewise during their 15 seconds of fame.

Suffice to say we could not have thrown a party like this without the help of these fine organizations.

I was also really pleased to see some of our industry thought-leaders out for the event, folks like Gary Angel, Jim Sterne, Larry, Judah Phillips, Brett Crosby, and Avinash Kaushik who has never attended Web Analytics Wednesday as far as I know but who just joined Google full-time, eschewing independent consulting for good old-fashioned job stability — congratulations Avinash and congratulations Google!

I was even more pleased to see many members of the Web Analytics Board of Directors at the show including Jim, June, Avinash, Bryan Induni, April Wilson, Richard Foley and probably a few more I am forgetting. I think this is great since the WAA has what can only be described as an estranged relationship with Web Analytics Wednesday … hopefully we can get that relationship worked out in 2008 so these two great organizations can work together for the benefit of our entire community!

Anyway, thanks to June, David Rogers, and all the volunteers and sponsors who made this great event happen. Mr. Sterne hinted that he’d like Web Analytics Wednesday to happen concurrently with every Emetrics conference around the world so hopefully we can work that out and take this great party on the road.

Analytics Strategy, Conferences/Community

Coremetrics and SiteSpect: Global Web Analytics Wednesday sponsors!

As Web Analytics Wednesday continues to gain momentum around the world leading into what is shaping up to be the largest event in WAW history in San Francisco on Tuesday, May 6th, I am pleased to announce that Coremetrics and SiteSpect have both signed on to be global sponsors of this event.

You can read the press release here but the essence of this announcement is that these great companies share my vision for what Web Analytics Wednesday is becoming — the largest and most widely recognized gathering of web analytics professionals in the world. In sharing the vision, their management teams have graciously decided to provide financial support to allow Analytics Demystified provide more reimbursement to a larger number of events around the world.

Starting today, we are pleased to be able to help emerging Web Analytics Wednesday chapters cover the cost of providing food and drink to participants. You can read about the WAW sponsorship policy here and if you have any questions please don’t hesitate to write me directly.

On behalf of myself, my wife Amity who provides event support, June, and every Web Analytics Wednesday host and participant around the world I want to thank Coremetrics and SiteSpect for their vision and contribution. So far in April nearly 700 people have signed up to participate in Web Analytics Wednesday and we’re well on the way to beat my goal of 5,000 participants worldwide in 2008!

In other Web Analytics Wednesday news …

  • I will be in New York this coming Wednesday giving a short Web Analytics Wednesday presentation on “The Future of Web Analytics” at the headquarters of Avenue A/Razorfish. This event is being organized by Joel Collymore, one of the WAW hosting superstars, and promises to be a great event (over 115 people are signed up to attend already!) Sign up here to join us since we need to add you on the security list at the door!
  • Don’t forget, if you live in the Bay Area in Northern California or are coming to Emetrics, we are having what is likely to be the largest WAW event in history at the Fluid Nightclub on Mission Avenue. This special WAW on Tuesday, May 6th is open to all web analytics practitioners regardless of whether you’re going to Emetrics or not so please sign up to join us!
  • Just in case you live in French Polynesia, the first ever Web Analytics Wednesday event is being held on Bora Bora in Tahiti. Steve Jackson, blogger, consultant, and likely soon-to-be EUWAA leader is heading to Bora Bora for his honeymoon and has offered to help spread the good word. While his new bride will almost certainly not think it amusing, if you can get to Bora Bora I’m buying the drinks!

I am especially excited about the San Francisco event because Coremetrics, ForeSee Results, SiteSpect, and Tealeaf have all made significant sponsorship donations, giving us quite a lot of lattitude to entertain. It looks like our efforts are paying off as the sign-up list is a virtual who’s who of web analytics thought-leaders, practitioner talent, and consulting genius!

Conferences/Community, General

Europe and the Web Analytics Association

Regular readers know that I travel to Europe twice a year to do business and work with my partners Satama and LBi/OX2. During my most recent trip I was delighted to have more time to talk at length with a wide variety of companies, practitioners, and thought leaders and a few things stood out in my mind after these conversations:

  1. The European market is not unlike the U.S. market in terms of practitioner experience and overall thought leadership. I reported this after my last trip based primarily on survey data, but have been delighted to verify that there are some really amazing people doing some truly great things “across the pond.” This includes end-users and analytics managers inside companies and thought and practice leaders like Steve Jackson at Satama, Aurelie Pols and her team at LBi/OX2, Dennis Mortensen, Lars Johannsen, Oliver Schiffers, Marianina Chapin, Brian Clifton, and a whole lot of folks I’m forgetting to list! In a way, Dennis Mortensen recently became the “Avinash Kaushik” of Europe, a full-blown analytics evangelist!
  2. The European market is different than the U.S. market in terms of investment in web analytics, although less so that I previously believed. After countless conversations about technology, people, and process, I kept coming back to the same conclusion: Europe is somewhere between two and four years behind the U.S. in terms of investment in web analytics. More specifically, I believe that the northern countries (Nordics, UK, Holland, primarily) are more like the U.S. in terms of their investment and, broadly speaking, the lag-behind time increases as you move further south. My evidence is anecdotal to be sure, but when I tested the theory most people working for pan-European organizations agreed — do you?

Based on these two points I come to the inevitable conclusion that Europe is about to really take off in terms of the adoption and use of web analytics. Those of you keeping track will recall that it was about two years ago that the practice of web analytics really started to accelerate here in the U.S. I think that the northern European countries especially are about to begin this same type of rapid adoption/expansion we’ve seen over the past two years, which is excellent news!

Now, some of you are certainly saying “well duh, Peterson” either because you work for a U.S.-based vendor who has been bulking up in Europe for the last 12 months, or more likely because you’re European and are experiencing what I’ve described first hand. Fair enough. But my point is not that Europe is running behind the U.S. in adoption of analytics; my point is that European practitioners, consultants, and vendors are in a different place than their U.S.-based counterparts and thusly would benefit from a different support organization than we benefit from here in North America.  Specifically, I believe that Europe should have its own Web Analytics Association.

Yep, I think we need a EuWAA.

Because the needs of European practitioners, vendors, consultants, and even the European media are different, I increasingly suspect that a North American-based WAA may not be best suited to provide the same type of great opportunities, educational events, and benefits we appreciate in the U.S. and Canada. And, while I agreed to not name names, I think some European WAA members don’t disagree with this assessment and would relish the chance to provide/receive additional value from a more locally run association.

A sister organization in Europe, one governed by a European Board of Directors and funded primarily by European vendors and consulting firms, would invariably be better able to serve the needs of specific markets at different stages of analytics maturity. The EuWAA could set country-specific pricing, have both regional and pan-European events, and make decisions that were carefully focused on the needs of different European constituencies.

I’m not saying anything is wrong with the current WAA; I think that the current and past board’s of directors have done a good job working to include European members in the decision making process and overall value chain.  I’m saying is that there is an opportunity to “think different” (to quote Jim Sterne) and consider how a more regional focus might be better for everyone. The NaWAA could focus on North American events, opportunites, outreach, and issues and create even more value for members here in the states and Canada.  And the NaWAA and EuWAA could work together to provide value for emerging markets across the globe.

In terms of funding, I would propose that A) there are a ton of European vendors who would be willing to support the EuWAA, B) that the U.S.-based vendors looking to expand into Europe would be motivated to support the group, C) European companies and practitioners would be more likely to support a European organization focused on the specific needs of European businesses and D) it would be very appropriate for the NaWAA to provide seed capital to this new, sister organization.

Analytics Demystified would gladly join as a founding member since we’re a global organization!

I don’t want to get into more specifics here, but if you have an open mind you might see that the idea makes a ton of sense and that a lot of the necessary work has already been done. And while I’m not 100% sure which of the European citizens running for the WAA Board have been elected, between those fine folks, the European thought leaders, and forward thinking European vendors and consultancies, I firmly believe that EuWAA can be done successfully.

I also believe, while some will argue this, that the Web Analytics Association in general will be better for breaking up into regionally focused sister organizations. Because our practice is still relatively young, there is undoubtedly differential geographic maturation and I think this needs to be recognized and treated appropriately.

Anyway, I just wanted to put the idea out there. With the annual meeting/party happening in a few weeks in San Francisco it seemed like as good a time as any to bring EuWAA up and get people talking.

Adobe Analytics, Analytics Strategy, Conferences/Community

Getting excited about Web Analytics Wednesday Emetrics

Those of you who regularly attend the Emetrics Marketing Optimization Summit here in the states know that from time to time we hold big Web Analytics Wednesday events in conjunction with the conference.  Especially in San Francisco where the philosophical founder of WAW lives (June Dershewitz!) we like to have big events.

This time June and her partner David are planning a doozy!

Thanks to the very generous support of Coremetrics, ForeSee Results, SiteSpect, Tealeaf, and Jim Sterne (Marketing Optimization Summit) we are having a big party at the Fluid Nightclub on Mission Street (just around the corner from the conference hotel.)

You can download a very snazzy PDF invitation or read the press release about the event.

If you’re coming to Emetrics, even if you’re planning on attending a vendor dinner or just hitting the town, we sincerely hope that you’ll join us at this special Web Analytics Wednesday (on Tuesday) event.  You can register to join us and get all the details here.

Adobe Analytics, Conferences/Community, General

Analytics Demystified is heading to Europe!

Yep, it’s that time of the year again, time for my bi- (soon to be tri-) annual pilgrimage to Europe to meet with some of the best and the brightest overseas. I’m very excited about this trip for a handful of reasons:

  1. The trip begins in London next Monday at what is likely to be the largest event in the history of Web Analytics Wednesday. Thanks to the fine folks from SCL Analytics and Unica and a little support from E-Consultancy there are currently 128 people registered to attend the event! London has always been a hotbed of WAW activity and this is my first time attending the event. I’ll be giving a short presentation on “The Future of Web Analytics” and taking questions from the audience.
  2. On Tuesday I will be presenting at Nedstat’s “Streaming Media on the Move” event at London’s Soho Hotel and talking about the white paper I recently authored with Nedstat’s Chief of Innovation and how measurement is changing in a Web 2.0 and Web 3.0 world.
  3. Wednesday and Thursday I will be in Amsterdam doing private presentations. Over the years I have grown to love the beauty, culture, and diversity Amsterdam has to offer (despite the presence of what Aurelie lovingly refers to as “the narcotourists!”)
  4. Friday I will be in Brussels, Belgium with the fine folks at OX2 giving a private presentation and participating in another special Web Analytics Wednesday event (albeit a somewhat smaller affair)
  5. The following Monday I will be in Helsinki, Finland working with my partner Trainer’s House/Satama and giving a presentation on Measuring Lead Generation site. The folks at Satama are great to work with and I’m very excited about getting to spend more than 18 hours in Helsinki this time …
  6. Back to London on the 8th for some client work and home on the 9th. Phew!

If you’re in or near London or Brussels I’d love to meet you at one of the Web Analytics Wednesday events. I suspect I will also have a little free time in Amsterdam and Helsinki so if you’d like to meet in one of those cities, please feel free to drop me a line and we can try and meet!

Analytics Strategy, Conferences/Community

June Dershewitz is running for WAA Board of Directors

Long-time readers surely know that I hold June Dershewitz in high regard; not only do I consider her a friend, I respect June as one of the most talented web analytics practitioners and consultants I have ever met. More importantly, June is one of the most fair-minded and thoughtful people working in our industry today, which is why I’m so delighted that she has decided to run for Web Analytics Association board of directors.

To help spread the word about June’s candidacy she allowed me to interview her via email. My questions and her answers follow:

June, can you tell me what made you decide to run for the Web Analytics Association (WAA) Board of Directors?

The thought hadn’t even crossed my mind until last month, Eric, when you suggested that I put my name on the ballot. The more I considered it, and the more people I talked to about what I could possibly bring to the Board, the more I realized that it was a great idea. I’ve invested a lot of energy in developing the web analytics community in my own local area, and I know that I could bring the same energy up a level to help the web analytics community at large on behalf of the WAA.

In a nutshell, what are the top three reasons you believe yourself to be qualified for the board position?

  1. I’ve been a hands-on web analyst my entire professional career, I love this work, and I am one of the strongest advocates you’ll find for our trade.
  2. I take volunteer work seriously. The Board is made up of volunteers who’ve agreed to spend 15-20 hours per month on the cause. That’s a lot to ask, but I’m ready to make a serious commitment to the job.
  3. I don’t play favorites. I want to make sure that we all benefit from the WAA’s efforts, and to that end I will strive to move the organization in a direction that’s in the best interest for all of us.

Have you given any thought to the kinds of things you would like to see the WAA accomplish in during your term if you are elected?

By all means we need to expand our member base at a rate that keeps up with the growth of our field, and at the same time we need to make sure that existing members continue to find value in their memberships. I’m all in favor of finding new ways to provide tangible, useful benefits to members. I also believe we need to form tighter bonds with related associations whose missions overlap with ours, especially as the scope of web analytics becomes broader. In terms of topics that are near and dear to me, I would like to see the formalization of local chapters and the development of a mentoring program.

I know you’re really involved in the web analytics community (being a founder of Web Analytics Wednesday!) Can you describe some of the other work you’ve done for our community in the past?

Web Analytics Wednesday has been a huge focus of my community involvement over the past couple of years. It’s evolved to the point where I’m not only heading up a monthly event series here in San Francisco, I’m also helping other organizers get started with their own events throughout the Bay Area and beyond. My work with WAW has really helped build an established local presence for the web analytics community, and I’m pleased to see similar developments in other cities where WAW has taken hold.

Within the WAA proper, I’ve been involved in the Education Committee, where I helped develop the document that will become the Web Analytics Body of Knowledge, and more recently I’ve become a member of Marshall Sponder’s Social Media Committee. I’m also contributing articles aimed at people who are new to the field of web analytics; my first one came out last month.

You’re running against some pretty heavy hitters in the field, folks like Avinash Kaushik and Jim Sterne to name a few. As you’ve looked at the slate of candidates, who would you like to see elected in this cycle: Who would you like to work with in 2008 and 2009 and why?

I would be honored to work with any previous Board member, especially those – like Avinash – who’ve voluntarily put themselves up for re-election a year early just so we’d have a balance of open positions this year and next.

As far as new people go, it would be great to get to work with Alex Langshur and Vicky Brock. After reading through all 17 candidate statements, I really like what those two have to say: Alex, because he’s committed to achievable goals aimed at bringing value to members, and Vicky, because she sees (as I do) web analytics evolving into business analytics.

Recently Lars Johansson of Satama proposed the idea of term limits for WAA board members, something that I don’t think is in place currently. What do you think? Should WAA board members be limited to one or two terms, or should people be free to serve for as long as they’re able to be re-elected?

The WAA has finally been around long enough for us to consider that issue. I’m definitely in favor of having a 2-term cap on Board membership. Our field is growing so quickly – there are great new people getting started all the time. If they have the energy and the inclination to run for the Board, I want to make sure they have every opportunity to get a spot – even without the name recognition that long-time Board members necessarily have.

Four years from now I’d love to see the Board made up of an entirely new set of people, full of enthusiasm and fresh ideas. By then we’ll be established enough as an association that our mission will be clear to whoever happens to be sitting in the driver’s seat.

You’re a web analytics blogger (one of my favorites!) so here’s an easy one: who’s blogs do you like to read and why do you like them?

Blogs are such a great way to keep up with our field and our community; I make a point to subscribe to everything I come across. Lately I’ve enjoyed Florian Pihs’s blog (I’m outing myself, he doesn’t know I’m a fan) because he’s covering web analytics in China and it’s a unique perspective that I could never hope to get on my own. Oh, and I like to follow bloggers whose sense of humor shines through in their writing, like Alex Cohen and Ian Thomas and (the occasional) Bob Page.

Some have accused the WAA of being somewhat close-minded and having a “not invented here” attitude, something that has the potential to negatively impact the community as a whole. Can you tell me if you encounter this how you might approach the problem?

I believe this attitude tends to propagate when the WAA’s activities are perceived as being shrouded in mystery. As members it’s really tough to figure out why certain policy decisions have been made when you don’t know what’s swirling around behind the scenes. I think it would be a lot better for everybody if more of what the WAA did, decision-wise, happened out in the public. I think we can do a better job being open with all members about what’s going on. Better communication – more honest, thorough communication – would keep negative sentiment in check.

What is your favorite thing about web analytics?

It’s a good intellectual challenge. There’s something about the natural shape of the data that lends itself really well to interesting, solvable story problems.

What is your least favorite thing about web analytics?

The occasional mistaken belief that what we’re doing is spying.

Ours is an increasingly international community and I firmly believe that some of the most exciting opportunities for growth in the industry are in Europe and Asia. Can you describe your experience working with international members of our community?

Over the course of my career I’ve been fortunate enough to work with a pretty global group. For 2 years I was employed by a first-generation web analytics vendor whose main office was in Britain; I spent some time working there, which was a great learning experience. Later, as a member of the central web analytics group at Oracle, I collaborated with an international team of marketers, analysts and developers. Now, as a consultant, I often find myself on the phone with clients many time zones away. Outside of work I’ve also enjoyed meeting international members of our community at conferences and through my blog.

Like you, I believe that our industry has a lot of growth potential beyond North America, and I want to make sure that the WAA does all it can to support international members by encouraging regional/local community, providing non-English language resources, and acknowledging the differences in the way we do business.

Fill in the blanks (here June’s responses are in bold print)

  1. At Emetrics, after 10 PM, you’re going to find me in the middle of a great conversation.
  2. On a long flight, I spend most of my time photographing my snack to post on Flickr as airplanefood.
  3. The one thing most people don’t know about me is I have a herd of dairy goats named in my honor.
  4. Everything I know about web analytics I learned from all the smart people I’ve gotten to work with and for over the past decade.

Anything else you think my readers should know about you as they prepare to vote this week?

If, after reading this, you’ve got any questions about where I stand or what my values are, you can write to me directly at june.dershewitz@gmail.com. I aim to represent every one of you, and I welcome your feedback, now and at any point in the future.

Conferences/Community, General

Hannah Montana loves Analytics Demystified!

Ha, made you look. Actually what is going on is some Web Analytics Wednesday antics in San Francisco where last week Analytics Demystified, Inc. sponsored an event hosted by the great June Dershewitz (read June’s blog!) You can see some of the other photos June took at Facebook

Speaking of Web Analytics Wednesday, we’ve made some pretty cool additions to the event system recently, including:

  • Better visibility for sponsors, which seems to have increased the number of event sponsors and thusly the volume of free food and drink being provided
  • Sponsorship from Analytics Demystified, Inc., to help smaller events in cities around the world get started. If you’re thinking about having an event, we’d love to hear from you!
  • The ability to share your experience at Analytics Demystified, which will inevitably help market these events to other practitioners around the globe
  • A snazzy interactive map done in Flash (alternates with other Flash content) to highlight how much of the world is participating in these events

I just participated in an EXCELLENT Web Analytics Wednesday event in New York hosted by Joel Collymore and Derek Monteverdi and sponsored by OpinionLab. Web Analytics Book has a nice write-up of the event and it was nice to have met Sebastian and the nearly 50 other folks who showed up.

Anyway, thanks to June for the fun photo and to all of you who are out there hosting, sponsoring, and most importantly participating in Web Analytics Wednesday events. If you have any questions about how you can host or sponsor an event, please drop me a line anytime.

Conferences/Community, General

Updates to Analytics Demystified.com

If you’ve been doing more than just reading my blog, you probably noticed that I massively updated the Analytics Demystified web site over the past week. Thanks to Jeff, Judah, and dozens of other kind folk who gently pushed me to build a site that was more reflective of the work I’m doing now.

Aside from an overhaul for the look-and-feel of the site, here are some of the things you may want to check out:

  • A substantial overhaul of the Web Analytics Wednesday site including the addition of new sections letting participants share their experience, information about how my company is now sponsoring events around the world, and better navigation tools for folks looking for local events.
  • An overhaul of the jobs section of the site, including an updated RSS feed for jobs, job content integrated into site search, better navigation for jobs, and an overall cleaner look.
  • The addition of new charting and trending tools to the Vendor Discovery Tool, which I’m really excited about since it makes it much easier to explore market relationships between vendors.
  • A much cleaner process for purchasing copies of my books, as well as the ability to purchase copies of Web Site Measurement Hacks and standalone copies of the key performance indicator worksheets that come with The Big Book of Key Performance Indicators.
  • An exciting new blog with Joseph Carrabis and (hopefully) a bunch of really bright people from inside the measurement community and out, The Future of Web Analytics, Demystified.
  • RSS feeds for all major content areas of the site including research, consulting, jobs, Web Analytics Wednesday, and a universal feed for my, Judah, Daniel, and the all new Future of Web Analytics, Demystified blog.

There is a lot more but it’s probably better if you just come back to the site and have a look rather than my trying to describe it all.

If you find any bugs please don’t hesitate to shoot me an email and let me know. I very much welcome your feedback on the new site and am open to suggestions. I have a handful of initiatives that I’m still working on, including some stuff around Web Analytics Wednesday, but welcome your ideas.

Adobe Analytics, Analytics Strategy, Conferences/Community, General, Industry Analysis, Reporting

My AMA presentation is now online and much more

For those of you who missed my presentation yesterday, “Web Analytics: A Day a Month”, you can now listen to the re-recorded webcast at WebEx thanks to Tableau and the American Marketing Association. I say “re-recorded” since once again I managed to bring a large enough crowd to the webcast to break WebEx. Web analytics is hot!

You can listen to the webcast without having to register (still requires name and email) until next week I think by going to:

amaevents.webex.com

Here are a few other things I should mention, as long as I’m writing:

  • I’m going to be in Boston next week for Judah’s Web Analytics Wednesday event (rescheduled from last month due to me being a weather-wimp) and if you’re in Boston or nearby I’d love to catch up. Please join us in Cambridge!
  • The next few weeks I will be in Chicago (Jan 25th), Seattle (Jan 30th), San Jose (Jan 31st) and New York (Feb 7th) giving the keynote address at OpinionLab’s client conferences. The nice folks at OpinionLab mentioned that they’re opening up the events to non-customers so if you’d like to hear me talk about how quantitative and qualitative data combined provide a much more actionable view of the online visitor, please join us!
  • The nice folks at the Direct Marketing Association who gave away PDF copies of my book Analytics Demystified in exchange for participation in their web analytics survey (written up by the amazing W. David Rhee) are holding a webinar on the research findings on Januay 23rd. The event is not free but the research is pretty good and if you’re in the DMA you should consider joining the call.
  • The nice folks at the Web Analytics Association are also holding a research call, tomorrow (Jan 17th) in fact, on the future of the web analytics industry. I think this event is free but it might only be free to WAA members (maybe if Richard or Andrea read this they can comment for all to see!) The call is tomorrow morning at 9 AM Pacific, noon Eastern and you can register to attend at the WAA web site.
  • Anil Batra has apparently jumped on the “bounce rate” bandwagon and is having a “bounce rate survey” that he’d like you to participate in. I haven’t had a chance to take it yet but I really enjoyed Anil’s salary research so I’m sure he’ll do a great job with bounce rate too!
  • I’ll be back in San Diego in late February at Aaron Kahlow’s Online Marketing Summit talking about Key Performance Indicators in a Web 2.0 World.  I really enjoyed OMS last year and am looking forward to getting back to Sea World Aaron’s event!
  • I had nothing to do with that movie on web analytics, despite it being filmed here in the Rose City, and have no idea what Ian is talking about.  Ian should spend less time at the movies and more time reading what experienced practitioners are saying about Gatineau.  <grin>

If I’m forgetting anything please comment below.  I think you’ll really like the webcast — the feedback I got has been excellent so far (despite some people going gossipy about the title of my last post on the subject … cage match indeed!)

Conferences/Community, General

Our survey is now closed but the WAA survey is just getting started!

Thanks to everyone who participated in the Analytics Demystified Fall 2007 survey!  We had nearly 1,000 responses again and a quick glance at the data shows some very, very interesting results.  Remember, if you want to see the results once I get them written up, you can either leave me your name and email address or, even better, subscribe to my weblog since I’ll be talking about the results as soon as they’re available.

Hot on the heels of our survey, the fine folks at the Web Analytics Association are gathering some similar information in what they’re describing as a “groundbreaking survey”.  I just took the survey and they certainly are asking some interesting questions.  Help the association out and take their survey right now!

I’m not sure if you have to be a WAA member to take the survey, but hopefully if not they’ll be making the results available to everyone.  Maybe someone from the research committee could comment below and let my readers know how the data will be used?

Analytics Strategy, Conferences/Community, General

World Tour Day Two: Stockolm, Sweden

I just got back from the special Web Analytics Wednesday event in Stockholm, Sweden and wanted to post some thoughts and a few of the pictures I took.

When I first founded Web Analytics Wednesday I wasn’t really sure what to expect. Like I’ve posted in the past, I started the event simply because it seemed like a really good idea — not to make money, not even necessarily to sell books, really just to bring the entire web analytics community together.

Now that I’ve seen what Lars Johanssen with help from IndexTools, WebTrends, and Omniture have built here in Sweden I have to say I am completely blown away!

Lars, with the help of his sponsors providing some food, some drink, and a nice place to gather and present, manages to draw the largest Web Analytics Wednesday group in the entire world almost every single time they get together. And while Lars does this for the betterment of the Web Analytics Association, when he asked the group, less than half of the 70 or so attendees were even WAA members! Lars has tapped into a rich community of very interesting (and interested) business people, all of whom appear quite passionate about learning more about web analytics.

It would be great if more cities around the world could reach out, get sponsors, plan activities, and really push to make their local Web Analytics Wednesday events something that people are excited to attend. I’ll ask Lars next time we talk, but I suspect it doesn’t really take that much effort on the part of the local organizer!

Let me ask you this: What would make you personally more willing to host, sponsor, or attend a local Web Analytics Wednesday event? Is it more support, more recognition, more formal education, or simply more free food and drink? Please leave me your thoughts in the comments or email them to me directly and I’ll summarize later this week (from Holland or Belgium!)

After seeing what Lars has put together, I am personally more motivated than ever to help the entire web analytics community benefit from Web Analytics Wednesday, regardless of your affiliation, location, or motivation! Please do let me know!

Okay, here are the pictures from Day Two of my web analytics world tour …

About half of the attendees, including Mr. Fulton Yancy from Visual Sciences (front left) and Lars Johansson waving in the back (red blob, sorry about the pictures this time!)  I’m not entirely sure why Fulton didn’t join the panel and why Visual Sciences declined to sponsor this event despite generous funding from WebTrends, Omniture, and IndexTools.

Google’s Dr. Brian Clifton (left), who flew in from London for the event and three unnamed Swedes.

The vendor and consultant panel. From the left, Dennis Mortenson of IndexTools, Steve Jackson from Satama, the guy from Omniture whose name I cannot begin to pronounce, Ian Tickle from Webtrends, and Per Strid of Sweden (not on the panel.)

Ian Tickle and Per Strid. I had heard a great deal about Mr. Tickle but had never met him. He turned out to be incredibly nice, thoughtful, and polite. He actually even cited an Omniture TouchClarity case study when an audience member asked about the value of optimization technology!

Anyway, despite having had almost no sleep since I got to Europe, and it being 3 AM as I finish this post, everyone seemed to enjoy my “web Analytics is Easy” presentation and I heard several people talking about the Analytics Demystified RAMP over beers.  Thanks again to Lars Johansson for inviting me to Sweden and further motivating me to help foster WAW events around the globe!!!

Analytics Strategy, Conferences/Community, General

World Tour Day One: Helsinki, Finland

After a long flight from Portland > Minneapolis > Amsterdam > Helsinki I finally arrived at my first destination in Europe: Global headquarters of Satama, a leading European digital services company with a global clientèle and an energetic, insight-oriented crew and authors of Captain Blackbeak’s Blog (arrrrr!) I didn’t mention Satama in my last post because the event tomorrow is private for a select list of roughly 70 Satama clients and prospects.

I’ve known some of the Satama crew for awhile now online but it was nice to put names with faces! Here are a few of those faces so you can play along at home:

Mikko Isoniemi, Business Unit Director for Analytics, and Steve Jackson, Senior Consultant for Analytics

Janne Korpi, Project Manager and Team Leader for Analytics

Many of the Satama crew, including Mia Luostarinen (front left) who provided invaluable help getting me to Helsinki!

I’m very much looking forward to meeting Satama clients tomorrow at the presentation, after which Steve, Mikko, and I will be heading directly to Stockholm, Sweden for Lars Johansson’s totally sold-out Web Analytics Wednesday event!

Adobe Analytics, Conferences/Community, General

Analytics Demystified World Tour starts tomorrow!

I’ve blogged about my travel schedule a few times but tomorrow I’m heading out on the official “Analytics Demystified World Tour” and I’d love to catch up with my blog readers if you’re coming to any of the following events:

  • Tuesday, September 11th I will be with the great Lars Johansson at the totally sold out Web Analytics Wednesday event in Stockholm, Sweden.  This event is co-sponsored by the nice folks at WebTrends, Omniture, and IndexTools and promises to be a full-evening of web analytics “demystification” for the 80+ folks who will be in attendance.  I will be giving my “Web Analytics is Easy!” presentation and then we’ll have a panel of experts that includes Dennis Mortenson of IndexTools, Ian Tickle from WebTrends, Steve Jackson from Satama, and Magnus Hultman from Omniture.  Despite this event being sold out/standing room only, you can still contact Lars about getting on the wait list.
  • Thursday, September 13th I will be presenting at e.Day 2007 in Rotterdam Holland.  I’m excited about presenting at e.Day since I will be working along side industry giants like Biz Stone (Twitter), Rolf Skyberg (eBay), Martin Stiksel (Last FM), Sep Kamvar (iGoogle), and Mark Fletcher (Startupping.com but you may know him as the founder of Bloglines)  You can see the entire line up of speakers at the e.Day web site.
  • Friday, September 14th I will be presenting three times at OX2’s Web Analytics Day in Brussels, Belgium.  I am hugely excited about this event since I will get to hang out with my good friends Rene, Aurelie, David Rhee, and even Ian Thomas from Microsoft who will be on hand to give the first public demo of Microsoft Gatineau.  Some great news that you may not have already read is that WEB ANALYTICS DAY IS NOW TOTALLY FREE for practitioners of web analytics.  Yep, thanks to the generosity of the sponsors, practitioners can join us at no charge and consultants pay only a small fee to attend this event that is sure to be talked about in Europe for years to come.  I hope you’ll join me in Brussels!

When I get home from Europe I will have barely enough time to clean my clothes and catch up on email before heading right back out on the road, this time in the American West.

  • Tuesday, September 18th I will be leading the Advanced Analytics workshop at Shop.ORG in Las Vegas, Nevada, working again with my good friend and former co-worker Patti Freeman-Evans of JupiterResearch.  Those of you who have been to Shop.ORG in the past know what an excellent event this is and how much fun it will be in Las Vegas.  Patti and I will be giving short presentations and then we’ll be leading an expert practitioner panel that features my good friends Dylan Lewis from TurboTax, Kim Weller from Circuit City, and Michael Fried from Backcountry.com.  If you’re coming to Shop.ORG, please join us in the Advanced Analytics session!
  • Thursday, September 20th I will be giving the keynote presentation at SEMphonic X Change in Napa Valley, California.  I am hugely honored to have been asked to present the keynote at this event, especially considering the rock star lineup that will be on hand to run “huddles” and help make X Change a unique event in the web analytics community.  If you haven’t already decided to go to X Change and would like to join us, send me an email and I’ll gladly help you save 15% off the cost of attending.

If you have any questions about how to hook up with me at any of these presentations, please don’t hesitate to write.  I always love meeting my book and blog readers in person and am always happy to sign copies of Analytics Demystified and Web Site Measurement Hacks if you bring them along.

See you on the tour!

Analytics Strategy, Conferences/Community, Reporting

Congratulations to the WAA Standards Committee!

I wanted to say congratulations to Jason Burby, Angie Brown, and everyone on the Web Analytics Association’s Standards Committee for publishing their standards document last week. Given the number of web analytics terms they defined (26) and the somewhat slow process the Association has for getting documents approved, this effort is a huge milestone for the organization, one that Jason and Angie deserve great praise for indeed!

If you haven’t already downloaded and read the definitions, check them out here (PDF download).

While the PDF document says that the final product is “Web Analytics Definitions – Version 4.0” this is clearly a “Web Analytics 1.0” document. The committee relegated all of the really wonderful Web 2.0 stuff like AJAX, RSS, XML, and the such to the same confusing obscurity they exist in today with the comment “certain technologies including (but not limited to) Flash, AJAX, media files, downloads, documents, and PDFs do not follow the typical page paradigm but may be definable as pages in specific tools.”

Given the last year’s push towards measuring Web 2.0 the right way and some great, insightful work from folks like Ian Houston and Judah Phillips it is kind of a shame that this document doesn’t address event-based measurement architecture more directly. The group does define “event” but only does so under the header of “Conversion Metrics” stating that an event is “any logged or recorded action that has a specific date and time assigned to it by either the browser or server.

Sounds like the definition of a Web 2.0 event to me, but I’m not sure why this is relegated to conversion metrics.

Regardless, this is great and valuable and useful work on the part of these hard-working volunteers. But the definition of standards raises one particularly important question: Given the definition of standards, what the hell do web analytics practitioners do with them?

The Fundamental Problem

The fundamental problem with these definitions (and any standard definitions IMHO) is that without an enforcement mechanism they are unlikely to provide any real benefit to the folks in the trenches. As long as smart folks like Eric Enge at Stone Temple Consulting continue to uncover as much as a 154% difference in the measured number of visitors and a 161% difference in the measured number of page views between concurrently deployed solutions, the average web analytics end user should not be comforted by the existence of standards.

Put another way, it is not the definition of standards that makes a difference, it is the adherence to standards by technology vendors that will provide the portability of skills, knowledge, and solutions so desired by many in our industry. Jason Burby sagely points this out in his Clickz article on his volunteer work when he says:

“Companies often switch metrics tools and subsequently change the terms they use to discuss analytics. One tool will call something one name, while another tool calls it by a different name or applies different meanings to a very similar name. When people switch tools and bring data with them, they don’t get an apples-to-apples comparisons. As a result, companies lose the important year-over-year view.

Though the new standards won’t instantly take care of that issue, they provide a step in the right direction.”

The Barrier to the Adoption of Standards

The problem as I see it is this: For many web analytics vendors, the way they calculate some of the critical metrics in web analytics is the “secret sauce” in their solution. Consider the WAA’s definition of unique visitors which states that unique visitors are:

“The number of inferred individual people (filtered for spiders and robots), with a designated reporting timeframe, with activity consisting of one or more visits to a site. Each individual is counted only once in the unique visitor measure for the reporting period.”

This is perfectly reasonable, but the definition goes on to say that “a unique visitor count is always associated with a time period (most often a day, week, or month), and it is a non-additive metric.”

Do you wonder what the folks at Visual Sciences who have spent millions to perfect their “data wheels” technology that effectively removes the “time period” requirement would say to this? One of the major value propositions at Visual Sciences (at least during my brief tenure) was that time was irrelevant — if you wanted the number of unique visitors for the football season, you dragged your mouse across the calendar; if you wanted the number of unique visitors for a few hours during the day, you dragged your mouse; if you wanted the number of unique visitors to your site since recording began, you dragged your mouse.

You can make the case that this example more or less removes the time dependence associated with the WAA definition. But should all the vendors who don’t have this capability (anywhere you are forced to use metrics like “Daily Unique Visitors”) spend the R&D money necessary to eliminate the dependence on time? Or should Visual back this functionality out of their application?

When you start to think about these kinds of things, much less issues associated with data sampling and data roll-off that occurs for a litany of reasons, you can start to understand why I made this somewhat snide comment in a MediaShift article awhile back:

“A friend of mine described it as the most beautiful fantasy…but it would never happen,” consultant Peterson said. “Omniture has a $1 billion market cap, and I don’t see Omniture tearing apart their technology to calculate unique visitors and page views differently because all their competitors have decided there’s a different way to do it. It’s hard to imagine. Not impossible. Fantasies sometimes come true.”

Ironically the cost isn’t the main problem: The impact on existing customers who would be forced to learn new definitions and suffer from potentially dramatic changes in data collection and reporting is the main problem. Do you want to be the person who has to tell a Fortune 500 customer that because you’re adopting more standard definitions that their page view count will suddenly drop by 35% month-over-month?

I had to do that once. Trust me here, it wasn’t a fun conversation to have.

An Idea in the Absence of a Solution

Given that I think that the WAA has produced some incredibly valuable work, despite some potential barriers to the work’s adoption, I do have an idea that I would love to see the Association follow-up on, one that would add a tremendous amount of value to this already great work.

I would love to see the Standards Committee create a matrix of standards compliance for each of the vendors in the marketplace today. Basically a checklist that details on a term-by-term basis which vendors are currently using the WAA definitions that would let companies looking for a solution to include that criteria in their assessment. Something that would let everyone quickly determine:

  1. How standards compliant a given solution is (and which solution today is “most compliant”)
  2. Which standard definitions are calculated out-of-box in each solution (for example, “Original Referrer” and “Bounce Rate”)
  3. Which currently available solutions dramatically differ from the norm in their use of standard terms

Something like this would probably have to be backed up with some documentation or examples as proof points, just for reference. And yeah, this is kind of a lot of work, but if you think about it all you really need is for one WAA member per solution to poke around in their documentation and then someone (Jason and Angie maybe) to collate the results and write it up. I would be happy to contribute the matrix assessment for the web analytics solution I’m using now if that would up!

Who knows, maybe we’d discover that all the vendors are already standards compliant and there really isn’t a problem with definitions!

What Do You Think?
I’d love to hear what all of you think about the new standards and my concerns about how they’ll be used (or not used.) Am I missing something? Were you disappointed to not see something that spoke more clearly to your concerns about Web 2.0 technology? Or are you just pleased that the WAA published these definitions and see them as a small-but-important first step?

Analytics Strategy, Conferences/Community, General

Congratulations to Jennifer Veesenmeyer and June Dershewitz!

I have been patiently and politely holding my tongue for quite awhile now waiting to say CONGRATULATIONS to both Jennifer Veesenmeyer and June Dershewitz on the career changes they recently made!

Jennifer has joined the already great team at Stratigent as a Senior Web Analytics Consultant, bringing her experience and very well-liked presentation technique (highest scoring presentation at Emetrics, ever, I read!) to Stratigent and their clients. I missed Jennifer’s PIMP my Reports presentation (which apparently she doesn’t own the rights to, too bad!) but heard only amazing things about it. She and I are presenting together at Emetrics so that should be fun!
June has joined Gary Angel and the team at SEMphonic as Vice President of Analytics! I’ve written about June in the past, citing her as one of my personal heroes and the inspiration for Web Analytics Wednesday. June and I even talked about her joining me as a partner at Analytics Demystified but alas, the timing was not quite right. Thusly I am thrilled that she has joined another of my favorite people, Gary Angel, bringing her significant expertise to SEMphonic clients.

Both Stratigent and SEMphonic are Analytics Demystified business partners so this news is even better since my clients will eventually be able to benefit from Jennifer and June’s greatness as well. Win-win-win!

Congrats to Josh Manion and Gary Angel on adding these very talented professionals to their teams.

Adobe Analytics, Conferences/Community, General

I'm doing a free Webcast for the WAA on August 29th …

One of the things a lot of companies struggle with is the actual “doing” of web analytics — but web analytics is easy, right?

On August 29th I’ll examine some of our assumptions and share my foolproof strategy for success through measurement. If you’ve ever struggled to transform data into insights and insights into action, this presentation is for you!

I will also be leaving a lot of time for open Q&A at the end of the call, to give attendees a chance to pick my brain about whatever topics they would like.
But, you have to be a Web Analytics Association member to attend this free event. Yep, the WAA is a co-sponsor and they’re trying to drive membership so hopefully this (and a series of other similar webinars they have planned with industry leaders like Jim Novo and Jim Sterne) will encourage non-members to join this fine organization!

If you’re in the Web Analytics Association already you can go to a password protected page on their site to register:

http://www.webanalyticsassociation.org/en/cms/?994

If you’re not a member, but are interested in joining the organization, you can follow this link to get more information about the WAA and join today:

http://www.webanalyticsassociation.org/en/memberships/applications/add.asp

Analytics Strategy, Conferences/Community, General

Lars gathers some of the best and brightest in Europe to chat

I’ve never been much for listening to podcasts for some reason but all the sudden I seem to be listening to them all the time. Last week it was Bryan’s interview with Avinash Kaushik from ZQInsights. This week it’s Lars Johansson, the Swedish coordinator for WAA, talking to seven of the brightest minds in web analytics in Europe.

Having recently been to Europe, I was delighted to listen to this conversation. While in Holland I presented data (links to a PDF) showing that European web analytics practitioners are not far behind their U.S. counterparts. When you listen to the podcast you’ll hear the participant’s talking about nearly the exact same challenges we all face here in the U.S. Concerns about process, distribution of decision making (Aurelie talks about pan-European companies, essentially multiple divisions but that speak different languages, have different values and expectations, etc.)

This is a long podcast but well worth a listen if you have time. Great work, Lars, bringing these bright minds together for the conversation.

Adobe Analytics, Analytics Strategy, Conferences/Community, General

Bryan, Avinash, and Judah …

I am just finishing up listening to Bryan Eisenberg’s interview with Avinash Kaushik, author of Web Analyics: An Hour a Day (which was in my office when I returned from San Francisco last week, thanks Avinash!)  Even if you’re not much for podcasts you should spend the time to listen to these guys talk.  Bryan asks Avinash some great questions and Avinash, as usual, provides some really great answers.

Also, Judah (who is not afraid to take on hard subjects) has opened his own can of worms with a post on selecting a web analytics vendor.  I personally know that Judah went through the selection process with two top vendors recently so it will be interesting to see both what he comes up with and also what comments he gets from his readers.

I’m off to Boston tomorrow for a variety of meetings and presentations.  If you’re in the Boston area, please join me at a special Web Analytics Wednesday on TUESDAY at Aquent headquarters (711 Boylston Street).

Adobe Analytics, Conferences/Community, General, Reporting

Analytics Demystified and Stratigent partnership and more

Today I am happy to announce Analytics Demystified’s third business partnership and our relationship with Josh Manion’s firm Stratigent.  I’ve known Josh for years and have always had a tremendous respect for the work he’s done and the firm he has built from the ground up.  Stratigent has a proven history of successful execution in long-term and tactical web analytics engagements, as well as a methodical approach to the vendor selection process (a service I have opted specifically to not provide through Analytics Demystified.)

You can read about our business partnership in the press release and I’m happy to take any questions directly via email.

Eric T. Peterson delivering the keynote at SEMphonic XChange conference
Also recently announced was SEMphonic’s XChange Conference where I will be delivering the keynote presentation and a class on key performance indicators.  I’m very excited about this conference and was thrilled when Gary asked me to deliver the keynote given that several other great speakers will be at the event including Gary, Paul Bruemmer, Jacques Warren, and Manoj Jasra.

You can learn more about the SEMphonic XChange Conference at SEMphonic’s web site.

Response to last week’s research announcement
The research that Analytics Demystified and the Web Analytics Association put out last week was very well received, having been written up in Newsfactor, BtoB, Daily Research News, ClickZ, MarketingVOX, E-consultancy, Online Media Daily, and DMNews.  You can follow all references to my company, our work and our research on this sites Articles and Interviews page.

If you haven’t yet seen the research, you can download the PDF from our web site.

Eric T. Peterson is writing for DM News!

I had been waiting and waiting to make this announcement until my first article was published by when I formed the company the nice folks at DM News asked me to write a regular, monthly column on web analytics.  My first article appeared in the June issue of DM News and is available online at dmnews.com.

I have been a big fan of DM News ever since they published their special report on web analytics in August of 2006. Since that time I have been lucky enough to be a trusted resource on the subject for the publication and look forward to this new relationship.

Presentation on KPIs at BMA Annual Conference, Thursday June 14th

Tomorrow (Thursday June 14th) at 10 AM I will be presenting on key performance indicators at the Business Marketing Association’s annual conference in Las Vegas.  The presentation will be a dramatically shortened version of our workshop on KPIs.  If you’re at the conference and would like to meet please come to the presentation and look for me afterwards.

Special Web Analytics Wednesday on TUESDAY in Boston, next week

Hopefully those of you who live in beautiful Boston, Mass. will be able to join me, my good friend Judah Phillips, my business partner Aquent, and the nice folks from Unica at a very special Web Analytics Wednesday event next Tuesday, June 19th.  I will be testing out a slightly new format for WAW events and giving a short presentation so hopefully that goes well.

If you’re in or near Boston please sign up today to join us for this special event.

Adobe Analytics, Analytics Strategy, Conferences/Community, General

Video from Jeremiah Owyang and the WAW Guru breakfast

About a month ago, just before I started Analytics Demystified, I had the pleasure of sitting down for an interview with Jeremiah Owyang of PodTech.net. Clint first introduced me to Jeremiah when I was talking about measuring visitor engagement and how social media might be best measured. Jeremiah is very much connected in the Bay Area and I though the interview went really well (but you can judge for yourself by watching the interview at Jeremiah’s web site.)

A number of folks have commented on the interview at Jeremiah’s site and the comments are well worth a read.

More recently I wrote a post on the 10/20/70 Rule for Achievable Web Analytics Success in which I outlined the importance of process to web analytics. A number of folks have since commented on the post but Rene Dechamps from OX2 was kind enough to post a video from the conversation that got me thinking about 10/20/70 (thanks Rene!)

Since Rene was about as tired as I was at 7:00 AM local time, and he’d been kind enough to bring me a coffee, I recommend ** not ** trying to watch the video and just listening instead.

What do you think?  Should I stick to writing and stay off the tele?  As always, I welcome your comments.

Analytics Strategy, Conferences/Community, General

Research summary from our March 2007 survey now available

The overview document I promised when we conducted our survey in March and April is finally available and can be downloaded here:

http://www.analyticsdemystified.com/research/

You can read the press release that was written about the research here:

http://new.marketwire.com/2.0/rel.jsp?id=739164

There is also a very nice write-up on the research written by Jennifer LeClaire called “Process-Driven Analytics or Bust” published on the NewsFactor Network. In the article Jennifer explores the data and captures good insights from both Megan Burns at Forrester and John Lovett at Aberdeen.

From Megan Burns:

Web analytics is so complex, Burns added, and there is so much analysis that organizations could do. Day-to-day reports need to be institutionalized, she explained, by putting in systems and processes that function smoothly.

“With a process-driven approach, your Web analytics analysts have the time to do higher level activities, advanced analysis, support multivariate testing, and other activities that deliver additional incremental value to an organization,” Burns said.

From John Lovett at Aberdeen:

“The next level [in web analytics] is establishing business processes so you can use analytics to measure results,” said Aberdeen’s Lovett. “That is the best way for companies to leverage the analytics platform.”

Thanks to Zori Bayriamova (my research partner), the Web Analytics Association (our research distribution partner) and over 1,000 people around the world who responded to our request for help with this report. We will be publishing follow-up reports over the next few months so definitely keep in touch.

Again, you can download this research at:

http://www.analyticsdemystified.com/research/

Adobe Analytics, Analytics Strategy, Conferences/Community, General

More feedback from the blogging community about my new company

I am blown away by the coverage of my announcement that I’ve left Visual Sciences to form my own company. I’m so behind on thanking people who have written about the news I wanted to summarize their thoughts and thank everyone en masse.

  • E-consultancy in the UK wishes me luck and says that my decision to help companies understand the process of doing web analytics is “bang on” which I’m pretty sure is a compliment. Thanks to Richard Maven for reaching out to me after the press release and I look forward to hopefully meeting the e-consultancy crew when I fly to Europe later this month.
  • Gary Angel from SEMphonic is a good friend but I was still humbled by his declaration that my announcement was “the biggest news out of Emetrics” Gary says that “[Eric is] consistently thoughtful. His opinions are rooted in real-world work. And see seems remarkably able to deal with web analytics at every level very successfully: from introducing web analytics to marketers to working hands-on with real analysts to helping senior executives get a handle on web measurement process. When you can do that and not get on the nerves of people like me, you’re doing something pretty special.” Coming from someone I respect as much as Gary this means a huge amount to me.
  • The bloggers at FutureNow congratulate me on not being afraid to “ask bigger questions
  • My good friend Judah Phillips (who blogs here at Analytics Demystified) says I have achieved self-actualization. Judah also bought me dinner on Tuesday night after I had been celebrating for several hours over vodka drinks so thanks to both Judah and his fiance.
  • Jacques Warren, who also recently left the comfort of his day job to become a consultant in Canada and who clearly read the copy on my web site and understands what I’m doing. Jacques comments “Do you realize? This guy is going to make a living telling companies how to organize Web Analytics” to which I can only say, “Yes.”
  • Anil Batra, who looks nothing like that lousy little picture of him on his blog, had an inkling of my intentions but was surprised by the timing. Thanks for the encouragement, Anil!
  • My good friend René Dechamps Otamendi from Belgium who has a good summary of my business model and who captured an interesting photo of my singing happy birthday to Aurelie Pols (his wife, and a member of my company’s advisory board.) I consider Rene and Aurelie two of the nicest people I know and am excited about the opportunity to work more closely with them in the future.
  • Sebastian Wenzel at Web Analytics Book wishes me luck and speculates that I’ll be plenty busy soon.
  • Marshall Sponder says he’s listening to me when I give him advice, which is good to hear, since he’s now on a WAA board with $250,000 in cash burning a hole in their pocket. Hey Marshall, you should buy a copy of my book for everyone in the organization. 😉

Phew. And that’s just what I culled out of my feeds this morning. I sincerely want to thank all of the bloggers I mention here and anyone I forgot. I’m hugely excited about having the freedom to explore other ways I can help the web analytics and broader business community and hope all of you will keep reading this blog and provide feedback as you think I need it.

Adobe Analytics, Analytics Strategy, Conferences/Community

Can't make Emetrics? You're in luck if you're in the WAA!

We’re just a few days away from the big event in San Francisco and I admit I’m getting excited. It’s so nice to be able to see old friends (congrats Ian, by the way!) and hopefully make a few new ones. I’ve even started making final preparations for the event.

I’m not sure how they’re advertising this event, but the WAA International Committee is piggybacking on the “Ask the Guru’s Breakfast” that Jim and Matthew have put together and offering the ability to join the breakfast virtually. According to the WAA web site:

  • 30 minute exclusive analytics discussion between Eric Peterson, Bryan Eisenberg and Avinash Kaushik
  • Virtual attendance at the San Francisco Emetric’s Summit Guru’s Breakfast – your chance to listen in to this one hour session with Eric Peterson, Avinash Kaushik, Bryan Eisenberg and Jim Sterne,
  • A question and answer session for international attendees

This event is limited to WAA members but my understanding is that the recorded event will be made available to everyone sometime in the coming weeks. If that is not the case, I will have some of my deadhead friends in San Francisco make a bootleg tape and we’ll share via the Archives.

Sign up today to join us in San Francisco, even if you’re not coming to Emetrics!

Adobe Analytics, Analytics Strategy, Conferences/Community, General

Are you coming to Emetrics?

It occurred to me today that by this time next week I will have already given my “Guru” presentation at Emetrics and will be dining with some of the brightest minds in the web analytics industry. While I have been almost zealous in my recommendation of Jim’s conference for the past six years (am I “old school”, or just “old” … you decide) I have to say I am excited about this particular event more than any other.

Why, you ask?

  1. Robbin’s “Birds of a Feather” Web Analytics Blogger’s luncheon on Monday, which I think was not Robbin’s idea but nonetheless is a wonderful idea! There are dozens of web analytics bloggers now, many of whom will be at the conference, and we’re having a private little meet-up. This is cool since my friend Judah can join us now, having recently joined the blogosphere!
  2. Great looking presentations from some of my favorite people in the industry, including Jim Sterne, Jason and Shane, Brett Crosby, Megan Burns, Robbin, Jason Palmer, John Marshall, Bill Gassman, Seth Romanow, Jodi McDermott, Jen Veesenmeyer, Rand Schulman, Josh Manion, Ian Houston and Judah Phillips, Kevin Heisler, Eric Hansen, Bryan Eisenberg, Bob Chatham, Gary Angel, … okay, so I pretty much just listed half of the presenters. As I look at that, do any of you remember when vendors weren’t allowed to present? I used to be special …
  3. Even greater looking presentations from a ton of people I know of but have never had the chance to meet formally, including Tim Kopp, Lou Rosenfeld and Rich Wiggins, Patrick Moran, Chris Gemignani, Paul Holstein, Lissa Gatz, and more!
  4. The Web Analytics Wednesday on Tuesday special event, which Jim and Matthew have graciously allowed to occur (and more importantly, have fully funded so we can have drinks, etc!) Are you already signed up? If not, sign up right now!
  5. Most importantly, I get to present to the entire audience this time in my “Guru Session” where, despite what you’ll read in the literature, I will be sharing the results of my recent web analytics survey. If you’re a data junkie like me, I promise that you will not be disappointed by my presentation.

Plus, the last five minutes of my presentation are not to be missed! Trust me on this one … there was one number that came out of the research that more than any will change our understanding of the web analytics industry forever. Sadly, you’ll have to wait until 4:45 PM on Monday, May 7th to hear what it was.

Anyway, if you’re coming to Emetrics and you’d like to get together please let me know. I will be in Sunday and in-and-out of the WAA training day so will have tons of time to sit down with folks and catch up.

Oh, if you have another minute, check out this humorous tribute Rene and Aurelie did for Jim Sterne.

Conferences/Community

The Web Analytics Association NEEDS YOU!

I was chatting with my good friend Bryan Eisenberg today and he reminded me that the WAA call for nominations to the board of directors is STILL OPEN but is closing soon. You can review the requirements and nomination process on the WAA web site but there is more you should know:

  • Bryan expressed that the current board is really looking for a practitioner as they have a number of consultants and vendors already represented. Nothing wrong with consultants and vendors … I mean hey, I think I’m technically both of those things … but the board needs some real-life, roll-up-your-sleeves web analytics practitioners to help shape the future of the association.
  • My personal observation is that the board is kinda guy-heavy right now (apologies to Andrea and Shubhra) so if you happen to be, umm, not a guy, and if you’re a practitioner, that would be an extra-added benefit to all us normal WAA member folks out here.
  • Another observation is that most of the people on the board are incredibly busy. Chris D’allesandro and Clint Ivy are too busy to blog. Jim Sterne is so busy he has to email us about his whereabouts from time to time. And Seth Romanow has a new job with Microsoft that is keeping him on his toes. Perhaps the reason that Bryan is looking for a practitioner is that they actually have the luxury of going home at night?

But enough of the soft stuff. Here are three people I’d like to see run for the board of directors and would get my vote (several times since I know how to delete my SurveyMonkey cookie!)

I’ll apologize in advance if any of my three candidates is uninterested or doesn’t have the time since I’m still going to write you in on the ballot.

Anyway, check out the nomination requirements and process ASAP since the time to vote is drawing near!

Analytics Strategy, Conferences/Community

A few items of note

[UPDATED: I mis-read the WAW announcement from Rene and Aurelie (see Rene’s comment on this post. I wish them all the best in Brussels!]

Here are a few small updates that I noticed that I thought worthy of passing along:

  • Bryan and Jeffery Eisenberg at FutureNow have completely redone their web site and have added a very cool RSS feed feature at GrokDotCom.
  • Jim Novo, one of the “OGs” of web analytics (man, I hope he takes that the right way!) is blogging! I didn’t see any email go out, or any announcement in the Yahoo! group, but sure as sunshine Jim is blogging at blog.jimnovo.com. Welcome to the navel-gazing contest, Jim!
  • Aurelie and Rene, the fine folks running the show at WebAnalytics.BE in Brussels, have announced that they’re going to bring Web Analytics Wednesday to the capital of Europe (Brussels!)
  • Speaking of Web Analytics Wednesday, remember that this month’s event is on FEBRUARY 21st to accommodate all you lovebirds out there who will rightly be spending February 14th with your sweetie. So far there are events planned in Quebec, Irving, Texas, and Sommerville, Massachusetts. Sign up and PARTICIPATE!
  • The fine folks at Digitas have two jobs posted on my premium job board, including a Vice President-level position.

I’m sure there is more but that’s all I have time for right now.

Analytics Strategy, Conferences/Community, General

An interview with one of my personal heros in the web analytics world

Often times people congratulate me for being smart enough to have started Web Analytics Wednesday, an event that was recently referred to as “the world’s only global social networking event.” While I think it’s great that the idea has caught on, I cannot claim sole ownership of the idea. In fact, the idea was nothing more than a fantasy until one person I had never met put the wheels in motion in her own community and simply made it happen.

That person was June Dershewitz.

When I finally met June for the first time, she turned out to be much quieter than I expected. June had done something nobody really expected people to actually do, she had paid her own way to Emetrics in Santa Barbara, not an insignificant investment. Over coffee one morning she told me she looked at is as an investment in her future. Boy howdy was she right!

June is as close to a web analytics superstar as they come in my book. She has experience, she is eloquent, and she understands how all the pieces come together to paint the bigger picture. She is one of the few people I know available (occasionally) for contract work in San Francisco and I consider her very much to be part of the heart and soul of our web analytics community. (Shhhh, don’t tell her I said that, okay?)

Recently I launched a new premium job board on my site with the folks from Simply Hired (the Job*a*Matic) in part because of the number of inquiries I would get from companies looking to hire bright folks just like June. But it occurred to me, what better way to explain what someone like June is looking for than to ask her directly. Our conversation went as follows:

Eric T. Peterson: June, tell me a little bit about your experience to date doing web analytics?

June Dershewitz: I’ve got 8 years of experience in the field of web analytics. Back in 1999 I took a job as a web analyst for a startup. After that I took a more technical role in data warehousing (still web measurement data). Since 2004 I’ve held a series of contract assignments as a web analytics specialist.

Eric T. Peterson: What kind of contract work do you usually do? More technical stuff or more analysis or more reporting?

June Dershewitz: It depends on what the client needs. Sometimes I get to do system implementation work. On other occasions I focus more on analysis, scorecards, reporting.

Eric T. Peterson: A personal question: what do you really like to do in the web analytics field? Put another way, given all your talents, which excites you the most?

June Dershewitz: I like to help businesses make the best use of web measurement data. I enjoy making improvements to what gets collected and how it gets interpreted and used within the company.

Eric T. Peterson: Can you share, without naming the company, some of the successes you’ve been or been a part of?

June Dershewitz: At one company, I was able to build out their existing web analytics system into something that’s now a useful and trustworthy source of information for a large audience. I felt like it was a big achievement to spread the word and help people see the business value in web activity data.

Eric T. Peterson: Excellent! No simple feat to drive widespread adoption of web analytics through a company.

New line of questions: What do you look for most in a job posting on the Internet (other than contract work and your local geography)?

June Dershewitz: As I scan a list of job postings, I look first at the job title and the company name. Job title usually gives me some clues about responsibilities and compensation. The company (and its industry) interest me as an analyst because I enjoy the prospect of a new and challenging set of data.

If I get that far I’ll read the whole job description and try to get a better sense of what the day-to-day work would actually involve, what tools they’re using (or hope to use), and if my skills match with what they’re looking for.

Eric T. Peterson: When you apply for a job, roughly what percentage of the time are you invited in for an interview? Given eight years of experience I’m thinking “often” but what would you say?

June Dershewitz: These days I post my resume on a couple of job boards and let interested parties contact me; I get a fair number of responses this way. I also monitor job postings and I’ll submit an application if I feel that I’ve found an especially good match. I’ve actually found four gigs in a row through postings where I’ve taken the initiative to apply.

Eric T. Peterson: Would you say it’s a “sellers” market for web analytics talent today? Perhaps more so than past years?

June Dershewitz: Definitely! As a job-seeker, it’s great to see so many open positions out there.

Eric T. Peterson: When you’re in the interview process, what impresses you most about a company vis-a-vis web analytics?

I really appreciate enthusiasm for the subject matter. It really grabs my attention when the prospective employer says, “We’ve got bucket-loads of web data and we could be making such better use of it! We could really use someone with your skills to help us figure out what’s interesting and what’s important and what we should be using to drive business decisions.”

To me that means there’s a challenge to be had.

Eric T. Peterson: What, in your opinion, are the best things someone relatively new to the field can do to prepare for a career in web analytics?

June Dershewitz: If the analyst track is your objective, it’s important to convince your prospective employer that you’d make a great analyst. Also, I’d recommend that you keep up with current issues in the field, read books, read blogs, talk to other analysts.

Show that you’ve got the curiosity it takes to enjoy this line of work

Eric T. Peterson: Okay, last few questions: In major markets, what do you think experienced web analytics professionals are worth from a salary perspective? I know you do more contract work but I wanted to see if you could/would share ballpark numbers that you’re hearing from folks?

June Dershewitz: I sometimes reference recruiting agency job postings where they’ve got salaries listed.

Eric T. Peterson: Cool. So are you looking for contract work now? If so, how can my readers get in touch with you and what should they know in advance?

June Dershewitz: I’m booked solid through the end of April, but I may be up for new opportunities after that. I also welcome communication from other veteran web analysts who’ve chosen to take the contract route. Find me on LinkedIn (http://www.linkedin.com/in/jdersh), send me an email (june.dershewitz@gmail.com), or say hi at Emetrics in San Francisco.

Eric T. Peterson: June, you’re awesome! Thanks for spending some time with me today. I’d wish you luck out there but knowing you, you don’t need luck.

Thanks again!

June Dershewitz: And thank you, Eric! I appreciate that job board you’ve put together.

It’s great to know that someone with June’s skills is reading my job board. In fact, she bugged me to set up an RSS feed for job postings which I quickly put together, just for June. If you’re looking for great jobs in web analytics, you might be interested in the feed as well:

http://www.analyticsdemystified.com/job_feed.asp

Adobe Analytics, Analytics Strategy, Conferences/Community, General

A question I get with some frequency these days …

As I have been doing more and more lately to help folks find and fill web analytics positions it seems like more emails like the following come in:

“I have just been promoted into a Marketing position and one of my primary responsibilities is web analytics. I do not have any formal education or experience with web analytics and I am expected to educate myself by any means necessary. After doing some research online, the first thing that I did was order your book, Analytics Demystified. I also picked up a copy of Waiting for Your Cat to Bark by Bryan and Jeffrey Eisenberg.What kind of advice would you offer to help me outline a practical education process? I know reading, as much as I can, will be expected and I have already begun the process. What about web marketing conferences? What about online courses like UBC Award of Achievement in Web Analytics? Would my company receive a greater ROI by having me take online classes or sending me to conferences? My gut tells me, to buy more books and take online classes, before I start worrying about going to conferences.”

The advice I would offer to anyone in this position is to do the following:

  1. Read the rest of my books, especially Web Site Measurement Hacks and The Big Book of Key Performance Indicators. The former is an excellent overview covering the breadth of things that web analytics professionals are tasked with doing and the latter is a deep-dive into the use of KPIs to help drive awareness of web data throughout the organization.
  2. Take the UBC Web Analytics Award of Achievement classes, offered via the Web Analytics Association. All of the feedback I hear from people who have taken the classes is excellent. The folks they have teaching the courses are world-class and the content that I’ve seen is both fresh and well-written.
  3. Join the Web Analytics Forum at Yahoo! Groups. While the conversation has a tendency to drift away towards the banal at times, the group is still the single largest and most active web analytics conversation on the planet.
  4. Read some of the web analytics weblogs to keep up on current happenings. I personally like mine (go figure), but I also highly recommend Avinash Kaushik and Gary Angel.
  5. By all means, go to the Emetrics Summit. Jim Sterne’s event is the single best place to meet the brightest minds, hear the best presentations, and meet the nicest people in the entire industry. There are upcoming events in London (March), Germany (April) and San Francisco (May).
  6. Ask your vendor what classes, documentation, presentations, etc. they have that might help you better learn how the technology is best used to create value. You’d be surprised at how much helpful information the vendors have when you ask.

If you think I’m forgetting anything I’d love to hear your comments.

Adobe Analytics, Conferences/Community

Do you live in the Washington, D.C. area?

If you live in the Washington, D.C. area, here are two events you should know about:

Speaking of Phil Kemelor, if you haven’t already checked out his book (see link above) you should have a look and see if it’s for you. Full of charts, diagrams, and checklists, this book is a real “hands on” guide to web analytics.

Conferences/Community

Web Analytics Wednesday Portland …

I have to say that last night’s Web Analytics Wednesday event in Portland, Oregon was a smashing success! We had good representation from a number of companies including WebTrends, Powells Books, Intel, Mentor Graphics, ISITE Design, the Web Analytics Association and of course, Visual Sciences who picked up the tab for the evening. I was smart enough to bring my camera so here are a few photos I grabbed while we socialized.

First we have Gordon, currently of Intel, and Jaimie, formerly of Intel, currently of Powells Books. Both gentlemen are sporting “Don’t Be a Fred” solidarity pins and have copies of Analytics Demystified and tasty Oregon homebrew so you know these guys are all set.

Next up is WebTrends own blogger, Eric Butler, seen here sporting his “Don’t Be a Fred” pin and flashing a smile that only a blogger who knows his picture is going to end up on a blog can flash. I’ve known Eric for years since we were both early-days hires at WebTrends. Eric has been solid as a rock, advancing through the ranks at WebTrends to his current position of Director, Systems Architecture.

Eric’s great to talk to because he has a ton of perspective on how measurement really happens. While he and I are always very careful about what we discuss (we being competitors now and all that) I very much look forward to his attendence at WAW events.

My third picture shows Nancy Taffera-Santos, formerly of WebTrends and currently in sales at DIRECT Magazine and the co-chair of the Web Analytics Association’s events committee. Nancy has a ton of energy and is tres enthusiastic about web analytics in general.

Nancy told me that she’s looking for a new co-chair for the WAA Events Committee–if any of you reading this are interested please let me know and I’ll get the word to Nancy. As you can see by the WAA informational page she’s holding up, Nancy is working hard to expand the ranks of the association and providing high-quality events and content for all web analytics practioners.

Finally, we have a picture of Jeff Katz, former WebTrends and current contractor with a variety of well-known organizations, sleeping. Jeff, like myself, has two small children at home and works entirely too much so I didn’t fault him for catching a nap at WAW.

As you look down the table you can see folks from Intel, Mentor Graphics and, at the end of the table, WebTrends new Digital Product Marketing Manager, Jenna Bussell. Jenna just moved to the Rose City from New York so I give her three more weeks before she’s bored to tears with our “country lifestyle” we appreciate so much here in Portland. I am told that inside WebTrends global HQ she is referred to as “Hurricane Jenna” … and it’s only her second week on the job.

All in all we had an excellent turnout and a gret time. You can read about other Web Analytics Wednesday events around the country in the Yahoo! group:

Adobe Analytics, Conferences/Community

New Google Analytics book is on the streets

I had been hearing about a book on Google Analytics for some time now and it just hit the streets. I haven’t had a chance to read it yet but Tim Seward at ROI Revolution has a nice write up on his weblog.

Tim’s funny. He talks a little bit about the book and then throws me mad props:

“As an interesting side note, and to highlight how far we still have to go to quench the thirst for understanding of the power of website analytics, 22% of all purchasers of this book from Amazon bought either of two books published by analytics luminary/author Eric Peterson (as of the date of this writing 12% bought “Analytics Demystified” and 10% bought “Web Site Measurement Hacks”). Eric has written practically half of all of the books on the subject.”

Tim, remind me to buy you drinks at Emetrics to thank you for the kind words. And, if you get your Web Analytics Wednesday up and running in North Carolina, let me know. I’ve been known to travel to Web Analytics Wednesday events and I love your part of the country.

It will be interesting to see how the G.A. book sells. I pitched O’Reilly on the idea back when they started giving it away but they were cool to the idea of Google books at the time. More recently I turned Yahoo! group co-moderator Brian Clifton onto an opportunity to write a O’Reilly Shortcut book on Google Analytics. I also know that “Web Analytics for Dummies” is coming out early next year … not sure if I’d buy a “for Dummies” book on this subject but who knows.

Anyway, thanks again to Tim and if you’ve got the G.A. book I’d love to hear your comments and impressions.

Conferences/Community

Web Analytics Wednesday in Boston was a success!

I went to Boston’s first Web Analytics Wednesday event last night and no surprise had a great time. Some highlights include:

  • Meeting Jared Spool from UIE and hearing how he approaches giving presentations. Jared, in case you haven’t seen him present, is a fantastic presenter. Like the Eisenbrothers, a “must see” presenter in my book!
  • Meeting Frank Faubert from Sane Solutions (recently acquired by Unica), someone who has been at this whole “web analytics” thing for about as long as any of us. His partner in crime, Akin Arikan, co-sponsored the event with me (don’t tell my wife, okay?) and had a nice post about the event today at the Yahoo! group.
  • Meeting Jeff Cram from ISITE Design, a Boston and Portland, Oregon based design and analytics firm. Jeff’s company is so cool they even put out a press release about their sponsorship of the Portland, Oregon event!
  • I also met Jeff’s wife, Jennifer, who is the Web Marketing Manager for Farm Aid. She asked me to mention to watch the Farm Aid Webcast on September 30th at 3:30 PM Eastern at www.farmaid.com. I asked her if she had met Willie Nelson but she just scowled at me.
  • Catching up with Eric Hansen, CEO of SiteSpect, and talking about the value that controlled experimentation provides for online businesses.
  • Meeting two very nice folks from the Harvard Business School who I pestered about the need for HBS to start offering coursework in web and multi-channel data analytics. They said they’d get back to me …
  • Meeting Hossam Elkhodary from Technology Leaders finally in person. Hossam has been a frequent contributor to the Yahoo! group for years so it was nice to meet in person.
  • Meeting Joseph Carrabis, Chairman and Founder of NextStage Analytics, who recently published a nice piece on Matching IT and Marketing Mythologies at iMedia Connection that references some background conversations we’d had.

Did I miss anyone?

All in all I am pretty excited about how this whole Web Analytics Wednesday thing is going. Someone asked me what I was thinking when I started it and it’s simply this: Web analytics can be lonely work in an organization, especially in an organization that doesn’t really value the data or ask for deeper analysis. In a world where social networking is the next really big thing, not having a social networking spot for web analytics people simply didn’t make sense! I mean, I wasn’t trying to be “Web 2.0” about it, it just happened.

Anyway, if you went to a Web Analytics Wednsday last night, how was it? And if not, WHY NOT?!

Conferences/Community

Web Analytics Wednesday is back in action!

After a summer hiatus in most cities around the globe it looks like Web Analytics Wednesday is back in action! I’m really pleased to see so many cities participating this month and especially excited for the folks in Stockholm, Sweden who have nearly 60 people signed up already.

I personally will be in Boston, Massachusetts for September’s WAW event, joining the crew from Unica and a dozen other folks. If you in Boston you should sign up to join us. If you can’t make it, you can use this handy form to let other folks who might be interested know about the event.

Hopefully by next month I’ll have worked out the details with Nancy Taffera-Santos, the Web Analytics Association’s Events Coordinator, such that these events will be co-sponsored by the WAA and Analytics Demystified. The idea behind working with the WAA is that local organizers will get access to the WAA’s membership, dramatically increasing the number of potentially interested folks invited to monthly get-togethers.

Anyway, keep reading this weblog for more information and if you’re already planning to attend an event this month, have a great time!

Analytics Strategy, Conferences/Community

We want Web 2.0 measurement standards and we want them now!

I had the great fortune this week to have dinner with Bob Page (founder of Accrue, currently at Yahoo!), Xavier Casanova (founder of Fireclick, currently running Perenety) and Bryan and Jeffery Eisenberg (who need no introduction.) At one point Bob turned to me and commented that he had a new book he wanted me to write; Bob wanted to see my take on how to measure Web 2.0.

This is a great idea and something I’ve been thinking about a lot lately. Think about the inherent complexity involved with measuring activity on your web site, the one where you ultimately own everything. Now think about how you’d get this same type of robust measurement from a mash-up. When you have a Google map, a widget like Bitty Browser, a ZoomCloud tag cloud and more in your web page—all applications unto themselves that don’t provide ANY TYPE of reporting about visitor interaction to the best of my knowledge.

So AJAX and Web 2.0 present a whole new suite of challenges to anyone considering their use who is concerned about measurement. And I think this is a freaking fascinating subject personally–something that has the potential to change our industry–so I’ve decided to propose a measurement strategy for all Web 2.0/AJAX/RIA applications designed to be mashed into other web sites.

I mean, why not just suggest that Web 2.0 is incomplete without providing the ability to measure it’s adoption in a meaningful way? You know you we’re thinking it already, right?

So here goes …

I want to be able to, with any request for an external application, pass in a visitor identifier and have the application record event level data for me. Then, later, I want to make a different request to the application and get back event-level information for all of my visitors who interacted with the application, keyed to the visitor identifier I originially passed in.

The event-level data would differ by application type. A tag cloud would report back something like:

VISITORID001 DATE/TIME Clicked on “analytics”
VISITORID002 DATE/TIME Clicked on “peterson”
VISITORID001 DATE/TIME Clicked on “kpi book”
VISITORID003 DATE/TIME Clicked on “event api”

Whereas a more complex application like Google Maps might report back something like:

VISITORID001 DATE/TIME Zoomed map to level 4
VISITORID002 DATE/TIME Added directions to [ADDRESS]

VISITORID001 DATE/TIME Dragged map to center of [LAT/LONG
]
VISITORID003 DATE/TIME Printed map

There would have to be a way to sync the dates and times such that these events could then be integrated into other clickstream data, essentially allowing these externally tracked events to be treated as “page views” in a clickstream path (“page view” being the canonical event type.) Still, those of you from the old guard–back when all we had was log files–will immediately recognize a simple log file and think to yourself either “Ahhhhh …” or “Dude, logs are so 1994!”

Regardless, those of us who use analytics packages that support hybrid data collection would simply take these logs and integrate them with our normally collected site data. This log-based approach is nice IMHO because the site owner could decide for his or herself which events they wanted included in the final analysis at integration time. Or, you could write a process that translated the text strings the application provider gave you into something more meaningful, you could categorize the events, etc.

Alternatively, assuming that few if any of the Web 2.0 application providers will actually build the necessary infrastructure to support this type of data capture and reporting, one could pass a reporting URL into the API and the application could use the reporting URL to log events using your existing meausurement application. For example, if I were to instantiate a Google Map like this:

var map = new GMap2(document.getElementById(“map”));
map.setCenter(new GLatLng(37.4419, -122.1419), 13);

Then the alternative method could be something like “setReportingURL” e.g.:

map.setReportingURL(“http://www.site.com/image.gif?ID=VISITORID001&EVENT=%5BE%5D&#8221;);

where the method would know to replace “[E]” with the encoded text string describing the actual event. This way, every time their was a meaningful event occurring, Google Maps would know to fire off a request to the tracking URL such that I could incorporate the event into my data set.

You’d almost surely have to also include the “ID=VISITORID001” string to properly sessionize the events and associate them with a visitor. The actual value of “ID=” would be set from the client based on the value of the tracking cookie.

I’m honestly not sure which approach I like better. The former is almost surely more robust from the viewpoint of creating a standard reporting API for “Web 2.0” applications, something Mark Baartse doubts will happen (Mark’s post being the only relevant Google result when I searched for “measuring Web 2.0”.) The latter is probably easier for the application providers to implement and more likely to work broadly given that only a handful of web analyics applications support integrating multiple data sources tied together by a common unique user identifier.

And yes, I realize that given a sufficiently robust API that you can already build this type of reporting. But man, wouldn’t it be easier if there was a standard tracking and reporting method that came with every such application that behaved the same way every time? Given that our industry has grown up almost entirely without standards, doesn’t this sound like a step in the right direction?

Keep in mind that this is only a technology proposal and only serves to highlight that every application provider would need to define and defend which events they reported and which they ignored. This is pretty much the same question we all asked ourselves seven years ago when Flash hit the scene and people started embedding script-based tracking inside Flash ActionScript.

It’s also the same question you have to ask and answer when you’re building any RIA: Which behaviors and actions are worth tracking and which should be ignored?

Maybe the practical solution is to set a level or threshold for event reporting–sort of a “few”, “many”, “firehose” hierarchy that would allow application designers to support a “log everything” mindset but allow their end users to be more conservative in what they actually collect and use. Few of the good Web 2.0 applications I’ve seen out there have enough events to really warrant this type of hierarchy; most are simple enough and likely to report click events which still provide great insight into visitor behavior.

Either way, there you have it, a line drawn in the sand. If Web 2.0 is going to change the Internet then I think the folks building these applications should play ball and report back on how our visitors are using their technologies. From the basic reporting I propose, sufficiently robust analytics packages will be able to calculate whether these applications have any effect on visitor retention, conversion, revenue, etc. Which, if you think about it, is exactly why the application providers should push reporting out ASAP.

Think I’m crazy? Have a great Web 2.0 application and want to implement my suggestion? Want to form an ad hoc Web 2.0 Measurement Standards Committee that meets on the second Wednesday of every month in a bar near you? Your comments are greatly appreciated and email is always answered.

Analytics Strategy, Conferences/Community

Casanova throws props at Web Analytics Wednesday

Over at Coffee, Sun & Technology, Xavier Casanova has a nice shout-out for Web Analytics Wednesday as a Web 2.0 event. When I first established the event nearly a year ago I wasn’t really thinking of it as “Web 2.0” I suppose I see what Xavier is saying, sort of “for the people, by the people” with a basic database to support it.

Honestly I like the idea of user groups, mostly because someone else picks up the tab. That said, I’ve never said that vendors can’t sponsor Web Analytics Wednesday events and would welcome the idea. Do any of you who have attended these events have any suggestions about how to improve on this Web 2.0 idea? If so, I welcome your comments!

Analytics Strategy, Conferences/Community

I'm excited about the upcoming UBC/WAA course on Creating and Managing an Analytical Business Culture

I got an email last week from Marianne Llewellyn at 2xL Consulting (who, if memory serves me correctly runs consulting services at Coremetrics) asking for volunteers to write content for the upcoming University of British Columbia/Web Analytics Association course on “Creating and Managing an Analytical Business Culture” and I have to say I’m very excited.

All of the coursework that I’ve seen from the UBC/WAA so far has been great (did you know you get all of the lectures from courses one and two on a companion CD when you buy Bryan and Jeff Eisenberg’s Waiting for your Cat to Bark?) but this course looks to me like the rubber hitting the road, everything you need to know about being successful with Web Analytics from vendor selection to organizational implementation. In my opinion, too many people are still focusing only on subtle variations in the numbers and not really working on how to use analytics technology to drive business success.

I wish I could encourage you to sign up for the course but it’s already completely sold out. Hopefully UBC will add a second session sometime in early 2007. Anyway, lucky you if you’re already signed up for the course.

If you’ve taken some of the previous courses, I’d love to hear your comments about how the courses have gone.

Analytics Strategy, Conferences/Community, General

I've updated my web site

Thanks to my friend Chris Garlotta who wrote me a few months ago and said, “Man, your web site is ugly!” I’ve finally updated the look and feel of Analytics Demystified. The site is hopefully now much more readable and more logically organized and I’ve added some new functionality. Some of the key additions include:

  • A special limited time offer that packages Analytics Demystified and The Big Book of Key Performance Indicators together for only $49.99 USD!
  • Expanded functionality in the Web Analytics Wednesday community tool including “Send to a Friend” and an RSS feed
  • A simple vendor code discovery tool, designed to quickly determine which of the hosted analytics vendors a web site is using
  • Some new promotional information including quotes that folks have started offering about my books.

I hope you’ll take the time to click back to the site and have a look around. Oh, and I’m interested in your comments if you care to leave them (and yes, I know the previous site was ugly but yeah, you can say that if you have to …)

Conferences/Community, General

No, I haven't dropped off the face of the Earth …

… but I have been busy redesigning my web site which has been taking up a ton of time. A friend gave me a great, new design but it got me thinking about some extra things I have long hoped to implement, mostly around book packaging and Web Analytics Wednesday events and planning. I had hoped to get the new site up this last weekend but the weather in Oregon was spectactular and thusly I ended up working in the garden, playing with my kids, lavishing attention on my wife, etc.

Keep your eye out for changes to my web site and hopefully when that’s I’ll done I can blog more frequently.

Analytics Strategy, Conferences/Community

(Nearly) Free Money from the WAA!

I just saw this post from Jim Novo of, among other things, the Web Analytics Association’s Education Committee. Apparently, if you’re a good writer and have any insight into the analysis and testing of …

  • Banner ads
  • Rich Media (Flash, EyeBlaster, etc.)
  • Branding
  • Buzz/Consumer Generated Media
  • Public Relations efforts

… then the WAA would like to pay you $500 for your work. Between 1,200 and 1,500 words which any good writer can kick out the time it takes to finish a double-tall nonfat latte.

Nice offer!

Analytics Strategy, Conferences/Community

Have you voted for your Web Analytics Association Board Members yet?

For those of you who are active members in the Web Analytics Association, you only have until March 30th to vote for new Board of Directors members. I was just looking at the nominees (requires member login) and noticed that two guys I know pretty well are running, Chris D’Allesandro and Clint Ivy. Chris and Clint are both web analytics bloggers and both extremely knowledgable about the web analytics arena in general having worked both as analytics end-users as well as analytics “process people” in very large organizations for years (Chris at JWT/Ford, Clint at Disney). These are guys that know the tools they use inside-and-out and have consistently pushed their respective vendors towards excellence.

While I am very sure that all of the canidates are well qualified to serve on the WAA Board of Directors, if I can figure out how the heck to vote, I’m voting for Chris and Clint. I think that it’s absolutely essential that experienced analytics practitioners like Clint and Chris help guide the Association, folks who have to do the real work day-in and day-out. Plus, their activity in the Yahoo! group and in their blogs will keep them doubly-connected to the largest part of the WAA’s constituency.

It’s too late to make “Vote for Chris and Clint” buttons but, well, hopefully you get the drift.

Analytics Strategy, Conferences/Community

Fred Kuu, talkin' about Web Analytics Wednesday!

Fred Kuu, HBX blogger, is pointing people towards the Web Analytics Wednesday event in Mountain View, CA next week. I’m pleased to see that the folks at Fireclick are sponsoring drinks, so nice of them!

It raises a good question about sponsoring these events. In general, I don’t have any problem with vendors or private parties ponying up money to buy the drinks at Web Analytics Wednesday events. As long as sponsors aren’t making people provide any information, something like “if you give me your phone number you can drink free …” which seems cheesy to me, I’m not going to stop anyone from buying drinks. This would also take some of the pressure off of Jacques Warren and the Web Analytics Association to feel like they have to buy the first round every month.

Who knows, maybe WebTrends will sponsor a Portland event?