Jason Hull is a principal at OpenSource Connections, a Solr search engine consultancy that works with clients across all three layers of the search experience to improve the search user experience in a cost-effective and revenue-driving way. Jason leads client engagements with marketing functions, helping them to think about the business case behind search. Jason holds a BSc from the United States Military Academy at West Point and a MBA from the University of Virginia’s Darden Graduate School of Business. Prior to founding OpenSource Connections, Jason led an analytics team at Capital One responsible for call center demand forecasting and managed their internal call center IT infrastructure investment budget. Jason is a DZone MVB and is not an employee of DZone and has posted 14 posts at DZone. You can read more from them at their website. View Full User Profile

Search Is Not Just an IT Problem

04.29.2011
| 9759 views |
  • submit to reddit

I recently attended the Fall 2010 Enterprise Search Summit anticipating that it would be a battle of the search engines – why choose Solr over FAST, Endeca, Autonomy, Google Search Appliance, etc. However, in talking to people who were there and wrestling with enterprise search problems, I realized that many of them were trying to determine a search engine technology strategy without incorporating that decision into a larger overall search strategy.

A computer will always do what you tell it to do, but not always what you intend for it to do. This is the case in developing a search strategy and for IT teams who are trying to execute the enterprise search technology implementation.

To me, search is about the user. It is a way for a user to find the information he seeks or that he didn’t know about in the first place with the most accurate results in the most rapid manner. Accuracy and relevancy is much more important than speed, as the average user won’t notice the difference in milliseconds in the search results, but will most certainly notice results that don’t further the inquiry.

Thus, the starting point and the keystone of implementing a search strategy is in defining users, both in who they are and what they seek, and also in what action you want from that user. Is your website an e-commerce website that generates revenues from sales, is it a website that generates revenues from advertising and needs long site visits (preferably with many page visits during the user’s stay and subsequent returns), or is it an internal knowledge site where the user is looking to find previous use cases to prevent duplication of work? Does the user have a specific need in mind, or are is he looking to expand his knowledge about a subject? Whom will the user trust?

These questions are just the beginning of the inquiry that a company must pursue to have an effective enterprise search strategy. Marketing and operations have to be involved in the planning stage. They can’t just turn to the IT organization and expect magic to happen. They also have to be involved in the discussion about the user experience. The user experience is what drives behavior to the desired outcome, and a search engine user experience is different than the broader term user interface. Chances are that your user didn’t land at your site’s home page, so the starting point is an indication of the path of travel for your user. Provide signposts for the user that tell him what to do next, where to go, and how to find more information.

A key component of extending the notion of search beyond the home page’s search box is to make faceted browsing available at many points within a website experience. Preventing the user from finding more information sacrifices the potential of broadcasting (allowing the user to expand out inquiry) for the sake of narrowcasting (assuming that the user is looking for one and only one thing). Getting a user to have a “hey, I didn’t know that…” response while on your site encourages inquiry and exploration and builds trust between the user and your site.

Once the users and their experience paths are mapped out, the marketing and operations teams need to determine what the metrics of success are. Broadly speaking, the categories are simple: for marketing, it’s an increase in revenue and for operations, it’s a decrease in cost. Still, at this point, it’s a multivariate analysis, so identify the interim steps that lead to the end result, such as decreases in abandonment and pogo-sticking and increases in time on site or time on a page. Next, measure a baseline. Without a baseline of statistics, it’s impossible to determine what, if any, progress has been made subsequent to a search engine strategy implementation.

Only at that point is an organization truly ready to begin analysis of a search engine technology. Evaluations of license cost, implementation cost, functional capabilities, organizational capabilities, and risk acceptance profiles all play into the determination of what search engine is correct.

Even after implementation of the search engine, the work is not done. Measuring the results, identifying candidates for A/B testing, tweaking relevancy calculations, and reevaluating user personnae mean that search is neither a fire and forget function nor just an IT problem to solve.

I’ve had many discussions with people who tell me that they’ve had problems with [insert name brand search engine here] and now are looking at Solr to improve performance. While Solr will often improve performance and relevancy, the discussion often should be reframed as “we’re not sure what we expect from a search engine, and we need help in determining what we want to do and how Solr can help us to get there.”

Otherwise, enterprises simply are not unlocking the power of a true, holistic enterprise search strategy.

References
Published at DZone with permission of Jason Hull, author and DZone MVB. (source)

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)

Comments

Javin Paul replied on Fri, 2011/04/29 - 6:52am

Completely agree and this article makes my respect for google even higher.  Google search result is most accurate search results available in web and most of the time it provides you what you are actually looking for developing and updating such search algorithm is not an easy task and just imagine your life without google :) is it possible even ......

Javin
5 tips on writing equals method in Java

Jason Hull replied on Fri, 2011/05/06 - 1:30pm

Javin-- Thanks for the comment. Google definitely has its place and we're all in debt to it for creating awareness of search. I'd love to get your thoughts on this article about why you can't Google for something in the enterprise: http://www.scribd.com/doc/17563004/Why-You-Cant-Just-Google-for-Enterprise-Knowledge Thanks! Jason

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.