Cuil is (currently) destined to fail

September 6th, 2008

As stated in our previous post, 97% of people we have tested use Google. It is the first and only search engine most all surfers employ. Google’s simple yet efficient display has moulded user’s subconscious search habits and preferences so strongly that new interfaces departing from its model are almost destined to fail even if they do have a compelling offering.

The two/three column approach taken by Cuil challenges the habitualised search behaviour people have developed using Google; it is not intuitive to a world of searchers with an unconscious preference for Google’s linear format.

In addition to this, people are happy with Google, a sample of 90 people recently tested by Think, 86% said they wouldn’t use anything else.

Cuil was created by two former Google employees and it boasts to have the largest search capacity to date, but is that what users are really interested in? People have learned how to search efficiently in order to minimize the time spent searching so how does a 3 column layout with paragraphs of text going to align itself with the learned behaviour?

We tested a sample of 30 people using the new search engine to better understand this.

As shown in the heatmap above, Cuil’s 3 column layout promotes localized areas of attention. Fixations are concentrated upon the headers – this is also where participants clicked to access their desired internet pages. The top results acquired the largest amount of fixations, receding gradually from left to right and top to bottom. Results appearing below the category search box suffered from a low fixation count as they were the last in the viewing order. Although limited attention was paid to the category search box, people did verbalise a sense that this would be helpful.

Breaking from the familiar linear format of Google has lead to an inconsistency in people’s visual behaviour. The gaze plots below illustrate some of the representative paths taken. The many long saccades indicate that users were confused. The page layout is different to the familiar flow of Google and so breaks with the users’ subconscious models of how to search. We believe this is a fundamental problem that will prevent users adopting Cuil.

Users also verbalised their confusion and dissatisfaction:

“When you first see it, it looks too busy. I have to choose what I want to look at.”

“I don’t like the layout – it’s too long-winded; too wordy, and I tend to look at things in a list rather than a box layout.”

“I just looked at the headings instead of the black writing. You wouldn’t need to have so much text if you knew what you were looking for. I think there’s more info than you need on it. It’s just supposed to give you a link. There’s lots of things you don’t see because you don’t bother to scroll down for it.”

Cuil’s layout challenges, rather than takes advantage of, the habitualised search behaviour people have developed through years of using Google.

For this reason we think Cuil is currently destined to fail.

Has Google gotten better?

September 4th, 2008

How many times do you use Google each day? Each week? Each month? Countless times! And would you say you use it in the same way you did a couple of years ago?

It’s likely that you don’t.

There has been a significant shift in search pattern behaviour; one that reflects rational and effective time management; one that is a result of habitualisation. Here at Think Eyetracking, we conducted a study into search behaviour to explore this.

In a 2005 study we found that people looked through many of the search results before clicking on one. The distribution of attention using Google can be seen in the heatmap below.

In our most recent study, we had 30 participants search for the broad term, Oasis. PEEP methodology was employed; participants were eyetracked while completing the task and later asked about their usual behaviour.

As seen in the heatmap above, fixations are studded around the top 5 results and the majority of clicks are upon the top 3 results (discounting the sponsored link). The sponsored link was actually not well attended to due to the fact that searchers are now familiar with advertiser placement within Google. The 2008 heatmap supports the recent trend observed by Cornell University (Their study found that the top 3 Google results get 79% of all clicks) and by AOL (Findings were that 63% of clicks were concentrated upon the top three search results).

Furthermore when asked afterwards what they would normally do when they couldn’t find their desired search result on the first page of Google, 87% respondents replied that they would modify the search terms or refine the search by category. 97% of people tested answered that Google was the search engine they most commonly used and out of those people, 87% stated they wouldn’t bother using anything else.

It’s not clear that Google has gotten any better, but certainly our use of it has become habitualised. Google’s popularity and dedicated following mean that a large majority of users have grown extremely familiar with the search giant and refine searches to display exactly what they need within the top 5 results. We now expect to find our required answer in the top 5 results.

The use of Google has become habit and users have optimized their behaviour accordingly; they now act in order to eliminate the need to scroll below the fold or sift through additional pages of results. Nowadays to compete competently, you must know your customer’s search words, and land in the top 5, if not top 3 results.

Why Think Eyetracking?

September 1st, 2008

Think helps deliver on the promise of marketing;

Create and maintain profitable relationships with consumers.

To date marketing has not delivered on its promise; approximately 80% of all new products launches fail to meet pre-launch expectations.

How can a multibillion dollar industry that employs lots of smart people and ideas get it so wrong?

The answer is simple, if not obvious: market research has largely ignored the importance of consumers’ subconscious minds. Consumers are rarely aware of what they are doing and why they are doing it – cognitive scientists have a rule of thumb “unconscious thought is 95 percent of all thought”, some believe this may be a serious underestimate. I know this may be hard to believe, so think for a moment about your daily commute today, how much of it do you remember?

Probably very little, if you take the same route to work each day. This is because your subconscious mind takes you there on autopilot; there is no need to engage your executive, conscious mind unless something novel or unexpected happens. If you need more convincing go and shop your usual weekly or monthly grocery shop at a new store. Pay attention to how it feels to need to engage your executive mind to find items when you are used to using your habitual mind. It is frustrating!

To date, market research has addressed the conscious or executive mind with questionnaires, focus groups, satisfaction surveys and the like. The problem is the conscious mind is at best only partially responsible for the many decisions people make on a daily basis. One unfortunate but real consequence of this is that 43% of smokers relapsed again within 12 months after undergoing surgery to remove cancerous parts of their lung (according to study by Walker, 2006). This is not the action of a rational conscious executive mind. It is the action of an unconscious habitual mind, stuck on a bad autopilot setting.

There is a disconnect between what people say and what they actually do, we believe this disconnect is symptomatic of the two different states of mind. It’s not that consumer lie on purpose, they usually answer truthfully, but using their executive mind and that is only part of the way we all make decisions. At Think we believe we have found a way to bridge the chasm between the executive and habitual minds to help market research deliver on the promise of marketing.

We rarely consciously control our eyes, this fact gives us the ability to see into some of the processes of the powerful habitual mind with eye tracking. Combining this with our experience, dedicated software, and methodologies, allows us to peer into the consumers’ minds to understand which (if any) mind is being engaged.

Our proven approach combines eyetracking with traditional market research to gain deeper understanding of how consumers engage with visual and written creative work on habitual and executive levels.

It’s the beginning of something special.