• Get Started
• Home
• About Us
• Developer Network Blog
• YDN Theater
• Frequently Asked Questions
• Support Communities
• Got Suggestions?
• Developer Central
• Java Developer Center
• JavaScript Developer Center
• Flash Developer Center
• ColdFusion Developer Center
• .NET Developer Center
• PHP Developer Center
• Python Developer Center
• Ruby Developer Center
• Lessons and Libraries
• Applications Gallery
• Browser Based Authentication
• Design Patterns
• Exceptional Performance
• Security Best Practices
• YUI - Yahoo! User Interface
• Work With Us
• Get an Application ID
• Merchant Solutions
• Partnerships
• Search Marketing
• Usage Policy
• Terms of Use
• Contact Us
• Services
• Answers
• Local
• Mail
• Maps
• OpenID
• Search
• Shopping
• Travel
• Utilities
• Sites
• del.icio.us
• Flickr™
• Live
• MyBlogLog
• Pipes
• Upcoming
• Yahoo! Research Berkeley
• Feeds
• Finance
• HotJobs
• RSS Feeds
• Traffic
• Weather
• Developer Kits
• Media Player
• Messenger
• Music Engine Plugins
• r3
• Search Developer Kit
• Widgets

« The Highland Fling 2008 - The browser and beyond is round the corner | Main | Yahoo! Media Player first milestone »

Yahoo! search results now with natural language support

March 13, 2008

I am happy to announce that based on some research and a Greasemonkey hack to make people aware of the consequences, Yahoo! is now a search engine that has natural language search results.

Natural language?

HTML has a wonderful attribute called lang that allows you to define the language of the text in the current HTML element. This seems a bit superfluous as it has nothing to do with the display of the language specific character set (which is the encoding and another issue). However, defining the language has other benefits.

The first one is that search engines and other robots know what language the text is in and thus have a much less harder job to differentiate between keywords and stopwords.

The second, and most important has to do with accessibility. If you do not see the text but you get it read out to you then the pronounciation is very important. Visually impaired surfers use screen readers to tell them what is on the current page, and by defining the language, you make this a lot easier. Screen readers have different voices for different languages with the correct pronounciation rules. This is best explained with an example.

Small attribute, great difference - with lang and without lang

The following files are recordings of what screen readers will tell visually impaired users on a search result page. They have been slowed down to make it easier for people that can see to follow, normally users will have the speed set a lot faster.

• Search result page in English with French content not flagged up with a lang attribute (mp3, 42 seconds, 670 KB)
• Search result page in English with French content flagged up as French using the lang attribute (mp3, 46 seconds, 720 KB)
• Italian search result page with French and English content without lang attributes (OGG Vorbis, 51 seconds ,400 KB)
• Italian search result page with French and English content with lang attributes (OGG Vorbis, 49 seconds ,300 KB

Thanks must go to Artur Ortega for testing with Jaws and Ryan Grove for adding the necessary information.

Posted at March 13, 2008 4:58 AM

   

Comments

Posted by: Ed at March 13, 2008 9:23 AM

Post a comment

Comment Policy: We encourage comments and look forward to hearing from you. Please note that Yahoo! may, in our sole discretion, remove comments if they are off topic, inappropriate, or otherwise violate our Terms of Service.

Name:

Email Address:

URL:

Remember Me? YesNo

Type "yahoo" here:

Comments: