Introducing ROCKZi


In life, there are some pairings that just work — wine and cheese, Bowie and Queen, Nutella and pretty much anything. Today, we are pleased to introduce ROCKZi and the beginning of a superb pairing with blekko. Temporal content is incredibly important when featuring both news and search results. ROCKZi is our answer to tackling the search and social divide.

ROCKZi is a news website that features high quality news stories and organizes them by topic — from celebrity gossip to the latest elections updates to water cooler fodder. But people don’t want to simply read news; they want to interact with it. More and more, we are seeing that people want to curate the web, and ROCKZi gives them the right set of tools to curate in a way that is easy and seamless. Everyone reading content on ROCKZi is essentially curating it. By voting up an article, leaving a comment, or submitting links, users are socially driving news and collecting the stories they care about.

Let’s get into the nitty gritty of the features, shall we? The site is visually pleasing and organized so you can quickly find the type of news you want. Clicking the “this rockz” button automatically puts the article onto your own user board and gives the article more weight in terms of buzz and popularity. You can also submit articles that you want to share with the ROCKZi community and your Facebook friends by clicking the “submit” button on the board, or by using the nifty browser bookmarklet. The bookmarklet allows you to add stories from any website to ROCKZi news boards.

This Rockz← Drag this to your Bookmarks Bar

We are constantly thinking of ways to empower our users to help shape web results. Given our powerful search engine and our editorial perspective on search, we believe we can use the social application of ROCKZi to improve blekko search results. ROCKZi currently has 30 top-level topics, but with the hundreds of existing blekko slashtags, the possibilities are vast. In turn, social signals generated by ROCKZi users will translate into search signals that we can use to identify the highest quality search results.

My favorite boards are MuZe for the latest in the books and art scene, and PopRockZ for entertainment news. Plus, with the Olympics coming up, I’m sure I’ll spend lots of time poring over OlympicZ 2012. How about you? Give ROCKZi a whirl and find your favorite boards. And don’t forget to tell your friends.


Posted in Features, ROCKZi | Tagged | 2 Comments

Blekko Upgrades SEO Data

Blekko integrated the up-to-date crawl information that powers our search engine index directly into our SEO product offerings. Not only is the data more comprehensive, but there are major improvements in real-time updates to our SEO pages.

When it comes to pages crawled, the sweet spot for blekko is a little more than 4 billion pages. To keep our crawl fresh, we update at least 100 million pages each day. As soon as our crawler, Scoutjet, crawls a webpage, users have access to information about it through blekko’s SEO product. We want to enable people to see the Internet the way a search engine sees it, especially what the rest of the internet is saying about an url.

Scoutjet updates the top ranked starting pages on the Internet around every hour, while other high quality pages are checked at least every week. The continuous updates to blekko’s SEO data include page content, meta data, duplicate text, and inbound link counts. Staying up-to-date is as much about forgetting the old as finding the new. So, we eliminate inbound links that are no longer live and duplicate content that is no longer available.

Since our traffic continues to grow rapidly, we are bringing more machines into service to keep our site humming. While we were upgrading our site to handle more traffic, we decided to leverage our highly customizable NoSQL database to make real time access to our crawl publicly available. Our “combinator” abstraction proved critical in quickly making the right tradeoffs between crawl throughput and user request latency.

We hope you will be pleased with the new and improved performance for web search and SEO data!

Posted in Features, SEO | Tagged | 11 Comments

Mozilla accelerates search navigation with blekko

We’re thrilled about the new Add-on the Prospector team at Mozilla Labs created! Back in March the Mozilla team invited us over to their offices to give a brown bag presentation about blekko. Afterwards, some team members approached us with some questions and some ideas to kick around. After a couple of meetings and a bunch of back and forth between our teams, the result is now live! The add-on they built creates a drop down suggestion with a favicon to help identify results faster, saving the user a click. They used our auto-suggest API and Nick here at blekko linked it to our nav query list to obtain the icons.

When you mouse over the suggested sites a preview pane appears for quick referencing without going to the site with a click. Now when you search, blekko can detect from your first letter what you may be searching for. “f” triggers facebook, fandango, frys and food network.

You can save time by searching faster than ever with this new blekko search add-on. Install the add-on in Firefox and make blekko your default search engine in the search bar. Give it a try and you’ll soon be hooked.


Install it today!

Mozilla Labs blogs about it here.

Posted in Features, Partnerships, Technology | Comments Off

Librarians Love Blekko

Computers in Libraries 2012

And blekko loves them back. You may have heard by now that our Content Team has a strong foundation in Library and Information Science. Librarians build taxonomies and dig ontologies. Librarians understand the complexities of organizing data and disseminating information. At blekko, this knowledge drives the creation of slashtags which in turn intersect our web results.

Picture the summer of 2011 in New Orleans. The American Library Association (ALA) conference is in full swing and a great deal of the revelers on Bourbon Street are librarians in town for the meeting. Blekko is there, attending our first library conference. Since then, we have made it a point to attend all the major meetings. Why, you may ask, does blekko sponsor and attend library conferences?

Our search engine appeals to librarians because of our focus on curating high quality content – similar to a librarian directing people to better resources. In our case, our resources are slashtags. The things that matter most to our librarian users are the advanced privacy features, especially handy when used in schools, and a more protected search in general. Here are some more qualities and features they appreciate about blekko:

1. We are a free and customizable service, making slashtag technology accessible to all users.

2. Blekko returns targeted results based on quality rather than SEO. We meet librarians’ needs by offering a variety of trusted resources that are easy to distinguish.

3. Librarians can embed our search engine into their respective domains.

4. Libraries can adopt custom slashtags.

5. The slashtag directory and our indices.

6. Advanced search features such as /date and /daterange. Try out /edu and /gov to search only .edu and .gov sites.

Useful Slashtags for Librarians

We make it easy for librarians to stay up-to-date on the latest news in librarianship. If users want to know what kind of programming for teens other libraries are offering, they can do a targeted search for “teens /librarianship /date”.

Users have the option of doing a straight web search or searching exclusively within a given slashtag. You don’t have to be familiar with our slashtags to get great web results. If a query is relevant to a slashtag, we will integrate slashtag content to improve the quality of the search results.

When you enter the query “research libraries”, it is easy to see which sites are in the /libraries slashtag. Boosting slashtags not only improves results, but also offers a visual cue to provide higher confidence in our results. Since librarians serve populations with a wide range of needs, these topical slashtags are quite useful. They may be assisting students with research projects (“us constitution”, “cure for cancer research”) or directing a community member to job resources (“sample resumes”).

Based on feedback we’ve received at the various library conferences, here are some well-loved slashtags amongst the library set:
/american-history
/finance
/health
/homework-help
/jobs
/journals
/taxes

We will be exhibiting at the library conferences this summer. If you’re attending, drop by the booth for a demo and a free t-shirt!

Upcoming Conferences:
Medical Libraries Association, May 19-22, Seattle
American Librarian Association Annual Conference, June 22-25, Anaheim
Special Libraries Association, July 15-18, Chicago

Posted in Features, Marketing & Tradeshows | 1 Comment

Searching without PageRank

… implemented in an hour (!)

[ Discuss this post on Hacker News ]

I recently saw a nice Hacker News discussion about millionshort.com, an experimental search engine that makes it easy to search the web, minus the million most popular websites.

blekko’s search engine has a feature called slashtags, which can be used to either restrict a search to a list of websites, or remove that list of websites from the results. We typically use this feature for human curation, for example, picking out the best health websites. Hm, I thought, what an interesting hack! I’ll take that list of the most popular websites, and make slashtags which can be used to either search or exclude the most popular 10, 100, 1000, 10,000, or 100,000 websites. Our current effective limit to slashtag size is 100,000 websites, so I couldn’t do the most popular 1,000,000 sites.

The way you search with a slashtag on blekko is to add /slashtagname to your search. In this case the top-100,000 site slashtag is named /top10/top100k, and we use a minus sign to exclude those sites:

And, after about an hour of work, voilà! Here are a couple of examples of our new bottom-website search engine in action.

great concert

This query happens to show another blekko feature in action, autoboosted slashtags. When you search for great concert, we automatically figure out that you’re interested in music, and so we use our curated /music slashtag to improve the results:

great concert

But, for the purposes of this experiment, let’s turn off this autoboost feature by adding /web on the end of our query:

great concert /web

Now let’s look at the web, minus the top 10, 100, etc. websites:

great concert -/top10/top10 – Voilà! amazon.com disappears.

great concert -/top10/top100

great concert -/top10/top1000

great concert -/top10/top10k – mtv.com and emusic.com disappear.

great concert -/top10/top100k

hugo winner

The Hugo Award is given annually to the best science fiction book of the year. Let’s see what the bottom of the web thinks about it:

hugo winner

hugo winner -/top10/top10

hugo winner -/top10/top100 – flickr and about.com disappear; davidbrin.com appears.

hugo winner -/top10/top1000 – goodreads disappears, librarything appears

hugo winner -/top10/top10k – io9, boingboing, and Esquire disappear; dpsinfo, sfwriter.com, and mabfan.livejournal.com appear

hugo winner -/top10/top100k – no change

Try it for yourself!

[ Discuss this post on Hacker News ]

Search the top 100,000:
Search all but the top 100,000:
Search the top 10,000:
Search all but the top 10,000:
Search the top 1000:
Search all but the top 1000:
Search the top 100:
Search all but the top 100:
Search the top 10:
Search all but the top 10:
Posted in Technology | 3 Comments

Infographic: blekko by the numbers

JBofill Creative Partners made this infographic based on the recent press about blekko. This is super cool. Thanks guys!

Posted in Marketing & Tradeshows | Comments Off

Up and to the right!

Hitwise:

Compete.com:

Posted in Uncategorized | Comments Off

Highlights for Q1

We’ve missed you on this here blog, so we are excited to share what’s been going on at blekko these past few, busy months.

1. Conferences. The roadshows have been a blast, with blekko representing at SMX West, the RSA Conference, SXSW, and Computers in Libraries (CIL). We enjoy meeting users and telling the uninitiated all about blekko. We have gotten great feedback on our site, and our privacy policy has been receiving a lot of love.

2. Mozilla Add-On. We recently released a FireFox plugin that allows some of blekko’s coveted search features to be used on any other search engine. The plugin lets you mark spam sites, look at SEO data and backlinks, and sort results by date. Try it out and let us and Mozilla know what you think.

3. Partners. Around here, we love collaboration and our latest partners are 1-800-Flowers and Lavasoft. 1-800-Flowers is lending their expertise to curate awesome sites for the /flowers and /gift-baskets slashtags.

In addition to our commitment to spam-free search, we’ve teamed up with Lavasoft to help us determine which sites are unsafe. blekko will also be powering search for Lavasoft’s ad-aware product.

4. Slashtags. Our content editors are dedicated to curating the best of the web to deliver relevant, high quality search results. We always have slashtags and how to improve search on the brain. Here are a few recent slashtags we are proud of: “mls listings /real estate”, “resume writing tips /jobs”, and “boba fett /star-wars”.

Our team of engineers continues to work hard behind the scenes to make blekko the game-changing search engine, so stay tuned. “Like” our Facebook page or follow us on Twitter to stay updated on new developments and check out photos from our latest adventures.

Posted in Features, Marketing & Tradeshows, Partnerships | Tagged , , , , , , , | Comments Off

Time to Slow Down and Look Back at a Year Gone By at blekko

“Do you know how fast you were going?” asked the Washington state trooper outside of Chehalis on my way to Seattle. “Our airplane caught you a few miles back doing 92 in a 60 zone.” Last June I rode my BMW R1200GS up to Seattle from the Bay Area to work the exhibit hall at SMX Advanced. That state trooper’s question pretty much sums up the past year at blekko for me. I was going so fast I don’t remember, but that’s not what I told the trooper.

While I was on the road promoting blekko with my trade show team, the engineers and product guys were constantly pumping out new products and features on our search engine. In January we made a bold move and banned content farms like Demand Media’s eHow from our search results, triggering our competitors to change their ranking algorithms. We followed it up in March and blocked another 1.1 million spam sites. It’s not over. The battle against spam continues daily.

Earlier in the day before I was brought down by The Man in Chehalis I was making my way from Bend, Oregon. I rode north past Mount Hood, over the Columbia River, planning to go up to the east side of Mount Ranier crossing over the pass into Seattle. Well we all know about best laid plans. About 15 miles deep into the Gifford Pinchot National Forest I came upon a large sign telling me that all the roads were closed due to snow. “Shit. I’m going to have to backtrack and take the slow road along the north shore of the Columbia River to the highway 5 slab. I’m going to be late.”

Meanwhile, back at the office, the Biz Dev team was hard at work. We inked some curation partnerships with Stack Overflow, Foodily, SB Nation and The Motley Fool to name a few. We also started powering the RSS search on Flipboard, the popular new social reader for iPad and iPhone.

The 60 mile ride along the Columbia River gorge was painfully slow and I passed the slow moving traffic whenever I had a chance; ignoring the double yellow lines. I was rewarded with spectacular views, the ones that the widest angle camera could not capture. Two hours later I jumped on to interstate 5 north, with time to make up I hit the throttle.

In late June we launched the Zorro update which included an improved index, auto-boosting slashtags and ‘3 Engine Monte.’

Riding a motorcycle on an interstate highway is about as exciting as a colonoscopy. Actually, some riders I know would disagree. So, to keep things interesting, I started to follow a white Porsche 911 driven by a guy who appeared to have purchased the car to make up for some of his inadequacies. His high levels of testosterone were obvious as he would not let me take the lead. My plan unfolded and he accelerated keeping the lead or as I call it, the bait for the radar gun. After about ten miles of cat and mouse the red led flashed on my radar detector. It appeared to be nothing.

We launched our ‘Grep the Web’ tool in September followed by good fortune, when we closed $30 million in funding with our new strategic partner Yandex leading the round with $15 million. We finished the year strong with a new index, increasing the number of slashtags we autofire to 500 and a slick new UI. All the while, staying true to our mission.

Cautiously, I slowed down and kept a tight eye on the road ahead. Five miles ahead the Porsche and I passed a trooper parked on the side of the highway. Within seconds his cherries lit up as I looked into my mirror. That sinking feeling took over my stomach as the trooper passed by me and the Porsche and signaled both of us to pull over. I was cursing to myself like a longshoreman as I navigated to a safe spot on the side of the road. He said that a airplane with radar had seen us speeding ten miles back. I did not see an airplane. He asked where I was going, and I told him, “To a trade show in Seattle.” He said the guy in Porsche was too. I was cordial and accepted the ticket for $120 which wasn’t that bad. What was bad, was that I had gotten a ticket one month earlier on highway 1 in Santa Cruz. Two tickets so close would increase my insurance rates drastically. The rest the way to Seattle and on the way home I slowed down and stuck to the speed limit. Something was wrong about that ticket and it bothered me. I did not see an airplane when my radar lit up for a second. So, the following week I hired an attorney from the Chehalis area that specialized in traffic violations to fight the ticket for me. A few months later she went to court for me and had my ticket dismissed on hearsay.

Surprisingly, speeding tickets do have a good side to them; they are telling you to slow down, smell the roses and enjoy the scenery. As the holidays are upon us and the year comes to a close, we look back at all the good times and our successes. We look forward to what 2012 will bring us. Best wishes to you from the blekko team!

Posted in Features, Funding, Marketing & Tradeshows, Partnerships, Technology | Comments Off

blekko: New and Improved Site, Same Mission

Today we are releasing a major upgrade to blekko. The new blekko has significant improvements to index quality and relevance. We are also now automatically applying slashtags for over 500 categories. That means users will get the benefit of curated search results (i.e. no spam!) for over 500 search categories, regardless of whether or not they manually append a slashtag to their query.

The results in action can be pretty eye opening:

how to clean gutters
good table manners

But, as usual, don’t take our word for it – compare the difference yourself. Just do a search on blekko and add /monte to any query.

As we head into 2012, our mission at blekko is more important than ever. If you think about it, prior to the internet the newspaper was the offline equivalent of the search engine. It was the starting spot where people went to get their news, job listings, personals, movies listings, classifieds, etc. Competing editorial voices were a hallmark of competition in the newspaper business and readers benefited because they had choice.

Online, the world has changed. Search is now the access point to information. But unlike the newspaper world, there are not a lot of people competing in search. We believe this is bad for users because at the end of the day, search engines are editorial products. In the newspaper world human beings wrote the articles with their editorial voice. In the search world human beings write the algorithms that make up the search results. Currently, there is one predominant editorial voice that dictates access to information.

Our goal is to give users the benefit of an alternative editorial voice in search. What is blekko’s editorial voice? Here’s our approach:

Quality: We purposefully bias our index away from sites with low quality content.

Source based, not link based ranking: regardless of how many people link to healthspamsite.com, we believe sites like the Mayo Clinic, NIH.gov, etc. are better sites. On blekko, brands trump links.

Spam-Free: blekko hates spam. We want users to get their information from quality sites designed to inform, not just monetize.

Human Curation: Their are subject matter experts in the community that will know more about specific topics than anyone in this office or any other office for that matter. We want to include these experts in our search experience, not exclude them.

Open and Transparent: blekko makes freely available to its users all of the data that provide the underpinning of our search results.

We believe that users will like the results our editorial voice delivers better than the competition. The important point though is that there is an alternative choice. The access point to information is too important and users deserve choice.

More coverage:

Venture Beat

Posted in Features, Technology | Comments Off