donderdag 7 januari 2010

Missing vendors in article on Network computing

In the article “Best and worst of times for enterprise search” the author, Paul Korzeniowski, mentions some vendors of enterprise search / eDiscovery solutions.

The list of vendors is missing some very important players though, like Autonomy, Attivio en Microsoft / FAST.

I would advise the author to be more thorough the next time

zaterdag 12 december 2009

OpenPipeline dead?

A year ago DieselPoint ("search and navigation technology") was promoting their open source project OpenPipeline. When I was reading the promising intention I was enthousiast about this initiative.

OpenPipeline intented to break open the closed source solutions to connect to different information sources and file formats. That would break down the walls of the vendors like Autonomy that protect their technology that enables the extraction of data from a variaty of sources and fileformats.

Now, a few months later, there is no more information coming from this project.

I wonder why the project is now inactive.
- was it a marketing trick from DieselPoint to get attention?
- Has Dieselpoint come to the conclusion that this problem of connectors can not be solved so easily?
- Has DieselPoint decided that they should not be so open?
- Is there not enough willingness from the community to participate?

dinsdag 1 december 2009

Google Wave and Microsoft Sharepoint... NOT alike

Today I read an article with the title "Can Google succeed outside of search?"

One piece of information got my attention a little bit more:

But Google keeps pushing: Its still-in-beta Google Wave promises to attack one of Microsoft's most beloved products, its SharePoint collaboration software.


To my knowlegde and experience with Google Wave, Wave is an online community platform and not so much a collaboration platform. Yes people can talk to each other, send messages, maybe even share a document through some link, but that is to simple to be compared with sharepoint.

The review of Google Wave vs. Microsoft Sharepoint on the Bamboo team blog makes the difference even clearer:

First of all, the question, "Is Google Wave a SharePoint Killer" is a completely artificial, nonsense argument dreamed up by either the Google PR team and/or the media to generate buzz. Wave is an email client (very tempted to say "consumer email client")... an exciting and innovative one, but it's not a collaboration platform... at least if your definition of collaboration is more sophisticated than sharing pictures from a boating trip. Wave doesn't compete with SharePoint, it competes with Outlook.

That being said, it has occurred to me recently that one of the weaknesses of SharePoint is its failure to account for the fact that email is and will continue to be the fundamental central connective tissue to all collaborative activies. As you might imagine, Bamboo has one of the most sophisticated, tricked-out SharePoint portals in the world, and yet even here, people continue to exchange documents in email and communicate issues in email that *should* be written into a wiki or discussion board. Why? Convenience. So long as it is more convenient to fire off an email than to upload a document or navigate to a message board, that is what people will do. Wave does address this problem head on, and I think introduces a new paradigm that Outlook will have to adopt, quickly.

But an enterprise collaboration platform? Hardly. There is no sign of document management, content management, workflow, data integration, dashboarding etc. etc. If Google truly believes that Wave is a platform for enterprise collaboration, it only serves as proof that they really don't understand the business. Maybe if they fully integrated Wave, Google Sites, Google Apps, Google Gears, Google Calendar in a comprehensive platform... then you might have something. But Microsoft has a big head start in lashing together all of these disparate capabilities and a huge installed base of customers to drive innovation based on real world feedback.


I sometimes wonder if the "reporters" who send out this kind of information to the world, just lack somekind of insight or that thay deliberately say things that are just not correct. Double check your sources and trust your own knowlegde.

maandag 23 november 2009

phpQuery: using Google as an information source

For some project I have to get search results from Google and follow the links on the result page to index those valuable resources.
Google doesn't supply an XML-interface to it's search results.

Bing (www.bing.com) and Yahoo (www.yahoo.com through an API key) do. Aside to the subject of this blog, I find this monopolistic behaviour of Google repulsive... They index al OUR content and resources, make money of it through advertising, and then they stop the "open source" character of their activities. Once our content enters their databases, the content is theirs!
Start using Bing more often!

Because of Google does not support an XML-response interface, I have find a way to "crawl" our own content.

I have found the "phpQuery" framework, ironicaly hosting on Google code.

What I wanted to do is get all the relevant links from the search results page and follow those links to make the information aivailable within the context of the search application.

I want to share the basic code that I have come with to establish getting the links from a webpage through the use of phpQuery:

require_once('phpQuery/phpQuery.php');

//The URL of the webpage to fetch
//$link = "http://www.emidconsult.com";
$link = "http://www.google.nl/search?q=multiple+sclerose";

//Get the whole HTML contents
$page = file_get_contents($link);
//Put the HTML content in a phpQuery object
phpQuery::newDocumentHTML($page, $charset = 'utf-8');

//Get the [body] contents out of the phpQuery object
//$body = pq('body');
//print $body;

//iterate through every link (a element) in the webpage.
foreach(pq('a') as $ref) {
//Get the link
$href = pq($ref)->attr('href');
//Show the url in the a element, but only if it contains external links
$pos1 = strpos($href, 'http://');
//and has no reference to Google own search commands
$pos2 = strpos($href, '/search?q');

if (($pos1 === false) || ($pos2 > 0)) {
//DO NOTHING
} else {
echo $href."\n";
//Now do some things with the href...
}
}
?>

donderdag 19 november 2009

Google and making multimedia searchable

Today I saw the announcement "Google adds automatic captions to YouTube". I really like this addition to the possibilities of Youtube.

But as we all know Google as a gigantic eposure in all thing they do.

This feature seems a neat thing that makes it easier for consumers to upload there video's to Youtube regardless of language and eliminating the need for adding manual captions or descriptions to there video's: Google converts the speech to text automaticaly...

As i am more involved in information access and enterprise search I place this news in another context: The possibility of making video and audio searchable.

Within the enterprise this issue of making video and audio searchable is getting more attention. Autonomy as well as Exalead are also focussing on this part of enterprise search.

To see the capabilities of Exalead you can visit their labs on http://labs.exalead.com/experiments/voxalead.html.

Autonomy also is very active on the market of media indexing. They have solutions like Virage that to the same thing. I find it very disapointing that Autonomy has no demo of their capabilities.

Bottom line?
Google is doing the same thing as the large search technology providers. The "public" will say that Google is "ahead of the pack". The advantage that Google has is a large community that follows everything that they do and spread the word fast.
Other search providers like Autonomy and Exalead can do and are doing the same thing as Google is doing now (and are maybe better), but are not in the position to reach the audience that Google can.

dinsdag 3 november 2009

Coveo into free enterprise search?

Short Post:
Today I received an email from KMWorld with an advertisement by Coveo.

They are issuing a free version of their Enterprise search suite with the name "Expresso".

While they are not the only one (Omnifind yahoo Edition and Microsoft Search Server Express do the same) I still think that wrapping something as "enterprise search" in a free gift is not a good idea.
As we all know Enterprise search is more than a software solution. Off course you can plug in a filesystem, but that not will solve most of your information needs.

Still it is something to play with.

Read more

maandag 2 november 2009

Microsoft's FAST and sharepoint integration (SharePoint 2010)

Stephen Arnold has written up an excellent analysis of the information that was given about the coming release of "Fast Search Server 2010 for SharePoint".

Third, there is a reminder to me that SharePoint is a work in progress. I think someone told me that it is the next operating system from Microsoft. The Fast component will be called Fast Search Server 2010 for SharePoint. Now the story gets interesting. Here’s what’s coming:
He then sums up some aspects of the features:
  • A content processing pipeline.
  • Metadata extraction.
  • Structured data search.
  • Visual search.
  • Advanced linguistics.
  • Best bets.
  • Development platform.
  • Customization.
Microsoft has a lot of work to do while their were no live demo's or example that could show these features in action.