Microsoft has seen the future of the datacenter, and oddly enough it's missing a roof.

The company's future datacenter design, which will be its de facto standard in five years, is a cross between an electrical switching station, an RV-park and the closing "warehouse" scene from the 1981 film Raiders of the Lost Ark .

[ Stay ahead of advances in technology with InfoWorld's Ahead of the Curve blog and newsletter. ]

The company envisions a set of prefabricated containers the size of a semi-trailer filled with as many as 2,000 preconfigured servers. The containers can be parked next to and plugged into pre-built mechanical, electrical, cooling and security components. In essence, it is a giant collection of boxes and pluggable components that can grow and shrink based on need.

The container portion of the idea is nothing revolutionary. Microsoft is installing them in its Chicago datacenter. Sun introduced a server container called Project Blackbox in 2006 and Google received a patent in 2007 on its "mobile datacenter" stored in a standard shipping container, which unlike Sun's Blackbox, could be clustered in the same modular fashion that Microsoft is proposing.

The container idea also has its critics who say they are rife with electrical and mechanical concerns, have power management and cooling issues, present a single point of failure, and are susceptible to damage during shipping.

Microsoft, however, is not just talking about containers, but the configuration of the entire datacenter.

The company this week unveiled what it is calling its "Generation 4 Modular Data Center" plan, a blueprint that will define its cloud datacenter infrastructure in the next five years.

The datacenters have four walls and a sophisticated perimeter security system, but are open to the elements as they lack a roof. Trucks wheel the boxes into the enclosure where they are connected to power/cooling stations before being brought online.

It's a bold plan to drive industry thinking about how to construct and operate datacenters in a world of capacity spikes, real-time needs for computing power and expanding green initiatives.

"We believe it is one of the most revolutionary changes to happen to datacenters in the last 30 years," said Michael Manos, general manager of global foundation services for Microsoft, in his blog introducing Microsoft's Generation 4 plan.

BusinessWeek reported last month that Microsoft said it was going to "reinvent the infrastructure of our industry" by building some 20 datacenters that can carry a price tag as much as $1 billion apiece.

"In short, we are striving to bring Henry Ford's Model T factory to the datacenter," Manos said. "In our design process, we questioned everything. You may notice there is no roof and some might be uncomfortable with this. We explored the need of one and throughout our research we got some surprising (positive) results that showed one wasn't needed."

Microsoft says all the pieces needed to construct the datacenter would be built off-site and assembled once they arrived at the datacenter location, much the way planes, cars, and computers are built today. The company says the process would mean less time and money to erect a new datacenter.  

And Microsoft expects efficiencies in power usage that blow away even the best-rated facilities today based on PUE (power usage effectiveness), a metric developed by The Green Grid and used to determine the energy efficiency of a datacenter.

"A key driver is our goal to achieve an average PUE at or below 1.125 by 2012 across our datacenters," Manos said on his blog.

Achieving such a low PUE average would be a breakthrough given that the typical datacenter has an average PUE of 2.5, according to the Uptime Institute. The Institute says that a best-case scenario today could produce a 1.6 PUE average if the datacenter is using the most efficient equipment and best practices.

Manos added: "More than that, we are on a mission to reduce the overall amount of copper and water used in these facilities."

Operationally, the datacenter would offer different classes of service defined to meet the needs of applications and services deployed and to create cost efficiencies. The classes include ala carte options, such as uninterruptible power supplies and backup generators, temperature controls, and redundancy.

Microsoft says the varying configurations will drive engineering innovations that will lower operational costs for applications.

And to show that Microsoft is aiming toward industry interoperability the datacenter's containers would have common interfaces so others can plug their wares into them including computer vendors, UPS vendors, and generator vendors.

Manos admits that a 2005 memo written to Microsoft employees by now chief software architect Ray Ozzie was the trigger for thinking about how Microsoft would evolve deeper into an operations company rather than a provider of packaged software.

What grew out of that were Generation 2 facilities, now operating in Quincy, Wash., and San Antonio, Texas, which took into account sustainability, energy efficiency, and total cost of operations.

Generation 3 facilities, which are represented by Microsoft's mammoth datacenter in Chicago, feature containers and a modular design.

Microsoft has posted a short video to show how its Generation 4 datacenters would be constructed and how they would operate.

Network World is an InfoWorld affiliate

According to surveys, most companies are dissatisfied with their ability to easily find information inside their own walls, meaning they have yet to find the right search tool for their business.

Given the slew of tools on the market, how can you find the appropriate one? Answering that question involves a dizzying array of factors, but the three critical things to examine are:

[ Keep up on the latest tech news headlines at InfoWorld News, or subscribe to the Today's Headlines newsletter. ]

– Connectivity: the ability to easily navigate around internal and external (Web) data from a variety of specific sources.
– Effort: the ability to implement, maintain, customize and use a solution with as little expenditure of manpower and time as possible.
– Scalability: the ability to accommodate large volumes of unstructured and structured to data keep pace as the company evolves.

These criteria offer a framework for assessing your company's data situation and how it may change over time, the ultimate concern when it comes to information access. These are also the criteria that most vendors highlight, so here are a few benchmarks for assessing your needs and vendor promises.

Connectivity
The amount of data that companies generate is staggering and shows no sign of slowing. IDC estimated that digital content and replicated data exceeded 281 exabytes in 2007 and expects it to grow 10 times before 2011. Moreover, the type of data to be searched and indexed is changing from mostly document-based structured data to a combination of structured and file-based, unstructured data (such as rich media). In a 2007 study by the Taneja Group, 73 percent of users surveyed indicated that 60 percent or more of their data is unstructured.

What's more, the information that must be queried is all over, some on local devices, some with databases and legacy applications, and still more outside the firewall with software-as-a-service applications and on the Web.

As such, connectivity to different data sources has become a major factor in successful, enterprise search implementations.

Answering a few basic but important questions will take you far in determining the level of connectivity you need, and that is worth paying for:

– What kind of information does your organization need to succeed?
– What context is required to give the information sufficient meaning?
– In what way should data be combined, integrated or processed?
– How many and what kind of users need to access this data?
– What will the access frequency be?
– Since connectivity has implications for performance and ease of use, what kind of indexing capabilities and results presentation does your business decision-making demand?
– How do you imagine your business — and your data pool — changing over time?

Solutions designed to meet the broad information-access needs of larger corporations — thousands of users, hundreds of queries per second, documents in the high millions — offer essentially unlimited connectivity. Of course, the downside is often complex search interfaces that can impede intuitive search, and the platforms can be expensive to customize, integrate and deploy. The key is finding a solution that gives you the connectivity you'll need with the simplicity you want. This is where effort comes in.

Effort
The ability to connect to disparate data sources is one leg of the stool. The ability to easily manage and configure both system and data is the second. There are two types of effort worth considering: manpower required to implement, configure and maintain the tool, and the energy required by the user to use it.

With regard to manpower, obviously the best technology investments are the ones that will perform their function well without becoming a drain on already busy staffers or already stretched resources.

Moreover, users accustomed to consumer Web search are increasingly unhappy with rigid, drill-down information-retrieval tools embedded in many enterprise applications. They are equally unhappy with the meager, Web-style keyword search tools. In a business environment, sifting through an endless, flat list of links to find the information you need is unacceptable. What workers need is the simplicity of launching their quests with a keyword text box which returns organized, navigable results that can guide them to the information they need.

When considering the effort your business is willing to support, consider these questions:

– How many people will be required to manage the tool, and will they be trained subject-matter experts or can they be part-timers who multiplex across other duties?
– How stable is the solution and what day-to-day maintenance is required? Do you need a high degree of administrator intervention?
– How much control do you need to exercise over the management of your information?
– How often do changes need to be made to the way you access information?
– What sort of results presentation do you need to make the fastest business decisions?

It is also important to determine what ongoing support will require. For example, if you want to add another content repository to a search application that is already running, you may have to bring down the whole application and re-index all the information as if starting from scratch. Which brings us to scalability.

Scalability
The third leg of the search stool is scalability. Interestingly, two major factors of scalability are its connectivity and the effort required to implement and maintain it. A scalable solution connects to a variety of data sources, requires limited touch to keep it functioning and can be easily configured and reconfigured as needed.

Here are a few questions to ask to make sure a solution can adapt to the business rather than vice versa:

– How much control do you have over applications? How extensible is the solution?
– Can you add search fields/data sources to the index without having to rebuild? Can you modify any index field without having to re-index the entire document?
– Can you add hardware as needed without having to reconfigure your existing system?
– How complete is the API?
– How easy is backup and rollback?

These baseline questions will help you home in on the "right" search solution that will optimize your ability to access information crucial to business decision making. The bottom line: You want to find a tool that is easy to deploy, manage and use but that offers levels of scalability, performance, sophistication and connectivity that fit with your IT environment. This way, you can really make your data sing.

Doscher is CEO of Exalead. Network World is an InfoWorld affiliate.

According to surveys, most companies are dissatisfied with their ability to easily find information inside their own walls, meaning they have yet to find the right search tool for their business.

Given the slew of tools on the market, how can you find the appropriate one? Answering that question involves a dizzying array of factors, but the three critical things to examine are:

[ Keep up on the latest tech news headlines at InfoWorld News, or subscribe to the Today's Headlines newsletter. ]

– Connectivity: the ability to easily navigate around internal and external (Web) data from a variety of specific sources.
– Effort: the ability to implement, maintain, customize and use a solution with as little expenditure of manpower and time as possible.
– Scalability: the ability to accommodate large volumes of unstructured and structured to data keep pace as the company evolves.

These criteria offer a framework for assessing your company's data situation and how it may change over time, the ultimate concern when it comes to information access. These are also the criteria that most vendors highlight, so here are a few benchmarks for assessing your needs and vendor promises.

Connectivity
The amount of data that companies generate is staggering and shows no sign of slowing. IDC estimated that digital content and replicated data exceeded 281 exabytes in 2007 and expects it to grow 10 times before 2011. Moreover, the type of data to be searched and indexed is changing from mostly document-based structured data to a combination of structured and file-based, unstructured data (such as rich media). In a 2007 study by the Taneja Group, 73 percent of users surveyed indicated that 60 percent or more of their data is unstructured.

What's more, the information that must be queried is all over, some on local devices, some with databases and legacy applications, and still more outside the firewall with software-as-a-service applications and on the Web.

As such, connectivity to different data sources has become a major factor in successful, enterprise search implementations.

Answering a few basic but important questions will take you far in determining the level of connectivity you need, and that is worth paying for:

– What kind of information does your organization need to succeed?
– What context is required to give the information sufficient meaning?
– In what way should data be combined, integrated or processed?
– How many and what kind of users need to access this data?
– What will the access frequency be?
– Since connectivity has implications for performance and ease of use, what kind of indexing capabilities and results presentation does your business decision-making demand?
– How do you imagine your business — and your data pool — changing over time?

Solutions designed to meet the broad information-access needs of larger corporations — thousands of users, hundreds of queries per second, documents in the high millions — offer essentially unlimited connectivity. Of course, the downside is often complex search interfaces that can impede intuitive search, and the platforms can be expensive to customize, integrate and deploy. The key is finding a solution that gives you the connectivity you'll need with the simplicity you want. This is where effort comes in.

Effort
The ability to connect to disparate data sources is one leg of the stool. The ability to easily manage and configure both system and data is the second. There are two types of effort worth considering: manpower required to implement, configure and maintain the tool, and the energy required by the user to use it.

With regard to manpower, obviously the best technology investments are the ones that will perform their function well without becoming a drain on already busy staffers or already stretched resources.

Moreover, users accustomed to consumer Web search are increasingly unhappy with rigid, drill-down information-retrieval tools embedded in many enterprise applications. They are equally unhappy with the meager, Web-style keyword search tools. In a business environment, sifting through an endless, flat list of links to find the information you need is unacceptable. What workers need is the simplicity of launching their quests with a keyword text box which returns organized, navigable results that can guide them to the information they need.

When considering the effort your business is willing to support, consider these questions:

– How many people will be required to manage the tool, and will they be trained subject-matter experts or can they be part-timers who multiplex across other duties?
– How stable is the solution and what day-to-day maintenance is required? Do you need a high degree of administrator intervention?
– How much control do you need to exercise over the management of your information?
– How often do changes need to be made to the way you access information?
– What sort of results presentation do you need to make the fastest business decisions?

It is also important to determine what ongoing support will require. For example, if you want to add another content repository to a search application that is already running, you may have to bring down the whole application and re-index all the information as if starting from scratch. Which brings us to scalability.

Scalability
The third leg of the search stool is scalability. Interestingly, two major factors of scalability are its connectivity and the effort required to implement and maintain it. A scalable solution connects to a variety of data sources, requires limited touch to keep it functioning and can be easily configured and reconfigured as needed.

Here are a few questions to ask to make sure a solution can adapt to the business rather than vice versa:

– How much control do you have over applications? How extensible is the solution?
– Can you add search fields/data sources to the index without having to rebuild? Can you modify any index field without having to re-index the entire document?
– Can you add hardware as needed without having to reconfigure your existing system?
– How complete is the API?
– How easy is backup and rollback?

These baseline questions will help you home in on the "right" search solution that will optimize your ability to access information crucial to business decision making. The bottom line: You want to find a tool that is easy to deploy, manage and use but that offers levels of scalability, performance, sophistication and connectivity that fit with your IT environment. This way, you can really make your data sing.

Doscher is CEO of Exalead. Network World is an InfoWorld affiliate.