The next item to plan for is the number of files that could potentially be stored on the volume. The file system uses Metadata (data about data) to describe the files that are stored. This means there is going to be a certain amount of volume space used by the file system just to manage the files that are there.
File systems that are not built for excessively large directories will slow down applications that access them. This can adversely affect users that have thousands of files on a volume that has millions of files.
Estimated Size of Files on the Volume
The next consideration is the sizes of the files that will be on the volume. Organizations that are running large database servers usually have the need to be able to pre-allocate very large files in the gigabyte range of sizes. The file system and operating system need to be able to handle this level of input and output. For these types of enterprises’ systems, expectations are high for performance and integrity. Will the file system be able to handle those extremely large files?
Shared Volume Requirements
There are mixed environments in many organizations today. Some organizations may have three or four different platforms of computer systems; from mainframe systems to 64-bit Sun machines, from Apple desktops to Intel based machines. Some of these systems may share storage space. Will the volume support mixed data types? Additionally, will the operating system that manages the file system allow for different types of data streams to be accessed simultaneously?
Backup Requirements
Backup requirements for large storage systems are becoming one of the most important aspects of the storage scenario. Despite all the advancements in storage technology, only about 20%* of back-up jobs are successful (*according to Enterprise Strategy Group). Large storage systems with millions of files present a serious data archiving challenge – backing up the data. There may be so much of it that to successfully back up the data could take days. Conversely, if there was a disaster, the archived data may be out of date or will be out of date by the time the restoration is completed.
One solution is to utilize file systems that have ‘Snap-shot’ technology incorporated into the backup software. This technology saves critical file system metadata (file name, size, multiple time and dates, security details such as Read/Write/Execute/Delete privileges) that can assist in locating where the files are stored. Another solution is to regularly run incremental file backups. Incremental backups ensure that your files are being backed up on a regular schedule so there is a smaller window of unprotected data. Incorporating both of these backup methods create a better system of data archiving.
Recovery Capabilities for Large Volumes
Despite the best planning, failures do happen. The best way to avoid data loss disasters with large storage systems is to have a relationship with a well-respected data recovery company. The best data recovery companies monitor the technological advancements in the storage industry, including research and development in new hardware and file systems.
Top providers have their own software development staff to create proprietary recovery software for their data recovery labs. For example, due to the increase in large, multi-terabyte size volumes, the best recovery companies have updated their tools to meet the 2TB barrier.
Remote recovery technology has become the standard recovery process for large volumes because shipping in several drives is impractical. Even if a RAID configuration is lost or if one drive has failed, remote recovery can retrieve the original data. Not all recovery companies have this capability, however, so it is important to look for providers that can offer this unique service.
As mentioned previously, terabyte volumes are becoming more common. If you have errors or problems accessing large terabyte volumes, call a professional recovery service for assistance immediately. A qualified engineer will discuss all of the options available to get the volume accessible in the quickest manner.
Your storage needs will continue to grow – so partnering with a data recovery company for recovery services means that you’ll be protected if there is ever a data disaster.
Contributed by Jim Reinert, director of software and services at Ontrack Data Recovery