Can Petabyte Storage be
fault tolerant

USING COMMODITY HARDWARE?

High Availability

No Single Point of Failure a.k.a SPOF-less configuration. Metadata of the file system is kept in two or more copies on physical redundant servers. User data is redundantly spread across the storage servers in the system.

Low-cost Data Safety

MooseFS enables users to save a lot of HDD space maintaining the same data redundancy level. In most common scenarios you will save at least 55% of HDD space. Available from MooseFS 4.0 Pro.

Scalability

Storage can be extended up to 16 exabytes (~16000 petabytes), which allows us to store more than 2 billion files.

High Performance

Designed to support high performance I/O operations. User data can be read/written simultaneously on many storage nodes, thereby avoiding single central server or single network connection bottlenecks.

MooseFS architecture

MooseFS

MooseFS is a Fault-tolerant, Highly available, Highly performing, Scaling-out, Network distributed file system. It spreads data over several physical commodity servers, which are visible to the user as one virtual disk. It is POSIX compliant and acts like any other Unix-like file system supporting:

  • Hierarchical structure: Files and Folders,
  • File attributes,
  • Special files: Pipes, Sockets, Block and Character devices,
  • Symbolic and Hard links,
  • Security attributes and ACLs.

It works with all applications that require a standard file system.

Download now

Need help?


We give 24/7 support

Watch a Video


Years Of Storage Experience

Minutes For Set Up

Countries

Petabytes Maximum

FAQ

Is it possible to add/remove chunkservers and disks on the fly?

You can add/remove chunk servers on the fly. But keep in mind that it is not wise to disconnect a chunk server if this server contains the only copy of a chunk in the file system (the CGI monitor will mark these in orange). You can also disconnect (change) an individual hard drive. The scenario for this operation would be:

  1. Mark the disk(s) for removal (see How to mark a disk for removal?)
  2. Reload the chunkserver process
  3. Wait for the replication (there should be no "undergoal" or "missing" chunks marked in yellow, orange or red in CGI monitor)
  4. Stop the chunkserver process
  5. Delete entry(ies) of the disconnected disk(s) in mfshdd.cfg
  6. Stop the chunkserver machine
  7. Remove hard drive(s)
  8. Start the machine
  9. Start the chunkserver process

If you have hotswap disk(s) you should follow these:

  1. Mark the disk(s) for removal (see How to mark a disk for removal?)
  2. Reload the chunkserver process
  3. Wait for the replication (there should be no "undergoal" or "missing" chunks marked in yellow, orange or red in CGI monitor)
  4. Delete entry(ies) of the disconnected disk(s) in mfshdd.cfg
  5. Reload the chunkserver process
  6. Unmount disk(s)
  7. Remove hard drive(s)

If you follow the above steps, work of client computers won't be interrupted and the whole operation won't be noticed by MooseFS users.

When I delete files or directories, the MooseFS size doesn't change. Why?

MooseFS does not immediately erase files on deletion, to allow you to revert the delete operation. Deleted files are kept in the trash bin for the configured amount of time before they are deleted.

You can configure for how long files are kept in trash and empty the trash manually (to release the space). There are more details in Reference Guide in section "Operations specific for MooseFS".

In short - the time of storing a deleted file can be verified by the mfsgettrashtime command and changed with mfssettrashtime.

What are limits in MooseFS (e.g. file size limit, filesystem size limit, max number of files, that can be stored on the filesystem)?
  • The maximum file size limit in MooseFS is 257 bytes = 128 PiB.
  • The maximum filesystem size limit is 264 bytes = 16 EiB = 16 384 PiB
  • The maximum number of files, that can be stored on one MooseFS instance is 231 - over 2.1 bln.
Does MooseFS support file locking?

Yes, since MooseFS 3.0.

Technical Features

Rolling Upgrades

Ability to perform one-node-at-a-time upgrades, hardware replacements and additions, without disruption of service. This feature allows you to maintain hardware platform up-to-date with no downtime.

Tiered Storage

The assignment of different categories of data to various types of storage media to reduce total storage cost. Hot data can be stored on fast SSD disks and infrequently used data can be moved to cheaper, slower mechanical hard disk drives.

Redundancy

All the system components are redundant and in case of a failure, there is an automatic failover mechanism that is transparent to the user.

Native Clients

Enhanced performance achieved through a dedicated client (mount) components specially designed for Linux, FreeBSD and MacOS systems.

Parallelism

Performs all I/O operations in parallel threads of execution to deliver high performance read/write operations.

Hardware Independence

Exceptional performance on almost every hardware platform that runs a POSIX compliant Operating System like Linux, Mac OSX or FreeBSD.

What our clients say

Products overview

MooseFS

  • Mission Critical
  • High on Performance
  • Scalable
  • Hardware Independent
  • Benefits for a Lifetime
  • Big Data Support
  • Minimal Investment
  • Hardware Durability
  • Manufacturer Support
  • x86-64 components availability
  • Safe Choice and Lifetime Usability
  • Data Redundancy with Erasure Coding
  • High Data Availability
  • Native Windows client
Download Now

MooseFS Pro

  • Mission Critical
  • High on Performance
  • Scalable
  • Hardware Independent
  • Benefits for a Lifetime
  • Big Data Support
  • Minimal Investment
  • Hardware Durability
  • Manufacturer Support
  • x86-64 components availability
  • Safe Choice and Lifetime Usability
  • Data Redundancy with Erasure Coding
  • High Data Availability
  • Native Windows client
Get a quotation

Download now!

Community Edition

Download MooseFS for Linux Download MooseFS for macOS Download MooseFS Windows Client

Subscribe to stay updated

Our Blog

Contact us

Europe

Aleja Stanów Zjednoczonych 61A

04-028 Warsaw, Poland

+48 22 390 90 90