量子Data Management Software Manages Earth Observing Data Archive

Every day, NASA's Earth Observing System satellites beam down terabytes of data about the earth, oceans, and atmosphere. The data is made available to climate researchers around the world using NASA's Earth Observing System Data and Information System (EOSDIS)—one of the most ambitious data projects ever conceived. The storage of this irreplaceable information is entrusted to Quantum's data management software.

Escalating Data Growth

Since going online in 1999, NASA's EOSDIS has become one of the world's largest and most active data repositories. Every day, it receives 3 terabytes of new data and distributes 2 terabytes of existing information to researchers around the world, giving hundreds of thousands of users access to more than 20 million files containing over a petabyte of information.

核心EOSDIS组件由Raytheon图像和地理空间系统开发。“此数据是国家资源,将提供对地球如何变化的卓越洞察力,”Raytheon的项目技术总监说。“存储它,组织它,并使研究人员可用是关键任务和巨大的挑战。”

The scale of the task meant that the system needed to be structured so that applications could write data and read it directly from automated tape libraries. "…we needed a robust storage system that could scale to handle massive data sets stored on multiple types of media,” Raytheon's Project Technical Director explains. “We also needed a stable solution that could support 24/7 operation.”

具有磁盘和磁带的高性能数据访问

Key to EOSDIS success was developing a system for managing high-speed disk cache that keeps metadata persistently available for rapid searches of millions of files and petabytes of primary data that are stored on tape. Quantum's data management software ties the whole system together and lets users access it effectively.

Quantum的数据管理软件将磁带库转换为在线,直接访问大众存储启用用户,管理员和应用程序,以归档PBRABYTES数据。Quantum的数据管理软件将自动磁带库呈现为一个设备和一个UNIX挂载点,使用户可以以与磁盘设备相同的方式访问驻留在磁带库上的文件。Quantum的数据管理软件管理磁盘缓存,在高可用的服务器集群中在线维护元数据,并缩放以管理有效无限数量的文件。

“完成的系统让我们获得最有效的用途,因为我们的存储资源中可能会有可能,”Raytheon的项目技术总监继续进行。“它为我们提供了高性能,非常有弹性的存储环境,可以轻松地访问来自所有应用程序的数据,并且它为我们提供了大量资源杠杆。所有文件检索,暂存到磁盘缓存,以及作为文件或重复一组介质的交付发生在后台。“对于通过EOSDIS网站访问数据的用户,将显示数据,好像它存储在单个数据库中。

支持系统架构并提供持续服务的量子的支持对项目的成功至关重要。汇位的项目技术总监缔结,“从主要供应商对该项目的总体承诺一直是其成功的关键之一。”