NAOC Open IR
A redistribution tool for long-term archive of astronomical observation data
Sun, C.1,3; Yu, C.1,3; Cui, C.2,3; He, B.2,3; Xiao, J.1,3; Li, Z.1,3; Tang, S.1,3; Sun, J.1,3
2020-07-01
Source PublicationASTRONOMY AND COMPUTING
ISSN2213-1337
Volume32Pages:7
AbstractAstronomical observation data require long-term preservation, and the rapid accumulation of observation data makes it necessary to consider the cost of long-term archive storage. In addition to low-speed disk-based online storage, optical disk or tape-based offline storage can be used to save costs. However, for astronomical research that requires historical data (particularly time-domain astronomy), the performance and energy consumption of data-accessing techniques cause problems because the requested data (which are organized according to observation time) may be located across multiple storage devices. In this study, we design and develop a tool referred to as AstroLayout to redistribute the observation data using spatial aggregation. The core algorithm uses graph partitioning to generate an optimized data placement according to the original observation data statistics and the target storage system. For the given observation data, AstroLayout can copy the long-term archive in the target storage system in accordance with this placement. An efficiency evaluation shows that AstroLayout can reduce the number of devices activated when responding to data-access requests in time-domain astronomy research. In addition to improving the performance of data-accessing techniques, AstroLayout can also reduce the storage system's power consumption. For enhanced adaptability, it supports storage systems of any media, including optical disks, tapes, and hard disks. (C) 2020 Elsevier B.V. All rights reserved.
KeywordData layout Data archive Long-term preservation Energy efficiency Graph partitioning
Funding OrganizationNational Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO)
DOI10.1016/j.ascom.2020.100400
WOS KeywordSTORAGE
Language英语
Funding ProjectNational Natural Science Foundation of China (NSFC)[U1731243] ; National Natural Science Foundation of China (NSFC)[U1931130] ; National Natural Science Foundation of China (NSFC)[U1731125] ; Chinese Academy of Sciences (CAS)[U1731243] ; Chinese Academy of Sciences (CAS)[U1931130] ; Chinese Academy of Sciences (CAS)[U1731125] ; National Natural Science Fund of China[11803022] ; National Natural Science Fund of China[11573019] ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO)
Funding OrganizationNational Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; National Natural Science Fund of China ; National Natural Science Fund of China ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO)
WOS Research AreaAstronomy & Astrophysics ; Computer Science
WOS SubjectAstronomy & Astrophysics ; Computer Science, Interdisciplinary Applications
WOS IDWOS:000571492100014
PublisherELSEVIER
Citation statistics
Document Type期刊论文
Identifierhttp://ir.bao.ac.cn/handle/114a11/81466
Collection中国科学院国家天文台
Corresponding AuthorYu, C.
Affiliation1.Tianjin Univ, Coll Intelligence & Comp, 135 Yaguan Rd, Tianjin 300350, Peoples R China
2.Chinese Acad Sci, Natl Astron Observ, 20A Datun Rd, Beijing 100012, Peoples R China
3.NAOC TJU Joint Res Ctr Astroinformat, 135 Yaguan Rd, Tianjin 300350, Peoples R China
Recommended Citation
GB/T 7714
Sun, C.,Yu, C.,Cui, C.,et al. A redistribution tool for long-term archive of astronomical observation data[J]. ASTRONOMY AND COMPUTING,2020,32:7.
APA Sun, C..,Yu, C..,Cui, C..,He, B..,Xiao, J..,...&Sun, J..(2020).A redistribution tool for long-term archive of astronomical observation data.ASTRONOMY AND COMPUTING,32,7.
MLA Sun, C.,et al."A redistribution tool for long-term archive of astronomical observation data".ASTRONOMY AND COMPUTING 32(2020):7.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Sun, C.]'s Articles
[Yu, C.]'s Articles
[Cui, C.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Sun, C.]'s Articles
[Yu, C.]'s Articles
[Cui, C.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Sun, C.]'s Articles
[Yu, C.]'s Articles
[Cui, C.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.