NAOC Open IR
AstroCatR: a mechanism and tool for efficient time series reconstruction of large-scale astronomical catalogues
Yu, Ce1,2; Li, Kun1,2; Tang, Shanjiang1,2; Sun, Chao1,2; Ma, Bin3; Zhao, Qing4
2020-07-01
Source PublicationMONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY
ISSN0035-8711
Volume496Issue:1Pages:629-637
AbstractTime series data of celestial objects are commonly used to study valuable and unexpected objects such as extrasolar planets and supernova in time domain astronomy. Due to the rapid growth of data volume, traditional manual methods are becoming extremely hard and infeasible for continuously analysing accumulated observation data. To meet such demands, we designed and implemented a special tool named AstroCatR that can efficiently and flexibly reconstruct time series data from large-scale astronomical catalogues. AstroCatR can load original catalogue data from Flexible Image Transport System (FITS) files or data bases, match each item to determine which object it belongs to, and finally produce time series data sets. To support the high-performance parallel processing of large-scale data sets, AstroCatR uses the extract-transform-load (ETL) pre-processing module to create sky zone files and balance the workload. The matching module uses the overlapped indexing method and an in-memory reference table to improve accuracy and performance. The output of AstroCatR can be stored in CSV files or be transformed other into formats as needed. Simultaneously, the module-based software architecture ensures the flexibility and scalability of AstroCatR. We evaluated AstroCatR with actual observation data from The three Antarctic Survey Telescopes (AST3). The experiments demonstrate that AstroCatR can efficiently and flexibly reconstruct all time series data by setting relevant parameters and configuration files. Furthermore, the tool is approximately 3x faster than methods using relational data base management systems at matching massive catalogues.
Keywordmethods: data analysis techniques: miscellaneous catalogues surveys
Funding OrganizationNational Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO)
DOI10.1093/mnras/staa1413
Language英语
Funding ProjectNational Natural Science Foundation of China[11803022] ; National Natural Science Foundation of China (NSFC)[U1731243] ; National Natural Science Foundation of China (NSFC)[U1931130] ; National Natural Science Foundation of China (NSFC)[U1731125] ; Chinese Academy of Sciences (CAS)[U1731243] ; Chinese Academy of Sciences (CAS)[U1931130] ; Chinese Academy of Sciences (CAS)[U1731125] ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO)
Funding OrganizationNational Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO) ; National Natural Science Foundation of China ; National Natural Science Foundation of China ; National Natural Science Foundation of China (NSFC) ; National Natural Science Foundation of China (NSFC) ; Chinese Academy of Sciences (CAS) ; Chinese Academy of Sciences (CAS) ; China National Astronomical Data Center (NADC) ; China National Astronomical Data Center (NADC) ; Chinese Virtual Observatory (China-VO) ; Chinese Virtual Observatory (China-VO)
WOS Research AreaAstronomy & Astrophysics
WOS SubjectAstronomy & Astrophysics
WOS IDWOS:000560784700048
PublisherOXFORD UNIV PRESS
Citation statistics
Document Type期刊论文
Identifierhttp://ir.bao.ac.cn/handle/114a11/82330
Collection中国科学院国家天文台
Corresponding AuthorYu, Ce
Affiliation1.Tianjin Univ, Coll Intelligence & Comp, 135 Yaguan Rd,Haihe Educ Pk, Tianjin 300350, Peoples R China
2.NA0C TJU Joint Res Ctr Astroinformat, 135 Yaguan Rd,Haihe Educ Pk, Tianjin 300350, Peoples R China
3.Chinese Acad Sci, Natl Astron Observ, 20 Datun Rd, Beijing 100012, Peoples R China
4.Tianjin Univ Sci & Technol, Sch Comp Sci & Informat Engn, Tianjin 300457, Peoples R China
Recommended Citation
GB/T 7714
Yu, Ce,Li, Kun,Tang, Shanjiang,et al. AstroCatR: a mechanism and tool for efficient time series reconstruction of large-scale astronomical catalogues[J]. MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY,2020,496(1):629-637.
APA Yu, Ce,Li, Kun,Tang, Shanjiang,Sun, Chao,Ma, Bin,&Zhao, Qing.(2020).AstroCatR: a mechanism and tool for efficient time series reconstruction of large-scale astronomical catalogues.MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY,496(1),629-637.
MLA Yu, Ce,et al."AstroCatR: a mechanism and tool for efficient time series reconstruction of large-scale astronomical catalogues".MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY 496.1(2020):629-637.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yu, Ce]'s Articles
[Li, Kun]'s Articles
[Tang, Shanjiang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yu, Ce]'s Articles
[Li, Kun]'s Articles
[Tang, Shanjiang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yu, Ce]'s Articles
[Li, Kun]'s Articles
[Tang, Shanjiang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.