Processing astronomical data often comes with huge challenges with regards to data management as well as data processing. MeerKAT telescope is one of the precursor telescopes of the World's largest observatory - Square Kilometre Array. So far, MeerKAT data was processed using the South African computing facility i.e. IDIA, and exploited to make ground-breaking discoveries. However, to process MeerKAT data on UK's IRIS computing facility requires new implementation of the MeerKAT pipeline. This paper focuses on how to transfer MeerKAT data from the South African site to UK's IRIS systems for processing. We discuss about our RapifXfer Data transfer framework for transferring the MeerKAT data from South Africa to the UK, and the MeerKAT job processing framework pertaining to the UK's IRIS resources.
翻译:处理天文数据通常伴随着数据管理和处理方面的巨大挑战。 MeerKAT 望远镜是世界上最大天文台——SKA的先驱望远镜之一。到目前为止,MeerKAT 数据使用南非计算设施 IDIA 进行处理,并用于取得突破性的发现。然而,要在英国的 IRIS 计算设施上处理 MeerKAT 数据需要新实现 MeerKAT pipeline。本文重点讨论如何将 MeerKAT 数据从南非站点转移到英国的 IRIS 系统进行处理。我们讨论了我们的 RapifXfer 数据传输框架,用于将 MeerKAT 数据从南非转移到英国,以及涉及英国的 IRIS 资源的 MeerKAT 工作处理框架。