Kolosov, Ivan
Normalized to: Kolosov, I.
1 article(s) in total. 2 co-authors. Median position in authors list is 1,0.
[1]
oai:arXiv.org:1703.10979 [pdf] - 1556401
Architecture of processing and analysis system for big astronomical data
Submitted: 2017-03-31
This work explores the use of big data technologies deployed in the cloud for
processing of astronomical data. We have applied Hadoop and Spark to the task
of co-adding astronomical images. We compared the overhead and execution time
of these frameworks. We conclude that performance of both frameworks is
generally on par. The Spark API is more flexible, which allows one to easily
construct astronomical data processing pipelines.