Normalized to: Morik, K.
[1]
oai:arXiv.org:1809.00581 [pdf] - 1743988
Distributed Real-Time Data Stream Analysis for CTA
Submitted: 2018-09-03
Once completed, the Cherenkov Telescope Array (CTA) will be able to map the
gamma-ray sky in a wide energy range from several tens of GeV to some hundreds
of TeV and will be more sensitive than previous experiments by an order of
magnitude. It opens up the opportunity to observe transient phenomena like
gamma-ray bursts (GRBs) and flaring active galactic nuclei (AGN). In order to
successfully trigger multi-wavelength observations of transients, CTA has to be
able to alert other observatories as quickly as possible. Multi-wavelength
observations are essential for gaining insights into the processes occurring
within these sources of such high energy radiation. CTA will consist of
approximately 100 telescopes of different sizes and designs. Images are
streamed from all the telescopes into a central computing facility on site.
During observation CTA will produce a stream of up to 20 000 images per second.
Noise suppression and feature extraction algorithms are applied to each image
in the stream as well as previously trained machine learning models. Restricted
computing power of a single machine and the limits of network's data transfer
rates become a bottleneck for stream processing systems in a traditional
single-machine setting. We explore several different distributed streaming
technologies from the Apache Big-Data eco-system like Spark, Flink, Storm to
handle the large amount of data coming from the telescopes. To share a single
code base while executing on different streaming engines we employ abstraction
layers such as the streams-framework. These use a high level language to build
up processing pipelines that can transformed into the native pipelines of the
different platforms. Here we present results of our investigation and show a
first prototype capable of analyzing CTA data in real-time.
[2]
oai:arXiv.org:1409.4535 [pdf] - 1361803
Development of a General Analysis and Unfolding Scheme and its
Application to Measure the Energy Spectrum of Atmospheric Neutrinos with
IceCube
Aartsen, M. G.;
Ackermann, M.;
Adams, J.;
Aguilar, J. A.;
Ahlers, M.;
Ahrens, M.;
Altmann, D.;
Anderson, T.;
Arguelles, C.;
Arlen, T. C.;
Auffenberg, J.;
Bai, X.;
Barwick, S. W.;
Baum, V.;
Beatty, J. J.;
Tjus, J. Becker;
Becker, K. -H.;
BenZvi, S.;
Berghaus, P.;
Berley, D.;
Bernardini, E.;
Bernhard, A.;
Besson, D. Z.;
Binder, G.;
Bindig, D.;
Bissok, M.;
Blaufuss, E.;
Blumenthal, J.;
Boersma, D. J.;
Bohm, C.;
Bos, F.;
Bose, D.;
Böser, S.;
Botner, O.;
Brayeur, L.;
Bretz, H. P.;
Brown, A. M.;
Casey, J.;
Casier, M.;
Cheung, E.;
Chirkin, D.;
Christov, A.;
Christy, B.;
Clark, K.;
Classen, L.;
Clevermann, F.;
Coenders, S.;
Cowen, D. F.;
Silva, A. H. Cruz;
Danninger, M.;
Daughhetee, J.;
Davis, J. C.;
Day, M.;
deAndré, J. P. A. M.;
De Clercq, C.;
De Ridder, S.;
Desiati, P.;
de Vries, K. D.;
de With, M.;
DeYoung, T.;
Díaz-Vélez, J. C.;
Dunkman, M.;
Eagan, R.;
Eberhardt, B.;
Eichmann, B.;
Eisch, J.;
Euler, S.;
Evenson, P. A.;
Fadiran, O.;
Fazely, A. R.;
Fedynitch, A.;
Feintzeig, J.;
Felde, J.;
Feusels, T.;
Filimonov, K.;
Finley, C.;
Fischer-Wasels, T.;
Flis, S.;
Franckowiak, A.;
Frantzen, K.;
Fuchs, T.;
Gaisser, T. K.;
Gaior, R.;
Gallagher, J.;
Gerhardt, L.;
Gier, D.;
Gladstone, L.;
Glüsenkamp, T.;
Goldschmidt, A.;
Golup, G.;
Gonzalez, J. G.;
Goodman, J. A.;
Góra, D.;
Grant, D.;
Gretskov, P.;
Groh, J. C.;
Groß, A.;
Ha, C.;
Haack, C.;
Ismail, A. Haj;
Hallen, P.;
Hallgren, A.;
Halzen, F.;
Hanson, K.;
Hebecker, D.;
Heereman, D.;
Heinen, D.;
Helbing, K.;
Hellauer, R.;
Hellwig, D.;
Hickford, S.;
Hill, G. C.;
Hoffman, K. D.;
Hoffmann, R.;
Homeier, A.;
Hoshina, K.;
Huang, F.;
Huelsnitz, W.;
Hulth, P. O.;
Hultqvist, K.;
Hussain, S.;
Ishihara, A.;
Jacobi, E.;
Jacobsen, J.;
Jagielski, K.;
Japaridze, G. S.;
Jero, K.;
Jlelati, O.;
Jurkovic, M.;
Kaminsky, B.;
Kappes, A.;
Karg, T.;
Karle, A.;
Kauer, M.;
Keivani, A.;
Kelley, J. L.;
Kheirandish, A.;
Kiryluk, J.;
Kläs, J.;
Klein, S. R.;
Köhne, J. H.;
Kohnen, G.;
Kolanoski, H.;
Koob, A.;
Köpke, L.;
Kopper, C.;
Kopper, S.;
Koskinen, D. J.;
Kowalski, M.;
Kriesten, A.;
Krings, K.;
Kroll, G.;
Kroll, M.;
Kunnen, J.;
Kurahashi, N.;
Kuwabara, T.;
Labare, M.;
Larsen, D. T.;
Larson, M. J.;
Lesiak-Bzdak, M.;
Leuermann, M.;
Leute, J.;
Lünemann, J.;
Madsen, J.;
Maggi, G.;
Maruyama, R.;
Mase, K.;
Matis, H. S.;
Maunu, R.;
McNally, F.;
Meagher, K.;
Medici, M.;
Meli, A.;
Meures, T.;
Miarecki, S.;
Middell, E.;
Middlemas, E.;
Milke, N.;
Miller, J.;
Mohrmann, L.;
Montaruli, T.;
Morse, R.;
Nahnhauer, R.;
Naumann, U.;
Niederhausen, H.;
Nowicki, S. C.;
Nygren, D. R.;
Obertacke, A.;
Odrowski, S.;
Olivas, A.;
Omairat, A.;
O'Murchadha, A.;
Palczewski, T.;
Paul, L.;
Penek, Ö.;
Pepper, J. A.;
Heros, C. Pérez de los;
Pfendner, C.;
Pieloth, D.;
Pinat, E.;
Posselt, J.;
Price, P. B.;
Przybylski, G. T.;
Pütz, J.;
Quinnan, M.;
Rädel, L.;
Rameez, M.;
Rawlins, K.;
Redl, P.;
Rees, I.;
Reimann, R.;
Relich, M.;
Resconi, E.;
Rhode, W.;
Richman, M.;
Riedel, B.;
Robertson, S.;
Rodrigues, J. P.;
Rongen, M.;
Rott, C.;
Ruhe, T.;
Ruzybayev, B.;
Ryckbosch, D.;
Saba, S. M.;
Sander, H. G.;
Sandroos, J.;
Santander, M.;
Sarkar, S.;
Schatto, K.;
Scheriau, F.;
Schmidt, T.;
Schmitz, M.;
Schoenen, S.;
Schöneberg, S.;
Schönwald, A.;
Schukraft, A.;
Schulte, L.;
Schulz, O.;
Seckel, D.;
Sestayo, Y.;
Seunarine, S.;
Shanidze, R.;
Smith, M. W. E.;
Soldin, D.;
Spiczak, G. M.;
Spiering, C.;
Stamatikos, M.;
Stanev, T.;
Stanisha, N. A.;
Stasik, A.;
Stezelberger, T.;
Stokstad, R. G.;
Stößl, A.;
Strahler, E. A.;
Ström, R.;
Strotjohann, N. L.;
Sullivan, G. W.;
Taavola, H.;
Taboada, I.;
Tamburro, A.;
Tepe, A.;
Ter-Antonyan, S.;
Terliuk, A.;
Tešić, G.;
Tilav, S.;
Toale, P. A.;
Tobin, M. N.;
Tosi, D.;
Tselengidou, M.;
Unger, E.;
Usner, M.;
Vallecorsa, S.;
van Eijndhoven, N.;
Vandenbroucke, J.;
van Santen, J.;
Vehring, M.;
Voge, M.;
Vraeghe, M.;
Walck, C.;
Wallraff, M.;
Weaver, Ch.;
Wellons, M.;
Wendt, C.;
Westerhoff, S.;
Whelan, B. J.;
Whitehorn, N.;
Wichary, C.;
Wiebe, K.;
Wiebusch, C. H.;
Williams, D. R.;
Wissing, H.;
Wolf, M.;
Wood, T. R.;
Woschnagg, K.;
Xu, D. L.;
Xu, X. W.;
Yanez, J. P.;
Yodh, G.;
Yoshida, S.;
Zarzhitsky, P.;
Ziemann, J.;
Zierke, S.;
Zoll, M.;
Morik, K.
Submitted: 2014-09-16, last modified: 2015-02-16
We present the development and application of a generic analysis scheme for
the measurement of neutrino spectra with the IceCube detector. This scheme is
based on regularized unfolding, preceded by an event selection which uses a
Minimum Redundancy Maximum Relevance algorithm to select the relevant variables
and a Random Forest for the classification of events. The analysis has been
developed using IceCube data from the 59-string configuration of the detector.
27,771 neutrino candidates were detected in 346 days of livetime. A rejection
of 99.9999% of the atmospheric muon background is achieved. The energy spectrum
of the atmospheric neutrino flux is obtained using the TRUEE unfolding program.
The unfolded spectrum of atmospheric muon neutrinos covers an energy range from
100 GeV to 1 PeV. Compared to the previous measurement using the detector in
the 40-string configuration, the analysis presented here, extends the upper end
of the atmospheric neutrino spectrum by more than a factor of two, reaching an
energy region that has not been previously accessed by spectral measurements.
