Normalized to: Lobzin, V.
[1]
oai:arXiv.org:2001.02808 [pdf] - 2054142
A Comparison of Flare Forecasting Methods. IV. Evaluating
Consecutive-Day Forecasting Patterns
Park, Sung-Hong;
Leka, K. D.;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob A.;
Steward, Graham;
Terkildsen, Michael
Submitted: 2020-01-08, last modified: 2020-01-21
A crucial challenge to successful flare prediction is forecasting periods
that transition between "flare-quiet" and "flare-active". Building on earlier
studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we
describe methodology, details, and results of flare forecasting comparison
efforts, we focus here on patterns of forecast outcomes (success and failure)
over multi-day periods. A novel analysis is developed to evaluate forecasting
success in the context of catching the first event of flare-active periods, and
conversely, of correctly predicting declining flare activity. We demonstrate
these evaluation methods graphically and quantitatively as they provide both
quick comparative evaluations and options for detailed analysis. For the
testing interval 2016-2017, we determine the relative frequency distribution of
two-day dichotomous forecast outcomes for three different event histories
(i.e., event/event, no-event/event and event/no-event), and use it to highlight
performance differences between forecasting methods. A trend is identified
across all forecasting methods that a high/low forecast probability on day-1
remains high/low on day-2 even though flaring activity is transitioning. For
M-class and larger flares, we find that explicitly including persistence or
prior flare history in computing forecasts helps to improve overall forecast
performance. It is also found that using magnetic/modern data leads to
improvement in catching the first-event/first-no-event transitions. Finally,
15% of major (i.e., M-class or above) flare days over the testing interval were
effectively missed due to a lack of observations from instruments away from the
Earth-Sun line.
[2]
oai:arXiv.org:1907.02905 [pdf] - 1953629
A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and
Performance Results for Operational Solar Flare Forecasting Systems
Leka, K. D.;
Park, Sung-Hong;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob;
Steward, Graham;
Terkildsen, Michael
Submitted: 2019-07-05
Solar flares are extremely energetic phenomena in our Solar System. Their
impulsive, often drastic radiative increases, in particular at short
wavelengths, bring immediate impacts that motivate solar physics and space
weather research to understand solar flares to the point of being able to
forecast them. As data and algorithms improve dramatically, questions must be
asked concerning how well the forecasting performs; crucially, we must ask how
to rigorously measure performance in order to critically gauge any
improvements. Building upon earlier-developed methodology (Barnes et al, 2016,
Paper I), international representatives of regional warning centers and
research facilities assembled in 2017 at the Institute for Space-Earth
Environmental Research, Nagoya University, Japan to - for the first time -
directly compare the performance of operational solar flare forecasting
methods. Multiple quantitative evaluation metrics are employed, with focus and
discussion on evaluation methodologies given the restrictions of operational
forecasting. Numerous methods performed consistently above the "no skill"
level, although which method scored top marks is decisively a function of flare
event definition and the metric used; there was no single winner. Following in
this paper series we ask why the performances differ by examining
implementation details (Leka et al. 2019, Paper III), and then we present a
novel analysis method to evaluate temporal patterns of forecasting errors in
(Park et al. 2019, Paper IV). With these works, this team presents a
well-defined and robust methodology for evaluating solar flare forecasting
methods in both research and operational frameworks, and today's performance
benchmarks against which improvements and new methods may be compared.
[3]
oai:arXiv.org:1907.02909 [pdf] - 1953630
A Comparison of Flare Forecasting Methods. III. Systematic Behaviors of
Operational Solar Flare Forecasting Systems
Leka, K. D.;
Park, Sung-Hong;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob;
Steward, Graham;
Terkildsen, Michael
Submitted: 2019-07-05
A workshop was recently held at Nagoya University (31 October - 02 November
2017), sponsored by the Center for International Collaborative Research, at the
Institute for Space-Earth Environmental Research, Nagoya University, Japan, to
quantitatively compare the performance of today's operational solar flare
forecasting facilities. Building upon Paper I of this series (Barnes et al.
2016), in Paper II (Leka et al. 2019) we described the participating methods
for this latest comparison effort, the evaluation methodology, and presented
quantitative comparisons. In this paper we focus on the behavior and
performance of the methods when evaluated in the context of broad
implementation differences. Acknowledging the short testing interval available
and the small number of methods available, we do find that forecast
performance: 1) appears to improve by including persistence or prior flare
activity, region evolution, and a human "forecaster in the loop"; 2) is hurt by
restricting data to disk-center observations; 3) may benefit from long-term
statistics, but mostly when then combined with modern data sources and
statistical approaches. These trends are arguably weak and must be viewed with
numerous caveats, as discussed both here and in Paper II. Following this
present work, we present in Paper IV a novel analysis method to evaluate
temporal patterns of forecasting errors of both types (i.e., misses and false
alarms; Park et al. 2019). Hence, most importantly, with this series of papers
we demonstrate the techniques for facilitating comparisons in the interest of
establishing performance-positive methodologies.
[4]
oai:arXiv.org:1406.2363 [pdf] - 1210051
Properties of a Coronal Shock Wave as A Driver of Early SEP Acceleration
Submitted: 2014-06-09, last modified: 2014-12-09
Coronal mass ejections (CMEs) are thought to drive collisionless shocks in
the solar corona, which in turn have been shown capable of accelerating solar
energetic particles (SEPs) in minutes. It has been notoriously difficult to
extract information about energetic particle spectra in the corona, due to lack
of in-situ measurements. It is possible, however, to combine remote
observations with data-driven models in order to deduce coronal shock
properties relevant to the local acceleration of SEPs and their heliospheric
connectivity to near-Earth space. We present such novel analysis applied to the
May 11, 2011 CME event on the western solar limb, focusing on the evolution of
the eruption-driven, dome-like shock wave observed by the Atmospheric Imaging
Assembly (AIA) EUV telescopes on board the Solar Dynamics Observatory
spacecraft. We analyze the shock evolution and estimate its strength using
emission measure modeling. We apply a new method combining a geometric model of
the shock front with a potential field source surface model to estimate
time-dependent field-to-shock angles and heliospheric connectivity during shock
passage in the low corona. We find that the shock was weak, with an initial
speed of ~450 km/s. It was initially mostly quasi-parallel, but significant
portion of it turned quasi-perpendicular later in the event. There was good
magnetic connectivity to near-Earth space towards the end of the event as
observed by the AIA instrument. The methods used in this analysis hold a
significant potential for early characterization of coronal shock waves and
forecasting of SEP spectra based on remote observations.
[5]
oai:arXiv.org:1406.2372 [pdf] - 833931
Off-limb Solar Coronal Wavefronts From SDO/AIA EUV Observations -
Implications For Particle Production
Submitted: 2014-06-09
We derive kinematic properties for two recent solar coronal transient waves
observed off the western solar limb with the Atmospheric Imaging Assembly (AIA)
onboard the Solar Dynamics Observatory (SDO) mission. The two waves occurred
over $\sim10$-min intervals on consecutive days - June 12 and 13, 2010. For the
first time, off-limb waves are imaged with a high 12-sec cadence, making
possible detailed analysis of these transients in the low corona between
$\sim1.1$-2.0 solar radii ($R_{s}$). We use observations in the 193 and 211
{\AA} AIA channels to constrain the kinematics of both waves. We obtain initial
velocities for the two fronts of $\sim1287$ and $\sim736$ km s$^{-1}$, and
accelerations of $-1170$ and $-800$ m s$^{-2}$, respectively. Additionally,
differential emission measure analysis shows the June 13 wave is consistent
with a weak shock. EUV wave positions are correlated with positions from
simultaneous type II radio burst observations. We find good temporal and height
association between the two, suggesting that the waves may be the EUV
signatures of coronal shocks. Furthermore, the events are associated with
significant increases in proton fluxes at 1 AU, possibly related to how waves
propagate through the coronal magnetic field. Characterizing these coronal
transients will be key to connecting their properties with energetic particle
production close to the Sun.
[6]
oai:arXiv.org:1101.0620 [pdf] - 1042853
First Spectroscopic Imaging Observations of the Sun at Low Radio
Frequencies with the Murchison Widefield Array Prototype
Oberoi, Divya;
Matthews, Lynn D.;
Cairns, Iver H.;
Emrich, David;
Lobzin, Vasili;
Lonsdale, Colin J.;
Morgan, Edward H.;
Prabu, T.;
Vedantham, Harish;
Wayth, Randall B.;
Williams, Andrew;
Williams, Christopher;
White, Stephen M.;
Allen, G.;
Arcus, Wayne;
Barnes, David;
Benkevitch, Leonid;
Bernardi, Gianni;
Bowman, Judd D.;
Briggs, Frank H.;
Bunton, John D.;
Burns, Steve;
Cappallo, Roger C.;
Clark, M. A.;
Corey, Brian E.;
Dawson, M.;
DeBoer, David;
De Gans, A.;
deSouza, Ludi;
Derome, Mark;
Edgar, R. G.;
Elton, T.;
Goeke, Robert;
Gopalakrishna, M. R.;
Greenhill, Lincoln J.;
Hazelton, Bryna;
Herne, David;
Hewitt, Jacqueline N.;
Kamini, P. A.;
Kaplan, David L.;
Kasper, Justin C.;
Kennedy, Rachel;
Kincaid, Barton B.;
Kocz, Jonathan;
Koeing, R.;
Kowald, Errol;
Lynch, Mervyn J.;
Madhavi, S.;
McWhirter, Stephen R.;
Mitchell, Daniel A.;
Morales, Miguel F.;
Ng, A.;
Ord, Stephen M.;
Pathikulangara, Joseph;
Rogers, Alan E. E.;
Roshi, Anish;
Salah, Joseph E.;
Sault, Robert J.;
Schinckel, Antony;
Shankar, N. Udaya;
Srivani, K. S.;
Stevens, Jamie;
Subrahmanyan, Ravi;
Thakkar, D.;
Tingay, Steven J.;
Tuthill, J.;
Vaccarella, Annino;
Waterson, Mark;
Webster, Rachel L.;
Whitney, Alan R.
Submitted: 2011-01-03
We present the first spectroscopic images of solar radio transients from the
prototype for the Murchison Widefield Array (MWA), observed on 2010 March 27.
Our observations span the instantaneous frequency band 170.9-201.6 MHz. Though
our observing period is characterized as a period of `low' to `medium'
activity, one broadband emission feature and numerous short-lived, narrowband,
non-thermal emission features are evident. Our data represent a significant
advance in low radio frequency solar imaging, enabling us to follow the
spatial, spectral, and temporal evolution of events simultaneously and in
unprecedented detail. The rich variety of features seen here reaffirms the
coronal diagnostic capability of low radio frequency emission and provides an
early glimpse of the nature of radio observations that will become available as
the next generation of low frequency radio interferometers come on-line over
the next few years.