Normalized to: Falconer, D.
[1]
oai:arXiv.org:2001.02808 [pdf] - 2054142
A Comparison of Flare Forecasting Methods. IV. Evaluating
Consecutive-Day Forecasting Patterns
Park, Sung-Hong;
Leka, K. D.;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob A.;
Steward, Graham;
Terkildsen, Michael
Submitted: 2020-01-08, last modified: 2020-01-21
A crucial challenge to successful flare prediction is forecasting periods
that transition between "flare-quiet" and "flare-active". Building on earlier
studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we
describe methodology, details, and results of flare forecasting comparison
efforts, we focus here on patterns of forecast outcomes (success and failure)
over multi-day periods. A novel analysis is developed to evaluate forecasting
success in the context of catching the first event of flare-active periods, and
conversely, of correctly predicting declining flare activity. We demonstrate
these evaluation methods graphically and quantitatively as they provide both
quick comparative evaluations and options for detailed analysis. For the
testing interval 2016-2017, we determine the relative frequency distribution of
two-day dichotomous forecast outcomes for three different event histories
(i.e., event/event, no-event/event and event/no-event), and use it to highlight
performance differences between forecasting methods. A trend is identified
across all forecasting methods that a high/low forecast probability on day-1
remains high/low on day-2 even though flaring activity is transitioning. For
M-class and larger flares, we find that explicitly including persistence or
prior flare history in computing forecasts helps to improve overall forecast
performance. It is also found that using magnetic/modern data leads to
improvement in catching the first-event/first-no-event transitions. Finally,
15% of major (i.e., M-class or above) flare days over the testing interval were
effectively missed due to a lack of observations from instruments away from the
Earth-Sun line.
[2]
oai:arXiv.org:1907.02905 [pdf] - 1953629
A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and
Performance Results for Operational Solar Flare Forecasting Systems
Leka, K. D.;
Park, Sung-Hong;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob;
Steward, Graham;
Terkildsen, Michael
Submitted: 2019-07-05
Solar flares are extremely energetic phenomena in our Solar System. Their
impulsive, often drastic radiative increases, in particular at short
wavelengths, bring immediate impacts that motivate solar physics and space
weather research to understand solar flares to the point of being able to
forecast them. As data and algorithms improve dramatically, questions must be
asked concerning how well the forecasting performs; crucially, we must ask how
to rigorously measure performance in order to critically gauge any
improvements. Building upon earlier-developed methodology (Barnes et al, 2016,
Paper I), international representatives of regional warning centers and
research facilities assembled in 2017 at the Institute for Space-Earth
Environmental Research, Nagoya University, Japan to - for the first time -
directly compare the performance of operational solar flare forecasting
methods. Multiple quantitative evaluation metrics are employed, with focus and
discussion on evaluation methodologies given the restrictions of operational
forecasting. Numerous methods performed consistently above the "no skill"
level, although which method scored top marks is decisively a function of flare
event definition and the metric used; there was no single winner. Following in
this paper series we ask why the performances differ by examining
implementation details (Leka et al. 2019, Paper III), and then we present a
novel analysis method to evaluate temporal patterns of forecasting errors in
(Park et al. 2019, Paper IV). With these works, this team presents a
well-defined and robust methodology for evaluating solar flare forecasting
methods in both research and operational frameworks, and today's performance
benchmarks against which improvements and new methods may be compared.
[3]
oai:arXiv.org:1907.02909 [pdf] - 1953630
A Comparison of Flare Forecasting Methods. III. Systematic Behaviors of
Operational Solar Flare Forecasting Systems
Leka, K. D.;
Park, Sung-Hong;
Kusano, Kanya;
Andries, Jesse;
Barnes, Graham;
Bingham, Suzy;
Bloomfield, D. Shaun;
McCloskey, Aoife E.;
Delouille, Veronique;
Falconer, David;
Gallagher, Peter T.;
Georgoulis, Manolis K.;
Kubo, Yuki;
Lee, Kangjin;
Lee, Sangwoo;
Lobzin, Vasily;
Mun, JunChul;
Murray, Sophie A.;
Nageem, Tarek A. M. Hamad;
Qahwaji, Rami;
Sharpe, Michael;
Steenburgh, Rob;
Steward, Graham;
Terkildsen, Michael
Submitted: 2019-07-05
A workshop was recently held at Nagoya University (31 October - 02 November
2017), sponsored by the Center for International Collaborative Research, at the
Institute for Space-Earth Environmental Research, Nagoya University, Japan, to
quantitatively compare the performance of today's operational solar flare
forecasting facilities. Building upon Paper I of this series (Barnes et al.
2016), in Paper II (Leka et al. 2019) we described the participating methods
for this latest comparison effort, the evaluation methodology, and presented
quantitative comparisons. In this paper we focus on the behavior and
performance of the methods when evaluated in the context of broad
implementation differences. Acknowledging the short testing interval available
and the small number of methods available, we do find that forecast
performance: 1) appears to improve by including persistence or prior flare
activity, region evolution, and a human "forecaster in the loop"; 2) is hurt by
restricting data to disk-center observations; 3) may benefit from long-term
statistics, but mostly when then combined with modern data sources and
statistical approaches. These trends are arguably weak and must be viewed with
numerous caveats, as discussed both here and in Paper II. Following this
present work, we present in Paper IV a novel analysis method to evaluate
temporal patterns of forecasting errors of both types (i.e., misses and false
alarms; Park et al. 2019). Hence, most importantly, with this series of papers
we demonstrate the techniques for facilitating comparisons in the interest of
establishing performance-positive methodologies.
[4]
oai:arXiv.org:1811.05557 [pdf] - 1830514
A Two-Sided-Loop X-Ray Solar Coronal Jet Driven by a Minifilament
Eruption
Submitted: 2018-11-13
Most of the commonly discussed solar coronal jets are of the type consisting
of a single spire extending approximately vertically from near the solar
surface into the corona. Recent research supports that eruption of a miniature
filament (minifilament) drives many such single-spire jets, and concurrently
generates a miniflare at the eruption site. A different type of coronal jet,
identified in X-ray images during the Yohkoh era, are two-sided-loop jets,
which extend from a central excitation location in opposite directions, along
low-lying coronal loops more-or-less horizontal to the surface. We observe such
a two-sided-loop jet from the edge of active region (AR) 12473, using data from
Hinode XRT and EIS, and SDO AIA and HMI. Similar to single-spire jets, this
two-sided-loop jet results from eruption of a minifilament, which accelerates
to over 140 km/s before abruptly stopping after striking overlying
nearly-horizontal loop field at about 30,000 km altitude and producing the
two-sided-loop jet. Analysis of EIS raster scans show that a hot brightening,
consistent with a small flare, develops in the aftermath of the eruption, and
that Doppler motions (approx 40 km/s) occur near the jet-formation region. As
with many single-spire jets, the magnetic trigger here is apparently flux
cancelation, which occurs at a rate of approx 4x10^18 Mx/hr, comparable to the
rate observed in some single-spire AR jets. An apparent increase in the
(line-of-sight) flux occurs within minutes of onset of the minifilament
eruption, consistent with the apparent increase being due to a rapid
reconfiguration of low-lying field during and soon after minifilament-eruption
onset.
[5]
oai:arXiv.org:1705.03373 [pdf] - 1574816
Small-scale filament eruptions as the driver of solar coronal hole X-ray
jets
Submitted: 2017-05-09
Solar X-ray jets are evidently made by a burst of reconnection of closed
magnetic field in a jet's base with ambient "open" field (1,2). In the
widely-accepted version of the "emerging-flux" model, that reconnection occurs
at a current sheet between the open field and emerging closed field and also
makes a compact hot brightening that is usually observed at the edge of the
jet's base (1,3). Here we report on high-resolution X-ray and EUV observations
of 20 randomly-selected X-ray jets in polar coronal holes. In each jet,
contrary to the emerging-flux model, a miniature version of the filament
eruptions that initiate coronal mass ejections (CMEs) (4-7) drives the
jet-producing reconnection, and the compact hot brightening is made by internal
reconnection of the legs of the minifilament-carrying erupting closed field,
analogous to solar flares of larger-scale eruptions. Previous observations have
found that some jets are driven by base-field eruptions (8-10,12), but only one
such study, of only one jet, provisionally questioned the emerging-flux model
(13). Our observations support the view that solar filament eruptions are made
by a fundamental explosive magnetic process that occurs on a vast range of
scales, from the biggest CME/flare eruptions down to X-ray jets, and perhaps
down to even smaller jets that are candidates for powering coronal heating
(10,14,15). A picture similar to that suggested by our observations was drawn
before, inferred from different observations and based on a different origin of
the erupting minifilament flux rope (11) (see Methods).
[6]
oai:arXiv.org:1705.03040 [pdf] - 1583230
Solar Active Region Coronal Jets II: Triggering and Evolution of Violent
Jets
Submitted: 2017-05-08
We study a series of X-ray-bright, rapidly-evolving active-region coronal
jets outside the leading sunspot of AR 12259, using Hinode/XRT, SDO/AIA and
HMI, and IRIS data. The detailed evolution of such rapidly evolving "violent"
jets remained a mystery after our previous investigation of active region jets
(Sterling et al. 2016, Paper 1). The jets we investigate here erupt from three
localized subregions, each containing a rapidly evolving (positive)
minority-polarity magnetic-flux patch bathed in a (majority) negative-polarity
magnetic-flux background. At least several of the jets begin with eruptions of
what appear to be thin (thickness <~2") miniature-filament (minifilament)
"strands" from a magnetic neutral line where magnetic flux cancelation is
ongoing, consistent with the magnetic configuration presented for coronal-hole
jets in Sterling et al. (2015). Some jets strands are difficult/impossible to
detect, perhaps due to, e.g. their thinness, obscuration by surrounding bright
or dark features, or the absence of erupting cool-material minifilaments in
those jets. Tracing in detail the flux evolution in one of the subregions, we
find bursts of strong jetting occurring only during times of strong flux
cancelation. Averaged over seven jetting episodes, the cancelation rate was
~1.5x10^19 Mx/hr. An average flux of ~5x10^18 Mx canceled prior to each
episode, arguably building up ~10^28 - 10^29 ergs of free magnetic energy per
jet. From these and previous observations, we infer that flux cancelation is
the fundamental process responsible for the pre-eruption buildup and triggering
of at least many jets in active regions, quiet regions, and coronal holes.
[7]
oai:arXiv.org:1612.01948 [pdf] - 1533044
A new method to quantify and reduce projection error in
whole-solar-active-region parameters measured from vector magnetograms
Submitted: 2016-12-06
Projection error limits the use of vector magnetograms of active regions
(ARs) far from disk center. In this Letter, for ARs observed up to 60o from
disk center, we demonstrate a method of measuring and reducing the projection
error in the magnitude of any whole-AR parameter derived from a vector
magnetogram that has been deprojected to disk center. The method assumes that
the center-to-limb curve of the average of the parameter's absolute values
measured from the disk passage of a large number of ARs and normalized to each
AR's absolute value of the parameter at central meridian, gives the average
fractional projection error at each radial distance from disk center. To
demonstrate the method, we use a large set of large-flux ARs and apply the
method to a whole-AR parameter that is among the simplest to measure: whole-AR
magnetic flux. We measure 30,845 SDO/HMI vector magnetograms covering the disk
passage of 272 large-flux ARs, each having whole-AR flux >1022 Mx. We obtain
the center-to-limb radial-distance run of the average projection error in
measured whole-AR flux from a Chebyshev fit to the radial-distance plot of the
30,845 normalized measured values. The average projection error in the measured
whole-AR flux of an AR at a given radial distance is removed by multiplying the
measured flux by the correction factor given by the fit. The correction is
important for both the study of evolution of ARs and for improving the accuracy
of forecasting an AR's major flare/CME productivity.
[8]
oai:arXiv.org:1608.06319 [pdf] - 1490851
A Comparison of Flare Forecasting Methods, I: Results from the
"All-Clear" Workshop
Barnes, G.;
Leka, K. D.;
Schrijver, C. J.;
Colak, T.;
Qahwaji, R.;
Ashamari, O. W.;
Yuan, Y.;
Zhang, J.;
McAteer, R. T. J.;
Bloomfield, D. S.;
Higgins, P. A.;
Gallagher, P. T.;
Falconer, D. A.;
Georgoulis, M. K.;
Wheatland, M. S.;
Balch, C.;
Dunn, T.;
Wagner, E. L.
Submitted: 2016-08-22
Solar flares produce radiation which can have an almost immediate effect on
the near-Earth environment, making it crucial to forecast flares in order to
mitigate their negative effects. The number of published approaches to flare
forecasting using photospheric magnetic field observations has proliferated,
with varying claims about how well each works. Because of the different
analysis techniques and data sets used, it is essentially impossible to compare
the results from the literature. This problem is exacerbated by the low event
rates of large solar flares. The challenges of forecasting rare events have
long been recognized in the meteorology community, but have yet to be fully
acknowledged by the space weather community. During the interagency workshop on
"all clear" forecasts held in Boulder, CO in 2009, the performance of a number
of existing algorithms was compared on common data sets, specifically
line-of-sight magnetic field and continuum intensity images from MDI, with
consistent definitions of what constitutes an event. We demonstrate the
importance of making such systematic comparisons, and of using standard
verification statistics to determine what constitutes a good prediction scheme.
When a comparison was made in this fashion, no one method clearly outperformed
all others, which may in part be due to the strong correlations among the
parameters used by different methods to characterize an active region. For
M-class flares and above, the set of methods tends towards a weakly positive
skill score (as measured with several distinct metrics), with no participating
method proving substantially better than climatological forecasts.
[9]
oai:arXiv.org:1508.01532 [pdf] - 1259971
Near-Sun Speed of CMEs and the Magnetic Non-potentiality of their Source
Active Regions
Submitted: 2015-08-06
We show that the speed of the fastest coronal mass ejections (CMEs) that an
active region (AR) can produce can be predicted from a vector magnetogram of
the AR. This is shown by logarithmic plots of CME speed (from the SOHO LASCO
CME catalog) versus each of ten AR-integrated magnetic parameters (AR magnetic
flux, three different AR magnetic-twist parameters, and six AR
free-magnetic-energy proxies) measured from the vertical and horizontal field
components of vector magnetograms (from the {\it Solar Dynamics Observatory's
Helioseismic and Magnetic Imager}) of the source ARs of 189 CMEs. These plots
show: (1) the speed of the fastest CMEs that an AR can produce increases with
each of these whole-AR magnetic parameters, and (2) that one of the AR
magnetic-twist parameters and the corresponding free-magnetic-energy proxy each
determine the CME-speed upper-limit line somewhat better than any of the other
eight whole-AR magnetic parameters.
[10]
oai:arXiv.org:1504.03700 [pdf] - 1154905
Magnetic Untwisting in Solar Jets that Go into the Outer Corona in Polar
Coronal Holes
Submitted: 2015-04-14
We study 14 large solar jets observed in polar coronal holes. In EUV movies
from SDO/AIA, each jet appears similar to most X-ray jets and EUV jets that
erupt in coronal holes, but each is exceptional in that it goes higher than
most, so high that it is observed in the outer corona beyond 2.2 RSun in images
from the SOHO/LASCO/C2 coronagraph. From AIA He II 304 {\AA} movies and
LASCO/C2 running-difference images of these high-reaching jets, we find: (1)
the front of the jet transits the corona below 2.2 RSun at a speed typically
several times the sound speed; (2) each jet displays an exceptionally large
amount of spin as it erupts; (3) in the outer corona, most of the jets display
measureable swaying and bending of a few degrees in amplitude; in three jets
the swaying is discernibly oscillatory with a period of order 1 hour. These
characteristics suggest that the driver in these jets is a magnetic-untwisting
wave that is basically a large-amplitude (i.e., non-linear) torsional Alfven
wave that is put into the reconnected open field in the jet by interchange
reconnection as the jet erupts. From the measured spinning and swaying we
estimate that the magnetic-untwisting wave loses most of its energy in the
inner corona below 2.2 RSun. We point out that the torsional waves observed in
Type-II spicules might dissipate in the corona in the same way as the
magnetic-untwisting waves in our big jets and thereby power much of the coronal
heating in coronal holes.
[11]
oai:arXiv.org:0712.0756 [pdf] - 7767
Modeling X-ray Loops and EUV "Moss" in an Active Region Core
Submitted: 2007-12-05
The Soft X-ray intensity of loops in active region cores and corresponding
footpoint, or moss, intensity observed in the EUV remain steady for several
hours of observation. The steadiness of the emission has prompted many to
suggest that the heating in these loops must also be steady, though no direct
comparison between the observed X-ray and EUV intensities and the steady
heating solutions of the hydrodynamic equations has yet been made. In this
paper, we perform these simulations and simultaneously model the X-Ray and EUV
moss intensities in one active regioncore with steady uniform heating. To
perform this task, we introduce a new technique to constrain the model
parameters using the measured EUV footpoint intensity to infer a heating rate.
We find that a filling factor of 8% and loops that expand with height provides
the best agreement with the intensity in two X-ray filters, though the
simulated SXT Al12 intensity is 147% the observed intensity and the SXT AlMg
intensity is 80% the observed intensity. From this solution, we determine the
required heating rate scales as ${\bar{B}}^{0.29} L^{-0.95}$. Finally we
discuss the future potential of this type of modeling, such as the ability to
use density measurements to fully constrain filling factor, and its
shortcomings, such as the requirement to use potential field extrapolations to
approximate the coronal field.