A crucial challenge to successful flare prediction is forecasting periods that transition between "flare-quiet" and "flare-active". Building on earlier studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we describe methodology, details, and results of flare forecasting comparison efforts, we focus here on patterns of forecast outcomes (success and failure) over multi-day periods. A novel analysis is developed to evaluate forecasting success in the context of catching the first event of flare-active periods, and conversely, of correctly predicting declining flare activity. We demonstrate these evaluation methods graphically and quantitatively as they provide both quick comparative evaluations and options for detailed analysis. For the testing interval 2016-2017, we determine the relative frequency distribution of two-day dichotomous forecast outcomes for three different event histories (i.e., event/event, no-event/event and event/no-event), and use it to highlight performance differences between forecasting methods. A trend is identified across all forecasting methods that a high/low forecast probability on day-1 remains high/low on day-2 even though flaring activity is transitioning. For M-class and larger flares, we find that explicitly including persistence or prior flare history in computing forecasts helps to improve overall forecast performance. It is also found that using magnetic/modern data leads to improvement in catching the first-event/first-no-event transitions. Finally, 15% of major (i.e., M-class or above) flare days over the testing interval were effectively missed due to a lack of observations from instruments away from the Earth-Sun line.

Solar flares are extremely energetic phenomena in our Solar System. Their impulsive, often drastic radiative increases, in particular at short wavelengths, bring immediate impacts that motivate solar physics and space weather research to understand solar flares to the point of being able to forecast them. As data and algorithms improve dramatically, questions must be asked concerning how well the forecasting performs; crucially, we must ask how to rigorously measure performance in order to critically gauge any improvements. Building upon earlier-developed methodology (Barnes et al, 2016, Paper I), international representatives of regional warning centers and research facilities assembled in 2017 at the Institute for Space-Earth Environmental Research, Nagoya University, Japan to - for the first time - directly compare the performance of operational solar flare forecasting methods. Multiple quantitative evaluation metrics are employed, with focus and discussion on evaluation methodologies given the restrictions of operational forecasting. Numerous methods performed consistently above the "no skill" level, although which method scored top marks is decisively a function of flare event definition and the metric used; there was no single winner. Following in this paper series we ask why the performances differ by examining implementation details (Leka et al. 2019, Paper III), and then we present a novel analysis method to evaluate temporal patterns of forecasting errors in (Park et al. 2019, Paper IV). With these works, this team presents a well-defined and robust methodology for evaluating solar flare forecasting methods in both research and operational frameworks, and today's performance benchmarks against which improvements and new methods may be compared.

A workshop was recently held at Nagoya University (31 October - 02 November 2017), sponsored by the Center for International Collaborative Research, at the Institute for Space-Earth Environmental Research, Nagoya University, Japan, to quantitatively compare the performance of today's operational solar flare forecasting facilities. Building upon Paper I of this series (Barnes et al. 2016), in Paper II (Leka et al. 2019) we described the participating methods for this latest comparison effort, the evaluation methodology, and presented quantitative comparisons. In this paper we focus on the behavior and performance of the methods when evaluated in the context of broad implementation differences. Acknowledging the short testing interval available and the small number of methods available, we do find that forecast performance: 1) appears to improve by including persistence or prior flare activity, region evolution, and a human "forecaster in the loop"; 2) is hurt by restricting data to disk-center observations; 3) may benefit from long-term statistics, but mostly when then combined with modern data sources and statistical approaches. These trends are arguably weak and must be viewed with numerous caveats, as discussed both here and in Paper II. Following this present work, we present in Paper IV a novel analysis method to evaluate temporal patterns of forecasting errors of both types (i.e., misses and false alarms; Park et al. 2019). Hence, most importantly, with this series of papers we demonstrate the techniques for facilitating comparisons in the interest of establishing performance-positive methodologies.

The most energetic solar flares are typically associated with the ejection of a cloud of coronal material into the heliosphere in the form of a coronal mass ejection (CME). However, there exist large flares which are not accompanied by a CME. The existence of these non-eruptive flares raises the question of whether such flares suffer from a lack of access to nearby open fields in the vicinity above the flare (reconnection) site. In this study, we use a sample of 56 flares from Sunspot Cycles 23 and 24 to test whether active regions that produce eruptive X-class flares are preferentially located near coronal magnetic field domains that are open to the heliosphere, as inferred from a potential field source surface model. The study shows that X-class flares having access to open fields are eruptive at a higher rate than those for which access is lacking. The significance of this result should be moderated due to the small number of non-eruptive X-class flares in the sample, based on the associated Bayes factor.

A classification infrastructure built upon Discriminant Analysis has been developed at NorthWest Research Associates for examining the statistical differences between samples of two known populations. Originating to examine the physical differences between flare-quiet and flare-imminent solar active regions, we describe herein some details of the infrastructure including: parametrization of large datasets, schemes for handling "null" and "bad" data in multi-parameter analysis, application of non-parametric multi-dimensional Discriminant Analysis, an extension through Bayes' theorem to probabilistic classification, and methods invoked for evaluating classifier success. The classifier infrastructure is applicable to a wide range of scientific questions in solar physics. We demonstrate its application to the question of distinguishing flare-imminent from flare-quiet solar active regions, updating results from the original publications that were based on different data and much smaller sample sizes. Finally, as a demonstration of "Research to Operations" efforts in the space-weather forecasting context, we present the Discriminant Analysis Flare Forecasting System (DAFFS), a near-real-time operationally-running solar flare forecasting tool that was developed from the research-directed infrastructure.

Although for many solar physics problems the desirable or meaningful boundary is the radial component of the magnetic field $B_{\rm r}$, the most readily available measurement is the component of the magnetic field along the line-of-sight to the observer, $B_{\rm los}$. As this component is only equal to the radial component where the viewing angle is exactly zero, some approximation is required to estimate $B_{\rm r}$ at all other observed locations. In this study, a common approximation known as the "$\mu$-correction", which assumes all photospheric field to be radial, is compared to a method which invokes computing a potential field that matches the observed $B_{\rm los}$, from which the potential field radial component, $B_{\rm r}^{\rm pot}$ is recovered. We demonstrate that in regions that are truly dominated by radially-oriented field at the resolution of the data employed, the $\mu$-correction performs acceptably if not better than the potential-field approach. However, it is also shown that for any solar structure which includes horizontal fields, i.e. active regions, the potential-field method better recovers both the strength of the radial field and the location of magnetic neutral line.

Magnetohydrostatic models of the solar atmosphere are often based on idealized analytic solutions because the underlying equations are too difficult to solve in full generality. Numerical approaches, too, are often limited in scope and have tended to focus on the two-dimensional problem. In this article we develop a numerical method for solving the nonlinear magnetohydrostatic equations in three dimensions. Our method is a fixed-point iteration scheme that extends the method of Grad and Rubin (Proc. 2nd Int. Conf. on Peaceful Uses of Atomic Energy 31, 190, 1958) to include a finite gravity force. We apply the method to a test case to demonstrate the method in general and our implementation in code in particular.

Solar flares produce radiation which can have an almost immediate effect on the near-Earth environment, making it crucial to forecast flares in order to mitigate their negative effects. The number of published approaches to flare forecasting using photospheric magnetic field observations has proliferated, with varying claims about how well each works. Because of the different analysis techniques and data sets used, it is essentially impossible to compare the results from the literature. This problem is exacerbated by the low event rates of large solar flares. The challenges of forecasting rare events have long been recognized in the meteorology community, but have yet to be fully acknowledged by the space weather community. During the interagency workshop on "all clear" forecasts held in Boulder, CO in 2009, the performance of a number of existing algorithms was compared on common data sets, specifically line-of-sight magnetic field and continuum intensity images from MDI, with consistent definitions of what constitutes an event. We demonstrate the importance of making such systematic comparisons, and of using standard verification statistics to determine what constitutes a good prediction scheme. When a comparison was made in this fashion, no one method clearly outperformed all others, which may in part be due to the strong correlations among the parameters used by different methods to characterize an active region. For M-class flares and above, the set of methods tends towards a weakly positive skill score (as measured with several distinct metrics), with no participating method proving substantially better than climatological forecasts.

NASA's Solar Dynamics Observatory is delivering vector field observations of the full solar disk with unprecedented temporal and spatial resolution; however, the satellite is in a highly inclined geostationary orbit. The relative spacecraft-Sun velocity varies by $\pm3$~km/s over a day which introduces major orbital artifacts in the Helioseismic Magnetic Imager data. We demonstrate that the orbital artifacts contaminate all spatial and temporal scales in the data. We describe a newly-developed three stage procedure for mitigating these artifacts in the Doppler data derived from the Milne-Eddington inversions in the HMI Pipeline. This procedure was applied to full disk images of AR11084 to produce consistent Dopplergrams. The data adjustments reduce the power in the orbital artifacts by 31dB. Furthermore, we analyze in detail the corrected images and show that our procedure greatly improve the temporal and spectral properties of the data without adding any new artifacts. We conclude that this new and easily implemented procedure makes a dramatic improvement in the consistency of the HMI data and in its usefulness for precision scientific studies.

The nonlinear force-free field (NLFFF) model is often used to describe the solar coronal magnetic field, however a series of earlier studies revealed difficulties in the numerical solution of the model in application to photospheric boundary data. We investigate the sensitivity of the modeling to the spatial resolution of the boundary data, by applying multiple codes that numerically solve the NLFFF model to a sequence of vector magnetogram data at different resolutions, prepared from a single Hinode/SOT-SP scan of NOAA Active Region 10978 on 2007 December 13. We analyze the resulting energies and relative magnetic helicities, employ a Helmholtz decomposition to characterize divergence errors, and quantify changes made by the codes to the vector magnetogram boundary data in order to be compatible with the force-free model. This study shows that NLFFF modeling results depend quantitatively on the spatial resolution of the input boundary data, and that using more highly resolved boundary data yields more self-consistent results. The free energies of the resulting solutions generally trend higher with increasing resolution, while relative magnetic helicity values vary significantly between resolutions for all methods. All methods require changing the horizontal components, and for some methods also the vertical components, of the vector magnetogram boundary field in excess of nominal uncertainties in the data. The solutions produced by the various methods are significantly different at each resolution level. We continue to recommend verifying agreement between the modeled field lines and corresponding coronal loop images before any NLFFF model is used in a scientific setting.

The Helioseismic and Magnetic Imager (HMI) began near-continuous full-disk solar measurements on 1 May 2010 from the Solar Dynamics Observatory (SDO). An automated processing pipeline keeps pace with observations to produce observable quantities, including the photospheric vector magnetic field, from sequences of filtergrams. The primary 720s observables were released in mid 2010, including Stokes polarization parameters measured at six wavelengths as well as intensity, Doppler velocity, and the line-of-sight magnetic field. More advanced products, including the full vector magnetic field, are now available. Automatically identified HMI Active Region Patches (HARPs) track the location and shape of magnetic regions throughout their lifetime. The vector field is computed using the Very Fast Inversion of the Stokes Vector (VFISV) code optimized for the HMI pipeline; the remaining 180 degree azimuth ambiguity is resolved with the Minimum Energy (ME0) code. The Milne-Eddington inversion is performed on all full-disk HMI observations. The disambiguation, until recently run only on HARP regions, is now implemented for the full disk. Vector and scalar quantities in the patches are used to derive active region indices potentially useful for forecasting; the data maps and indices are collected in the SHARP data series, hmi.sharp_720s. Patches are provided in both CCD and heliographic coordinates. HMI provides continuous coverage of the vector field, but has modest spatial, spectral, and temporal resolution. Coupled with limitations of the analysis and interpretation techniques, effects of the orbital velocity, and instrument performance, the resulting measurements have a certain dynamic range and sensitivity and are subject to systematic errors and uncertainties that are characterized in this report.

A new data product from the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO) called Space-weather HMI Active Region Patches (SHARPs) is now available. SDO/HMI is the first space-based instrument to map the full-disk photospheric vector magnetic field with high cadence and continuity. The SHARP data series provide maps in patches that encompass automatically tracked magnetic concentrations for their entire lifetime; map quantities include the photospheric vector magnetic field and its uncertainty, along with Doppler velocity, continuum intensity, and line-of-sight magnetic field. Furthermore, keywords in the SHARP data series provide several parameters that concisely characterize the magnetic-field distribution and its deviation from a potential-field configuration. These indices may be useful for active-region event forecasting and for identifying regions of interest. The indices are calculated per patch and are available on a twelve-minute cadence. Quick-look data are available within approximately three hours of observation; definitive science products are produced approximately five weeks later. SHARP data are available at http://jsoc.stanford.edu and maps are available in either of two different coordinate systems. This article describes the SHARP data products and presents examples of SHARP data and parameters.

The Very Fast Inversion of the Stokes Vector (VFISV) is a Milne-Eddington spectral line inversion code used to determine the magnetic and thermodynamic parameters of the solar photosphere from observations of the Stokes vector in the 6173 A Fe I line by the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO). We report on the modifications made to the original VFISV inversion code in order to optimize its operation within the HMI data pipeline and provide the smoothest solution in active regions. The changes either sped up the computation or reduced the frequency with which the algorithm failed to converge to a satisfactory solution. Additionally, coding bugs which were detected and fixed in the original VFISV release, are reported here.

The subsurface properties of active regions prior to their appearance at the solar surface may shed light on the process of active region formation. Helioseismic holography has been applied to samples taken from two populations of regions on the Sun (pre-emergence and without emergence), each sample having over 100 members, that were selected to minimize systematic bias, as described in Paper I (Leka et al., 2012). Paper II (Birch et al., 2012) showed that there are statistically significant signatures in the average helioseismic properties that precede the formation of an active region. This paper describes a more detailed analysis of the samples of pre-emergence regions and regions without emergence, based on discriminant analysis. The property that is best able to distinguish the populations is found to be the surface magnetic field, even a day before the emergence time. However, after accounting for the correlations between the surface field and the quantities derived from helioseismology, there is still evidence of a helioseismic precursor to active region emergence that is present for at least a day prior to emergence.

This first paper in a series describes the design of a study testing whether pre-appearance signatures of solar magnetic active regions were detectable using various tools of local helioseismology. The ultimate goal is to understand flux-emergence mechanisms by setting observational constraints on pre-appearance subsurface changes, for comparison with results from simulation efforts. This first paper provides details of the data selection and preparation of the samples, each containing over 100 members, of two populations: regions on the Sun that produced a numbered NOAA active region, and a "control" sample of areas that did not. The seismology is performed on data from the GONG network; accompanying magnetic data from SOHO/MDI are used for co-temporal analysis of the surface magnetic field. Samples are drawn from 2001 -- 2007, and each target is analyzed for 27.7 hr prior to an objectively determined time of emergence. The results of two analysis approaches are published separately: one based on averages of the seismology- and magnetic-derived signals over the samples, another based on Discriminant Analysis of these signals, for a statistical test of detectable differences between the two populations. We include here descriptions of a new potential-field calculation approach and the algorithm for matching sample distributions over multiple variables. We describe known sources of bias and the approaches used to mitigate them. We also describe unexpected bias sources uncovered during the course of the study and include a discussion of refinements that should be included in future work on this topic.

We report on average subsurface properties of pre-emerging active regions as compared to areas where no active region emergence was detected. Helioseismic holography is applied to samples of the two populations (pre-emergence and without emergence), each sample having over 100 members, which were selected to minimize systematic bias, as described in Leka et al. We find that there are statistically significant signatures (i.e., difference in the means of more than a few standard errors) in the average subsurface flows and the apparent wave speed that precede the formation of an active region. The measurements here rule out spatially extended flows of more than about 15 m/s in the top 20 Mm below the photosphere over the course of the day preceding the start of visible emergence. These measurements place strong constraints on models of active region formation.

We address points recently discussed in Georgoulis (2011) in reference to Leka et al. (2009b). Most importantly, we find that the results of Georgoulis (2011) support a conclusion of Leka et al. (2009b): that limited spatial resolution and the presence of unresolved magnetic structures can challenge ambiguity- resolution algorithms. Moreover, the findings of both Metcalf et al. (2006) and Leka et al. (2009b) are confirmed in Georgoulis (2011): a method's performance can be diminished when the observed field fails to conform to that method's assumptions. The implication of boundaries in models of solar magnetic structures is discussed; we confirm that the distribution of the field components in the model used in Leka et al. (2009b) is closer to what is observed on the Sun than what is proposed in Georgoulis (2011). It is also shown that method does matter with regards to simulating limited spatial resolution and avoiding an inadvertent introduction of bias. Finally, the assignment of categories to data- analysis algorithms is revisited; we argue that assignments are only useful and elucidating when used appropriately.

Different methods for simulating the effects of spatial resolution on magnetic field maps are compared, including those commonly used for inter-instrument comparisons. The investigation first uses synthetic data, and the results are confirmed with {\it Hinode}/SpectroPolarimeter data. Four methods are examined, one which manipulates the Stokes spectra to simulate spatial-resolution degradation, and three "post-facto" methods where the magnetic field maps are manipulated directly. Throughout, statistical comparisons of the degraded maps with the originals serve to quantify the outcomes. Overall, we find that areas with inferred magnetic fill fractions close to unity may be insensitive to optical spatial resolution; areas of sub-unity fill fractions are very sensitive. Trends with worsening spatial resolution can include increased average field strength, lower total flux, and a field vector oriented closer to the line of sight. Further-derived quantities such as vertical current density show variations even in areas of high average magnetic fill-fraction. In short, unresolved maps fail to represent the distribution of the underlying unresolved fields, and the "post-facto" methods generally do not reproduce the effects of a smaller telescope aperture. It is argued that selecting a method in order to reconcile disparate spatial resolution effects should depend on the goal, as one method may better preserve the field distribution, while another can reproduce spatial resolution degradation. The results presented should help direct future inter-instrument comparisons.

We investigate the evolution of coronal loop emission in the context of the coronal magnetic field topology. New modeling techniques allow us to investigate the magnetic field structure and energy release in active regions. Using these models and high resolution multi-wavelength coronal observations from the Transition Region and Coronal Explorer (TRACE) and the X-ray Telescope (XRT) on Hinode, we are able to establish a relationship between the light curves of coronal loops and their associated magnetic topologies for NOAA Active Region 10963. We examine loops that show both transient and steady emission, and we find that loops that show many transient brightenings are located in domains associated with a high number of separators. This topology provides an environment for continual impulsive heating events through magnetic reconnection at the separators. A loop with relatively constant X-ray and EUV emission, on the other hand, is located in domains that are not associated with separators. This result implies that larger-scale magnetic field reconnections are not involved in heating plasma in these regions, and the heating in these loops must come from another mechanism, such as small-scale reconnections (i.e., nanoflares) or wave heating. Additionally, we find that loops that undergo repeated transient brightenings are associated with separators that have enhanced free energy. In contrast, we find one case of an isolated transient brightening that seems to be associated with separators with a smaller free energy.

We investigate how the divergence-free property of magnetic fields can be exploited to resolve the azimuthal ambiguity present in solar vector magnetogram data, by using line-of-sight and horizontal heliographic derivative information as approximated from discrete measurements. Using synthetic data we test several methods that each make different assumptions about how the divergence-free property can be used to resolve the ambiguity. We find that the most robust algorithm involves the minimisation of the absolute value of the divergence summed over the entire field of view. Away from disk centre this method requires the sign and magnitude of the line-of-sight derivatives of all three components of the magnetic field vector.

Nonlinear force-free field (NLFFF) models are thought to be viable tools for investigating the structure, dynamics and evolution of the coronae of solar active regions. In a series of NLFFF modeling studies, we have found that NLFFF models are successful in application to analytic test cases, and relatively successful when applied to numerically constructed Sun-like test cases, but they are less successful in application to real solar data. Different NLFFF models have been found to have markedly different field line configurations and to provide widely varying estimates of the magnetic free energy in the coronal volume, when applied to solar data. NLFFF models require consistent, force-free vector magnetic boundary data. However, vector magnetogram observations sampling the photosphere, which is dynamic and contains significant Lorentz and buoyancy forces, do not satisfy this requirement, thus creating several major problems for force-free coronal modeling efforts. In this article, we discuss NLFFF modeling of NOAA Active Region 10953 using Hinode/SOT-SP, Hinode/XRT, STEREO/SECCHI-EUVI, and SOHO/MDI observations, and in the process illustrate the three such issues we judge to be critical to the success of NLFFF modeling: (1) vector magnetic field data covering larger areas are needed so that more electric currents associated with the full active regions of interest are measured, (2) the modeling algorithms need a way to accommodate the various uncertainties in the boundary data, and (3) a more realistic physical model is needed to approximate the photosphere-to-corona interface in order to better transform the forced photospheric magnetograms into adequate approximations of nearly force-free fields at the base of the corona. We make recommendations for future modeling efforts to overcome these as yet unsolved problems.

Coronal magnetic field may be characterized by how its field lines interconnect regions of opposing photospheric flux -- its connectivity. Connectivity can be quantified as the net flux connecting pairs of opposing regions, once such regions are identified. One existing algorithm will partition a typical active region into a number of unipolar regions ranging from a few dozen to a few hundred, depending on algorithmic parameters. This work explores how the properties of the partitions depend on some algorithmic parameters, and how connectivity depends on the coarseness of partitioning for one particular active region magnetogram. We find the number of connections among them scales with the number of regions even as the number of possible connections scales with its square. There are several methods of generating a coronal field, even a potential field. The field may be computed inside conducting boundaries or over an infinite half-space. For computation of connectivity, the unipolar regions may be replaced by point sources or the exact magnetogram may be used as a lower boundary condition. Our investigation shows that the connectivities from these various fields differ only slightly -- no more than 15%. The greatest difference is between fields within conducting walls and those in the half-space. Their connectivities grow more different as finer partitioning creates more source regions. This also gives a quantitative means of establishing how far away conducting boundaries must be placed in order not to significantly affect the extrapolation. For identical outer boundaries, the use of point sources instead of the exact magnetogram makes a smaller difference in connectivity: typically 6% independent of the number of source regions.

Solar flares and coronal mass ejections are associated with rapid changes in field connectivity and powered by the partial dissipation of electrical currents in the solar atmosphere. A critical unanswered question is whether the currents involved are induced by the motion of pre-existing atmospheric magnetic flux subject to surface plasma flows, or whether these currents are associated with the emergence of flux from within the solar convective zone. We address this problem by applying state-of-the-art nonlinear force-free field (NLFFF) modeling to the highest resolution and quality vector-magnetographic data observed by the recently launched Hinode satellite on NOAA Active Region 10930 around the time of a powerful X3.4 flare. We compute 14 NLFFF models with 4 different codes and a variety of boundary conditions. We find that the model fields differ markedly in geometry, energy content, and force-freeness. We discuss the relative merits of these models in a general critique of present abilities to model the coronal magnetic field based on surface vector field measurements. For our application in particular, we find a fair agreement of the best-fit model field with the observed coronal configuration, and argue (1) that strong electrical currents emerge together with magnetic flux preceding the flare, (2) that these currents are carried in an ensemble of thin strands, (3) that the global pattern of these currents and of field lines are compatible with a large-scale twisted flux rope topology, and (4) that the ~10^32 erg change in energy associated with the coronal electrical currents suffices to power the flare and its associated coronal mass ejection.