Solar active region jets are small-scale collimated plasma eruptions that are triggered from magnetic sites embedded in sunspot penumbral regions. Multiple trigger mechanisms for recurrent jets are under debate. Vector magnetic field data from SDO-HMI observations are used to analyze a prolific photospheric configuration, identified in extreme ultraviolet observations as a `Coronal Geyser', that triggered a set of at least 10 recurrent solar active region jets. We focus on interpreting the magnetic fields of small-scale flaring sites aiming to understand the processes that govern recurrent jet eruptions. We perform a custom reprocessing of the SDO-HMI products, including disambiguation and uncertainty estimation. We scrutinized the configuration and dynamics of the photospheric magnetic structures. The magnetic configuration is described via the analysis of the photospheric magnetic vertical fields, to identify the process is responsible for driving the jet eruptions. We report that the two widely debated magnetic trigger processes, namely magnetic flux cancellation and magnetic flux emergence, appear to be responsible on a case by case basis for generating each eruption in our set. We find that 4 of 10 jets were due to flux cancellation while the rest were clearly not, and were more likely due to flux emergence.

A crucial challenge to successful flare prediction is forecasting periods that transition between "flare-quiet" and "flare-active". Building on earlier studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we describe methodology, details, and results of flare forecasting comparison efforts, we focus here on patterns of forecast outcomes (success and failure) over multi-day periods. A novel analysis is developed to evaluate forecasting success in the context of catching the first event of flare-active periods, and conversely, of correctly predicting declining flare activity. We demonstrate these evaluation methods graphically and quantitatively as they provide both quick comparative evaluations and options for detailed analysis. For the testing interval 2016-2017, we determine the relative frequency distribution of two-day dichotomous forecast outcomes for three different event histories (i.e., event/event, no-event/event and event/no-event), and use it to highlight performance differences between forecasting methods. A trend is identified across all forecasting methods that a high/low forecast probability on day-1 remains high/low on day-2 even though flaring activity is transitioning. For M-class and larger flares, we find that explicitly including persistence or prior flare history in computing forecasts helps to improve overall forecast performance. It is also found that using magnetic/modern data leads to improvement in catching the first-event/first-no-event transitions. Finally, 15% of major (i.e., M-class or above) flare days over the testing interval were effectively missed due to a lack of observations from instruments away from the Earth-Sun line.

The space physics community continues to grow and become both more interdisciplinary and more intertwined with commercial and government operations. This has created a need for a framework to easily identify what projects can be used for specific applications and how close the tool is to routine autonomous or on-demand implementation and operation. We propose the Application Usability Level (AUL) framework and publicizing AULs to help the community quantify the progress of successful applications, metrics, and validation efforts. This framework will also aid the scientific community by supplying the type of information needed to build off of previously published work and publicizing the applications and requirements needed by the user communities. In this paper, we define the AUL framework, outline the milestones required for progression to higher AULs, and provide example projects utilizing the AUL framework. This work has been completed as part of the activities of the Assessment of Understanding and Quantifying Progress working group which is part of the International Forum for Space Weather Capabilities Assessment.

A workshop was recently held at Nagoya University (31 October - 02 November 2017), sponsored by the Center for International Collaborative Research, at the Institute for Space-Earth Environmental Research, Nagoya University, Japan, to quantitatively compare the performance of today's operational solar flare forecasting facilities. Building upon Paper I of this series (Barnes et al. 2016), in Paper II (Leka et al. 2019) we described the participating methods for this latest comparison effort, the evaluation methodology, and presented quantitative comparisons. In this paper we focus on the behavior and performance of the methods when evaluated in the context of broad implementation differences. Acknowledging the short testing interval available and the small number of methods available, we do find that forecast performance: 1) appears to improve by including persistence or prior flare activity, region evolution, and a human "forecaster in the loop"; 2) is hurt by restricting data to disk-center observations; 3) may benefit from long-term statistics, but mostly when then combined with modern data sources and statistical approaches. These trends are arguably weak and must be viewed with numerous caveats, as discussed both here and in Paper II. Following this present work, we present in Paper IV a novel analysis method to evaluate temporal patterns of forecasting errors of both types (i.e., misses and false alarms; Park et al. 2019). Hence, most importantly, with this series of papers we demonstrate the techniques for facilitating comparisons in the interest of establishing performance-positive methodologies.

Solar flares are extremely energetic phenomena in our Solar System. Their impulsive, often drastic radiative increases, in particular at short wavelengths, bring immediate impacts that motivate solar physics and space weather research to understand solar flares to the point of being able to forecast them. As data and algorithms improve dramatically, questions must be asked concerning how well the forecasting performs; crucially, we must ask how to rigorously measure performance in order to critically gauge any improvements. Building upon earlier-developed methodology (Barnes et al, 2016, Paper I), international representatives of regional warning centers and research facilities assembled in 2017 at the Institute for Space-Earth Environmental Research, Nagoya University, Japan to - for the first time - directly compare the performance of operational solar flare forecasting methods. Multiple quantitative evaluation metrics are employed, with focus and discussion on evaluation methodologies given the restrictions of operational forecasting. Numerous methods performed consistently above the "no skill" level, although which method scored top marks is decisively a function of flare event definition and the metric used; there was no single winner. Following in this paper series we ask why the performances differ by examining implementation details (Leka et al. 2019, Paper III), and then we present a novel analysis method to evaluate temporal patterns of forecasting errors in (Park et al. 2019, Paper IV). With these works, this team presents a well-defined and robust methodology for evaluating solar flare forecasting methods in both research and operational frameworks, and today's performance benchmarks against which improvements and new methods may be compared.

A classification infrastructure built upon Discriminant Analysis has been developed at NorthWest Research Associates for examining the statistical differences between samples of two known populations. Originating to examine the physical differences between flare-quiet and flare-imminent solar active regions, we describe herein some details of the infrastructure including: parametrization of large datasets, schemes for handling "null" and "bad" data in multi-parameter analysis, application of non-parametric multi-dimensional Discriminant Analysis, an extension through Bayes' theorem to probabilistic classification, and methods invoked for evaluating classifier success. The classifier infrastructure is applicable to a wide range of scientific questions in solar physics. We demonstrate its application to the question of distinguishing flare-imminent from flare-quiet solar active regions, updating results from the original publications that were based on different data and much smaller sample sizes. Finally, as a demonstration of "Research to Operations" efforts in the space-weather forecasting context, we present the Discriminant Analysis Flare Forecasting System (DAFFS), a near-real-time operationally-running solar flare forecasting tool that was developed from the research-directed infrastructure.

Although for many solar physics problems the desirable or meaningful boundary is the radial component of the magnetic field $B_{\rm r}$, the most readily available measurement is the component of the magnetic field along the line-of-sight to the observer, $B_{\rm los}$. As this component is only equal to the radial component where the viewing angle is exactly zero, some approximation is required to estimate $B_{\rm r}$ at all other observed locations. In this study, a common approximation known as the "$\mu$-correction", which assumes all photospheric field to be radial, is compared to a method which invokes computing a potential field that matches the observed $B_{\rm los}$, from which the potential field radial component, $B_{\rm r}^{\rm pot}$ is recovered. We demonstrate that in regions that are truly dominated by radially-oriented field at the resolution of the data employed, the $\mu$-correction performs acceptably if not better than the potential-field approach. However, it is also shown that for any solar structure which includes horizontal fields, i.e. active regions, the potential-field method better recovers both the strength of the radial field and the location of magnetic neutral line.

Solar flares produce radiation which can have an almost immediate effect on the near-Earth environment, making it crucial to forecast flares in order to mitigate their negative effects. The number of published approaches to flare forecasting using photospheric magnetic field observations has proliferated, with varying claims about how well each works. Because of the different analysis techniques and data sets used, it is essentially impossible to compare the results from the literature. This problem is exacerbated by the low event rates of large solar flares. The challenges of forecasting rare events have long been recognized in the meteorology community, but have yet to be fully acknowledged by the space weather community. During the interagency workshop on "all clear" forecasts held in Boulder, CO in 2009, the performance of a number of existing algorithms was compared on common data sets, specifically line-of-sight magnetic field and continuum intensity images from MDI, with consistent definitions of what constitutes an event. We demonstrate the importance of making such systematic comparisons, and of using standard verification statistics to determine what constitutes a good prediction scheme. When a comparison was made in this fashion, no one method clearly outperformed all others, which may in part be due to the strong correlations among the parameters used by different methods to characterize an active region. For M-class flares and above, the set of methods tends towards a weakly positive skill score (as measured with several distinct metrics), with no participating method proving substantially better than climatological forecasts.

NASA's Solar Dynamics Observatory is delivering vector field observations of the full solar disk with unprecedented temporal and spatial resolution; however, the satellite is in a highly inclined geostationary orbit. The relative spacecraft-Sun velocity varies by $\pm3$~km/s over a day which introduces major orbital artifacts in the Helioseismic Magnetic Imager data. We demonstrate that the orbital artifacts contaminate all spatial and temporal scales in the data. We describe a newly-developed three stage procedure for mitigating these artifacts in the Doppler data derived from the Milne-Eddington inversions in the HMI Pipeline. This procedure was applied to full disk images of AR11084 to produce consistent Dopplergrams. The data adjustments reduce the power in the orbital artifacts by 31dB. Furthermore, we analyze in detail the corrected images and show that our procedure greatly improve the temporal and spectral properties of the data without adding any new artifacts. We conclude that this new and easily implemented procedure makes a dramatic improvement in the consistency of the HMI data and in its usefulness for precision scientific studies.

The nonlinear force-free field (NLFFF) model is often used to describe the solar coronal magnetic field, however a series of earlier studies revealed difficulties in the numerical solution of the model in application to photospheric boundary data. We investigate the sensitivity of the modeling to the spatial resolution of the boundary data, by applying multiple codes that numerically solve the NLFFF model to a sequence of vector magnetogram data at different resolutions, prepared from a single Hinode/SOT-SP scan of NOAA Active Region 10978 on 2007 December 13. We analyze the resulting energies and relative magnetic helicities, employ a Helmholtz decomposition to characterize divergence errors, and quantify changes made by the codes to the vector magnetogram boundary data in order to be compatible with the force-free model. This study shows that NLFFF modeling results depend quantitatively on the spatial resolution of the input boundary data, and that using more highly resolved boundary data yields more self-consistent results. The free energies of the resulting solutions generally trend higher with increasing resolution, while relative magnetic helicity values vary significantly between resolutions for all methods. All methods require changing the horizontal components, and for some methods also the vertical components, of the vector magnetogram boundary field in excess of nominal uncertainties in the data. The solutions produced by the various methods are significantly different at each resolution level. We continue to recommend verifying agreement between the modeled field lines and corresponding coronal loop images before any NLFFF model is used in a scientific setting.

The use of acoustic holography in the high-frequency $p$-mode spectrum can resolve the source distributions of enhanced acoustic emissions within halo structures surrounding active regions. In doing so, statistical methods can then be applied to ascertain relationships with the magnetic field. This is the focus of this study. The mechanism responsible for the detected enhancement of acoustic sources around solar active regions has not yet been explained. Furthermore the relationship between the magnetic field and enhanced acoustic emission has not yet been comprehensively examined. We have used vector magnetograms from the \Helioseismic and Magnetic Imager (HMI) on-board the Solar Dynamics Observatory (SDO) to image the magnetic-field properties in the halo. We have studied the acoustic morphology of an active region, with a complex halo and "glories," and we have linked some acoustic properties to the magnetic-field configuration. In particular, we find that acoustic sources are significantly enhanced in regions of intermediate field strength with inclinations no different from the distributions found in the quiet Sun. Additionally we have identified a transition region between the active region and the halo, in which the acoustic source power is hindered by inclined fields of intermediate field strength. Finally, we have compared the results of acoustic emission maps, calculated from holography, and the commonly used local acoustic maps, finding that the two types of maps have similar properties with respect to the magnetic field but lack spatial correlation when examining the highest-powered regions.

A new data product from the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO) called Space-weather HMI Active Region Patches (SHARPs) is now available. SDO/HMI is the first space-based instrument to map the full-disk photospheric vector magnetic field with high cadence and continuity. The SHARP data series provide maps in patches that encompass automatically tracked magnetic concentrations for their entire lifetime; map quantities include the photospheric vector magnetic field and its uncertainty, along with Doppler velocity, continuum intensity, and line-of-sight magnetic field. Furthermore, keywords in the SHARP data series provide several parameters that concisely characterize the magnetic-field distribution and its deviation from a potential-field configuration. These indices may be useful for active-region event forecasting and for identifying regions of interest. The indices are calculated per patch and are available on a twelve-minute cadence. Quick-look data are available within approximately three hours of observation; definitive science products are produced approximately five weeks later. SHARP data are available at http://jsoc.stanford.edu and maps are available in either of two different coordinate systems. This article describes the SHARP data products and presents examples of SHARP data and parameters.

The Helioseismic and Magnetic Imager (HMI) began near-continuous full-disk solar measurements on 1 May 2010 from the Solar Dynamics Observatory (SDO). An automated processing pipeline keeps pace with observations to produce observable quantities, including the photospheric vector magnetic field, from sequences of filtergrams. The primary 720s observables were released in mid 2010, including Stokes polarization parameters measured at six wavelengths as well as intensity, Doppler velocity, and the line-of-sight magnetic field. More advanced products, including the full vector magnetic field, are now available. Automatically identified HMI Active Region Patches (HARPs) track the location and shape of magnetic regions throughout their lifetime. The vector field is computed using the Very Fast Inversion of the Stokes Vector (VFISV) code optimized for the HMI pipeline; the remaining 180 degree azimuth ambiguity is resolved with the Minimum Energy (ME0) code. The Milne-Eddington inversion is performed on all full-disk HMI observations. The disambiguation, until recently run only on HARP regions, is now implemented for the full disk. Vector and scalar quantities in the patches are used to derive active region indices potentially useful for forecasting; the data maps and indices are collected in the SHARP data series, hmi.sharp_720s. Patches are provided in both CCD and heliographic coordinates. HMI provides continuous coverage of the vector field, but has modest spatial, spectral, and temporal resolution. Coupled with limitations of the analysis and interpretation techniques, effects of the orbital velocity, and instrument performance, the resulting measurements have a certain dynamic range and sensitivity and are subject to systematic errors and uncertainties that are characterized in this report.

The Very Fast Inversion of the Stokes Vector (VFISV) is a Milne-Eddington spectral line inversion code used to determine the magnetic and thermodynamic parameters of the solar photosphere from observations of the Stokes vector in the 6173 A Fe I line by the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO). We report on the modifications made to the original VFISV inversion code in order to optimize its operation within the HMI data pipeline and provide the smoothest solution in active regions. The changes either sped up the computation or reduced the frequency with which the algorithm failed to converge to a satisfactory solution. Additionally, coding bugs which were detected and fixed in the original VFISV release, are reported here.

The subsurface properties of active regions prior to their appearance at the solar surface may shed light on the process of active region formation. Helioseismic holography has been applied to samples taken from two populations of regions on the Sun (pre-emergence and without emergence), each sample having over 100 members, that were selected to minimize systematic bias, as described in Paper I (Leka et al., 2012). Paper II (Birch et al., 2012) showed that there are statistically significant signatures in the average helioseismic properties that precede the formation of an active region. This paper describes a more detailed analysis of the samples of pre-emergence regions and regions without emergence, based on discriminant analysis. The property that is best able to distinguish the populations is found to be the surface magnetic field, even a day before the emergence time. However, after accounting for the correlations between the surface field and the quantities derived from helioseismology, there is still evidence of a helioseismic precursor to active region emergence that is present for at least a day prior to emergence.

We report on average subsurface properties of pre-emerging active regions as compared to areas where no active region emergence was detected. Helioseismic holography is applied to samples of the two populations (pre-emergence and without emergence), each sample having over 100 members, which were selected to minimize systematic bias, as described in Leka et al. We find that there are statistically significant signatures (i.e., difference in the means of more than a few standard errors) in the average subsurface flows and the apparent wave speed that precede the formation of an active region. The measurements here rule out spatially extended flows of more than about 15 m/s in the top 20 Mm below the photosphere over the course of the day preceding the start of visible emergence. These measurements place strong constraints on models of active region formation.

This first paper in a series describes the design of a study testing whether pre-appearance signatures of solar magnetic active regions were detectable using various tools of local helioseismology. The ultimate goal is to understand flux-emergence mechanisms by setting observational constraints on pre-appearance subsurface changes, for comparison with results from simulation efforts. This first paper provides details of the data selection and preparation of the samples, each containing over 100 members, of two populations: regions on the Sun that produced a numbered NOAA active region, and a "control" sample of areas that did not. The seismology is performed on data from the GONG network; accompanying magnetic data from SOHO/MDI are used for co-temporal analysis of the surface magnetic field. Samples are drawn from 2001 -- 2007, and each target is analyzed for 27.7 hr prior to an objectively determined time of emergence. The results of two analysis approaches are published separately: one based on averages of the seismology- and magnetic-derived signals over the samples, another based on Discriminant Analysis of these signals, for a statistical test of detectable differences between the two populations. We include here descriptions of a new potential-field calculation approach and the algorithm for matching sample distributions over multiple variables. We describe known sources of bias and the approaches used to mitigate them. We also describe unexpected bias sources uncovered during the course of the study and include a discussion of refinements that should be included in future work on this topic.

The NOAA active region AR 11029 was a small but highly active sunspot region which produced 73 GOES soft X-ray flares. The flares appear to show a departure from the well known power-law frequency-size distribution. Specifically, too few GOES C-class and no M-class flares were observed by comparison with a power-law distribution (Wheatland in Astrophys. J. 710, 1324, 2010). This was conjectured to be due to the region having insufficient magnetic energy to power large events. We construct nonlinear force-free extrapolations of the coronal magnetic field of active region AR 11029 using data taken on 24 October by the SOLIS Vector-SpectroMagnetograph (SOLIS/VSM), and data taken on 27 October by the Hinode Solar Optical Telescope SpectroPolarimeter (Hinode/SP). Force-free modeling with photospheric magnetogram data encounters problems because the magnetogram data are inconsistent with a force-free model, and we employ a recently developed `self-consistency' procedure which addresses this and accommodates uncertainties in the boundary data (Wheatland and Regnier in Astrophys. J. 700, L88, 2009). We calculate the total energy and free energy of the self-consistent solution and find that the free energy was 4x10^29 erg on 24 October, and 7x10^31 erg on 27 October. An order of magnitude scaling between RHESSI non-thermal energy and GOES peak X-ray flux is established from a sample of flares from the literature and is used to estimate flare energies from observed GOES peak X-ray flux. Based on the scaling, we conclude that the estimated free energy of AR 11029 on 27 October when the flaring rate peaked is sufficient to power M-class or X-class flares, and hence the modeling does not appear to support the hypothesis that the absence of large flares is due to the region having limited energy.

We address points recently discussed in Georgoulis (2011) in reference to Leka et al. (2009b). Most importantly, we find that the results of Georgoulis (2011) support a conclusion of Leka et al. (2009b): that limited spatial resolution and the presence of unresolved magnetic structures can challenge ambiguity- resolution algorithms. Moreover, the findings of both Metcalf et al. (2006) and Leka et al. (2009b) are confirmed in Georgoulis (2011): a method's performance can be diminished when the observed field fails to conform to that method's assumptions. The implication of boundaries in models of solar magnetic structures is discussed; we confirm that the distribution of the field components in the model used in Leka et al. (2009b) is closer to what is observed on the Sun than what is proposed in Georgoulis (2011). It is also shown that method does matter with regards to simulating limited spatial resolution and avoiding an inadvertent introduction of bias. Finally, the assignment of categories to data- analysis algorithms is revisited; we argue that assignments are only useful and elucidating when used appropriately.

Different methods for simulating the effects of spatial resolution on magnetic field maps are compared, including those commonly used for inter-instrument comparisons. The investigation first uses synthetic data, and the results are confirmed with {\it Hinode}/SpectroPolarimeter data. Four methods are examined, one which manipulates the Stokes spectra to simulate spatial-resolution degradation, and three "post-facto" methods where the magnetic field maps are manipulated directly. Throughout, statistical comparisons of the degraded maps with the originals serve to quantify the outcomes. Overall, we find that areas with inferred magnetic fill fractions close to unity may be insensitive to optical spatial resolution; areas of sub-unity fill fractions are very sensitive. Trends with worsening spatial resolution can include increased average field strength, lower total flux, and a field vector oriented closer to the line of sight. Further-derived quantities such as vertical current density show variations even in areas of high average magnetic fill-fraction. In short, unresolved maps fail to represent the distribution of the underlying unresolved fields, and the "post-facto" methods generally do not reproduce the effects of a smaller telescope aperture. It is argued that selecting a method in order to reconcile disparate spatial resolution effects should depend on the goal, as one method may better preserve the field distribution, while another can reproduce spatial resolution degradation. The results presented should help direct future inter-instrument comparisons.

A nonlinear force-free solution is constructed for the coronal magnetic field in NOAA solar active region AR 10953 based on a photospheric vector magnetogram derived from Hinode satellite observations on 30 April 2007, taking into account uncertainties in the boundary data and using improved methods for merging multiple-instrument data. The solution demonstrates the "self-consistency" procedure of Wheatland & Regnier (2009), for the first time including uncertainties. The self-consistency procedure addresses the problem that photospheric vector magnetogram data are inconsistent with the force-free model, and in particular that the boundary conditions on vertical electric current density are over-specified and permit the construction of two different nonlinear force-free solutions. The procedure modifies the boundary conditions on current density during a sequence of cycles until the two nonlinear force-free solutions agree. It hence constructs an accurate single solution to the force-free model, with boundary values close, but not matched exactly, to the vector magnetogram data. The inclusion of uncertainties preserves the boundary conditions more closely at points with smaller uncertainties. The self-consistent solution obtained for active region AR 10953 is significantly non-potential, with magnetic energy E/E_0 = 1.08, where E_0 is the energy of the reference potential (current-free) magnetic field. The self-consistent solution is shown to be robust against changes in the details of the construction of the two force-free models at each cycle. This suggests that reliable nonlinear force-free modeling of active regions is possible if uncertainties in vector magnetogram boundary data are included.

We investigate the evolution of coronal loop emission in the context of the coronal magnetic field topology. New modeling techniques allow us to investigate the magnetic field structure and energy release in active regions. Using these models and high resolution multi-wavelength coronal observations from the Transition Region and Coronal Explorer (TRACE) and the X-ray Telescope (XRT) on Hinode, we are able to establish a relationship between the light curves of coronal loops and their associated magnetic topologies for NOAA Active Region 10963. We examine loops that show both transient and steady emission, and we find that loops that show many transient brightenings are located in domains associated with a high number of separators. This topology provides an environment for continual impulsive heating events through magnetic reconnection at the separators. A loop with relatively constant X-ray and EUV emission, on the other hand, is located in domains that are not associated with separators. This result implies that larger-scale magnetic field reconnections are not involved in heating plasma in these regions, and the heating in these loops must come from another mechanism, such as small-scale reconnections (i.e., nanoflares) or wave heating. Additionally, we find that loops that undergo repeated transient brightenings are associated with separators that have enhanced free energy. In contrast, we find one case of an isolated transient brightening that seems to be associated with separators with a smaller free energy.

We investigate how the divergence-free property of magnetic fields can be exploited to resolve the azimuthal ambiguity present in solar vector magnetogram data, by using line-of-sight and horizontal heliographic derivative information as approximated from discrete measurements. Using synthetic data we test several methods that each make different assumptions about how the divergence-free property can be used to resolve the ambiguity. We find that the most robust algorithm involves the minimisation of the absolute value of the divergence summed over the entire field of view. Away from disk centre this method requires the sign and magnitude of the line-of-sight derivatives of all three components of the magnetic field vector.

Nonlinear force-free field (NLFFF) models are thought to be viable tools for investigating the structure, dynamics and evolution of the coronae of solar active regions. In a series of NLFFF modeling studies, we have found that NLFFF models are successful in application to analytic test cases, and relatively successful when applied to numerically constructed Sun-like test cases, but they are less successful in application to real solar data. Different NLFFF models have been found to have markedly different field line configurations and to provide widely varying estimates of the magnetic free energy in the coronal volume, when applied to solar data. NLFFF models require consistent, force-free vector magnetic boundary data. However, vector magnetogram observations sampling the photosphere, which is dynamic and contains significant Lorentz and buoyancy forces, do not satisfy this requirement, thus creating several major problems for force-free coronal modeling efforts. In this article, we discuss NLFFF modeling of NOAA Active Region 10953 using Hinode/SOT-SP, Hinode/XRT, STEREO/SECCHI-EUVI, and SOHO/MDI observations, and in the process illustrate the three such issues we judge to be critical to the success of NLFFF modeling: (1) vector magnetic field data covering larger areas are needed so that more electric currents associated with the full active regions of interest are measured, (2) the modeling algorithms need a way to accommodate the various uncertainties in the boundary data, and (3) a more realistic physical model is needed to approximate the photosphere-to-corona interface in order to better transform the forced photospheric magnetograms into adequate approximations of nearly force-free fields at the base of the corona. We make recommendations for future modeling efforts to overcome these as yet unsolved problems.