The Stratospheric Observatory for Infrared Astronomy (SOFIA) is an airborne astronomical observatory comprised of a 2.5-meter telescope mounted in the aft section of a Boeing 747SP aircraft. During routine operations, several instruments will be available to the astronomical community including cameras and spectrographs in the near- to far-IR. Raw data obtained in-flight require a significant amount of processing to correct for background emission (from both the telescope and atmosphere), remove instrumental artifacts, correct for atmospheric absorption, and apply both wavelength and flux calibration. In general, this processing is highly specific to the instrument and telescope. In order to maximize the scientific output of the observatory, the SOFIA Science Center must provide these post-processed data sets to Guest Investigators in a timely manner. To meet this requirement, we have designed and built the SOFIA Data Processing System (DPS): an in-house set of tools and services that can be used in both automatic ("pipeline") and manual modes to process data from a variety of instruments. Here we present an overview of the DPS concepts and architecture, as well as operational results from the first two SOFIA observing cycles (2013--2014).

The Stratospheric Observatory for Infrared Astronomy (SOFIA) is an airborne astronomical observatory comprised of a 2.5 meter infrared telescope mounted in the aft section of a Boeing 747SP aircraft that flies at operational altitudes between 37,000 and 45,00 feet, above 99% of atmospheric water vapor. During routine operations, a host of instruments will be available to the astronomical community including cameras and spectrographs in the near- to far-IR; a sub-mm heterodyne receiver; and an high-speed occultation imager. One of the challenges for SOFIA (and all observatories in general) is providing a uniform set of tools that enable the non-expert General Investigator (GI) to propose, plan, and obtain observations using a variety of very different instruments in an easy and seamless manner. The SOFIA Data Cycle System (DCS) is an integrated set of services and user tools for the SOFIA Science and Mission Operations GI Program designed to address this challenge. Program activities supported by the DCS include: proposal preparation and submission by the GI; proposal evaluation by the telescope allocation committee and observatory staff; Astronomical Observation Request (AOR) preparation and submission by the GI; observation and mission planning by observatory staff; data processing and archiving; data product distribution. In this poster paper we present an overview of the DCS concepts, architecture, and user tools that are (or soon will be) available in routine SOFIA operations. In addition, we present experience from the SOFIA Basic Science program, and planned upgrades.

SOFIA presents a number of interesting challenges for the development of a data reduction environment which, at its initial phase, will have to incorporate pipelines from seven different instruments. Therefore, the SOFIA data reduction software must run code which has been developed in a variety of dissimilar environments which will only increase in future generations of instrumentation. We investigated three distinctly different situations for performing pipelined data reduction in SOFIA: automated data reduction after data archival at the end of a mission, re-pipelining of science data with updated calibrations or optimum parameters, and the interactive user-driven local execution and analysis of data reduction by an investigator. These different modes would traditionally result in very different software implementations of algorithms used by each instrument team, in effect tripling the amount of data reduction software that would need to be maintained by SOFIA. We present here a unique approach for enfolding all the instrument-specific data reduction software in the observatory framework and verifies the needs for all three reduction scenarios as well as the standard visualization tools. The SOFIA data reduction structure would host the different algorithms and techniques that the instrument teams develop in their own environment. Ideally, duplication of software is minimized across the system because instrument teams can draw on software solutions and techniques previously delivered to SOFIA by other instruments. With this approach, we minimize the effort for analyzing and developing new software reduction pipelines for future generation instruments. We also explore the potential benefits of this approach in the portability of the software to an ever-broadening science audience, as well as its ability to ease the use of distributed processing for data reduction pipelines.