Normalized to: Shamir, L.
[1]
oai:arXiv.org:2004.02963 [pdf] - 2102934
Multipole alignment in the large-scale distribution of spin direction of
spiral galaxies
Submitted: 2020-04-06, last modified: 2020-05-27
Previous observations have suggested non-random distribution of spin
directions of galaxies at scales far larger than the size of a supercluster.
Here I use $\sim1.7\cdot10^5$ spiral galaxies from SDSS and $3.3\cdot10^4$
spiral galaxies from Pan-STARRS to analyze the distribution of galaxy spin
patterns of spiral galaxies as observed from Earth. The analysis shows in both
SDSS and Pan-STARRS that the distribution of galaxy spin directions forms a
non-random pattern, and can be fitted to a dipole axis in probability much
higher than mere chance. These observations agree with previous findings, but
are based on more data and two different telescopes. The analysis also shows
that the distribution of galaxy spin directions fits a large-scale multipole
alignment, with best fit to quadrupole alignment with probability of
$\sim6.9\sigma$ to have such distribution by chance. Comparison of two separate
datasets from SDSS and Pan-STARRS such that the galaxies in both datasets have
similar redshift distribution provides nearly identical quadrupole patterns.
[2]
oai:arXiv.org:2004.02960 [pdf] - 2105671
Large-scale asymmetry between clockwise and counterclockwise galaxies
revisited
Submitted: 2020-04-06
The ability of digital sky surveys to collect and store very large amounts of
data provides completely new ways to study the local universe. Perhaps one of
the most provocative observations reported with such tools is the asymmetry
between galaxies with clockwise and counterclockwise spin patterns. Here I use
$\sim1.7\cdot10^5$ spiral galaxies from SDSS and sort them by their spin
patterns (clockwise or counterclockwise) to identify and profile a possible
large-scale pattern of the distribution of galaxy spin patterns as observed
from Earth. The analysis shows asymmetry between the number of clockwise and
counterclockwise spiral galaxies imaged by SDSS, and a dipole axis. These
findings largely agree with previous reports using smaller datasets. The
probability of the differences between the number of galaxies to occur by
chance is (P<4*10^-9), and the probability of an asymmetry axis to occur by
mere chance is (P<1.4*10^-5).
[3]
oai:arXiv.org:1911.11735 [pdf] - 2063772
Asymmetry between galaxies with different spin patterns: A comparison
between COSMOS, SDSS, and Pan-STARRS
Submitted: 2019-11-26, last modified: 2020-03-13
Previous observations of a large number of galaxies show differences between
the photometry of spiral galaxies with clockwise spin patterns and spiral
galaxies with counterclockwise spin patterns. In this study the mean magnitude
of a large number of clockwise galaxies is compared to the mean magnitude of a
large number of counterclockwise galaxies. The observed difference between
clockwise and counterclockwise spiral galaxies imaged by the space-based COSMOS
survey is compared to the differences between clockwise and counterclockwise
galaxies imaged by the Earth-based SDSS and Pan-STARRS around the same field.
The annotation of clockwise and counterclockwise galaxies is a fully automatic
process that does not involve human intervention, and in all experiments both
clockwise and counterclockwise galaxies are separated from the same fields. The
comparison shows that the same asymmetry was identified by all three
telescopes, providing strong evidence that the rotation direction of a spiral
galaxy is linked to its luminosity as measured from Earth. Analysis of the
luminosity difference using a large number of galaxies from different parts of
the sky shows that the difference between clockwise and counterclockwise
galaxies changes with the direction of observation, and oriented around an
axis.
[4]
oai:arXiv.org:1912.05429 [pdf] - 2015845
Large-scale patterns of galaxy spin rotation show cosmological-scale
parity violation and multipoles
Submitted: 2019-12-09, last modified: 2019-12-16
The distribution of spin direction of ~6.4*10^4 spiral galaxies with spectra
was examined. The analysis shows a statistically significant cosmological-scale
asymmetry between galaxies with opposite spin direction. The data also reveals
that the asymmetry changes with the direction of observation, and with the
redshift. The redshift dependence shows that the distribution of the spin
direction of galaxies becomes more homogeneous as the redshift gets higher. The
data also show photometric differences between galaxies with opposite spin
patterns. When normalizing the data by the redshift, the photometric asymmetry
is eliminated. However, when normalizing the data by the magnitude,
statistically significant differences in the redshift remain. These evidence
suggest a violation of the cosmological isotropy and homogeneity assumptions.
Fitting the distribution of the galaxy spin directions to a quadrupole
alignment provides fitness with statistical significance >5 sigma, which grows
to >8 sigma when just galaxies with $z>0.15$ are used. The data analysis
process is fully automatic, and it is based on deterministic and symmetric
algorithms with defined rules. It does not involve neither manual analysis of
the data that can lead to human perceptual bias, nor machine learning that can
capture human biases or other subtle differences that are difficult to identify
due to the complex and non-intuitive nature of machine learning processes.
[5]
oai:arXiv.org:1911.11730 [pdf] - 2005632
Automatic detection of full ring galaxy candidates in SDSS
Submitted: 2019-11-26
A full ring is a form of galaxy morphology that is not associated with a
specific stage on the Hubble sequence. Digital sky surveys can collect many
millions of galaxy images, and therefore even rare forms of galaxies are
expected to be present in relatively large numbers in image databases created
by digital sky surveys. Sloan Digital Sky Survey (SDSS) data release (DR) 14
contains ~2.6*10^6 objects with spectra identified as galaxies. The method
described in this paper applied automatic detection to identify a set of 443
ring galaxy candidates, 104 of them were already included in the Buta + 17
catalogue of ring galaxies in SDSS, but the majority of the galaxies are not
included in previous catalogues. Machine analysis cannot yet match the superior
pattern recognition abilities of the human brain, and even a small false
positive rate makes automatic analysis impractical when scanning through
millions of galaxies. Reducing the false positive rate also increases the true
negative rate, and therefore the catalogue of ring galaxy candidates is not
exhaustive. However, due to its clear advantage in speed, it can provide a
large collection of galaxies that can be used for follow-up observations of
objects with ring morphology.
[6]
oai:arXiv.org:1911.02479 [pdf] - 1994455
Algorithms and Statistical Models for Scientific Discovery in the
Petabyte Era
Nord, Brian;
Connolly, Andrew J.;
Kinney, Jamie;
Kubica, Jeremy;
Narayan, Gautaum;
Peek, Joshua E. G.;
Schafer, Chad;
Tollerud, Erik J.;
Avestruz, Camille;
Babu, G. Jogesh;
Birrer, Simon;
Burke, Douglas;
Caldeira, João;
Caldwell, Douglas A.;
Carlberg, Joleen K.;
Chen, Yen-Chi;
Dong, Chuanfei;
Feigelson, Eric D.;
Golkhou, V. Zach;
Kashyap, Vinay;
Li, T. S.;
Loredo, Thomas;
Lucie-Smith, Luisa;
Mandel, Kaisey S.;
Martínez-Galarza, J. R.;
Miller, Adam A.;
Natarajan, Priyamvada;
Ntampaka, Michelle;
Ptak, Andy;
Rapetti, David;
Shamir, Lior;
Siemiginowska, Aneta;
Sipőcz, Brigitta M.;
Smith, Arfon M.;
Tran, Nhan;
Vilalta, Ricardo;
Walkowicz, Lucianne M.;
ZuHone, John
Submitted: 2019-11-04
The field of astronomy has arrived at a turning point in terms of size and
complexity of both datasets and scientific collaboration. Commensurately,
algorithms and statistical models have begun to adapt --- e.g., via the onset
of artificial intelligence --- which itself presents new challenges and
opportunities for growth. This white paper aims to offer guidance and ideas for
how we can evolve our technical and collaborative frameworks to promote
efficient algorithmic development and take advantage of opportunities for
scientific discovery in the petabyte era. We discuss challenges for discovery
in large and complex data sets; challenges and requirements for the next stage
of development of statistical methodologies and algorithmic tool sets; how we
might change our paradigms of collaboration and education; and the ethical
implications of scientists' contributions to widely applicable algorithms and
computational modeling. We start with six distinct recommendations that are
supported by the commentary following them. This white paper is related to a
larger corpus of effort that has taken place within and around the Petabytes to
Science Workshops (https://petabytestoscience.github.io/).
[7]
oai:arXiv.org:1907.06981 [pdf] - 1917113
Astro2020 APC White Paper: Elevating the Role of Software as a Product
of the Research Enterprise
Smith, Arfon M.;
Norman, Dara;
Cruz, Kelle;
Desai, Vandana;
Bellm, Eric;
Lundgren, Britt;
Economou, Frossie;
Nord, Brian D.;
Schafer, Chad;
Narayan, Gautham;
Harrington, Joseph;
Tollerud, Erik;
Sipőcz, Brigitta;
Pickering, Timothy;
Peeples, Molly S.;
Berriman, Bruce;
Teuben, Peter;
Rodriguez, David;
Gradvohl, Andre;
Shamir, Lior;
Allen, Alice;
Brownstein, Joel R.;
Ginsburg, Adam;
Sinha, Manodeep;
Hummels, Cameron;
Smith, Britton;
Stevance, Heloise;
Price-Whelan, Adrian;
Cherinka, Brian;
Chan, Chi-kwan;
Kartaltepe, Jeyhan;
Turk, Matthew;
Weiner, Benjamin;
Modjaz, Maryam;
Nemiroff, Robert J.;
Kerzendorf, Wolfgang;
Laginja, Iva;
Dong, Chuanfei;
Merín, Bruno;
Sobeck, Jennifer;
Buzasi, Derek;
Faherty, Jacqueline K;
Momcheva, Ivelina;
Connolly, Andrew;
Golkhou, V. Zach
Submitted: 2019-07-14
Software is a critical part of modern research, and yet there are
insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and
measure the impact of research software. The majority of academic fields rely
on a one-dimensional credit model whereby academic articles (and their
associated citations) are the dominant factor in the success of a researcher's
career. In the petabyte era of astronomical science, citing software and
measuring its impact enables academia to retain and reward researchers that
make significant software contributions. These highly skilled researchers must
be retained to maximize the scientific return from petabyte-scale datasets.
Evolving beyond the one-dimensional credit model requires overcoming several
key challenges, including the current scholarly ecosystem and scientific
culture issues. This white paper will present these challenges and suggest
practical solutions for elevating the role of software as a product of the
research enterprise.
[8]
oai:arXiv.org:1810.11283 [pdf] - 1774150
A hybrid approach to machine learning annotation of large galaxy image
databases
Submitted: 2018-10-26
Modern astronomy relies on massive databases collected by robotic telescopes
and digital sky surveys, acquiring data in a much faster pace than what manual
analysis can support. Among other data, these sky surveys collect information
about millions and sometimes billions of extra-galactic objects. Since the very
large number of objects makes manual observation impractical, automatic methods
that can analyze and annotate extra-galactic objects are required to fully
utilize the discovery power of these databases. Machine learning methods for
annotation of celestial objects can be separated broadly into methods that use
the photometric information collected by digital sky surveys, and methods that
analyze the image of the object. Here we describe a hybrid method that combines
photometry and image data to annotate galaxies by their morphology, and a
method that uses that information to identify objects that are visually similar
to a query object (query-by-example). The results are compared to using just
photometric information from SDSS, and to using just the morphological
descriptors extracted directly from the images. The comparison shows that for
automatic classification the image data provide marginal addition to the
information provided by the photometry data. For query-by-example, however, the
analysis of the image data provides more information that improves the
automatic detection substantially. The source code and binaries of the method
can be downloaded through the Astrophysics Source Code Library.
[9]
oai:arXiv.org:1806.03395 [pdf] - 1697184
A catalog of photometric redshift and the distribution of broad galaxy
morphologies
Submitted: 2018-06-08
We created a catalog of photometric redshift of ~3,000,000 SDSS galaxies
annotated by their broad morphology. The photometric redshift was optimized by
testing and comparing several pattern recognition algorithms and variable
selection strategies, trained and tested on a subset of the galaxies in the
catalog that had spectra. The galaxies in the catalog have i magnitude brighter
than 18 and Petrosian radius greater than 5.5''. The majority of these objects
are not included in previous SDSS photometric redshift catalogs such as the
photoz table of SDSS DR12. Analysis of the catalog shows that the number of
galaxies in the catalog that are visually spiral increases until redshift of
~0.085, where it peaks and starts to decrease. It also shows that the number of
spiral galaxies compared to elliptical galaxies drops as the redshift
increases. The catalog is publicly available at
https://figshare.com/articles/Morphology_and_photometric_redshift_catalog/4833593
[10]
oai:arXiv.org:1802.00552 [pdf] - 1628793
Best Practices for a Future Open Code Policy: Experiences and Vision of
the Astrophysics Source Code Library
Submitted: 2018-02-01
We are members of the Astrophysics Source Code Library's Advisory Committee
and its editor-in-chief. The Astrophysics Source Code Library (ASCL, ascl.net)
is a successful initiative that advocates for open research software and
provides an infrastructure for registering, discovering, sharing, and citing
this software. Started in 1999, the ASCL has been expanding in recent years,
with an average of over 200 codes added each year, and now houses over 1,600
code entries.
[11]
oai:arXiv.org:1712.02973 [pdf] - 1600971
The Astrophysics Source Code Library: What's new, what's coming
Allen, Alice;
Berriman, G. Bruce;
DuPrie, Kimberly;
Mink, Jessica;
Nemiroff, Robert;
Ryan, P. Wesley;
Schmidt, Judy;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter;
Wallin, John;
Warmels, Rein H.
Submitted: 2017-12-08
The Astrophysics Source Code Library (ASCL, ascl.net), established in 1999,
is a citable online registry of source codes used in research that are
available for download; the ASCL's main purpose is to improve the transparency,
reproducibility, and falsifiability of research. In 2017, improvements to the
resource included real-time data backup for submissions and newly-published
entries, improved cross-matching of research papers with software entries in
ADS, and expansion of preferred citation information for the software in the
ASCL.
[12]
oai:arXiv.org:1703.07889 [pdf] - 1582086
Large-scale asymmetry between spin patterns of spiral galaxies
Submitted: 2017-03-22, last modified: 2017-08-31
Spin patterns of spiral galaxies can be broadly separated into galaxies with
clockwise (Z-wise) patterns and galaxies with counterclockwise (S-wise) spin
patterns. While the differences between these patterns are visually noticeable,
they are a matter of the perspective of the observer, and therefore in a
sufficiently large universe no other differences are expected between galaxies
with Z-wise and S-wise patterns. Here large datasets of spiral galaxies
separated by their spin patterns are used to show that spiral galaxies with
Z-wise spin patterns are photometrically different from spiral galaxies with
S-wise patterns. That asymmetry changes based on the direction of observation,
such that the observed asymmetry in one hemisphere is aligned with the inverse
observed asymmetry in the opposite hemisphere. The results are consistent
across different sky surveys (SDSS and PanSTARRS) and analysis methods. The
proximity of the most probable asymmetry axis to the galactic pole suggests
that the asymmetry might be driven by relativistic beaming. Annotated data from
SDSS and PanSTARRS are publicly available.
[13]
oai:arXiv.org:1706.03873 [pdf] - 1584592
A catalog of automatically detected ring galaxy candidates in PanSTARRS
Submitted: 2017-06-12
We developed and applied a computer analysis method to detect ring galaxy
candidates in the first data release of PanSTARRS. The method works by applying
a low-pass filter, followed by dynamic global thresholding to search for closed
regions in the binary mask of each galaxy image. Applying the method to ~3*10^6
PanSTARRS galaxy images produced a catalog of 185 ring galaxy candidates based
on their visual appearance.
[14]
oai:arXiv.org:1701.06255 [pdf] - 1534861
Colour asymmetry between galaxies with clockwise and counterclockwise
handedness
Submitted: 2017-01-22
Recent studies have shown that SDSS galaxies with clockwise patterns are
photometrically different from galaxies with anti-clockwise patterns. The
purpose of this study is to identify possible differences between the colour of
galaxies with clockwise handedness and the colour of galaxies with
anti-clockwise handedness. A dataset of 162,514 SDSS galaxies was separated
into clockwise and counterclockwise galaxies, and the colours of spiral
galaxies with clockwise handedness were compared to the colour of spiral
galaxies with anti-clockwise handedness. The results show that the i-r colour
in clockwise galaxies in SDSS is significantly higher compared to
anti-clockwise SDSS galaxies. The colour difference is strongest between the
right ascension of 30$^o$ and 60$^o$, while the RA range of 180$^o$ to 210$^o$
shows a much smaller difference.
[15]
oai:arXiv.org:1611.06465 [pdf] - 1542808
Photometric asymmetry between clockwise and counterclockwise spiral
galaxies in SDSS
Submitted: 2016-11-19, last modified: 2017-01-17
While galaxies with clockwise and counterclockwise handedness are visually
different, they are expected to be symmetric in all of their other
characteristics. Previous experiments using both manual analysis and machine
vision have shown that the handedness of Sloan Digital Sky Survey (SDSS)
galaxies can be predicted with accuracy significantly higher than mere chance
using its photometric data alone, showing that SDSS photometry pipeline is
sensitive to the handedness of the galaxy. However, some of these previous
experiments were based on manually classified galaxies, and the results may
therefore be subjected to bias originated from the human perception. This paper
describes an experiment based on a set of 162,514 celestial objects classified
as clockwise and counterclockwise spiral galaxies in a fully automatic process,
showing that the source of the asymmetry is more than the human perception
bias. The results are compared to two smaller datasets, and confirm the
observation that the handedness of SDSS galaxies can be predicted by their
photometric information, and show that the position angle of counterclockwise
galaxies computed by SDSS photometry pipeline is consistently higher than the
position angle computed for galaxies with clockwise patterns. The experiment
also shows statistically significant differences in the measured magnitude,
according which galaxies with clockwise patterns are brighter than galaxies
with counterclockwise patterns. The magnitude of that difference changes across
RA ranges, and exhibits a strong correlation with the cosine of the right
ascension.
[16]
oai:arXiv.org:1611.06464 [pdf] - 1532723
Morphology-based query for galaxy image databases
Submitted: 2016-11-19
Galaxies of rare morphology are of paramount scientific interest, as they
carry important information about the past, present, and future universe. Once
a rare galaxy is identified, studying it more effectively requires a set of
galaxies of similar morphology, allowing generalization and statistical
analysis that cannot be done when $N=1$. Databases generated by digital sky
surveys can contain a very large number of galaxy images, and therefore once a
rare galaxy of interest is identified it is possible that more instances of the
same morphology are also present in the database. However, when a researcher
identifies a certain galaxy of rare morphology in the database, it is virtually
impossible to mine the database manually in the search for galaxies of similar
morphology. Here we propose a computer method that can automatically search
databases of galaxy images and identify galaxies that are morphologically
similar to a certain user-defined query galaxy. That is, the researcher
provides an image of a galaxy of interest, and the pattern recognition system
automatically returns a list of galaxies that are visually similar to the
target galaxy. The algorithm uses a comprehensive set of descriptors, allowing
it to support different types of galaxies, and it is not limited to a finite
set of known morphology. While the list of returned galaxies is neither clean
nor complete, it contains a far higher frequency of galaxies of the morphology
of interest, providing a substantial reduction of the data. Such algorithms can
be integrated into data management systems of autonomous digital sky surveys
such as the Large Synoptic Survey Telescope (LSST), where the number of
galaxies in the database is extremely large. The source code of the method is
available at http://vfacstaff.ltu.edu/lshamir/downloads/udat.
[17]
oai:arXiv.org:1611.06219 [pdf] - 1516967
Astrophysics Source Code Library: Here we grow again!
Allen, Alice;
Berriman, G. Bruce;
DuPrie, Kimberly;
Mink, Jessica;
Nemiroff, Robert;
Robitaille, Thomas;
Schmidt, Judy;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter;
Wallin, John
Submitted: 2016-11-18
The Astrophysics Source Code Library (ASCL) is a free online registry of
research codes; it is indexed by ADS and Web of Science and has over 1300 code
entries. Its entries are increasingly used to cite software; citations have
been doubling each year since 2012 and every major astronomy journal accepts
citations to the ASCL. Codes in the resource cover all aspects of astrophysics
research and many programming languages are represented. In the past year, the
ASCL added dashboards for users and administrators, started minting Digital
Objective Identifiers (DOIs) for software it houses, and added metadata fields
requested by users. This presentation covers the ASCL's growth in the past year
and the opportunities afforded it as one of the few domain libraries for
science research codes.
[18]
oai:arXiv.org:1601.04424 [pdf] - 1411284
Asymmetry between galaxies with clockwise handedness and
counterclockwise handedness
Submitted: 2016-01-18, last modified: 2016-03-28
While it is clear that spiral galaxies can have different handedness,
galaxies with clockwise patterns are assumed to be symmetric in all of their
other characteristics to galaxies with counterclockwise patterns. Here we use
data from SDSS DR7 to show that photometric data can distinguish between
clockwise and counterclockwise galaxies. Pattern recognition algorithms trained
and tested using the photometric data of a clean manually crafted dataset of
13,440 spiral galaxies with z<0.25 can predict the handedness of a spiral
galaxy in ~64% of the cases, significantly higher than mere chance accuracy of
50% (P<10^{-5}). Experiments with a different dataset of 10,281 automatically
classified galaxies showed similar results of $~65% classification accuracy,
suggesting that the observed asymmetry is consistent also in datasets annotated
in a fully automatic process, and without human intervention. That shows that
the photometric data collected by SDSS is sensitive to the handedness of the
galaxy. Also, analysis of the number of galaxies classified as clockwise and
counterclockwise by crowdsourcing shows that manual classification between
spiral and elliptical galaxies can be affected by the handedness of the galaxy,
and therefore galaxy morphology analyzed by citizen science campaigns might be
biased by the galaxy handedness. Code and data used in the experiment are
publicly available, and the experiment can be easily replicated.
[19]
oai:arXiv.org:1602.06854 [pdf] - 1392864
Computer-generated visual morphology catalog of ~3,000,000 SDSS galaxies
Submitted: 2016-02-22, last modified: 2016-03-27
We applied computer analysis to classify the broad morphological type of
~3,000,000 SDSS galaxies. The catalog provides for each galaxy the DR8 object
ID, right ascension, declination, and the certainty of the automatic
classification to spiral or elliptical. The certainty of the classification
allows controlling the accuracy of a subset of galaxies by sacrificing some of
the least certain classifications. The accuracy of the catalog was tested using
galaxies that were classified by the manually annotated Galaxy Zoo catalog. The
results show that the catalog contains ~900,000 spiral galaxies and ~600,000
elliptical galaxies with classification certainty that has a statistical
agreement rate of ~98% with Galaxy Zoo debiased 'superclean' dataset. That also
demonstrates the ability of computers to turn large datasets of galaxy images
into structured catalogs of galaxy morphology. The catalog can be downloaded at
http://vfacstaff.ltu.edu/lshamir/data/morph_catalog , and can be accessed
through public tables on CAS: public.broadMorph.LargeGM,
public.broadMorph.LargeWnnGM, and public.broadMorph.SpectraGM. The image
analysis software that was used to create the catalog is also publicly
available.
[20]
oai:arXiv.org:1512.07919 [pdf] - 1332632
Improving Software Citation and Credit
Allen, Alice;
Berriman, G. Bruce;
DuPrie, Kimberly;
Mink, Jessica;
Nemiroff, Robert;
Robitaille, Thomas;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter;
Wallin, John
Submitted: 2015-12-24
The past year has seen movement on several fronts for improving software
citation, including the Center for Open Science's Transparency and Openness
Promotion (TOP) Guidelines, the Software Publishing Special Interest Group that
was started at January's AAS meeting in Seattle at the request of that
organization's Working Group on Astronomical Software, a Sloan-sponsored
meeting at GitHub in San Francisco to begin work on a cohesive research
software citation-enabling platform, the work of Force11 to "transform and
improve" research communication, and WSSSPE's ongoing efforts that include
software publication, citation, credit, and sustainability.
Brief reports on these efforts were shared at the BoF, after which
participants discussed ideas for improving software citation, generating a list
of recommendations to the community of software authors, journal publishers,
ADS, and research authors. The discussion, recommendations, and feedback will
help form recommendations for software citation to those publishers represented
in the Software Publishing Special Interest Group and the broader community.
[21]
oai:arXiv.org:1505.04876 [pdf] - 1048286
Galaxy morphology - an unsupervised machine learning approach
Submitted: 2015-05-19, last modified: 2015-05-23
Structural properties posses valuable information about the formation and
evolution of galaxies, and are important for understanding the past, present,
and future universe. Here we use unsupervised machine learning methodology to
analyze a network of similarities between galaxy morphological types, and
automatically deduce a morphological sequence of galaxies. Application of the
method to the EFIGI catalog show that the morphological scheme produced by the
algorithm is largely in agreement with the De Vaucouleurs system, demonstrating
the ability of computer vision and machine learning methods to automatically
profile galaxy morphological sequences. The unsupervised analysis method is
based on comprehensive computer vision techniques that compute the visual
similarities between the different morphological types. Rather than relying on
human cognition, the proposed system deduces the similarities between sets of
galaxy images in an automatic manner, and is therefore not limited by the
number of galaxies being analyzed. The source code of the method is publicly
available, and the protocol of the experiment is included in the paper so that
the experiment can be replicated, and the method can be used to analyze
user-defined datasets of galaxy images.
[22]
oai:arXiv.org:1411.2031 [pdf] - 894814
Astrophysics Source Code Library Enhancements
Hanisch, Robert J.;
Allen, Alice;
Berriman, G. Bruce;
DuPrie, Kimberly;
Mink, Jessica;
Nemiroff, Robert J.;
Schmidt, Judy;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter J.;
Wallin, John
Submitted: 2014-11-07
The Astrophysics Source Code Library (ASCL; ascl.net) is a free online
registry of codes used in astronomy research; it currently contains over 900
codes and is indexed by ADS. The ASCL has recently moved a new infrastructure
into production. The new site provides a true database for the code entries and
integrates the WordPress news and information pages and the discussion forum
into one site. Previous capabilities are retained and permalinks to ascl.net
continue to work. This improvement offers more functionality and flexibility
than the previous site, is easier to maintain, and offers new possibilities for
collaboration. This presentation covers these recent changes to the ASCL.
[23]
oai:arXiv.org:1409.7935 [pdf] - 1222285
Combining human and machine learning for morphological analysis of
galaxy images
Submitted: 2014-09-28
The increasing importance of digital sky surveys collecting many millions of
galaxy images has reinforced the need for robust methods that can perform
morphological analysis of large galaxy image databases. Citizen science
initiatives such as Galaxy Zoo showed that large datasets of galaxy images can
be analyzed effectively by non-scientist volunteers, but since databases
generated by robotic telescopes grow much faster than the processing power of
any group of citizen scientists, it is clear that computer analysis is
required. Here we propose to use citizen science data for training machine
learning systems, and show experimental results demonstrating that machine
learning systems can be trained with citizen science data. Our findings show
that the performance of machine learning depends on the quality of the data,
which can be improved by using samples that have a high degree of agreement
between the citizen scientists. The source code of the method is publicly
available.
[24]
oai:arXiv.org:1407.5000 [pdf] - 1215783
Automatic detection of peculiar galaxy pairs in Sloan Digital Sky Survey
Submitted: 2014-07-18
We applied computational tools for automatic detection of peculiar galaxy
pairs. We first detected in SDSS DR7 ~400,000 galaxy images with i magnitude
<18 that had more than one point spread function, and then applied a machine
learning algorithm that detected ~26,000 galaxy images that had morphology
similar to the morphology of galaxy mergers. That dataset was mined using a
novelty detection algorithm, producing a short list of 500 most peculiar
galaxies as quantitatively determined by the algorithm. Manual examination of
these galaxies showed that while most of the galaxy pairs in the list were not
necessarily peculiar, numerous unusual galaxy pairs were detected. In this
paper we describe the protocol and computational tools used for the detection
of peculiar mergers, and provide examples of peculiar galaxy pairs that were
detected.
[25]
oai:arXiv.org:1312.7352 [pdf] - 764839
Ideas for Advancing Code Sharing (A Different Kind of Hack Day)
Teuben, Peter;
Allen, Alice;
Berriman, Bruce;
DuPrie, Kimberly;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Wallin, John
Submitted: 2013-12-27
How do we as a community encourage the reuse of software for telescope
operations, data processing, and calibration? How can we support making codes
used in research available for others to examine? Continuing the discussion
from last year Bring out your codes! BoF session, participants separated into
groups to brainstorm ideas to mitigate factors which inhibit code sharing and
nurture those which encourage code sharing. The BoF concluded with the sharing
of ideas that arose from the brainstorming sessions and a brief summary by the
moderator.
[26]
oai:arXiv.org:1312.6693 [pdf] - 763719
Astrophysics Source Code Library: Incite to Cite!
DuPrie, Kimberly;
Allen, Alice;
Berriman, Bruce;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert J.;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark B.;
Teuben, Peter;
Wallin, John F.
Submitted: 2013-12-23
The Astrophysics Source Code Library (ASCL, http://ascl.net/) is an online
registry of over 700 source codes that are of interest to astrophysicists, with
more being added regularly. The ASCL actively seeks out codes as well as
accepting submissions from the code authors, and all entries are citable and
indexed by ADS. All codes have been used to generate results published in or
submitted to a refereed journal and are available either via a download site or
froman identified source. In addition to being the largest directory of
scientist-written astrophysics programs available, the ASCL is also an active
participant in the reproducible research movement with presentations at various
conferences, numerous blog posts and a journal article. This poster provides a
description of the ASCL and the changes that we are starting to see in the
astrophysics community as a result of the work we are doing.
[27]
oai:arXiv.org:1312.5334 [pdf] - 761885
The Astrophysics Source Code Library: Where do we go from here?
Allen, Alice;
Berriman, Bruce;
DuPrie, Kimberly;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter;
Wallin, John
Submitted: 2013-12-18
The Astrophysics Source Code Library, started in 1999, has in the past three
years grown from a repository for 40 codes to a registry of over 700 codes that
are now indexed by ADS. What comes next? We examine the future of the ASCL, the
challenges facing it, the rationale behind its practices, and the need to
balance what we might do with what we have the resources to accomplish.
[28]
oai:arXiv.org:1310.7485 [pdf] - 738605
Color Differences between Clockwise and Counterclockwise Spiral Galaxies
Submitted: 2013-10-28
While spiral galaxies observed from Earth clearly seem to spin in different
directions, little is yet known about other differences between galaxies that
spin clockwise and galaxies that spin counterclockwise. Here we compared the
color of 64,399 spiral galaxies that spin clockwise to 63,215 spiral galaxies
that spin counterclockwise. The results show that clockwise galaxies tend to be
bluer than galaxies that spin counterclockwise. The probability that the color
differences can be attributed to chance is ~0.019.
[29]
oai:arXiv.org:1310.0387 [pdf] - 1179629
Quantitative analysis of spirality in elliptical galaxies
Submitted: 2013-10-01
We use an automated galaxy morphology analysis method to quantitatively
measure the spirality of galaxies classified manually as elliptical. The data
set used for the analysis consists of 60,518 galaxy images with redshift
obtained by the Sloan Digital Sky Survey (SDSS) and classified manually by
Galaxy Zoo, as well as the RC3 and NA10 catalogues. We measure the spirality of
the galaxies by using the Ganalyzer method, which transforms the galaxy image
to its radial intensity plot to detect galaxy spirality that is in many cases
difficult to notice by manual observation of the raw galaxy image. Experimental
results using manually classified elliptical and S0 galaxies with redshift <0.3
suggest that galaxies classified manually as elliptical and S0 exhibit a
nonzero signal for the spirality. These results suggest that the human eye
observing the raw galaxy image might not always be the most effective way of
detecting spirality and curves in the arms of galaxies.
[30]
oai:arXiv.org:1309.4014 [pdf] - 719543
Automatic quantitative morphological analysis of interacting galaxies
Submitted: 2013-09-16
The large number of galaxies imaged by digital sky surveys reinforces the
need for computational methods for analyzing galaxy morphology. While the
morphology of most galaxies can be associated with a stage on the Hubble
sequence, morphology of galaxy mergers is far more complex due to the
combination of two or more galaxies with different morphologies and the
interaction between them. Here we propose a computational method based on
unsupervised machine learning that can quantitatively analyze morphologies of
galaxy mergers and associate galaxies by their morphology. The method works by
first generating multiple synthetic galaxy models for each galaxy merger, and
then extracting a large set of numerical image content descriptors for each
galaxy model. These numbers are weighted using Fisher discriminant scores, and
then the similarities between the galaxy mergers are deduced using a variation
of Weighted Nearest Neighbor analysis such that the Fisher scores are used as
weights. The similarities between the galaxy mergers are visualized using
phylogenies to provide a graph that reflects the morphological similarities
between the different galaxy mergers, and thus quantitatively profile the
morphology of galaxy mergers.
[31]
oai:arXiv.org:1304.6780 [pdf] - 656546
Practices in source code sharing in astrophysics
Submitted: 2013-04-24
While software and algorithms have become increasingly important in
astronomy, the majority of authors who publish computational astronomy research
do not share the source code they develop, making it difficult to replicate and
reuse the work. In this paper we discuss the importance of sharing scientific
source code with the entire astrophysics community, and propose that journals
require authors to make their code publicly available when a paper is
published. That is, we suggest that a paper that involves a computer program
not be accepted for publication unless the source code becomes publicly
available. The adoption of such a policy by editors, editorial boards, and
reviewers will improve the ability to replicate scientific results, and will
also make the computational astronomy methods more available to other
researchers who wish to apply them to their data.
[32]
oai:arXiv.org:1207.5464 [pdf] - 1125034
Handedness asymmetry of spiral galaxies with z<0.3 shows cosmic parity
violation and a dipole axis
Submitted: 2012-07-23
A dataset of 126,501 spiral galaxies taken from Sloan Digital Sky Survey was
used to analyze the large-scale galaxy handedness in different regions of the
local universe. The analysis was automated by using a transformation of the
galaxy images to their radial intensity plots, which allows automatic analysis
of the galaxy spin and can therefore be used to analyze a large galaxy dataset.
The results show that the local universe (z<0.3) is not isotropic in terms of
galaxy spin, with probability P<5.8*10^-6 of such asymmetry to occur by chance.
The handedness asymmetries exhibit an approximate cosine dependence, and the
most likely dipole axis was found at RA=132, DEC=32 with 1 sigma error range of
107 to 179 degrees for the RA. The probability of such axis to occur by chance
is P<1.95*10^-5 . The amplitude of the handedness asymmetry reported in this
paper is generally in agreement with Longo, but the statistical significance is
improved by a factor of 40, and the direction of the axis disagrees somewhat.
[33]
oai:arXiv.org:1202.1028 [pdf] - 472637
Practices in Code Discoverability: Astrophysics Source Code Library
Submitted: 2012-02-05
Here we describe the Astrophysics Source Code Library (ASCL), which takes an
active approach to sharing astrophysical source code. ASCL's editor seeks out
both new and old peer-reviewed papers that describe methods or experiments that
involve the development or use of source code, and adds entries for the found
codes to the library. This approach ensures that source codes are added without
requiring authors to actively submit them, resulting in a comprehensive listing
that covers a significant number of the astrophysics source codes used in
peer-reviewed studies. The ASCL now has over 340 codes in it and continues to
grow. In 2011, the ASCL (http://ascl.net) has on average added 19 new codes per
month. An advisory committee has been established to provide input and guide
the development and expansion of the new site, and a marketing plan has been
developed and is being executed. All ASCL source codes have been used to
generate results published in or submitted to a refereed journal and are freely
available either via a download site or from an identified source.
This paper provides the history and description of the ASCL. It lists the
requirements for including codes, examines the benefits of the ASCL, and
outlines some of its future plans.
[34]
oai:arXiv.org:1202.1026 [pdf] - 472636
Practices in Code Discoverability
Submitted: 2012-02-05
Much of scientific progress now hinges on the reliability, falsifiability and
reproducibility of computer source codes. Astrophysics in particular is a
discipline that today leads other sciences in making useful scientific
components freely available online, including data, abstracts, preprints, and
fully published papers, yet even today many astrophysics source codes remain
hidden from public view. We review the importance and history of source codes
in astrophysics and previous efforts to develop ways in which information about
astrophysics codes can be shared. We also discuss why some scientist coders
resist sharing or publishing their codes, the reasons for and importance of
overcoming this resistance, and alert the community to a reworking of one of
the first attempts for sharing codes, the Astrophysics Source Code Library
(ASCL). We discuss the implementation of the ASCL in an accompanying poster
paper. We suggest that code could be given a similar level of referencing as
data gets in repositories such as ADS.
[35]
oai:arXiv.org:1105.3214 [pdf] - 1076674
Ganalyzer: A tool for automatic galaxy image analysis
Submitted: 2011-05-16
We describe Ganalyzer, a model-based tool that can automatically analyze and
classify galaxy images. Ganalyzer works by separating the galaxy pixels from
the background pixels, finding the center and radius of the galaxy, generating
the radial intensity plot, and then computing the slopes of the peaks detected
in the radial intensity plot to measure the spirality of the galaxy and
determine its morphological class. Unlike algorithms that are based on machine
learning, Ganalyzer is based on measuring the spirality of the galaxy, a task
that is difficult to perform manually, and in many cases can provide a more
accurate analysis compared to manual observation. Ganalyzer is simple to use,
and can be easily embedded into other image analysis applications. Another
advantage is its speed, which allows it to analyze ~10,000,000 galaxy images in
five days using a standard modern desktop computer. These capabilities can make
Ganalyzer a useful tool in analyzing large datasets of galaxy images collected
by autonomous sky surveys such as SDSS, LSST or DES. The software is available
for free download at http://vfacstaff.ltu.edu/lshamir/downloads/ganalyzer, and
the data used in the experiment are available at
http://vfacstaff.ltu.edu/lshamir/downloads/ganalyzer/GalaxyImages.zip.
[36]
oai:arXiv.org:0908.3904 [pdf] - 1017242
Automatic morphological classification of galaxy images
Submitted: 2009-08-26
We describe an image analysis supervised learning algorithm that can
automatically classify galaxy images. The algorithm is first trained using a
manually classified images of elliptical, spiral, and edge-on galaxies. A large
set of image features is extracted from each image, and the most informative
features are selected using Fisher scores. Test images can then be classified
using a simple Weighted Nearest Neighbor rule such that the Fisher scores are
used as the feature weights. Experimental results show that galaxy images from
Galaxy Zoo can be classified automatically to spiral, elliptical and edge-on
galaxies with accuracy of ~90% compared to classifications carried out by the
author. Full compilable source code of the algorithm is available for free
download, and its general-purpose nature makes it suitable for other uses that
involve automatic image analysis of celestial objects.
[37]
oai:arXiv.org:0908.3123 [pdf] - 1017163
Frequency Limits on Naked-Eye Optical Transients Lasting from Minutes to
Years
Submitted: 2009-08-21
How often do bright optical transients occur on the sky but go unreported? To
constrain the bright end of the astronomical transient function, a systematic
search for transients that become bright enough to be noticed by the unaided
eye was conducted using the all-sky monitors of the Night Sky Live network. Two
fisheye continuous cameras (CONCAMs) operating over three years created a data
base that was searched for transients that appeared in time-contiguous CCD
frames. Although a single candidate transient was found (Nemiroff and Shamir
2006), the lack of more transients is used here to deduce upper limits to the
general frequency of bright transients. To be detected, a transient must have
increased by over three visual magnitudes to become brighter than visual
magnitude 5.5 on the time scale of minutes to years. It is concluded that, on
the average, fewer than 0.0040 ($t_{dur} / 60$ seconds) transients with
duration $t_{dur}$ between minutes and hours, occur anywhere on the sky at any
one time. For transients on the order of months to years, fewer than 160
($t_{dur} / 1$ year) occur, while for transients on the order of years to
millennia, fewer than 50 ($t_{dur}/1$ year)$^2$ occur.
[38]
oai:arXiv.org:astro-ph/0607033 [pdf] - 83236
OT 060420: A Seemingly Optical Transient Recorded by All-Sky Cameras
Submitted: 2006-07-03
We report on a ~5th magnitude flash detected for approximately 10 minutes by
two CONCAM all-sky cameras located in Cerro Pachon - Chile and La Palma -
Spain. A third all-sky camera, located in Cerro Paranal - Chile did not detect
the flash, and therefore the authors of this paper suggest that the flash was a
series of cosmic-ray hits, meteors, or satellite glints. Another proposed
hypothesis is that the flash was an astronomical transient with variable
luminosity. In this paper we discuss bright optical transient detection using
fish-eye all-sky monitors, analyze the apparently false-positive optical
transient, and propose possible causes to false optical transient detection in
all-sky cameras.
[39]
oai:arXiv.org:astro-ph/0511685 [pdf] - 78043
Software design for panoramic astronomical pipeline processing
Submitted: 2005-11-23
We describe the software requirement and design specifications for all-sky
panoramic astronomical pipelines. The described software aims to meet the
specific needs of super-wide angle optics, and includes cosmic-ray hit
rejection, image compression, star recognition, sky opacity analysis, transient
detection and a web server allowing access to real-time and archived data. The
presented software is being regularly used for the pipeline processing of 11
all-sky cameras located in some of the world's premier observatories. We
encourage all-sky camera operators to use our software and/or our hosting
services and become part of the global Night Sky Live network.
[40]
oai:arXiv.org:astro-ph/0506618 [pdf] - 74018
Using Fuzzy Logic for Automatic Analysis of Astronomical Pipelines
Submitted: 2005-06-27
Fundamental astronomical questions on the composition of the universe, the
abundance of Earth-like planets, and the cause of the brightest explosions in
the universe are being attacked by robotic telescopes costing billions of
dollars and returning vast pipelines of data. The success of these programs
depends on the accuracy of automated real time processing of the astronomical
images. In this paper the needs of modern astronomical pipelines are discussed
in the light of fuzzy-logic based decision-making. Several specific fuzzy-logic
algorithms have been develop for the first time for astronomical purposes, and
tested with excellent results on data from the existing Night Sky Live sky
survey.
[41]
oai:arXiv.org:astro-ph/0506354 [pdf] - 73754
All-sky Relative Opacity Mapping Using Night Time Panoramic Images
Submitted: 2005-06-15
An all-sky cloud monitoring system that generates relative opacity maps over
many of the world's premier astronomical observatories is described.
Photometric measurements of numerous background stars are combined with
simultaneous sky brightness measurements to differentiate thin clouds from sky
glow sources such as air glow and zodiacal light. The system takes a continuous
pipeline of all-sky images, and compares them to canonical images taken on
other nights at the same sidereal time. Data interpolation then yields
transmission maps covering almost the entire sky. An implementation of this
system is currently operating through the Night Sky Live network of CONCAM3s
located at Cerro Pachon (Chile), Mauna Kea (Hawaii), Haleakala (Hawaii), SALT
(South Africa) and the Canary Islands (Northwestern Africa).
[42]
oai:arXiv.org:astro-ph/0502548 [pdf] - 71339
A Fuzzy Logic Based Algorithm for Finding Astronomical Objects in
Wide-Angle Frames
Submitted: 2005-02-25
Accurate automatic identification of astronomical objects in an imperfect
world of non-linear wide-angle optics, imperfect optics, inaccurately pointed
telescopes, and defect-ridden cameras is not always a trivial first step. In
the past few years, this problem has been exacerbated by the rise of digital
imaging, providing vast digital streams of astronomical images and data. In the
modern age of increasing bandwidth, human identifications are many times
impracticably slow. In order to perform an automatic computer-based analysis of
astronomical frames, a quick and accurate identification of astronomical
objects is required. Such identification must follow a rigorous transformation
from topocentric celestial coordinates into image coordinates on a CCD frame.
This paper presents a fuzzy logic based algorithm that estimates needed
coordinate transformations in a practical setting. Using a training set of
reference stars, the algorithm statically builds a fuzzy logic model. At
runtime, the algorithm uses this model to associate stellar objects visible in
the frames to known-catalogued objects, and generates files that contain
photometry information of objects visible in the frame. Use of this algorithm
facilitates real-time monitoring of stars and bright transients, allowing
identifications and alerts to be issued more reliably. The algorithm is being
implemented by the Night Sky Live all-sky monitoring global network and has
shown itself significantly more reliable than the previously used non-fuzzy
logic algorithm.
[43]
oai:arXiv.org:astro-ph/0410212 [pdf] - 68062
PHOTZIP: A Lossy FITS Image Compression Algorithm that Protects
User-Defined Levels of Photometric Integrity
Submitted: 2004-10-07
A lossy compression algorithm is presented for astronomical images that
protects photometric integrity for detected point sources at a user-defined
level of statistical tolerance. PHOTZIP works by modeling, smoothing, and then
compressing the astronomical background behind self-detected point sources,
while completely preserving values in and around those sources. The algorithm
also guaranties a maximum absolute difference (in terms of $\sigma$) between
each compressed and original background pixel, allowing users to control
quality and lossiness. For present purposes, PHOTZIP has been tailored to FITS
format and is freely available over the web. PHOTOZIP has been tested over a
broad range of astronomical imagery and is in routine use by the Night Sky Live
(NSL) project for compression of all-sky FITS images. Compression factors
depend on source densities, but for the canonical NSL implementation, a PHOTZIP
(and subsequently GZIP or BZIP2) compressed file is typically 20% of its
uncompressed size.