catsHTM: A Tool for Fast Accessing and Cross-matching Large Astronomical Catalogs

Maayane T. Soumagnac; Eran O. Ofek

doi:10.1088/1538-3873/aac410

catsHTM: A Tool for Fast Accessing and Cross-matching Large Astronomical Catalogs

Maayane T. Soumagnac
, Eran O. Ofek

Weizmann Institute of Science

Research output: Contribution to journal › Article › peer-review

23 Scopus citations

Abstract

Fast access to large catalogs is required for some astronomical applications. Here we introduce the catsHTM tool, consisting of several large catalogs reformatted into HDF5-based file format, which can be downloaded and used locally. To allow fast access, the catalogs are partitioned into hierarchical triangular meshes and stored in HDF5 files. Several tools are provided to perform efficient cone searches at resolutions spanning from a few arc-seconds to degrees, within a few milliseconds time. The first released version includes the following catalogs (by alphabetical order): 2MASS, 2MASS extended sources, AKARI, APASS, Cosmos, DECaLS/DR5, FIRST, GAIA/DR1, GAIA/DR2, GALEX/DR6Plus7, HSC/v2, IPHAS/DR2, NED redshifts, NVSS, Pan-STARRS1/ DR1, PTF photometric catalog, ROSAT faint source, SDSS sources, SDSS/DR14 spectroscopy, SkyMapper, Spitzer/SAGE, Spitzer/IRAC galactic center, UCAC4, UKIDSS/DR10, VST/ATLAS/DR3, VST/KiDS/DR3, WISE and XMM. We provide Python code that allows to perform cone searches, as well as MATLAB code for performing cone searches, catalog cross-matching, general searches, as well as load and create these catalogs.

Original language	English
Pages (from-to)	1-5
Number of pages	5
Journal	Publications of the Astronomical Society of the Pacific
Volume	130
Issue number	989
DOIs	https://doi.org/10.1088/1538-3873/aac410
State	Published - Jul 2018
Externally published	Yes

Bibliographical note

Publisher Copyright:
© 2018, The Astronomical Society of the Pacific. All rights reserved.

Funding

E.O.O. is grateful for the support by grants from the Israel Science Foundation, Minerva, Israeli ministry of Science, the US-Israel Binational Science Foundation, and the I-CORE Program of the Planning and Budgeting Committee and The Israel Science Foundation.

Funders
Israeli Ministry of Science
US-Israel Binational Science Foundation
Minerva Foundation
Israel Science Foundation
Planning and Budgeting Committee of the Council for Higher Education of Israel

Keywords

Catalogs – methods
Color figures
Data analysis – surveys Online material

Access to Document

10.1088/1538-3873/aac410

Cite this

@article{606836268bce42aaab55aff1313516f8,

title = "catsHTM: A Tool for Fast Accessing and Cross-matching Large Astronomical Catalogs",

abstract = "Fast access to large catalogs is required for some astronomical applications. Here we introduce the catsHTM tool, consisting of several large catalogs reformatted into HDF5-based file format, which can be downloaded and used locally. To allow fast access, the catalogs are partitioned into hierarchical triangular meshes and stored in HDF5 files. Several tools are provided to perform efficient cone searches at resolutions spanning from a few arc-seconds to degrees, within a few milliseconds time. The first released version includes the following catalogs (by alphabetical order): 2MASS, 2MASS extended sources, AKARI, APASS, Cosmos, DECaLS/DR5, FIRST, GAIA/DR1, GAIA/DR2, GALEX/DR6Plus7, HSC/v2, IPHAS/DR2, NED redshifts, NVSS, Pan-STARRS1/ DR1, PTF photometric catalog, ROSAT faint source, SDSS sources, SDSS/DR14 spectroscopy, SkyMapper, Spitzer/SAGE, Spitzer/IRAC galactic center, UCAC4, UKIDSS/DR10, VST/ATLAS/DR3, VST/KiDS/DR3, WISE and XMM. We provide Python code that allows to perform cone searches, as well as MATLAB code for performing cone searches, catalog cross-matching, general searches, as well as load and create these catalogs.",

keywords = "Catalogs {\textendash} methods, Color figures, Data analysis {\textendash} surveys Online material",

author = "Soumagnac, \{Maayane T.\} and Ofek, \{Eran O.\}",

year = "2018",

month = jul,

doi = "10.1088/1538-3873/aac410",

language = "אנגלית",

volume = "130",

pages = "1--5",

journal = "Publications of the Astronomical Society of the Pacific",

issn = "0004-6280",

publisher = "Institute of Physics",

number = "989",

}

TY - JOUR

T1 - catsHTM

T2 - A Tool for Fast Accessing and Cross-matching Large Astronomical Catalogs

AU - Soumagnac, Maayane T.

AU - Ofek, Eran O.

PY - 2018/7

Y1 - 2018/7

N2 - Fast access to large catalogs is required for some astronomical applications. Here we introduce the catsHTM tool, consisting of several large catalogs reformatted into HDF5-based file format, which can be downloaded and used locally. To allow fast access, the catalogs are partitioned into hierarchical triangular meshes and stored in HDF5 files. Several tools are provided to perform efficient cone searches at resolutions spanning from a few arc-seconds to degrees, within a few milliseconds time. The first released version includes the following catalogs (by alphabetical order): 2MASS, 2MASS extended sources, AKARI, APASS, Cosmos, DECaLS/DR5, FIRST, GAIA/DR1, GAIA/DR2, GALEX/DR6Plus7, HSC/v2, IPHAS/DR2, NED redshifts, NVSS, Pan-STARRS1/ DR1, PTF photometric catalog, ROSAT faint source, SDSS sources, SDSS/DR14 spectroscopy, SkyMapper, Spitzer/SAGE, Spitzer/IRAC galactic center, UCAC4, UKIDSS/DR10, VST/ATLAS/DR3, VST/KiDS/DR3, WISE and XMM. We provide Python code that allows to perform cone searches, as well as MATLAB code for performing cone searches, catalog cross-matching, general searches, as well as load and create these catalogs.

AB - Fast access to large catalogs is required for some astronomical applications. Here we introduce the catsHTM tool, consisting of several large catalogs reformatted into HDF5-based file format, which can be downloaded and used locally. To allow fast access, the catalogs are partitioned into hierarchical triangular meshes and stored in HDF5 files. Several tools are provided to perform efficient cone searches at resolutions spanning from a few arc-seconds to degrees, within a few milliseconds time. The first released version includes the following catalogs (by alphabetical order): 2MASS, 2MASS extended sources, AKARI, APASS, Cosmos, DECaLS/DR5, FIRST, GAIA/DR1, GAIA/DR2, GALEX/DR6Plus7, HSC/v2, IPHAS/DR2, NED redshifts, NVSS, Pan-STARRS1/ DR1, PTF photometric catalog, ROSAT faint source, SDSS sources, SDSS/DR14 spectroscopy, SkyMapper, Spitzer/SAGE, Spitzer/IRAC galactic center, UCAC4, UKIDSS/DR10, VST/ATLAS/DR3, VST/KiDS/DR3, WISE and XMM. We provide Python code that allows to perform cone searches, as well as MATLAB code for performing cone searches, catalog cross-matching, general searches, as well as load and create these catalogs.

KW - Catalogs – methods

KW - Color figures

KW - Data analysis – surveys Online material

UR - https://www.scopus.com/pages/publications/85049081361

U2 - 10.1088/1538-3873/aac410

DO - 10.1088/1538-3873/aac410

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

AN - SCOPUS:85049081361

SN - 0004-6280

VL - 130

SP - 1

EP - 5

JO - Publications of the Astronomical Society of the Pacific

JF - Publications of the Astronomical Society of the Pacific

IS - 989

ER -

catsHTM: A Tool for Fast Accessing and Cross-matching Large Astronomical Catalogs

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this