cosmo-corr

Abstract

Properly estimating correlations between objects at different spatial scales necessitates $\mathcal{O}(n^2)$ distance calculations. For this reason, most widely adopted packages for estimating correlations use clustering algorithms to approximate local trends. Methods for quantifying the error introduced by clustering have been understudied. In response, we present an algorithm for estimating correlations that is probabilistic in the way that it clusters objects, enabling us to quantify the uncertainty caused by clustering simply through model inference. We also observe that these soft clustering assignments enable correlation estimators that are theoretically differentiable with respect to their input catalogs. Thus, we follow by building up a theoretical framework for differentiable correlation functions and describe their utility in comparison to existing surrogate models. Notably, we find that the repeated use of the normalization and distance function calls makes gradient calculations slow and sparsity patterns in Jacobians that propagate through the chain rule makes the precision unstable, pointing towards either approximate or surrogate methods as a necessary solution to exact gradients from correlation functions. To that end, we close with a discussion of surrogate models as proxies for correlation functions. We provide an example that demonstrates the efficacy of surrogate models to enable gradient based optimization of astrophysical model parameters, successfully minimizing a correlation function output. Our numerical experiments cover science cases across cosmology, from point spread function (PSF) modeling efforts to gravitational simulations to intrinsic alignments (IA). We release the code used in this study at https://github.com/EdwardBerman/cosmo-corr and https://github.com/EdwardBerman/jax-cosmo-corr.

Julia Implementation and Probabilistic Clustering

Use the figure component to display images, videos, equations, or any other element, with an optional caption.

Jax Implementation and Differentiability

Use the two columns component to display two columns of content. In this example, the first column contains a figure with a YouTube video and the second column contains a figure with a custom React component. By default, they display side by side, but if the screen is narrow enough (for example, on mobile), they’re arranged vertically.

Key Results

BibTeX citation

  
  @misc{CosmoCorr,
  author = {Edward Berman},
  title = {CosmoCorr: Cosmological Correlation Function Estimator},
  year = {2024},
  howpublished = {\url{https://github.com/EdwardBerman/CosmoCorr}},
  note = {Accessed: 2024-09-23}
}