Columbia Lensing

Welcome!
We are the weak lensing group originated from Columbia University Department of Astronomy.
Here you can download weak lensing maps (and more!) we created using the NSF XSEDE (Stampede2) and NASA HECC (Pleiades) supercomputing facilities.

© Columbia Lensing


About

Our group uses numerical simulations to study the weak gravitational lensing signature of large-scale structure and to understand fundamental physics such as the nature of dark energy and the total mass of neutrinos. In particular, we try to capture the rich information that is beyond the traditional two-point statistics, using non-Gaussian statistics and convolutional neural networks.

PUBLICATIONS: ADS

Active contributors:
Zoltan Haiman
(Columbia)
Jia Liu
(Berkeley->IPMU)
Jose M. Zorrilla
(Princeton)
Ken Osato
(Kyoto)
J. Colin Hill
(Columbia/Flatiron)
Brian (Tianhuan) Lu
(Columbia)
Past contributors:
Andrea Petri
Simeon Bird
Mathew Madhavacheril
David Spergel
Xiuyuan Yang
Jan Kratochvil
Morgan May


kappaTNG

DOWNLOAD
Sample data (4.8GB): 100 realizations with 3 redshifts: z_s = 0.5, 1.0, 1.5 for kappaTNG and kappaTNG-Dark.
Please contact Ken Osato (ken.osato@yukawa.kyoto-u.ac.jp) to obtain the full dataset.

DESCRIPTION (simulation paper: arxiv:2010.09731)
The kappaTNG is a suite of mock weak lensing maps based on the cosmological hydrodynamic simulations IllustrisTNG (TNG300-1). We also include the kappaTNG-Dark suit of maps, generated based on the corresponding dark matter-only TNG simulations. These mock maps are suitable for studying the effects of baryons on weak lensing.

Simulation configuration:
- 10,000 realizations
- map size: 5x5 deg^2, 1024x1024 pixels
- resolution: 0.29 arcmin/pixel
- 40 source redshifts up to zs = 2.6

Sample Jupyter Notebook for loading data: https://github.com/0satoken/kappaTNG





Baryon Painting

DESCRIPTION
The dataset includes ray-traced convergence maps generated from N-body simulations with the baryonic correction model. See Lu et al. (2021) for the description of how the maps are generated. See Petri (2016) for the information of the underlying simulations.

The convergence maps have a field-of-view of 3.5×3.5 deg2 and a resolution of 2048×2048, ray-traced from z=1. The maps do not contain shape noise and smoothing. There are two groups files in the dataset:
(1) `[cosmo]_fiducial.f32` includes 128 realization of the maps with fiducial baryonic model;
(2) `[cosmo]_baryon.f32` includes one realization (same random seed) for each of the 160 baryonic model (see `baryonic_parameters.txt` for the table of baryonic parameters).
`[cosmo]` denotes the cosmological parameter of the simulation (Om=ΩM, si=σ8). Each file stores the a row-major array of little-endian 32-bit floating point numbers with dimensions n×2048×2048, where n is the number of maps in the file.

Full data can be downloaded from here, please email zoltan@astro.columbia.edu for a guest username/password.

MassiveNuS

DOWNLOAD
data
Please contact Jia Liu (jialiu@berkeley.edu) for technical issues.

DESCRIPTION (simulation paper: arxiv:1711.10524):
MassiveNuS (Cosmological Massive Neutrino Simulations) include 100 massive neutrino models + 1 massless model with three varying parameters (parameter file):
(1) neutrino mass sum M_nu (ranging from 0 to 0.6 eV, assuming normal hierarchy)
(2) matter density Omega_m
(3) primordial power spectrum amplitude A_s (sigma_8 is a derived parameter)

The simulations correctly capture the background expansion as neutrinos turn from relativistic to non-relativistic, as well as the growth of neutrino clustering in response to the nonlinear matter growth.

DATA PRODUCTS (data)
(1) 67 snapshots:
For the two fiducial models (z=0 to z=45, every126 comoving Mpc/h)
Format: Gadget-2 format2, with position and velocity information.
Size: 2.2TB/model.
Code: Gadget-2 (1024^3 particles, 512 Mpc/h box size) + neutrino patch (Ali-Haïmoud & Bird 2013)
(2) Halo catalogues:
For each of the 101 models.
Halos and properties, complete down to minimal halo mass 10^11.5 M_sun, around three million halos at z=0, for z=0 to z=45.
Format: ascii (recommend analysis tool: Halotools)
Size: 16GB/model.
Code: rockstar
(3) Merger trees:
For the two fiducial models.
Format: ascii (recommend analysis tool: Halotools)
Size: 18GB/model. Code: consistent tree
(4) Convergence maps (galaxy & CMB lensing):
10,000 realizations for each of the 101 models, for 6 source redshifts.
Source redshifts z_s = 0.5, 1, 1.5, 2, 2.5, 1100.
Map size: 12.25 deg^2, 512^2 pixels, 0.4 arcmin resolution.
Format: fits.
Size: 59GB/model (10,000 realizations x 6 redshifts).
Code: LensTools


We thank New Mexico State University (USA) and Instituto de Astrofisica de Andalucia CSIC (Spain) for hosting the Skies & Universes site for cosmological simulation products.

Dark Energy

DESCRIPTION
For the full detail for our simulation pipeline see Petri 2016.
A briefer description can be found in the "simulation" section in either Zorrilla et al 2016, Liu et al 2016 , or Petri et al 2016 .

Each tar.gz file (15GB) has 1000 fits maps (17MB each).
Simulation configuration (also in the header of the fits files):
size of the box = 240 Mpc/h
source redshift z_s = 2.0
map size = 3.5 x 3.5 = 12.25 deg^2
number of particles = 512^3
resolution = 2048 x 2048 pixels
No shape noise
Fixed cosmological parameters:
h = 0.72
n_s = 0.96
Omega_b = 0.046
Tcmb = 2.725K
N_eff = 3.04
neutrino masses = 0, 0, 0
Varying parameters are in the file name (also in the fits header), for example:
"Om0.260_Ode0.740_w-0.800_wa0.000_si0.800.tar.gz" has:
Omega_m = 0.26
Omega_lambda = 0.74
w_0 = -0.8, w_a = 0, where the dark energy EoS is w(a)=w_0+(1-a)w_a.
sigma_8 = 0.80

kappa maps:
Om0.230_Ode0.770_w-1.000_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-0.800_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa-0.200_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa-0.500_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-1.200_wa0.000_si0.800.tar.gz
Om0.290_Ode0.710_w-1.000_wa0.000_si0.800.tar.gz

B-mode maps (for null tests):
Om0.230_Ode0.770_w-1.000_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-0.800_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa-0.200_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa-0.500_si0.800.tar.gz
Om0.260_Ode0.740_w-1.000_wa0.000_si0.800.tar.gz
Om0.260_Ode0.740_w-1.200_wa0.000_si0.800.tar.gz
Om0.290_Ode0.710_w-1.000_wa0.000_si0.800.tar.gz

Dark Matter

DESCRIPTION
This is a set of simulated convergence maps for 96 different cosmologies. Each cosmology differs only on two cosmological parameters, the density of matter, Omega_m, and the amplitude of density fluctuations measured in the late universe, sigma_8. Each is saved in a compressed directory. Within the directory, there are 512 convergence maps, saved as fits files.

This dataset was used for the analyses presented in Matilla et al 2016 and Gupta et al 2018, where you can find detailed descriptions of the data. These two papers should be cited in a publication that makes use of the maps.

For convenience, here is a brief description:

- Each convergence map covers a field of view of 3.5deg x 3.5deg, and has a resolution of 1024 x 1024 pixels.
- Maps share the initial random seeds between cosmologies. That is, the map 0001 for cosmology a and the same map for cosmology b were generated using the same random seed, and will exhibit similar structures in the same regions.
- Maps represent noiseless convergence from sources at a constant redshift z=1.0.
- Each map was generated ray-tracing the outputs of dark matter-only, N-body simulations, using the multi plane algorithm implemented in Lenstools. The ray-tracing does not use the Born approximation, but assumes a flat sky.
- Each past light-cone was built from snapshots from a single N-body simulation for each cosmology. The simulations evolved a 240Mpc/h side cube with 512^3 dark matter particles, using GADGET2. The distance between planes corresponds to 80Mpc/h on the fiducial cosmology (Omega_m=0.260, sigma_8=0.800).
- Initial conditions for the Nbody simulations were built using NGenIC, from scaled power spectra computed with CAMB.

Sample data: Download
Full data (set of maps in all 96 cosmologies) can be downloaded from here, please email zoltan@astro.columbia.edu for a guest username/password.

Note that a few maps were lost during a file transfer to a permanent repository and these two cosmological models have fewer maps:
Om0.246_si0.926: 508 maps
Om0.251_si0.807: 455 maps

Acknowledgement

When our maps are used in your paper:

(1) Please add the following to the Acknowledgement section of your publication if you used any data product from this website: "We thank the Columbia Lensing group (http://columbialensing.org) for making their simulations available. The creation of these simulations is supported through grants NSF AST-1210877, NSF AST-140041, and NASA ATP-80NSSC18K1093."

(2) For the kappaTNG dataset, please cite Osato, Liu, & Haiman 2020 and the 5 TNG300 presentation papers.

(3) For the MassiveNuS dataset, please cite Liu et al. 2018, and add to Acknowledgement (in addition to #1 above): "We thank New Mexico State University (USA) and Instituto de Astrofisica de Andalucia CSIC (Spain) for hosting the Skies & Universes site for cosmological simulation products."

(4) For the Dark Matter dataset, please cite Matilla et al 2016 and Gupta et al 2018.

(5) For the Baryon Painting dataset, please cite Lu et al. (2021).

Background image credit: CFHTLenS