Open-set semantic mapping is crucial for open-world robots.RayFronts is a unified representation that enables both dense and beyond-range efficient semantic mapping.RayFronts provides improved zero-shot 3D semantic segmentation performance and enhanced throughput compared to traditional methods.RayFronts reduces search volume more efficiently than online baselines, making it a suitable option for online scene understanding and exploration.