NeurIPS 2026
University of Science, Ho Chi Minh CityVietnam National University, Ho Chi Minh CityUniversity of Warwick

NeurIPS 2026Main TrackSydney

SkyPart Weather-Robust Cross-View Geo-Localization via Prototype-Based Semantic Part Discovery

Chi-Nguyen Tran1,2* Duy-Minh Dao-Sy1,2* Trung-Kiet Huynh1,2* Phu-Hoa Pham1,2 Phu-Quy Nguyen-Lam1,2 Long Tran-Thanh3

1University of Science, Ho Chi Minh City  ·  2Vietnam National University, Ho Chi Minh City  ·  3University of Warwick  ·  *Equal contribution

Abstract

Low-altitude economy has been experiencing rapid growth in recent years, with significant contributions to the global economy. While common drone tasks such as delivery, inspection, and search-and-rescue typically use Global Navigation Satellite Systems (GNSS) to navigate, there is an increasing need for developing alternative solutions as GNSS signals can be easily jammed, spoofed, or unavailable over a prolonged operational time. As such, cross-view geo-localization (CVGL), which matches an oblique drone view to a geo-referenced satellite tile, has emerged as a potent alternative that lets an autonomous drone localize itself when GNSS fails. Despite strong recent progress, three limitations persist in current CVGL methods: 1) global-descriptor designs compress the patch grid into a single vector without separating what is shared across the view gap (layout) from what is not (texture); 2) altitude-related scale variation is implicitly retained in the learned embedding rather than treated as a nuisance to be marginalized out; and 3) multi-objective training relies on hand-tuned scalars over losses that live on incompatible gradient scales. To address these limitations, we propose SkyPart, a lightweight swappable head for patch-based vision transformers (ViTs) that institutes explicit part grouping over the patch grid. SkyPart has four components grounded in established theory: (i) learnable prototypes that compete for patch tokens via a single-pass cosine assignment; (ii) altitude-conditioned linear modulation applied only during training so that the retrieval embedding is altitude-free at inference; (iii) a graph-attention readout over active prototypes, and (iv) a Kendall uncertainty-weighted multi-objective loss that learns the loss-group weights end-to-end rather than tuning them by hand. At 26.95M parameters and 22.14 GFLOPs, SkyPart is the smallest among the top-performing methods in our comparison and sets a new state of the art on SUES-200, University-1652, and DenseUAV datasets under a single-pass, no-re-ranking, no test-time augmentation (TTA) protocol. Furthermore, its accuracy gap to the strongest baseline widens under the ten-condition WeatherPrompt corruption benchmark.

Method

SkyPart overview: a shared DINOv2 ViT-S/14 tokenizes the drone query and the satellite tile; a global CLS lane, a part-prototype lane and a layout-graph lane are fused into one 768-D embedding for cosine retrieval; four loss groups are used only during training

One DINOv2 ViT-S/14 encodes both views; the global CLS token, the part prototypes and the layout graph are fused into one 768-D embedding for cosine retrieval. Training objectives (bottom row) are dropped at test time.

Results

Ten weather conditions

WeatherPrompt protocol: the drone query is corrupted, the satellite gallery stays clean. Bars give SUES-200 drone→satellite R@1 (%) for SkyPart and WeatherPrompt (NeurIPS 2025), the strongest baseline.

The drone query under normal
Normal97.2176.72
The drone query under fog
Fog96.2768.49
The drone query under rain
Rain96.0671.77
The drone query under snow
Snow95.3359.95
The drone query under dark
Dark92.0640.42
The drone query under over-exposure
Over-exposure93.3461.57
The drone query under fog + rain
Fog + rain94.7158.24
The drone query under fog + snow
Fog + snow90.4464.36
The drone query under rain + snow
Rain + snow95.1758.49
The drone query under wind
Wind96.5465.19
Radar charts of recall at rank one over ten conditions on SUES-200, University-1652 and DenseUAV. The figure compares SkyPart with Sample4Geo, CCR, Safe-Net and WeatherPrompt.

Recall at rank one over ten conditions on three benchmarks. SkyPart is the red outline.

Learned parts

One colour per prototype. The same parts appear in the drone view, the satellite view and under weather.

Each column shows an example location. Rows show the input drone image, the drone part overlay, the satellite part overlay, and the drone part overlay under the condition named below.

Datasets

SUES-200

  • 200 locations, altitudes 150–300 m
  • Train: 120 locations, 24,000 drone images
  • Test: 16,000 queries, 200-tile gallery
  • Direct download
Get the data

University-1652

  • 1,652 buildings from 72 universities
  • Train: 701 buildings, 37,854 drone images
  • Test: 37,855 queries, 951-tile gallery
  • Request form, then download
Get the data

DenseUAV

  • 3,033 urban locations, heights 80–100 m
  • Train: 2,256 locations, 6,768 drone images
  • Test: 2,331 queries, 18,198-tile gallery
  • Direct download (Hugging Face)
Get the data

BibTeX

Bibliographic reference
@inproceedings{skypart2026,
  title     = {Weather-Robust Cross-View Geo-Localization
               via Prototype-Based Semantic Part Discovery},
  author    = {Chi-Nguyen Tran and Duy-Minh Dao-Sy and Trung-Kiet Huynh
               and Phu-Hoa Pham and Phu-Quy Nguyen-Lam and Long Tran-Thanh},
  booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
  year      = {2026}
}