To Blog

SpaceNet 7 Results: arXiv Paper and Winning Model Release

Preface: SpaceNet LLC is a nonprofit organization dedicated to accelerating open source, artificial intelligence applied research for geospatial applications, specifically foundational mapping (i.e., building footprint & road network detection). SpaceNet is run in collaboration by co-founder and managing partner CosmiQ Works, co-founder and co-chair Maxar Technologies, and our partners including Amazon Web Services (AWS)Capella SpaceTopcoderIEEE GRSS, the National Geospatial-Intelligence Agency and Planet.

Building tracking and change detection from moderate satellite imagery is surprisingly tractable, as we’ve demonstrated in the last few DownLinQ blogs. The SpaceNet 7 Multi-Temporal Urban Development Challenge yielded some impressive results, with some interesting phenomena noted in analysis blogs 12. This post serve as the final installment in the SpaceNet 7 analysis series, and we are pleased to announce that the winning models are now available in the open source. Furthermore, our paper on the SpaceNet 7 dataset and initial results can now be found on arXiv. In the sections below we explore performance with an interactive map, and provide details on how to access the models.

1. Winning Models

Recall from our results announcement blog that the top-5 submissions to SpaceNet improved markedly upon the SpaceNet 7 algorithmic baseline, and applied a variety of clever approaches to improve performance. Table 1 below details the specifics of each model, while Figure 1 illustrates the SpaceNet Change and Object Tracking (SCOT) score vs inference speed (for an in-depth analysis of SCOT scores, see our previous blog).

Table 1. SpaceNet 7 winners (originally presented here).
Figure 1. Performance vs inference speed for the winning algorithms, up and right is best (originally presented here).

2. Interactive Map

Figure 2 links to an interactive (pan, zoom, hover) map that allows interested users to explore various metrics (F1, Track Score, Change Score, and SCOT) for the winning submission of lxastro0.

Figure 2. Performance in various cities for the winning SpaceNet 7 model. Click here for an interactive map.

3. Tracking and Change Illustration

Figure 3 below provides an example of the winning model’s ability to correctly track building identifiers over time, as well as catalog change.

Click to see animation over time.

4. Model Access

The winning algorithms are available under a permissive license at:

https://github.com/SpaceNetChallenge/SpaceNet7_Multi-Temporal_Solutions

All algorithms leverage Docker for easy deployment, and be either trained on new data or tested using existing model weights.

5. Conclusions

Quantifying population statistics is fundamental to dozens of the United Nations Sustainable Development Goals, yet many countries lack effective civil registration systems. SpaceNet 7 has demonstrated that identifying, tracking, and detecting change in precise building footprints using moderate resolution (4m) Planet imagery is possible. Tracking urbanization and construction at the unique building level is critical for improving upon existing course population estimates. By tracking unique building identifiers SpaceNet 7 algorithms can determine which exact buildings changed (whose properties such as precise location, area can be correlated with features such as road access, distance to hospitals, etc.), thus providing a much more granular view into population growth. We look forward to improvements upon these techniques permitted and encouraged by the open source nature of the dataset and algorithms.

IQT Blog

Insights & Thought Leadership from IQT

Read More