SpaceNet 數據集
SpaceNet是DigitalGlobe商業衛星公司提供的遙感圖像集合,包含一些標記信息可用作機器學習研究.
SpaceNet Challenge主頁: https://spacenetchallenge.github.io/
數據集下載命令: https://github.com/SpaceNetChallenge/utilities/tree/master/content/download_instructions
關於SpaceNet數據集
| Source | DigitalGlobe, Inc. |
|---|---|
| Category | Computer Vision, Geospatial |
| Format | GeoTIFF, GeoJSON |
| License | Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International |
| Storage Service | Amazon S3 |
| Location | s3://spacenet-dataset in us-east-1 |
| Update Frequency | New imagery and features are added quarterly |
下載
安裝aws-cli客戶端
pip install awscli
如果安裝時提示找不到yaml.h,安裝libyaml-dev (apt-get install libyaml-dev)
配置aws賬號
$# aws configure
AWS Access Key ID [None]: 你的賬號
AWS Secret Access Key [None]: 你的賬號
Default region name [None]: us-west-2
Default output format [None]: json
查看SpaceNet Data中的所有文件列表,訪問該數據集需要添加--request-payer選項來訪問收取流量費用的bucket存儲:
$# aws s3 ls spacenet-dataset --request-payer requester
PRE /
PRE AOI_1_Rio/
PRE AOI_2_Vegas/
PRE AOI_3_Paris/
PRE AOI_3_Paris2/
PRE AOI_4_Shanghai/
PRE AOI_5_Khartoum/
PRE SpaceNet_Roads_Competition/
PRE competition1/
PRE mvs_dataset/
PRE test/
2016-08-19 02:52:48 2742 .
2016-09-02 03:10:03 2910 AOI_1_Rio_manifest.txt
2017-01-05 07:22:45 17953095 Rio_BuildingLabels.tar.gz
2016-11-16 11:03:40 338 competition_manifest.txt
2016-11-16 11:10:23 3404 manifest.txt
2017-02-16 02:24:49 0 manifest2.txt
2017-03-10 00:29:14 213227956 spacenet_sample.tar.gz
下載上海數據AOI 4 (23 GB)
aws s3api get-object --bucket spacenet-dataset --key AOI_4_Shanghai/AOI_4_Shanghai_Train.tar.gz --request-payer requester AOI_4_Shanghai_Train.tar.gz
彩蛋
數據處理
To be continued...
參考鏈接