FAST Aiming at the problems of cumbersome steps and slow download speed of GNSS data

Related tags

Deep LearningFAST
Overview

FAST (Fusion Abundant multi-Source data download Terminal)

介绍

FAST 针对目前GNSS数据下载步骤繁琐、下载速度慢等问题,开发了一套较为完备的融合多源数据下载终端软件——FAST。
软件目前包含GNSS科研学习过程中绝大部分所需的数据源,采用并行下载的方式极大的提升了下载的效率。

Git地址

软件特点

  • 多平台:同时支持windows与linux系统;
  • 资源丰富:基本囊括了GNSS科研学习中所需的数据源,目前支持15个大类、62个小类,具体支持数据见数据支持
  • 快速:软件采用并行下载方式,在命令行参数运行模式可自行指定下载线程数,经测试下载100天的brdc+igs+clk文件只需要48.93s!
  • 易拓展:如需支持更多数据源,可在FTP_Source.py、GNSS_TYPE.py中指定所需的数据与数据源;
  • 简单易行:程序有引导下载模式与命令行带参数运行模式两种方式下载,直接运行程序便可进入引导下载模式,命令行带参数运行FAST -h可查看带参数运行模式介绍;
  • 灵活:在带参数运行模式下,用户可灵活指定下载类型、下载位置、下载时间、是否解压、线程数等,可根据自我需求编写bat、shell、python等脚本运行;
  • 轻便:windows程序包仅有18.9 MB,Liunx程序包仅有6.63 MB.

安装教程

  • Windows系统下仅需解压程序包即可直接运行,CMD运行FAST.exe -h可查看带参数运行模式介绍;
  • Linux系统下需安装先导软件wget\lftp\ncompress\python3,以Ubuntu系统为例,于终端中输入以下代码:
apt-get install wget
apt-get install lftp
apt-get install ncompress
apt-get install python3

安装后如windows系统下相同可直接运行程序,或将程序配置至环境变量中。

使用说明

引导下载模式Windows系统双击运行FAST.exe便可进入引导下载,若为Linux系统终端输入FAST运行即可:

  1. 以下载武汉大学多系统精密星历为例,在一级选择目录中选择SP3,即为输入2后回车;
    一级目录

  2. 选择MGEX_WUH_sp3即为输入6并回车,其中MGEX代表多系统,WUH代表武汉大学IGS数据处理中心,SP3代表精密星历; 二级目录

  3. 根据引导输入时间,回车完成输入; 输入时间

  4. 下载完成,根据提示直接回车完成解压或者输入任意字符回车不解压; 下载完成 解压完成

  5. 根据提示输入y再次进入引导或退出;
    在此引导

命令行带参数运行模式Windows系统CMD或power shell运行FAST.exe -h可查看命令行运行帮助,若为Linux系统终端输入FAST -h查看帮助:

  FAST : Fusion Abundant multi-Source data download Terminal
  ©Copyright 2022.01 @ Chang Chuntao
  PLEASE DO NOT SPREAD WITHOUT PERMISSION OF THE AUTHOR !

  Usage: FAST 

  Where the following are some of the options avaiable:

  -v,  --version                   display the version of GDD and exit
  -h,  --help                      print this help
  -t,  --type                      GNSS type, if you need to download multiple data,
                                   Please separate characters with " , "
                                   Example : GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk
  -l,  --loc                       which folder is the download in
  -y,  --year                      where year are the data to be download
  -d,  --day                       where day are the data to be download
  -o,  --day1                      where first day are the data to be download
  -e,  --day2                      where last day are the data to be download
  -m,  --month                     where month are the data to be download
  -u,  --uncomprss Y/N             Y - unzip file (default)
                                   N - do not unzip files
  -f,  --file                      site file directory,The site names in the file are separated by spaces.
                                   Example : bjfs irkj urum
  -p   --process                   number of threads (default 12)

  Example: FAST -t MGEX_IGS_atx
           FAST -t GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk -y 2022 -d 22 -p 30
           FAST -t MGEX_WUH_sp3 -y 2022 -d 22 -u N -l D:\code\CDD\Example
           FAST -t MGEX_IGS_rnx -y 2022 -d 22 -f D:\code\cdd\mgex.txt
           FAST -t IVS_week_snx -y 2022 -m 1

数据支持

  1. BRDC : GPS_brdc / MGEX_brdm

  2. SP3 : GPS_IGS_sp3 / GPS_IGR_sp3 / GPS_IGU_sp3 / GPS_GFZ_sp3 / GPS_GRG_sp3
    MGEX_WUH_sp3 / MGEX_WUHU_sp3 / MGEX_GFZ_sp3 / MGEX_COD_sp3
    MGEX_SHA_sp3 / MGEX_GRG_sp3 / GLO_IGL_sp3

  3. RINEX :GPS_IGS_rnx / MGEX_IGS_rnx / GPS_USA_cors / GPS_HK_cors / GPS_EU_cors
    GPS_AU_cors

  4. CLK : GPS_IGS_clk / GPS_IGR_clk / GPS_IGU_clk / GPS_GFZ_clk / GPS_GRG_clk GPS_IGS_clk_30s MGEX_WUH_clk / MGEX_COD_clk / MGEX_GFZ_clk / MGEX_GRG_clk / WUH_PRIDE_clk

  5. ERP : IGS_erp / WUH_erp / COD_erp / GFZ_erp

  6. BIA : MGEX_WHU_bia / GPS_COD_bia / MGEX_COD_bia / MGEX_GFZ_bia

  7. ION : IGS_ion / WUH_ion / COD_ion

  8. SINEX : IGS_day_snx / IGS_week_snx / IVS_week_snx / ILS_week_snx / IDS_week_snx

  9. CNES_AR : CNES_post / CNES_realtime

  10. ATX : MGEX_IGS_atx

  11. DCB : GPS_COD_dcb / MGEX_CAS_dcb / MGEX_WHU_OSB / P1C1 / P1P2 / P2C2

  12. Time_Series : IGS14_TS_ENU / IGS14_TS_XYZ / Series_TS_Plot

  13. Velocity_Fields : IGS14_Venu / IGS08_Venu / PLATE_Venu

  14. SLR : HY_SLR / GRACE_SLR / BEIDOU_SLR

  15. OBX : GPS_COD_obx / GPS_GRG_obx / MGEX_WUH_obx / MGEX_COD_obx / MGEX_GFZ_obx

  16. TRO : IGS_zpd / COD_tro / JPL_tro / GRID_1x1_VMF3 / GRID_2.5x2_VMF1 / GRID_5x5_VMF3

参与贡献

  1. 常春涛@中国测绘科学研究院
    程序思路、主程序编写、文档编写、程序测试

  2. 蒋科材博士后@武汉大学
    程序思路、并行计算处理思路

  3. 慕任海博士@武汉大学
    程序思路、程序编写、程序测试

  4. 李博博士@辽宁工程技术大学&中国测绘科学研究院
    程序测试、文档编写、节点汇总

  5. 李勇熹@兰州交通大学&中国测绘科学研究院
    程序测试、节点汇总

  6. 曹多明@山东科技大学&中国测绘科学研究院
    程序测试、节点汇总

Owner
ChangChuntao
QQ 1252443496 WECHAT amst-jazz
ChangChuntao
A computer vision pipeline to identify the "icons" in Christian paintings

Christian-Iconography A computer vision pipeline to identify the "icons" in Christian paintings. A bit about iconography. Iconography is related to id

Rishab Mudliar 3 Jul 30, 2022
A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution

DRSAN A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution Karam Park, Jae Woong Soh, and Nam Ik Cho Environments U

4 May 10, 2022
The official implementation of the IEEE S&P`22 paper "SoK: How Robust is Deep Neural Network Image Classification Watermarking".

Watermark-Robustness-Toolbox - Official PyTorch Implementation This repository contains the official PyTorch implementation of the following paper to

49 Dec 19, 2022
🔮 A refreshing functional take on deep learning, compatible with your favorite libraries

Thinc: A refreshing functional take on deep learning, compatible with your favorite libraries From the makers of spaCy, Prodigy and FastAPI Thinc is a

Explosion 2.6k Dec 30, 2022
Lava-DL, but with PyTorch-Lightning flavour

Deep learning project seed Use this seed to start new deep learning / ML projects. Built in setup.py Built in requirements Examples with MNIST Badges

Sami BARCHID 4 Oct 31, 2022
Python implementation of NARS (Non-Axiomatic-Reasoning-System)

Python implementation of NARS (Non-Axiomatic-Reasoning-System)

Bowen XU 11 Dec 20, 2022
Auditing Black-Box Prediction Models for Data Minimization Compliance

Data-Minimization-Auditor An auditing tool for model-instability based data minimization that is introduced in "Auditing Black-Box Prediction Models f

Bashir Rastegarpanah 2 Mar 24, 2022
Constrained Language Models Yield Few-Shot Semantic Parsers

Constrained Language Models Yield Few-Shot Semantic Parsers This repository contains tools and instructions for reproducing the experiments in the pap

Microsoft 43 Nov 23, 2022
Edge-oriented Convolution Block for Real-time Super Resolution on Mobile Devices, ACM Multimedia 2021

Codes for ECBSR Edge-oriented Convolution Block for Real-time Super Resolution on Mobile Devices Xindong Zhang, Hui Zeng, Lei Zhang ACM Multimedia 202

xindong zhang 236 Dec 26, 2022
Official Pytorch implementation for Deep Contextual Video Compression, NeurIPS 2021

Introduction Official Pytorch implementation for Deep Contextual Video Compression, NeurIPS 2021 Prerequisites Python 3.8 and conda, get Conda CUDA 11

51 Dec 03, 2022
Contrastive Learning for Compact Single Image Dehazing, CVPR2021

AECR-Net Contrastive Learning for Compact Single Image Dehazing, CVPR2021. Official Pytorch based implementation. Paper arxiv Pytorch Version TODO: mo

glassy 253 Jan 01, 2023
Iris prediction model is used to classify iris species created julia's DecisionTree, DataFrames, JLD2, PlotlyJS and Statistics packages.

Iris Species Predictor Iris prediction is used to classify iris species using their sepal length, sepal width, petal length and petal width created us

Siva Prakash 2 Jan 06, 2022
Python wrapper class for OpenVINO Model Server. User can submit inference request to OVMS with just a few lines of code

Python wrapper class for OpenVINO Model Server. User can submit inference request to OVMS with just a few lines of code.

Yasunori Shimura 7 Jul 27, 2022
Trading and Backtesting environment for training reinforcement learning agent or simple rule base algo.

TradingGym TradingGym is a toolkit for training and backtesting the reinforcement learning algorithms. This was inspired by OpenAI Gym and imitated th

Yvictor 1.1k Jan 02, 2023
Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track (SIGIR 2021 Full Paper).

Optimizing Dense Retrieval Model Training with Hard Negatives Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Jiafeng Guo, Min Zhang, Shaoping Ma This repo provi

Jingtao Zhan 99 Dec 27, 2022
Scikit-event-correlation - Event Correlation and Forecasting over High Dimensional Streaming Sensor Data algorithms

scikit-event-correlation Event Correlation and Changing Detection Algorithm Theo

Intellia ICT 5 Oct 30, 2022
METS/ALTO OCR enhancing tool by the National Library of Luxembourg (BnL)

Nautilus-OCR The National Library of Luxembourg (BnL) started its first initiative in digitizing newspapers, with layout recognition and OCR on articl

National Library of Luxembourg 36 Dec 05, 2022
Semantic Image Synthesis with SPADE

Semantic Image Synthesis with SPADE New implementation available at imaginaire repository We have a reimplementation of the SPADE method that is more

NVIDIA Research Projects 7.3k Jan 07, 2023
[ICCV2021] Official Pytorch implementation for SDGZSL (Semantics Disentangling for Generalized Zero-Shot Learning)

Semantics Disentangling for Generalized Zero-shot Learning This is the official implementation for paper Zhi Chen, Yadan Luo, Ruihong Qiu, Zi Huang, J

25 Dec 06, 2022
Datasets for new state-of-the-art challenge in disentanglement learning

High resolution disentanglement datasets This repository contains the Falcor3D and Isaac3D datasets, which present a state-of-the-art challenge for co

NVIDIA Research Projects 37 May 26, 2022