gamkov/mvn_flight
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

MVN ASOTR data processing is performed using docker containers. Checked in ubuntu, rewrite readme

Browse Source
This commit is contained in:
Danila Gamkov
2025-10-29 20:09:02 +03:00
parent 14c306818c
commit fcb3a38441
5 changed files with 128 additions and 107 deletions
Download Patch File Download Diff File Expand all files Collapse all files

163
README.markdown
View File

@@ -6,12 +6,10 @@ This project contains tools for decoding, converting, and visualizing telemetry
- **Project structure**
- **Requirements**
- **Linux Setup**
- **Windows 10 Setup**
- **Setup**
- **Using the tools**
- *Plot all ASOTR data*
- *Plot ASOTR data in specified date borders (for MVN reports)*
- **Docker setup**
- **Contacts**
**Note 1**: \<PATH_TO_MVN_FLIGHT\> - path where is mvn_flight scripts is cloned from heagit
@@ -29,60 +27,12 @@ This project contains tools for decoding, converting, and visualizing telemetry
-> `/plots/` — folder where output plots are saved.
## Requirements
- git
- Python version 3.10 or upper. For checking type:
```bash
python3 --version
```
- Rust compiler version 1.83.0 or upper. For checking type:
```bash
rustc --version
```
## Linux Setup
1. Clone the repo to your computer:
```bash
git clone http://heagit.cosmos.ru/gamkov/mvn_flight.git
```
2. Install python and python libraries (if you don't have):
```bash
sudo apt update
sudo apt install python3 python3-pip
pip3 install --upgrade matplotlib pandas openpyxl scipy
```
1. Install Rust compiler (if you do not have):
```bash
curl --proto '=https' --tlsv1.2 https://sh.rustup.rs -sSf | sh
```
## Windows 10 Setup
1. Clone the repo to your computer:
```cmd
git clone http://heagit.cosmos.ru/gamkov/mvn_flight.git
```
2. Install Python from https://www.python.org/downloads/
3. Open CMD and install python dependencies:
```cmd
pip install --upgrade matplotlib pandas openpyxl scipy
```
4. Install Rust compiler (if you do not have):
Go to address https://www.rust-lang.org/tools/install and follow instructions
For more detailed information you can go to: https://doc.rust-lang.ru/book/ch01-01-installation.html
## Using the tools
### Plot all ASOTR data
1. Donwload data from science data server to directory \<PATH_TO_ASOTR_DATA\>.
- Ubuntu linux or Windows 10/11
- sftp client
- git client
- Donwloaded data from science data server to directory \<PATH_TO_ASOTR_DATA\>.
If you don't have MVN data, you might download it from server with science SRG data (IP: 193.232.11.95).
For questions about downloading science data contact Shtykovsky A. (a.shtykovsky@cosmos.ru) or Chelovekov I. (chelovekov@cosmos.ru)
For questions about downloading science data contact Shtykovsky A. (a.shtykovsky@cosmos.ru) or Chelovekov I. (chelovekov@cosmos.ru)
Linux (for example):
```
@@ -91,77 +41,88 @@ cd mvn/data/data/2025
get -r 20250101*
```
Windows:
```
Open filezilla
connect to sft server
get data from: /export/home/user_name/mvn/data/data/2025
## Setup
1. Clone the repo to your computer:
```bash
git clone http://heagit.cosmos.ru/gamkov/mvn_flight.git
```
2. Install `wsl` (for Windows 10/11):
2.1 open powershell
``` powerShell
wsl --install
```
2.2 Restart windows
2.3 check that the `wsl` is installed correctly
``` powerShell
wsl --list --online
```
3. Install Docker in `wsl` if you use Windows (follow the instructions in web-cite):
https://docs.docker.com/engine/install/ubuntu/
Running a docker image is an alternative way to use `mvn_flight` software.
Just follow the instructions:
4. in `docker-compose.yml` file replace the following string:
`/home/danila/Danila/work/MVN/flight/data:/mnt/raw_mvn_data`
with:
`\<PATH_TO_ASOTR_DATA\>` (see `Requirements`)
5. compose and run docker image (in `wsl` if you use Windows):
```bash
docker compose up -d --build
```
6. Check docker images and currently running containers:
```bash
docker images
docker ps -a
```
## Using the tools
### Plot all ASOTR data
1. Donwload data from science data server to directory: \<PATH_TO_ASOTR_DATA\>.
2. Parse all raw data from ASOTR into csv files and plot all csv data:
Linux:
```bash
cd bin
./asotr_unzip_plot.sh <PATH_TO_ASOTR_DATA>/
cd <PATH_TO_MVN_FLIGHT>
docker compose run --rm asotr_cronjob
```
Windows:
```cmd
cd bin
asotr_unzip_plot.bat <PATH_TO_ASOTR_DATA>\
or using crontab (parse all ASOTR raw data every 2 hours):
```bash
crontab -e
0 */2 * * * cd \<PATH_TO_MVN_FLIGHT\> && docker compose run --rm asotr_cronjob
```
csv data will be in directory:
```cmd
/data/asotr/
```
csv files with ASOTR data: in directory:
`<PATH_TO_MVN_FLIGHT>/data/asotr/`
### Plot ASOTR data in specified date borders (for MVN reports)
1-2. See previous chapter (``Plot all ASOTR data``)
3. plot ASOTR data in specified data borders
Linux:
```bash
cd bin
./plot_flight_borders.sh 10.03.2025_00:00:00 23.04.2025_23:59:59
```
Windows:
```cmd
cd bin
plot_flight_borders.bat 10.03.2025_00:00:00 23.04.2025_23:59:59
cd \<PATH_TO_MVN_FLIGHT\>
docker exec -it asotr_container bash
ls
./plot_flight_borders.sh 25.10.2025_00:00:00 28.10.2025_10:00:00
```
where:
10.03.2025_00:00:00 - start date_time
23.04.2025_23:59:59 - end date_time
25.10.2025_00:00:00 - start date_time
28.10.2025_10:00:00 - end date_time
plots with data are in the directory:
```cmd
/plots/reports
<PATH_TO_MVN_FLIGHT>/plots/reports
```
### Docker Setup
running a docker image is an alternative way to use `mvn_flight` software.
you just follow steps:
1. download mvn raw data into \<PATH_TO_ASOTR_DATA\>, see chapter: `Plot all ASOTR data`
2. compose and run docker image:
```bash
docker compose up -d --build
docker exec -it asotr_container bash
```
3. Parse all raw data from ASOTR into csv files and plot all csv data:
```bash
./asotr_unzip_plot.sh /mnt/raw_mvn_data/
```
4. plot ASOTR data in specified data borders:
./plot_flight_borders.sh 10.03.2025_00:00:00 23.04.2025_23:59:59
Attention: this plots you should pack to arcive and send to vvl@cosmos.ru
## Contatcs
For questions about the program, please contact Danila Gamkov, email: danila_gamkov@cosmos.ru