Skip to content

horzvert_timeseries.py pair analysis examples #57

@falkamelung

Description

@falkamelung

Here how it works:
https://github.com/geodesymiami/PlotData/blob/main/docs/ARCHITECTURE_horzvert_timeseries.md
Some examples are below. If we find one where it does not work we should fix.

This is not a bug to fix. Lets keep the issue open until we are convinced that it works.

It is helpful to run using --dry-run option and examinthe

horzvert_timeseries.py ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5 ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5 --ref-lalo 0.665 -77.897 --dry-run


HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=84
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=131
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=213
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=2
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A120: 251 images, D142: 387 images
+2 days  213 pairs
-4 days  2 pairs
Total: 215 pair

and examine the image_pairs.txt:

cat image_pairs.txt
     A120      D142
 20141013
*20141025  20141027 (+2)
 20141106
 20141130
*20141212  20141214 (+2)
 20141224
*20150105  20150107 (+2)
 20150117
           20150131
           20150224
 20150306
*20150318  20150320 (+2)
 20150330
*20150411  20150413 (+2)
*20150505  20150507 (+2)
 20150517
           20150531
           20150624
 20150704
           20150718
 20150728
           20150811
 20150821
*20150902  20150904 (+2)
 20150914
*20150926  20150928 (+2)
*20151020  20151022 (+2)
 20151101
*20151113  20151115 (+2)
*20151207  20151209 (+2)
 20151219
 20151231
 20160112
*20160124  20160126 (+2)
*20160217  20160219 (+2)
 20160229
*20160312  20160314 (+2)
 20160324
           20160407
 20160417
*20160429  20160501 (+2)
 20160511
*20160523  20160525 (+2)
 20160604
 20160628
 20160710
*20160803  20160805 (+2)
 20160815
*20160827  20160829 (+2)
+20160926  20160922 (-4)
 20161008
           20161016
           20161022
 20161101
           20161109
           20161115
 20161125
           20161209
 20161219
           20170102
 20170112
           20170126
 20170205
           20170219
 20170301
*20170313  20170315 (+2)
*20170325  20170327 (+2)
           20170408
*20170418  20170420 (+2)
*20170430  20170502 (+2)

First example: Karpathos

horzvert_timeseries.py /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5 
/media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5 --ref-lalo 35.77467 27.18494


HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
open HDFEOS file: geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
open HDFEOS file: geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=328
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=99
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=2

Testing swapped input files:
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
open HDFEOS file: geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
open HDFEOS file: geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=328
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=102
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=2
Writing image_pairs.txt .....
Summary:
A131: 472 images, D036: 479 images
0 days  328 pairs
+6 days  102 pairs
-6 days  2 pairs
Total: 432 pairs

It uses A131 as reference although D36 was the first argument:

info.py S1_vert_131_036_miaplpy_20141014_20250805_N3585E02707_N3585E02728_N3562E02728_N3562E02707.he5 | grep ORB
  ORBIT_DIRECTION                             ASCENDING
  ORBIT_DIRECTION_SECOND                      DESCENDING

Second example: Fernandina

horzvert_timeseries.py "/media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5" "/media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5" --ref-lalo -0.453 -91.390

HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=111
shift=+6 pairs found=0
shift=-1 pairs found=83
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=195
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A106: 200 images, D128: 238 images
+1 days  195 pairs
Total: 195 pairs

Third example: Chiles as above:

horzvert_timeseries.py ChilesSenD142/mintpy_6_24_070/ ChilesSenA120/mintpy_6_24_065 --ref-lalo 0.665 -77.897
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=84
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=131
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=213
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=2
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A120: 251 images, D142: 387 images
+2 days  213 pairs
-4 days  2 pairs
Total: 215 pairs

It found most pairs for A120 as reference and used it

info.py Chiles/mintpy/S1_horz_120_142_mintpy_20141025_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5 | grep ORBIT
  ORBIT_DIRECTION                             ASCENDING
  ORBIT_DIRECTION_SECOND                      DESCENDING

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions