Skip to content

Commit 9f20eec

Browse files
authored
Merge pull request #73 from hmorimitsu/nf2
Nf2
2 parents a0399f1 + 9b7316f commit 9f20eec

29 files changed

+1340
-173
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -99,7 +99,8 @@ This is still under development, so some things may not work as intended. I plan
9999
- MatchFlow [https://arxiv.org/abs/2303.08384](https://arxiv.org/abs/2303.08384)
100100
- MemFlow [https://arxiv.org/abs/2404.04808](https://arxiv.org/abs/2404.04808)
101101
- MS-RAFT+ [https://arxiv.org/abs/2210.16900](https://arxiv.org/abs/2210.16900)
102-
- NeuFlow [https://arxiv.org/abs/2403.10425](https://arxiv.org/abs/2403.10425)
102+
- NeuFlow v1 [https://arxiv.org/abs/2403.10425](https://arxiv.org/abs/2403.10425)
103+
- NeuFlow v2 [https://arxiv.org/abs/2408.10161](https://arxiv.org/abs/2408.10161)
103104
- PWCNet [https://arxiv.org/abs/1709.02371](https://arxiv.org/abs/1709.02371)
104105
- RAFT [https://arxiv.org/abs/2003.12039](https://arxiv.org/abs/2003.12039)
105106
- RAPIDFlow [https://hmorimitsu.com/publication/2024-icra-rapidflow/](https://hmorimitsu.com/publication/2024-icra-rapidflow/)

docs/source/_static/plot-memory(gb)-fp32-sintel-final-occ-val_epe.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/_static/plot-memory(gb)-fp32-sintel-final-occ-val_outlier.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/_static/plot-params-flops.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/_static/plot-sintel-final-occ-val_epe-kitti-2015-val_outlier.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/_static/plot-time(ms)-fp32-sintel-final-occ-val_epe.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/_static/plot-time(ms)-fp32-sintel-final-occ-val_outlier.html

Lines changed: 2 additions & 2 deletions
Large diffs are not rendered by default.

docs/source/models/checkpoint_list.csv

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -110,6 +110,9 @@ memflow_t-kitti-9eeabb65.ckpt,MemFlowNet_T_kitti.pth,
110110
ms_raft_plus-mixed-2bb01f62.ckpt,mixed.pth,https://github.com/cv-stuttgart/MS_RAFT_plus
111111
neuflow-things-c402aa7a.ckpt,neuflow_things.pth,https://github.com/neufieldrobotics/neuflow
112112
neuflow-sintel-0d969ea2.ckpt,neuflow_sintel.pth,
113+
neuflow2-mixed-acac1a70.ckpt,neuflow_mixed.pth,https://github.com/neufieldrobotics/NeuFlow_v2
114+
neuflow2-sintel-15c625f8.ckpt,neuflow_sintel.pth,
115+
neuflow2-things-6ed47437.ckpt,neuflow_things.pth,
113116
pwcdcnet-sintel-c7d08a46.ckpt,pwc_net.pth.tar,https://github.com/NVlabs/PWC-Net/tree/master/PyTorch
114117
pwcdcnet-things-cc223701.ckpt,pwc_net_chairs.pth.tar,
115118
pwcnet-sintel-533815e5.ckpt,pwc_net.pth.tar,

docs/source/models/models_list.rst

Lines changed: 13 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -288,8 +288,8 @@ MS-RAFT+
288288

289289
- Model names: ``ms_raft+``
290290

291-
NeuFlow
292-
-------
291+
NeuFlow v1
292+
----------
293293

294294
`[source code] <https://github.com/hmorimitsu/ptlflow/tree/main/ptlflow/models/neuflow>`__
295295

@@ -299,6 +299,17 @@ NeuFlow
299299

300300
- Model names: ``neuflow``
301301

302+
NeuFlow v2
303+
----------
304+
305+
`[source code] <https://github.com/hmorimitsu/ptlflow/tree/main/ptlflow/models/neuflow2>`__
306+
307+
- Paper: **NeuFlow v2: Push High-Efficiency Optical Flow To the Limit** - `https://arxiv.org/abs/2408.10161 <hhttps://arxiv.org/abs/2408.10161>`_
308+
309+
- Reference code: `https://github.com/neufieldrobotics/NeuFlow_v2 <https://github.com/neufieldrobotics/NeuFlow_v2>`_
310+
311+
- Model names: ``neuflow2``
312+
302313
PWCNet
303314
------
304315

docs/source/results/metrics_all.csv

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -119,6 +119,9 @@ memflow_t,kitti,2.237,0.855,0.927,0.945,7.004,6.481,1.54,0.486,0.886,0.71,0.95,0
119119
ms_raft+,mixed,0.648,0.961,0.979,0.984,1.939,2.664,0.243,0.775,0.985,0.881,0.993,0.911,0.995,10.58,0.627,1.107,0.913,0.954,0.967,4.172,3.525,0.654,0.696,0.936,0.836,0.97,0.878,0.98,15.02,2.64,1.015,0.87,0.956,0.972,3.054,0.679,0.877,0.964,0.981,1.724,,,,,,
120120
neuflow,things,1.66,0.837,0.935,0.956,6.148,5.449,0.985,0.472,0.87,0.734,0.959,0.816,0.975,25.104,3.818,3.126,0.787,0.892,0.921,10.424,7.954,2.244,0.415,0.817,0.664,0.917,0.751,0.942,32.279,7.933,5.056,0.525,0.789,0.848,20.281,11.111,0.45,0.682,0.747,30.918,,,,,,
121121
neuflow,sintel,0.988,0.871,0.952,0.97,4.411,3.414,0.609,0.552,0.901,0.787,0.973,0.856,0.985,19.69,2.49,1.294,0.838,0.93,0.955,6.463,3.933,0.889,0.517,0.865,0.756,0.95,0.831,0.971,22.786,4.53,2.297,0.673,0.887,0.931,9.489,2.06,0.645,0.868,0.922,9.539,,,,,,
122+
neuflow2,mixed,0.999,0.906,0.96,0.972,3.733,3.821,0.544,0.601,0.935,0.803,0.979,0.861,0.987,18.277,1.973,1.661,0.861,0.931,0.951,6.513,5.012,1.112,0.546,0.888,0.753,0.951,0.819,0.967,23.268,4.593,1.293,0.802,0.938,0.963,4.691,1.666,0.756,0.912,0.946,6.106,,,,,,
123+
neuflow2,sintel,0.801,0.917,0.965,0.977,3.175,3.182,0.416,0.629,0.946,0.82,0.983,0.876,0.99,16.462,1.531,1.321,0.874,0.94,0.96,5.539,4.093,0.901,0.57,0.901,0.775,0.959,0.841,0.975,20.968,3.73,1.474,0.799,0.932,0.957,5.281,1.897,0.762,0.909,0.94,6.594,,,,,,
124+
neuflow2,things,1.265,0.898,0.956,0.969,4.176,4.54,0.684,0.585,0.928,0.791,0.976,0.85,0.985,19.584,2.26,2.767,0.845,0.916,0.937,8.054,7.032,1.962,0.518,0.874,0.726,0.937,0.793,0.955,26.094,5.958,1.725,0.725,0.911,0.948,7.089,4.065,0.63,0.83,0.88,14.515,,,,,,
122125
pwcnet,things,2.643,0.801,0.909,0.934,8.811,7.733,1.697,0.369,0.835,0.65,0.937,0.749,0.958,33.673,6.064,4.059,0.749,0.871,0.904,12.592,9.855,2.943,0.337,0.78,0.599,0.898,0.7,0.927,38.921,9.872,4.042,0.545,0.788,0.854,20.243,10.288,0.452,0.662,0.731,33.014,,,,,,
123126
pwcnet,sintel,1.849,0.872,0.936,0.952,6.164,6.205,1.12,0.502,0.906,0.724,0.96,0.795,0.972,26.298,3.858,2.338,0.836,0.912,0.935,8.387,6.74,1.597,0.47,0.866,0.694,0.936,0.772,0.955,29.229,6.096,1.93,0.76,0.915,0.946,6.921,3.122,0.696,0.869,0.911,10.184,,,,,,
124127
pwcnet_nodc,things,3.329,0.724,0.88,0.917,11.639,9.577,2.164,0.271,0.758,0.549,0.915,0.678,0.947,43.948,8.154,4.769,0.675,0.843,0.885,15.416,11.502,3.454,0.257,0.704,0.516,0.874,0.636,0.913,47.481,12.212,5.29,0.503,0.743,0.811,25.053,12.274,0.414,0.633,0.704,36.11,,,,,,

0 commit comments

Comments
 (0)