You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: vimunet.md
+11-10
Original file line number
Diff line number
Diff line change
@@ -1,25 +1,25 @@
1
-
# ViM-UNet: Vision Mamba in Biomedical Segmentation*
1
+
# ViM-UNet: Vision Mamba in Biomedical Segmentation
2
2
3
-
We introduce **ViM-UNet**. a novel segmentation architecture based on Vision Mamba for instance segmentation in microscopy.
3
+
We introduce **ViM-UNet**, a novel segmentation architecture based on [Vision Mamba](https://github.com/hustvl/Vim) for instance segmentation in microscopy.
4
4
5
5
This is the documentation for the installation instructions, known issues and linked suggestions, benchmarking scripts, and link to the tutorial notebook.
6
6
7
7
## TLDR
8
8
1. Please install [`torch-em`](https://github.com/constantinpape/torch-em) and `ViM` (based on our fork: https://github.com/anwai98/Vim)
9
9
2. Supports `ViM Tiny` and `ViM Small` for 2d segmentation using ViM-UNet.
10
-
3.*More details on the preprint coming soon.
11
-
-Our observations: "ViM-UNet performs similarly or better that UNet (depending on the task), and outperforms UNETR while being more efficient."
10
+
3.Our preprint on ViMUNet will be available soon.
11
+
-The key observation: "ViM-UNet performs similarly or better that UNet (depending on the task), and outperforms UNETR while being more efficient. Its main advantages is for segmentation problems that rely on large context."
> [Here](https://github.com/anwai98/vimunet-benchmarking) are the scripts to run the benchmarking for the aforementioned external methods.
22
+
> [Here](https://github.com/anwai98/vimunet-benchmarking) are the scripts to run the benchmarking for the reference methods.
23
23
24
24
1. nnU-Net (see [here](https://github.com/MIC-DKFZ/nnUNet) for installation instructions)
25
25
2. U-Mamba (see [here](https://github.com/bowang-lab/U-Mamba#installation) for installation instructions, and [issues]() encountered with our suggestions to take care of them)
> Q1. Why use `pip`? - for installation consistency
42
42
43
-
> Q2. Why choose CUDA 11.8? - Vim seems to prefer $\le$ 11.8 ([hint](https://github.com/hustvl/Vim/issues/51))
43
+
> Q2. Why choose CUDA 11.8? - Vim seems to prefer $\le$ 11.8 ([see here](https://github.com/hustvl/Vim/issues/51))
44
44
45
45
4. Install `ViM` and related dependencies (`causal-conv1d`\**, `mamba`, `Vim`\***):
46
46
```bash
@@ -53,6 +53,7 @@ $ pip install -e .
53
53
```
54
54
55
55
> NOTE: The installation is sometimes a bit tricky, but following the steps and keeping the footnotes in mind should do the trick.
56
+
> We are working on providing an easier and more stable installation, [see this issue](https://github.com/constantinpape/torch-em/issues/237).
56
57
57
58
### For UNet and UNETR
58
59
@@ -77,4 +78,4 @@ $ pip install -e .
77
78
- Suggestion: This one's a bit tricky. From our findings, the possible issue is that the path to `CUDA_HOME` isn't visible to the installed PyTorch. The quickest way to test this is: `python -c "from torch.utils.cpp_extension import CUDA_HOME; print(CUDA_HOME)"`. It's often stored at `/usr/local/cuda`, hence to expose the path, here's the example script: `export CUDA_HOME=/usr/local/cuda`.
78
79
> NOTE: If you are using your cluster's cuda installation and not sure where is it located, this should do the trick: `module show cuda/$VERSION`
79
80
80
-
- ***Remember to install the suggested `ViM` branch for installation. It's important as we enable a few changes to: a) automatically install the vision mamba as a developer module, and b) setting AMP to false for known issues (see [mention 1](https://github.com/hustvl/Vim/issues/30) and [mention 2](https://github.com/bowang-lab/U-Mamba/issues/8) for hints)
81
+
- ***Remember to install the suggested `ViM` branch for installation. It's important as we enable a few changes to: a) automatically install the vision mamba as a developer module, and b) setting AMP to false for known issues (see [mention 1](https://github.com/hustvl/Vim/issues/30) and [mention 2](https://github.com/bowang-lab/U-Mamba/issues/8) for hints)
0 commit comments