CT Segmentation

All kinds of models and scripts for data processing and visualizations.

Environment

Python3.12 is recommended. Libraries are managed by https://python-poetry.org/

After installing poetry, run this to start poetry venv:

poetry install

Create a jupyter kernel from venv:

poetry run python -m ipykernel install --user --name ctseg-py3.12

To edit or remove kernels:

jupyter kernelspec list
jupyter kernelspec remove KERNEL_NAME

2D Segmentation with BBox Prompt

• Main folder: 2d_seg_and_video
• Training: 2d_seg_and_video/2d_box_seg.ipynb
• Processing logic mostly in: 2d_seg_and_video/dataset.py
  • Cropping and resizing
  • Adding bbox prompt

• Green: true positive
• Red: false positive
• Purple: false negative

Dataset

DeepLesion 3D subset of the ULS23 dataset

• 743 3D lesion segmentations
• 4538 2D slices
• train/val split done by lesions to avoid data leakage

Video Generation

AutoPET

Dataset that we are labeling and reviewing (2024-2025).

Script: notebooks/ct_video.ipynb

ULS23

• Download all 6 .zip parts files from https://github.com/DIAGNijmegen/ULS23/
• Unzip all 6 parts such that they are in the same folder
  • The folder should contain fragmented zip files (.z01, .z02, ...) for all 6 parts
• Unzip the fragmented zip files

sudo apt update
sudo apt install p7zip-full

7z x ULS23_Part1.zip
7z x ULS23_Part2.zip
...

Labels in git repo - merge the label folder with the existing ULS23 data folder.

3D segmentation

• Main folder: 3d_seg

CT-FM Seg Model

• Project page: https://aim.hms.harvard.edu/ct-fm
• Model: https://huggingface.co/project-lighter/whole_body_segmentation

Out of the box results on AutoPET

Relevant files

• patching.ipynb Scripts to split existing datasets into patches
• ct-fm.ipynb Scripts for testing and training ct-fm seg model
• lesion3D Dataset folder in the Kingston SSD

nnUNetv2

nnUNet repo All commands below should be run in the nnUNet project directory.

Relevant files

• nnunet_data_proc.ipynb Scripts to generate raw data
• nnUNet_raw Dataset folder in the Kingston SSD

Setting up

Set env variables e.g. by creating an env.sh file:

export nnUNet_raw="path/to/nnUNet_raw"
export nnUNet_preprocessed="/path/to/nnUNet_preprocessed/"
export nnUNet_results="/path/to/nnUNet_results"

Apply them in terminal:

source env.sh

Preprocess

At 64GB memory, 2 processes -np 2 is the max possible on this dataset. Proocessed data will be stored at the nnUNet_preprocessed path.

nnUNetv2_plan_and_preprocess -d 1 -np 2

Train

Train model dataset 1 on the 2nd cross-validation fold. Change 2 to any value from 1-5 to train on other of the 5 folds.

nnUNetv2_train 1 3d_fullres 2 --npz

Other training config are 2d, 3d_lowres, 3d_cascade_fullres. The log and results will be stored at the nnUNet_preprocessed path.

Resume Training

Save the best and final checkpoints from previous run before running this:

nnUNetv2_train 1 3d_fullres all --npz -pretrained_weights path/to/checkpoint.pth