QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Last update: Dec 31, 2022

Related tags

Overview

QueryDet-PyTorch

This repository is the official implementation of our paper: QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection

Requirement

a. Install Pytorch 1.4 following here

b. Install APEX following here

c. Install our Pytorch based sparse convolution operation following here

d. Install the detectron2 toolkit following here, note that we build our approach based on version 0.2.1. Note you may follow the instructions to set COCO configs

d. Clone our repository and have fun with it!

Usage

1. Data preparation

a. To prepare MS-COCO, you may follow the instructions of Detectron2

b. We provide the data preprocessing code for VisDrone2018. You need to first download dataset from here

c. Check visdrone/data_prepare.py to process the dataset

2. Training

% train coco RetinaNet baseline
python train_coco.py --config-file models/retinanet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train coco QueryDet 
python train_coco.py --config-file models/querydet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone RetinaNet baseline
python train_visdrone.py --config-file models/retinanet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone QueryDet
python train_visdrone.py --config-file models/querydet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

3. Test

% test coco RetinaNet baseline
python infer_coco.py --config-file models/retinanet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with Dense Inference
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with CSQ
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth MODEL.QUERY.QUERY_INFER True

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Related tags

Overview

QueryDet-PyTorch

Requirement

Usage

1. Data preparation

2. Training

3. Test

Owner

Chenhongyi Yang

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

Benchmarks for the Optimal Power Flow Problem

This repo provides the base code for pytorch-lightning and weight and biases simultaneous integration.

Optical machine for senses sensing using speckle and deep learning

Algorithms for outlier, adversarial and drift detection

PyTorch-Geometric Implementation of MarkovGNN: Graph Neural Networks on Markov Diffusion

Generative Adversarial Networks for High Energy Physics extended to a multi-layer calorimeter simulation

An end-to-end framework for mixed-integer optimization with data-driven learned constraints.

This example implements the end-to-end MLOps process using Vertex AI platform and Smart Analytics technology capabilities

Voice Conversion Using Speech-to-Speech Neuro-Style Transfer

[ICCV 2021] Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification

Semantic Segmentation for Aerial Imagery using Convolutional Neural Network

This program will stylize your photos with fast neural style transfer.

上海交通大学全自动抢课脚本，支持准点开抢与抢课后持续捡漏两种模式。2021/06/08更新。

PyTorch implementation of "Contrast to Divide: self-supervised pre-training for learning with noisy labels"

Winners of DrivenData's Overhead Geopose Challenge

FridaHookAppTool - Frida Hook App Tool With Python

Repository for RNNs using TensorFlow and Keras - LSTM and GRU Implementation from Scratch - Simple Classification and Regression Problem using RNNs

[CVPR 2021] A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts

Implementation of Kronecker Attention in Pytorch