The Wayback Machine - https://web.archive.org/web/20211105112226/https://github.com/open-mmlab/mmdetection3d/issues/16
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Roadmap of MMDetection3d #16

Open
6 of 7 tasks
hellock opened this issue Jul 13, 2020 · 30 comments
Open
6 of 7 tasks

Roadmap of MMDetection3d #16

hellock opened this issue Jul 13, 2020 · 30 comments

Comments

@hellock
Copy link
Member

@hellock hellock commented Jul 13, 2020

We keep this issue open to collect feature requests from users and hear your voice. Our monthly release plan is also available here.

You can either:

  1. Suggest a new feature by leaving a comment.
  2. Vote for a feature request with 👍 or be against with 👎. (Remember that developers are busy and cannot respond to all feature requests, so vote for your most favorable one!)
  3. Tell us that you would like to help implement one of the features in the list or review the PRs. (This is the greatest things to hear about!)

V0.7.0 (October-November)

  • Switch visualization backend to Open3D
  • More performance on Waymo, nuScenes, SUN RGB-D, and ScanNet dataset

V0.6.0 (September)

@turboxin
Copy link

@turboxin turboxin commented Jul 15, 2020

Hi all, thanks for releasing this wonderful project$1�7

I 'm wondering what's your recent development plan for new models or methods?

@thuyngch
Copy link

@thuyngch thuyngch commented Jul 15, 2020

In the previous version (PCDet), I see that PV-RCNN is supported. However, it is not supported now. So, I hope to see PV-RCNN again.

@hellock
Copy link
Member Author

@hellock hellock commented Jul 15, 2020

In the previous version (PCDet), I see that PV-RCNN is supported. However, it is not supported now. So, I hope to see PV-RCNN again.

PCDet and mmdet3d are two different codebases. You may refer to PCDet for PV-RCNN now, and we will support it in mmdet3d soon.

@SilvioGiancola
Copy link

@SilvioGiancola SilvioGiancola commented Jul 20, 2020

Thanks for the development of MMDetection3d. I would appreciate the support for the Waymo Dataset.

@chuong98
Copy link

@chuong98 chuong98 commented Jul 21, 2020

Thanks for the opensource. Can we support 3DSSD https://github.com/Jia-Research-Lab/3DSSD?
It seems achieve both good speed and high AP.
Thank you.

@zehanzhang
Copy link

@zehanzhang zehanzhang commented Aug 21, 2020

Can we support SA-SSD https://github.com/skyhehe123/SA-SSD?The AP and speed is also good.

@hhcNUAA
Copy link

@hhcNUAA hhcNUAA commented Sep 5, 2020

Hello, this code can visualize the 3D detection box in the point cloud, may I ask if the 3D detection box can be visualized in the 2D image,and how do we do that?

@ChunmianLin
Copy link

@ChunmianLin ChunmianLin commented Sep 17, 2020

Hi. all. I hope to see the implementation of pseudo LiDAR in mmdetection3d. And also, I think more visualization of data processing and detection result are required, too.
Thanks.

@AllenPeng0209
Copy link

@AllenPeng0209 AllenPeng0209 commented Oct 12, 2020

Hi, all.
the current strongest backbone SPVNAS could be a good thing to implement.
Also, it's new library torchsparse is much faster than the current library.

https://github.com/mit-han-lab/torchsparse
https://github.com/mit-han-lab/e3d/blob/master/spvnas/core/models/semantic_kitti/spvnas.py

@PersistentXQ
Copy link

@PersistentXQ PersistentXQ commented Oct 19, 2020

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

@ZwwWayne
Copy link
Collaborator

@ZwwWayne ZwwWayne commented Oct 19, 2020

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

@PersistentXQ
Copy link

@PersistentXQ PersistentXQ commented Oct 20, 2020

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

ZwwWayne, thank you very much for your answer. I think I asked a wrong question 1�7 The new kitti-like dataset (x,y,z,intensity,another feature) have already been made. The question is how I can train the model with my dataset. I tried to change the "load_dims" and "use_dims" in configs from 4 to 5, but some errors were threw 1�7 After I fixed these errors, another errors were threw again 1�7 Now the newest error is Runtime Error: size mismatch.

@ZwwWayne
Copy link
Collaborator

@ZwwWayne ZwwWayne commented Oct 20, 2020

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

ZwwWayne, thank you very much for your answer. I think I asked a wrong question 1�7 The new kitti-like dataset (x,y,z,intensity,another feature) have already been made. The question is how I can train the model with my dataset. I tried to change the "load_dims" and "use_dims" in configs from 4 to 5, but some errors were threw 1�7 After I fixed these errors, another errors were threw again 1�7 Now the newest error is Runtime Error: size mismatch.

Feel free to create a new issue to describe your issues following the reimplementation issues template if you need some help. This issue is mainly about the roadmap.

@ZwwWayne
Copy link
Collaborator

@ZwwWayne ZwwWayne commented Oct 20, 2020

Hi, all.
the current strongest backbone SPVNAS could be a good thing to implement.
Also, it's new library torchsparse is must faster than the current library.

https://github.com/mit-han-lab/torchsparse
https://github.com/mit-han-lab/e3d/blob/master/spvnas/core/models/semantic_kitti/spvnas.py

Thanks for the suggestion. We will investigate these repos and may change the dependency if necessary.

@YoushaaMurhij
Copy link

@YoushaaMurhij YoushaaMurhij commented Nov 4, 2020

Can you add support for sematic-kitti ?

@ZwwWayne ZwwWayne closed this Nov 5, 2020
@ZwwWayne ZwwWayne reopened this Nov 5, 2020
@chasingw
Copy link

@chasingw chasingw commented Nov 17, 2020

any plan for ONNX support?

@ZwwWayne
Copy link
Collaborator

@ZwwWayne ZwwWayne commented Nov 22, 2020

any plan for ONNX support?

This is a planned feature, but we may not support it very soon. So PRs are also welcomed.

@qinsimon
Copy link

@qinsimon qinsimon commented Nov 30, 2020

Thanks for your job. And it would be nice if cuda11.1/torch1.7 are compatible

@chakri1804
Copy link

@chakri1804 chakri1804 commented Dec 23, 2020

Can you add support for Pandaset ?

@filaPro
Copy link
Contributor

@filaPro filaPro commented Jan 2, 2021

Do you have plans to release the code for your FCOS3D on NuScenes in near future?

@Tai-Wang
Copy link
Member

@Tai-Wang Tai-Wang commented Jan 2, 2021

Do you have plans to release the code for your FCOS3D on NuScenes in near future?

Yes. More information could be referred to #247 .

@Jsijon
Copy link

@Jsijon Jsijon commented Jan 31, 2021

Can you support Cirrus dataset ?
https://arxiv.org/abs/2012.02938

@Wuziyi616
Copy link
Collaborator

@Wuziyi616 Wuziyi616 commented Apr 19, 2021

Hello, this code can visualize the 3D detection box in the point cloud, may I ask if the 3D detection box can be visualized in the 2D image,and how do we do that?

Hi, this multi-modality visualization has been supported recently. Check out our demo and how to use for it!

@xinghuokang
Copy link

@xinghuokang xinghuokang commented Jun 23, 2021

any plan for ONNX support?

This is a planned feature, but we may not support it very soon. So PRs are also welcomed.

when to support onnx?

@zehuichen123
Copy link
Contributor

@zehuichen123 zehuichen123 commented Jul 4, 2021

Any plans for Range-View 3D detection models? such as RCD, RangeDet, RSN(CVPR2021), ToThePoint(CVPR2021).

@ZwwWayne
Copy link
Collaborator

@ZwwWayne ZwwWayne commented Jul 5, 2021

Any plans for Range-View 3D detection models? such as RCD, RangeDet, RSN(CVPR2021), ToThePoint(CVPR2021).

We are actually planning for it. Do you have any recommendations?

@zehuichen123
Copy link
Contributor

@zehuichen123 zehuichen123 commented Jul 6, 2021

Any plans for Range-View 3D detection models? such as RCD, RangeDet, RSN(CVPR2021), ToThePoint(CVPR2021).

We are actually planning for it. Do you have any recommendations?

I think RSN is a great choice though it does not ONLY use range view compared to RangeDet, ToThePoint or RCD :)

@AfonsoSalgadoSousa
Copy link

@AfonsoSalgadoSousa AfonsoSalgadoSousa commented Aug 16, 2021

I would love to see more Mono3D, Stereo3D, and Camera+LiDAR detectors. Maybe RTM3D, YoloStereo3D and Frustum-PointNet.

@fortkord
Copy link

@fortkord fortkord commented Sep 16, 2021

I would really appreciate seeing the implementation of MoCa since it has been announced quite some time ago, as well as more (real-time) camera-lidar pipelines. Happy to list some examples if necessary

@victoryc
Copy link

@victoryc victoryc commented Oct 10, 2021

It will be nice to support 3D semantic labeling and 3D instance segmentation, along with sparse convolution functionality.
Some examples of items that would be good to have are:

  • 3D Unet
  • PointGroup
  • OccuSeg
  • PointTransformer
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment