Image Object Segmentation Visual Quality Evaluation Database

Ran SHI    King Ngi NGAN   Songnan LI

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong



Online Subjective Survey

Online Subjective Survey


Download: 

The subjective survey is performed in two sessions. And the obtained subjective ratings are also processed separately.

Download the image object segmentation visual quality evaluation database link.

For requiring the unzipping password, please contact the investigator Ran SHI (1155038598@link.cuhk.edu.hk) .


How to Cite this Database:  

This website accompanies our papers:

@article{shi2015visual,
  title={Visual Quality Evaluation of Image Object Segmentation: Subjective Assessment and Objective Measure},
  author={Shi, Ran and Ngan, King Ngi and Li, Songnan and Paramesran, Raveendran and Li, Hongliang},
  journal={Image Processing, IEEE Transactions on},
  volume={24},
  number={12},
  pages={5033--5045},
  year={2015},
  publisher={IEEE}
}

Please cite the above  papers if you use any part of the images, or data supplied in this website.


Note that our database borrowed sources from other public object segmentation databases and object segmentation methods.

The original images and ground truth are selected from five popular databases:

1) Weizmann Segmentation Evaluation Database http://www.wisdom.weizmann.ac.il/~vision/Seg_Evaluation_DB/index.html

2) Visual Object Classes Challenge 2012 (VOC2012) http://pascallin.ecs.soton.ac.uk/challenges/VOC/voc2012/

3) MSRA Salient Object Database (Image Set B) http://research.microsoft.com/en-us/um/people/jiansun/SalientObject/salient_object.htm

  Ground Truth is provided by Achanta http://ivrg.epfl.ch/people/achanta

4) Microsoft research Cambridge’s grabcut dataset http://research.microsoft.com/en-us/um/cambridge/projects/visionimagevideoediting/segmentation/grabcut.htm

5) Berkely Segmentation Dataset http://www.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/

  Ground Truth is provided by 4)

 

Eight object segmentation methods are adopted in our survey:

1) Four interactive object segmentation methods: The Interactive Segmentation Tool http://www.eeng.dcu.ie/~mcguinne/software/index.html

McGuinness, Kevin, and Noel E. O’Connor. "A comparative evaluation of interactive segmentation algorithms." Pattern Recognition 43.2 (2010): 434-444.

2) Grabcut method: Interactive Segmentation Tool-Box: http://www.cs.cmu.edu/~mohitg/segmentation.htm

Rother, Carsten, Vladimir Kolmogorov, and Andrew Blake. "Grabcut: Interactive foreground extraction using iterated graph cuts." ACM Transactions on Graphics. Vol. 23. No. 3. ACM, 2004.

3) LeveL Set method: http://www.engr.uconn.edu/~cmli/

C. Li, C. Xu, C. Gui, and M. D. Fox, "Distance Regularized Level Set Evolution and its Application to Image Segmentation", IEEE Trans. Image Processing, vol. 19 (12), pp. 3243-3254, 2010

4) Rahtu’s automatic method: http://www.ee.oulu.fi/~erahtu/

E. Rahtu, J. Kannala, M. Salo, and J. Heikkila, “Segmenting salient objects from images and videos,” Proc. ECCV, pp. 366-379, Sept. 2010.

5) Achanta’s automatic method: http://ivrg.epfl.ch/people/achanta

R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, “Frequency-tuned salient region detection,” Proc. IEEE CVPR, pp. 1597-1604, Jun. 2009


Copyright Notice:

Copyright (c) 2011 The Chinese University of Hong Kong

All rights reserved. Permission is hereby granted, without written agreement and without license or royalty fees, to use, copy, and distribute this database (the images, the results, and the source files) and its documentation for non-commercial research and educational purposes only, provided that the copyright notice in its entirety appear in all copies of this database, and the original source of this database, Image and Video Processing Laboratory (IVP, http://ivp.ee.cuhk.edu.hk/) at The Chinese University of Hong Kong, is acknowledged in any publication that reports research using this database.

IN NO EVENT SHALL THE CHINESE UNIVERSITY OF HONG KONG BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL LOSS OR DAMAGES ARISING OUT OF OR IN CONNECTION WITH THE USE OF OR THE INABILITY TO USE THIS DATABASE, ITS DOCUMENTATION AND INFORMATION, EVEN IF THE CHINESE UNIVERSITY OF HONG KONG HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH LOSS OR DAMAGE.

THE CHINESE UNIVERSITY OF HONG KONG SPECIFICALLY DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, ACCURACY OR COMPLETENESS AND NON INFRINGEMENT OF INTELLECTUAL PROPERTY RIGHTS OF ANY PARTY. THE DATABASE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND THE CHINESE UNIVERSITY OF HONG KONG HAS NO OBLIGATION TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.