The progress of week 3 and week 4

December 22, 2008

Work item

Web query interface and multiple feature fusion

Description

In those weeks, Web query interface is refined. The search results are based on two visual features that are GCM and Gabor.

An average fusion approach is used then to obtain final search scores for photos in data set.

For annotation part, the system currently provides three types of strategies, which are representative tags, TDIDF tags and frequent tags.

Observation

The suggested annotations or tags for a given photo contain a lot of noises. Due to the semantic gap existing in current CBIR systems, the suggested tags are somehow unrelated to the purpose of user.

A possible approach to solve this problem is going to rely on a given search term using as a preliminary term.

Next stage it is worth trying inducing Ontologies from tags. Ontology may help user to find and annotate photos more appropriate.

The progress of week 2

December 1, 2008

Work item

CBIR component and Web interface

Description

Basic CBIR service is done. There is an online service running to serve GCM feature query for Flickr550k dataset.

The Web interface is based on smallbighead’s Flickr550k text-based query interface.

A proposed user scenario is:

1. User sends text query on text-based query interface to obtain related flickr photos from Flickr550k dataset.

2. User browsers details of particular photo.

3. User sends CBIR-based query for the photo.

4. System retrieves visually related flickr photos from Flickr550k dataset and presents to user.

The progress of week 1

November 18, 2008

Work item

CBIR component

Description

We have tried to apply GCM feature of Flickr550 with kd-tree. In first look, the retrieval speed is fast. Despite of the small dimension (225 for GCM), it is quite a good news for later implementation.

What is the project?

November 18, 2008

Abstract

In this project, an annotation by search system will be designed and implemented. The whole system is based on Web-based architecture. The goal of the project is the construction of a baseline of annotation by search. This baseline could be expanded later and be added novel features.

Dataset

The project uses Flickr550 dataset as the image database for CBIR component.

Architecture

  • CBIR component
  • Web annotation baseline interface

Schedule

  • CBIR component will be implemented in 2 weeks
  • Web interface will be implemented in 2 weeks

Follow

Get every new post delivered to your Inbox.