Fruit Recognition – Continuing Research

27/05/14
Share

DataArt Research Lab continues to publish the results of fruit recognition using the Color Distance method.

The Color Distance method showed good result as an engine for fruit recognition. Just for testing purposes, we took 15 classes of fruits (10 ‘ideal’ samples for each class) and a simple classifier of Euclidian distance. But such an approach has serious disadvantages:

  • in everyday life we do not deal with ideal pictures: the photos may contain different distortions, irregular brightness etc.;
  • the classifier of Euclidian distance cannot provide us with real time work, particularly if we have a lot of classes and etalons.

So our next step is to use a more complicated real time working classifier and increase the sample set with new ‘real’ images.

To obtain images that are more alike to a working environment, we created a HSV-filter. The filter changes the values of Saturation (S) and Brightness (V) and generates dark, light, more and less ‘gray’ images:

As a result, we generated over 800 samples for 15 classes.

Classifier selection – this is a very important step for recognition system development.

The main requirements for the classifier in our system are:

  • ability to detect nonlinear relationships between dependent and independent variables;
  • simple training and retraining procedures;
  • realtime results.

All these features can be provided for by a simple neural network: a multi-layer perceptron. In our system the neural net has 3 layers: input, hidden and output, that contains a corresponding 72, 12 and 15 nodes. The network learns with a back propagation algorithm with 10000 iterations and an error of 0.147.

The results of the neural net is shown in the picture:

Note: the numbers in the circles represent the amount of correctly recognized samples; the numbers –on the arrows represent the amount of incorrectly recognized samples; the pointers lead from the class which they were incorrectly recognized as to the correct class.

Some of the classes (Gooseberry, Grapefruit, Kiwifruit, Lemon, Lingonberry, Orange-mandarin, Pear, Persimmon, Plum, Raspberry, Strawberry) are recognized quite well, some of them (Apricot, Banana, Blackberry, Blueberry) quite badly. More detailed results for each class are given below.

The poor results are probably obtained because using only a Color Distance method is not enough for parameterization. To improve the suituation we need to implement another parameterization method, for instance, a texture analyzer. But this is the next step in our investigation and topic for the next post.

[caption id="attachment_4260" align="alignnone" width="250"] Banana (5/20)[/caption] [caption id="attachment_4263" align="alignnone" width="250"] Blackberry (12/26)[/caption]

[caption id="attachment_4266" align="alignnone" width="250"] Apricot (3/17)[/caption] [caption id="attachment_4267" align="alignnone" width="250"] Blueberry (22/73)[/caption]

[caption id="attachment_4268" align="alignnone" width="250"] Gooseberry (48/55)[/caption] [caption id="attachment_4269" align="alignnone" width="250"] Grapefruit (32/34)[/caption]

[caption id="attachment_4270" align="alignnone" width="250"] Lemon (37/38)[/caption] [caption id="attachment_4272" align="alignnone" width="250"] Pear (21/30)[/caption]
[caption id="attachment_4271" align="alignnone" width="250"] Lingonberry (67/69)[/caption]

[caption id="attachment_4273" align="alignnone" width="250"] Plum (28/34)[/caption]

[caption id="attachment_4274" align="alignnone" width="250"] Raspberry (50/54)[/caption]

[caption id="attachment_4279" align="alignnone" width="76"] Kiwifruit[/caption] [caption id="attachment_4276" align="alignnone" width="101"] Orange-mandarin[/caption] [caption id="attachment_4277" align="alignnone" width="122"] Persimmon[/caption] [caption id="attachment_4278" align="alignnone" width="71"] Strawberry[/caption]

Sign Up for Updates!

Subscribe now to receive industry-related articles and updates

Choose industries of interest
Thank You for Joining!

You will receive regular updates based on your interests. No spam guaranteed

Add another email address
Read more
Sign Up for Updates!
Choose industries of interest
Thank You for Joining!

You will receive regular updates based on your interests. No spam guaranteed

Add another email address
Welcome
We are glad you found us
Please explore our services and find out how we can support your business goals.
Get in Touch
travel-risk-management-social.png
Download the white paper «Brave New World»: Information Technology in the Post-COVID Environment

DataArt experts and practice leaders examine the role information technologies will play in helping businesses across multiple industrial sectors respond to the «new normal» demands.