skip to main content
research-article

Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification

Published: 01 August 2017 Publication History

Abstract

Genetic programming (GP) is a well-known evolutionary computation technique, which has been successfully used to solve various problems, such as optimization, image analysis, and classification. Transfer learning is a type of machine learning approach that can be used to solve complex tasks. Transfer learning has been introduced to GP to solve complex Boolean and symbolic regression problems with some promise. However, the use of transfer learning with GP has not been investigated to address complex image classification tasks with noise and rotations, where GP cannot achieve satisfactory performance, but GP with transfer learning may improve the performance. In this paper, we propose a novel approach based on transfer learning and GP to solve complex image classification problems by extracting and reusing blocks of knowledge/information, which are automatically discovered from similar as well as different image classification tasks during the evolutionary process. The proposed approach is evaluated on three texture data sets and three office data sets of image classification benchmarks, and achieves better classification performance than the state-of-the-art image classification algorithm. Further analysis on the evolved solutions/trees shows that the proposed approach with transfer learning can successfully discover and reuse knowledge/information extracted from similar or different problems to improve its performance on complex image classification problems.

References

[1]
S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345–1359, Oct. 2010.
[2]
P. Stone and M. Veloso, “Layered learning,” in Proc. Eur. Conf. Mach. Learn., vol. 1810. Barcelona, Spain, 2000, pp. 369–381.
[3]
A. H. Gandomi, A. H. Alavi, and C. Ryan, Handbook of Genetic Programming Applications. Cham, Switzerland: Springer, 2015.
[4]
J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA, USA: MIT Press, 1992.
[5]
D. Jackson and A. P. Gibbons, “Layered learning in boolean GP problems,” in Proceedings of the European Conference on Genetic Programming (LNCS 4445). Heidelberg, Germany: Springer, 2007, pp. 148–159.
[6]
H. Al-Sahaf, A. Song, K. Neshatian, and M. Zhang, “Two-tier genetic programming: Towards raw pixel-based image classification,” Expert Syst. Appl., vol. 39, no. 16, pp. 12291–12301, 2012.
[7]
Y. Li, J. Ma, and Q. Zhao, “Two improvements in genetic programming for image classification,” in Proc. IEEE Congr. Evol. Comput., Hong Kong, 2008, pp. 2492–2497.
[8]
H. Al-Sahaf, M. Zhang, M. Johnston, and B. Verma, “Image descriptor: A genetic programming approach to multiclass texture classification,” in Proc. IEEE Congr. Evol. Comput., Sendai, Japan, 2015, pp. 2460–2467.
[9]
A. Lensen, H. Al-Sahaf, M. Zhang, and B. Xue, “A hybrid genetic programming approach to feature detection and image classification,” in Proc. 30th Int. Conf. Image Vis. Comput. New Zealand, Auckland, New Zealand, 2015, pp. 1–6.
[10]
K. Krawiec and B. Wieloch, “Automatic generation and exploitation of related problems in genetic programming,” in Proc. IEEE Congr. Evol. Comput., Barcelona, Spain, 2010, pp. 1–8.
[11]
N. T. Hien, N. X. Hoai, and B. McKay, “A study on genetic programming with layered learning and incremental sampling,” in Proc. IEEE Congr. Evol. Comput., New Orleans, LA, USA, 2011, pp. 1179–1185.
[12]
T.-H. Hoang, R. I. B. McKay, D. Essam, and N. X. Hoai, “On synergistic interactions between evolution, development and layered learning,” IEEE Trans. Evol. Comput., vol. 15, no. 3, pp. 287–312, Jun. 2011.
[13]
Q. Chen, B. Xue, and M. Zhang, “Generalisation and domain adaptation in GP with gradient descent for symbolic regression,” in Proc. IEEE Congr. Evol. Comput., Sendai, Japan, 2015, pp. 1137–1144.
[14]
W. Jaśkowski, K. Krawiec, and B. Wieloch, “Cross-task code reuse in genetic programming applied to visual learning,” Int. J. Appl. Math. Comput. Sci., vol. 24, no. 1, pp. 183–197, 2014.
[15]
T. T. H. Dinh, T. H. Chu, and Q. U. Nguyen, “Transfer learning in genetic programming,” in Proc. IEEE Congr. Evol. Comput., Sendai, Japan, 2015, pp. 1145–1151.
[16]
M. Iqbal, B. Xue, and M. Zhang, “Reusing extracted knowledge in genetic programming to solve complex texture image classification problems,” in Proc. Pac.–Asia Knowl. Disc. Data Min. Conf. II, Auckland, New Zealand, 2016, pp. 117–129.
[17]
M. Hauschild, M. Pelikan, K. Sastry, and C. Lima, “Analyzing probabilistic models in hierarchical BOA,” IEEE Trans. Evol. Comput., vol. 13, no. 6, pp. 1199–1217, Dec. 2009.
[18]
S. J. Pan, I. W. Tsang, J. T. Kwok, and Q. Yang, “Domain adaptation via transfer component analysis,” IEEE Trans. Neural Netw., vol. 22, no. 2, pp. 199–210, Feb. 2011.
[19]
J. Luet al., “Transfer learning using computational intelligence: A survey,” Knowl. Based Syst., vol. 80, pp. 14–23, May 2015.
[20]
R. Santana, R. Armañanzas, C. Bielza, and P. Larrañaga, “Network measures for information extraction in evolutionary algorithms,” Int. J. Comput. Intell. Syst., vol. 6, no. 6, pp. 1163–1188, 2013.
[21]
B. Koçer and A. Arslan, “Genetic transfer learning,” Expert Syst. Appl., vol. 37, no. 10, pp. 6997–7002, 2010.
[22]
A. Moshaiov and A. Tal, “Family bootstrapping: A genetic transfer learning approach for onsetting the evolution for a set of related robotic tasks,” in Proc. IEEE Congr. Evol. Comput., Beijing, China, 2014, pp. 2801–2808.
[23]
S. Yang and X. Yao, “Population-based incremental learning with associative memory for dynamic environments,” IEEE Trans. Evol. Comput., vol. 12, no. 5, pp. 542–561, Oct. 2008.
[24]
M. Mavrovouniotis and S. Yang, Direct Memory Schemes for Population-Based Incremental Learning in Cyclically Changing Environments. Cham, Switzerland: Springer, 2016, pp. 233–247.
[25]
L. Feng, Y.-S. Ong, A.-H. Tan, and I. W. Tsang, “Memes as building blocks: A case study on evolutionary optimization + transfer learning for routing problems,” Memetic Comput., vol. 7, no. 3, pp. 159–180, 2015.
[26]
R. Meuth, M.-H. Lim, Y.-S. Ong, and D. C. Wunsch, II, “A proposition on memes and meta-memes in computing for higher-order learning,” Memetic Comput., vol. 1, no. 2, pp. 85–100, 2009.
[27]
A. Gupta, Y.-S. Ong, and L. Feng, “Multifactorial evolution: Toward evolutionary multitasking,” IEEE Trans. Evol. Comput., vol. 20, no. 3, pp. 343–357, Jun. 2016.
[28]
Y.-S. Ong and A. Gupta, “Evolutionary multitasking: A computer science view of cognitive multitasking,” Cogn. Comput., vol. 8, no. 2, pp. 125–142, 2016.
[29]
D. Lim, Y. S. Ong, A. Gupta, C. K. Goh, and P. S. Dutta, “Towards a new Praxis in optinformatics targeting knowledge re-use in evolutionary computation: Simultaneous problem learning and optimization,” Evol. Intell., vol. 9, no. 4, pp. 203–220, 2016. 10.1007/s12065-016-0146-1.
[30]
S. M. Gustafson and W. H. Hsu, “Layered learning in genetic programming for a cooperative robot soccer problem,” in Proc. Eur. Conf. Genet. Program., 2001, pp. 291–301.
[31]
N. T. Hien and N. X. Hoai, “Learning in stages: A layered learning approach for genetic programming,” in Proc. Int. Conf. Comput. Commun. Technol. Res. Innov. Vis. Future, Ho Chi Minh City, Vietnam, 2012, pp. 1–4.
[32]
N. X. Hoai, R. I. B. McKay, and D. Essam, “Representation and structural difficulty in genetic programming,” IEEE Trans. Evol. Comput., vol. 10, no. 2, pp. 157–166, Apr. 2006.
[33]
M. Iqbal, W. N. Browne, and M. Zhang, “Reusing building blocks of extracted knowledge to solve complex, large-scale boolean problems,” IEEE Trans. Evol. Comput., vol. 18, no. 4, pp. 465–480, Aug. 2014.
[34]
I. M. Alvarez, W. N. Browne, and M. Zhang, “Human-inspired scaling in learning classifier systems: Case study on the N-bit multiplexer problem set,” in Proc. Genet. Evol. Comput. Conf., Denver, CO, USA, 2016, pp. 429–436.
[35]
P. G. Espejo, S. Ventura, and F. Herrera, “A survey on the application of genetic programming to classification,” IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, no. 2, pp. 121–144, Mar. 2010.
[36]
C. B. Perez and G. Olague, “Evolutionary learning of local descriptor operators for object recognition,” in Proc. 11th Annu. Conf. Genet. Evol. Comput., Montreal, QC, Canada, 2009, pp. 1051–1058.
[37]
K. Neshatian, M. Zhang, and P. Andreae, “A filter approach to multiple feature construction for symbolic learning classifiers using genetic programming,” IEEE Trans. Evol. Comput., vol. 16, no. 5, pp. 645–661, Oct. 2012.
[38]
U. Bhowan, M. Johnston, M. Zhang, and X. Yao, “Evolving diverse ensembles using genetic programming for classification with unbalanced data,” IEEE Trans. Evol. Comput., vol. 17, no. 3, pp. 368–386, Jun. 2013.
[39]
H. Al-Sahaf, M. Zhang, and M. Johnston, “Binary image classification: A genetic programming approach to the problem of limited training instances,” Evol. Comput., vol. 24, no. 1, pp. 143–182, 2016. 10.1162/EVCO_a_00146.
[40]
D. L. Atkins, K. Neshatian, and M. Zhang, “A domain independent genetic programming approach to automatic feature extraction for image classification,” in Proc. IEEE Congr. Evol. Comput., New Orleans, LA, USA, 2011, pp. 238–245.
[41]
D. Agnelli, A. Bollini, and L. Lombardi, “Image classification: An evolutionary approach,” Pattern Recognit. Lett., vol. 23, nos. 1–3, pp. 303–309, 2002.
[42]
W. A. Albukhanajer, J. A. Briffa, and Y. Jin, “Evolutionary multiobjective image feature extraction in the presence of noise,” IEEE Trans. Cybern., vol. 45, no. 9, pp. 1757–1768, Sep. 2015.
[43]
K. Krawiec and B. Bhanu, “Visual learning by evolutionary and coevolutionary feature synthesis,” IEEE Trans. Evol. Comput., vol. 11, no. 5, pp. 635–650, Oct. 2007.
[44]
G. A. Smara and F. Khalefah, “Localization of license plate number using dynamic image processing techniques and genetic algorithms,” IEEE Trans. Evol. Comput., vol. 18, no. 2, pp. 244–257, Apr. 2014.
[45]
J. Santamaría, S. Damas, O. Cordón, and A. Escámez, “Self-adaptive evolution toward new parameter free image registration methods,” IEEE Trans. Evol. Comput., vol. 17, no. 4, pp. 545–557, Aug. 2013.
[46]
R. Poli, “Genetic programming for image analysis,” in Proc. 1st Annu. Conf. Genet. Program., 1996, pp. 363–368.
[47]
W. R. Smart and M. Zhang, “Classification strategies for image classification in genetic programming,” in Proc. 18th Int. Conf. Image Vis. Comput. New Zealand, Marseilles, France, 2003, pp. 402–407.
[48]
C. Ryan, J. Fitzgerald, K. Krawiec, and D. Medernach, “Image classification with genetic programming: Building a stage 1 computer aided detector for breast cancer,” in Handbook of Genetic Programming Applications. Cham, Switzerland: Springer, 2015, pp. 245–287.
[49]
S. Hindmarsh, P. Andreae, and M. Zhang, “Genetic programming for improving image descriptors generated using the scale-invariant feature transform,” in Proc. 27th Int. Conf. Image Vis. Comput. New Zealand, Dunedin, New Zealand, 2012, pp. 85–90.
[50]
D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis., vol. 60, no. 2, pp. 91–110, 2004.
[51]
L. Shao, L. Liu, and X. Li, “Feature learning for image classification via multiobjective genetic programming,” IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 7, pp. 1359–1371, Jul. 2014.
[52]
B. Yang and S. Chen, “A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image,” Neurocomputing, vol. 120, pp. 365–379, Nov. 2013.
[53]
M. Zhang, V. B. Ciesielski, and P. Andreae, “A domain-independentwindow approach to multiclass object detection using genetic programming,” EURASIP J. Adv. Signal Process., vol. 2003, no. 8, pp. 841–859, 2003.
[54]
A. Lensen, H. Al-Sahaf, M. Zhang, and B. Xue, “Genetic programming for region detection, feature extraction, feature construction and classification in image data,” in Proc. 19th Eur. Conf. Genet. Program., vol. 9594. Porto, Portugal, 2016, pp. 49–64.
[55]
A. Quattoni, M. Collins, and T. Darrell, “Transfer learning for image classification with sparse prototype representations,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp. 1–8.
[56]
Y. Zhuet al., “Heterogeneous transfer learning for image classification,” in Proc. AAAI Conf. Artif. Intell., San Francisco, CA, USA, 2011, pp. 1304–1309.
[57]
G. Griffin, A. Holub, and P. Perona, “Caltech-256 object category dataset,” Dept. Elect. Eng. California Inst. Technol., Pasadena, CA, USA, Tech. Rep. 7694, 2007. [Online]. Available: http://authors.library.caltech.edu/7694
[58]
D. C. Cireşan, U. Meier, and J. Schmidhuber, “Transfer learning for Latin and Chinese characters with deep neural networks,” in Proc. Int. Joint Conf. Neural Netw., Brisbane, QLD, Australia, 2012, pp. 1–6.
[59]
C. Kandaswamy, L. M. Silva, L. A. Alexandre, J. M. Santos, and J. M. de Sá, “Improving deep neural network performance by reusing features trained with transductive transference,” in Proc. Int. Conf. Artif. Neural Netw., Hamburg, Germany, 2014, pp. 265–272.
[60]
J. Donahueet al., “DeCAF: A deep convolutional activation feature for generic visual recognition,” in Proc. Int. Conf. Mach. Learn., Beijing, China, 2014, pp. 647–655.
[61]
M. Ghifary, W. B. Kleijn, and M. Zhang, “Domain adaptive neural networks for object recognition,” in Proc. 13th Pac. Rim Int. Conf. Artif. Intell. Trends Artif. Intell., Gold Coast, QLD, Australia, 2014, pp. 898–904.
[62]
K. M. Borgwardtet al., “Integrating structured biological data by kernel maximum mean discrepancy,” Bioinformatics, vol. 22, no. 14, pp. e49–e57, 2006.
[63]
M. Ghifary, W. B. Kleijn, M. Zhang, and D. Balduzzi, “Domain generalization for object recognition with multi-task autoencoders,” in Proc. IEEE Int. Conf. Comput. Vis., Santiago, Chile, 2015, pp. 2551–2559.
[64]
W. Jaśkowski, K. Krawiec, and B. Wieloch, “Multitask visual learning using genetic programming,” Evol. Comput., vol. 16, no. 4, pp. 439–459, 2008.
[65]
M. Iqbal, M. Zhang, and B. Xue, “Improving classification on images by extracting and transferring knowledge in genetic programming,” in Proc. IEEE Congr. Evol. Comput., Vancouver, BC, Canada, 2016, pp. 3582–3589.
[66]
H. Al-Sahaf, A. Song, and M. Zhang, “Hybridisation of genetic programming and nearest neighbour for classification,” in Proc. IEEE Congr. Evol. Comput., Cancún, Mexico, 2013, pp. 2650–2657.
[67]
D. Androutsos, K. N. Plataniotiss, and A. N. Venetsanopoulos, “Distance measures for color image retrieval,” in Proc. Int. Conf. Image Process., vol. 2. Chicago, IL, USA, 1998, pp. 770–774.
[68]
S.-H. Cha, “Comprehensive survey on distance/similarity measures between probability density functions,” Int. J. Math. Models Methods Appl. Sci., vol. 1, no. 4, pp. 300–307, 2007.
[69]
A. van Opbroek, M. A. Ikram, M. W. Vernooij, and M. de Bruijne, “Transfer learning improves supervised image segmentation across imaging protocols,” IEEE Trans. Med. Imag., vol. 34, no. 5, pp. 1018–1030, May 2015.
[70]
V. M. Patel, R. Gopalan, R. Li, and R. Chellapa, “Visual domain adaptation: A survey of recent advances,” IEEE Signal Process. Mag., vol. 32, no. 3, pp. 53–69, May 2015.
[71]
M. Ghifary, W. B. Kleijn, M. Zhang, D. Balduzzi, and W. Li, “Deep reconstruction-classification networks for unsupervised domain adaptation,” in Proc. 14th Eur. Conf. Comput. Vis., Amsterdam, The Netherlands, 2016, pp. 597–613.
[72]
M. Ghifary, D. Balduzzi, W. B. Kleijn, and M. Zhang. Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization. Accessed on Aug. 11, 2016. [Online]. Available: http://ieeexplore.ieee.org/document/7542175/
[73]
G. Kylberg, “The Kylberg texture dataset v. 1.0,” Centre Image Anal., Swedish Univ. Agric. Sci. and Uppsala Univ., Uppsala, Sweden, External Tech. Rep. 35, 2011.
[74]
P. Brodatz, Textures: A Photographic Album for Artists and Designers. Mineola, NY, USA: Dover, 1999.
[75]
T. Ojalaet al., “Outex—New framework for empirical evaluation of texture analysis algorithms,” in Proc. 16th Int. Conf. Pattern Recognit., Quebec City, QC, Canada, 2002, pp. 701–706.
[76]
K. Saenko, B. Kulis, M. Fritz, and T. Darrell, “Adapting visual category models to new domains,” in Proc. 11th Eur. Conf. Comput. Vis., Heraklion, Greece, 2010, pp. 213–226.
[77]
S. Luke, Essentials of Metaheuristics, 2nd ed. San Francisco, CA, USA: Lulu, 2013. [Online]. Available: http://cs.gmu.edu/~sean/book/metaheuristics/
[78]
Y. Zhao, D.-S. Huang, and W. Jia, “Completed local binary count for rotation invariant texture classification,” IEEE Trans. Image Process., vol. 21, no. 10, pp. 4492–4497, Oct. 2012.
[79]
R. Mehta and K. Egiazarian, “Dominant rotated local binary patterns (DRLBP) for texture classification,” Pattern Recognit. Lett., vol. 71, no. 1, pp. 16–22, 2016.
[80]
H. Al-Sahaf, A. Al-Sahaf, B. Xue, M. Johnston, and M. Zhang, “Automatically evolving rotation-invariant texture image descriptors by genetic programming,” IEEE Trans. Evol. Comput., vol. 21, no. 1, pp. 83–101, Feb. 2017.

Cited By

View all

Index Terms

  1. Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image IEEE Transactions on Evolutionary Computation
        IEEE Transactions on Evolutionary Computation  Volume 21, Issue 4
        Aug. 2017
        168 pages

        Publisher

        IEEE Press

        Publication History

        Published: 01 August 2017

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 06 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        View options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media