I was introduced to the subject Pattern Recognition in 1975 when I joined Indian Statistical Institute (ISI), Calcutta, to do my PhD with Prof. D. Dutta Majumder as a CSIR Senior Research Fellow. At that time there was no text book; only a few edited volumes, mostly by Prof.  K.S. Fu, were available in our library or in the market. Another edited book that I used to consult often was “Fuzzy sets and their applications to cognitive and decision processes“ by Zadeh, Fu, Tanaka and Shimura, published by Academic Press in 1975. Apart from them I studied, though it was extremely difficult to understand, the DSc thesis of G.S. Sebestyen, entitled “Decision-making process in pattern recognition” published as a monograph by Mc Milan Press in 1962. I worked in the area of speech recognition and man-machine communication using fuzzy set theory. Prof. K.S. Fu was the foreign examiner of my PhD thesis. After that I moved to Imperial College, London, in 1979 as a Commonwealth Scholar and did another PhD in image processing using fuzzy sets.  Though there had been a possibility to work at Purdue University, USA, as a Post-doc Fellow with Prof Fu, I chose to go to Imperial College. At that time labs with complete software and hardware facilities for working in (gray) image processing were not readily available at many universities/Institutes, even in the developed nations. In 1981, I attended, as a speaker, the workshop on pattern recognition organized at Oxford University, UK, organized by NATO Advanced Studies Institute. I was thrilled as well as proud to be an invited speaker amongst several PR stalwarts including KS FU, K Fugunaga, L Kanal, P Devijver, MG Thomason and J. Kittler.

I returned from England to India in May, 1983. Then during 1986-1987, I visited the University of California, Berkeley, and the University of Maryland, College Park, as a Fulbright Fellow, and had an opportunity to work with two giants, namely, Prof. Lotfi A. Zadeh, father of Fuzzy Sets, and Prof. Azriel Rosenfeld, father of Image Processing. I also spent more than two years at the NASA Johnson Space Center, Houston, during 1990-92, and in 1994 as NRC Associate to work in the Software Technology Branch, Information Technology Division, where I came across and got interested in subjects like genetic algorithms (GA) and rough sets.

Subsequently, my research interests moved towards developing primarily the soft computing approaches comprising fuzzy sets, neural networks, genetic algorithms and rough sets, both individually and in integration. Tasks like classification, rule generation, learning with mislabeled samples, uncertainty analysis, case based reasoning, image segmentation, data mining and knowledge discovery, designing connectionist knowledge based systems, page ranking, and proving convergence were primarily considered. Methodologies with theoretical analysis, and different tools were developed. The theory of probability was also used in the process, wherever required. Real life application domains that I dealt with include speech recognition, remote sensed image analysis, medical imaging, bio-informatics, web intelligence, and social network mining.

Salient features of some of the contributions are as follows:

In the area of image analysis, we have given various definitions of image entropy based on exponential gain function, rough-fuzzy generalized entropy, and other quantitative indices for image processing tasks. The exponential gain function relies on the fact that a better measure of ignorance is 1 – pi rather than 1/pi (as used by Shannon), when pi is the probability in receiving the ith event.  Rough-fuzzy entropy, on the other hand, takes care of the fuzziness involved in the boundaries of both sets and granules in the definition of rough sets, in general. In image processing it reflects the ambiguity resulting from resemblance in nearby gray levels and pixels as well as the ambiguity arising from fuzzy boundaries of regions; thereby providing a stronger paradigm for uncertainty handling. Although we have demonstrated their extensive applications mainly for image segmentation problems, one can use them for other image processing tasks, and for any other data involving uncertainty arising from fuzziness, granularity and randomness.

In neural computation, we have pioneered the synergistic integration of fuzzy sets with artificial neural networks (ANNs), introducing the notion of fuzziness at various levels. We have developed a family of generic models encompassing fuzzy multilayer perceptron (FMLP), fuzzy logical MLP, knowledge-based FMLP, rough-fuzzy MLP, fuzzy decision tree based knowledge-based MLP, and modular evolutionary rough-fuzzy MLP — particularly for classification/clustering and rule mining, under uncertainty. The proposed fusion of fuzzy sets with ANNs has the effect of enhancing the capability of latter for handling classes with overlapping or complex boundaries and accepting non-numeric inputs, and hence their performance and application domains.

In granular computing, my research has shown that rough information granules derived from the data can improve the learning efficacy, dimensionality reduction and classification performance, and reduce significantly the computation time for various tasks, e.g., inferring the architecture of networks, estimating initial value for k-means algorithms, generating cases or prototypes, and retrieving. The symbiotic integration of this concept with other heterogeneous paradigms such as fuzzy-neural networks and genetic algorithms with variable mutation probability results in a highly effective tool for mining structures, patterns and more meaningful rules, and dealing with knowledge discovery aspect in very large and heterogeneous data sets.

Among my other contributions related to data mining, I would like to mention the fast, efficient and powerful data condensation and dimension reduction methods that have been very useful for developing speedy, accurate, and scalable data mining tools.

In web intelligence research, we have defined a new metric that generalizes Kendall's Tau distance for comparing two page rank vectors, or more generally, any pair of score vectors. The metric is found, theoretically and experimentally, to be powerful in determining the stopping time of the power method (thereby saving the computation time massively) and measuring how well ranks represent scores. The probabilistic surfer model, developed maintaining the continuity of topics, can simultaneously rank and categorize web pages, while the fuzzy surfer results in a robust version of PageRank, called FuzzRank.

The aforesaid research in pattern recognition and machine intelligence has led to the emergence of several modern disciplines involving fuzzy sets with other computational paradigms, as evident from the literature. This has also led to the incorporation of rough sets as a component of soft computing; Zadeh’s original definition had components like fuzzy logic, neurocomputing, GA, and probabilistic reasoning. This augmentation by rough sets has enhanced the computational intelligence property of soft computing and triggered its multifarious applications. 

My current research interest is primarily pivoted on social network mining, video tracking, and computational theory of perceptions involving granular computing, among others.

For furtherance of research in the said topics in a consolidated manner, our Institute created a new unit in March 1993 called Machine Intelligence Unit under my headship. As recognition of my research contributions, the Department of Science and Technology, Govt. of India established the nation’s first research center in Soft Computing in October 2004 under my leadership at ISI, Calcutta. The international conference PReMI (Pattern Recognition and Machine Intelligence) is my brain child. The conference is unique in the sense that it provides a platform to exchange ideas regularly between these two communities for mutual benefit. The first edition was in Calcutta in 2005, and the fourth one in Moscow in 2011; and all of them were co-sponsored by IAPR. It will remain incomplete if I do not acknowledge my PhD students and collaborators. Most of my work was done with PhD students and young colleagues/collaborators. I have learnt a lot from my students who keep me always young.  My foreign collaborators where I pay (or used to pay) several visits are in Warsaw University, Poland; Hong Kong Poly University, Hong Kong; and the University of Naples Parthenope, Italy. Through the Warsaw collaboration with Prof. Andrzej Skowron, I met Prof. Z. Pawlak (father of rough sets) in the mid 90s, who unfortunately passed away in 2008.

“Pattern recognition” has not only led me to win several prestigious awards and honors in India and abroad and attain the highest administrative and academic position (namely Director, of my Institute), but also gave me opportunities to visit more than thirty countries for academic purposes and, more importantly, to know the common people and culture there and make new friends. I enjoy my research work very much and love publishing in peer reviewed archival journals. I look into every problem mostly from a PR perspective. I would like to remain active as long as I can, and continue to do what I love to.

FEATURE

 

Getting to know…Sankar K. Pal, IAPR Fellow

 

 

 

 

 

 

 

 

By Sankar K. Pal, IAPR Fellow (India)

Professor Sankar K. Pal, IAPR Fellow

ICPR 2002, Quebec City, Quebec, Canada

For contributions to pattern recognition and image processing

using soft computing.

Click here for Top of Page
Right Arrow: Next

Click here

for other articles in the

Get to know...Series

Right Arrow: Previous

Sankar K. Pal (www.isical.ac.in/~sankar)

is a Distinguished Scientist of the Indian

Statistical Institute and a former Director.

He is also a J.C. Bose Fellow of the Govt. of

India. He founded the Machine Intelligence

Unit and the Center for Soft Computing

Research, A National Facility in the

Institute in Calcutta. He received a Ph.D. in

Radio Physics and Electronics from the

University of Calcutta in 1979, and another

Ph.D. in Electrical Engineering along with

DIC from Imperial College, University of

London, in 1982. He joined his Institute in

1975 as a CSIR Senior Research Fellow and

later became a Full Professor in 1987,

Distinguished Scientist in 1998, and the

Director for the term 2005-10.

 

He worked at the University of California,

Berkeley, and the University of Maryland,

College Park, in 1986-87; the NASA

Johnson Space Center, Houston, Texas in

1990-92 & 1994; and in the US Naval

Research Laboratory, Washington D.C., in

2004. Since 1997, he has been serving as a

Distinguished Visitor of IEEE Computer

Society (USA) for the Asia-Pacific Region,

and has held several visiting positions at

universities in Italy, Poland, Hong Kong,

and Australia.

 

Prof. Pal is a Fellow of the IEEE, USA, the

Academy of Sciences for the Developing

World (TWAS), Italy, the International

Association for Pattern recognition, USA,

the International Association of Fuzzy

Systems, USA, and the four National

Academies for Science/Engineering in

India. He is a co-author of seventeen books

and more than four hundred research

publications in the areas of Pattern

Recognition and Machine Learning, Image

Processing, Data Mining and Web

Intelligence, Soft Computing, Neural Nets,

Genetic Algorithms, Fuzzy Sets, Rough Sets,

and Bioinformatics.

 

He has received the 1990 S.S. Bhatnagar

Prize (which is the most coveted award for a

scientist in India), and many prestigious

awards in India and abroad including the

1999 G.D. Birla Award, 1998 Om Bhasin

Award, 1993 Jawaharlal Nehru Fellowship,

2000 Khwarizmi International Award from

the Islamic Republic of Iran, 2000-2001

FICCI Award, 1993 Vikram Sarabhai

Research Award, 1993 NASA Tech Brief

Award (USA), 1994 IEEE Trans. Neural

Networks Outstanding Paper Award (USA),

1995 NASA Patent Application Award (USA), 1997 IETE-R.L. Wadhwa Gold Medal, the

2001 INSA-S.H. Zaheer Medal, 2005-06

Indian Science Congress-P.C. Mahalanobis

Birth Centenary Award (Gold Medal) for

Lifetime Achievement, 2007 J.C. Bose

Fellowship of the Government of India and

2008 Vigyan Ratna Award from Science &

Culture Organization, West Bengal.

 

Prof. Pal is/was an Associate Editor of IEEE

Transactions on Pattern Analysis and

Machine Intelligence (2002-06), IEEE

Transactions on Neural Networks [1994-98 &

2003-06], Neurocomputing (1995-2005),

Pattern Recognition Letters (1993-2011),

International Journal of Pattern Recognition

& Artificial Intelligence, Applied Intelligence,

Information Sciences, Fuzzy Sets and

Systems, Fundamenta Informaticae, LNCS

Trans. On Rough Sets, International Journal

of Computational Intelligence and

Applications, IET Image Processing, Journal

of  Intelligent Information Systems, and Proc. INSA-A; Editor-in-Chief, Int. J. Signal

Processing, Image Processing and Pattern

Recognition; a Book Series Editor, Frontiers

in Artificial Intelligence and Applications,

IOS Press, and Statistical Science and

Interdisciplinary Research, World Scientific;

a Member, Executive Advisory Editorial

Board, IEEE Trans. Fuzzy Systems, Int.

Journal on Image and Graphics, Int. J.

Computational Science & Engineering, and

Int. J. Approximate Reasoning; and Guest

Editor, IEEE Computer, and Theoretical

Computer Science - C.