Machine Learning Times
Machine Learning Times
EXCLUSIVE HIGHLIGHTS
Three Best Practices for Unilever’s Global Analytics Initiatives
    This article from Morgan Vawter, Global Vice...
Getting Machine Learning Projects from Idea to Execution
 Originally published in Harvard Business Review Machine learning might...
Eric Siegel on Bloomberg Businessweek
  Listen to Eric Siegel, former Columbia University Professor,...
Effective Machine Learning Needs Leadership — Not AI Hype
 Originally published in BigThink, Feb 12, 2024.  Excerpted from The...
SHARE THIS:

CONTINUE READING: Access the complete article in hexanika, where it was originally published.   

8 years ago
Hadoop in Banking: Changing the Game

 

The reason for Hadoop’s success in the banking and finance domain is its ability to address various issues faced by the financial industry at minimal cost and time. Despite the various benefits of Hadoop, to apply it to a particular problem needs due diligence. Some of the scenarios in which it is used are:

Fraud Detection

Hadoop addresses most common industry challenges like fraud, financial crimes and data breaches effectively. Analyzing point of sale, authorization and transactions, and other points, banks can identify and mitigate fraud. Big Data also helps in picking up unusual patterns and alerting banks of the same, while also drastically reducing the time and resources required to complete these tasks.

Risk Management

Assess risks accurately using Big Data Solutions. Hadoop gives a complete and accurate view of risk and impact, enabling firms to makes informed decisions by analyzing transactional data to determine risk based on market behavior, scoring customers, and potential clients.

Data Storage and Security

Protection, easy storage and access of financial data are the optimal needs of banks and finance firms. While Hadoop Distributed File System (HDFS) provides scalable and reliable data storage designed to span large clusters of commodity servers, MapReduce processes each node in parallel, transferring only the package code for that node. This means information is stored in more than one cluster but with additional safety to provide a better and safer data storage option.

Analysis

Bank need to analyze unstructured data residing in various sources like social media profiles, emails, calls, complaint logs, discussion forums, etc. as well as through traditional sources like transactional data, cash and equity, trade and lending, etc. to get a better understanding of their customers. Hadoop allows financial firms to access and analyze this data and also provides accurate insights to help make the right decision.

Hadoop is also used in other departments like customer segmentation and experience analysis, credit risk assessment, targeted services, etc.

Does Hadoop have limitations too?

Although Hadoop has been embraced by several banking organizations and it forms the backbone of several applications running Big Data technology, there are also several reasons Hadoop may not always be the best solution. Some of them are:

Big Data understanding

Hadoop is normally implemented when Big Data is to be implemented. But before using it, one must ask the right questions and ponder upon whether it is the right solution. Any organization that has a huge inflow of data from various sources and which is facing issues to store and effectively use the existent data can use Hadoop and Big Data solutions for their enterprise.

It is not a solution, but a tool

Hadoop is not the complete solution. Although fraud detection and risk management leverage the strengths of Hadoop, Hadoop by itself does not solve these issues. Programmers need to write codes with an understanding of the problem so that they utilize Hadoop’s strong points to solve the business problem. e.g. Big Data does not help in picking up unusual patterns. Big data merely allows large data to be processed concurrently.

Not a unique service

Hadoop allows analysis, but there are many products who allow you to do data analysis. So, though Hadoop can be used for the purpose of analysis, implementing the framework only to address analytical issues will not be a smart idea. Hadoop is beneficial only if one finds more than one scenarios where its USPs can be used properly.

Other vulnerabilities

Like any other technology, Hadoop is not full proof or foolproof for that matter.  Data is at risk as encryption is missing in Hadoop system at storage and network levels. Also, since Hadoop makes various duplicates to store data so that it can be retrieved in case of failure, it is vulnerable to data breaches like Java, the language in which the framework of Hadoop is written in.

Here’s an analogy: Consider a dinner knife. You can use it very well to butter your toast, to cut a piece of potato, to wedge open a shut tin, or use as a screwdriver for wide-notched screws; but it is useless if you want to drink soup or if you want to make a phone call.

Hadoop is like a knife. The programmers use it to do things effectively where it is applicable. Hadoop does not do fraud detection or risk management, actually it does not do any business logic by itself; it just manages the storage and retrieval of data in a distributed way.

CONTINUE READING: Access the complete article in hexanika, where it was originally published

Author Bio:

Sankar Aiyar has a combined banking and finance experience of more than 28 years, with expertise in developing and executing technology strategies in the financial services industry. He has a B.S in Mechanical Engineering from BITS, Pilani and an MS in System Engineering from IIT, Delhi.

Leave a Reply