Big Data Consolidation Platform For a leading Hedge Fund

Overview

• In absence of an in-house system, the AUM calculations and Sales commissions were driven based on manual reports and data supplied by these platforms. SALESFORCE is the master reference data source for Investment consultants and management.
• This process had inherent problems with data quality, redundancy, non-conformity to structure and at times even missing data. The data was also not available for real time consumption and decision making of Management.
• This resulted in lot of manual work, re-work, inaccurate calculations, under/over reported AUM and did not reflect accurate performance checks for the management.

Solution

Coforge Solutions proposed to develop an Automated Data Visualization solution along with a Dashboard.

• Single platform for all Sales & AUM data view
• Data Quality checks performed in Real-Time
• Automated Reconciliation of Data before upload
• Complete Automated Commission Calculation & detailed Report generation for all clients
• Tableau Dashboard to manage reference data, handle workflow events, apply adjustments that were not scoped in

Tech Stack

SPARK-Scala is used extensively in Ingestion layer, while rest of transformation is done using PENTAHO. The reports are served using Tableau Server and web. The infrastructure can be managed using Ambari view i.e. memory management, adding new nodes and monitoring.