Snowflake Implementation for an American Financial Services Company.

Problem

The Customer did not have a centralized data warehouse solution. Internal business groups were extracting the data using ad hoc queries and generating reports. The data used to reside in local machines causing data security concerns. Business teams used to extract the data from multiple databases and transform it into the excel sheets and provide the reports to management. Master data was not available to perform customer analysis and cross/up selling.

Solution

  • Implemented Snowflake centralized data lake platform.
  • Designed and implemented ETL processes to meet the requirements.
  • Developed the views in Reporting layer to consume by business group directly.

Project Highlights

Technology

Methodology - Agile

Team Size - 9

Geographical Locations: Ohio, US

Activities

  • Identified the technology stack and completed the required configuration.
  • Administration and operational support for the technology stack.
  • Ingest raw data; Built the snowflake stored procedures to implement masking algorithms.
  • Code repository to hold the Snowflake code; orchestrated with CICD (Python scripts).
  • Designed and Developed the Talend Jobs to ingest the data into Salesforce platform.
  • Developed Tableau reports, dashboards and provided operational support.