Description

We are embarking on a transformative data management project and are looking for a talented freelance Data Engineer to lead the design, development, and implementation of a Cloud Data Lake infrastructure using Microsoft Azure and Snowflake. The selected engineer will play a crucial role in integrating data from various sources and ensuring data quality, with a specific focus on leveraging PurpleCube for enhanced analytics capabilities.

Responsibilities:

Azure Data Lake and Snowflake Architecture:

Design and architect a Cloud Data Lake infrastructure using Microsoft Azure.

Implement data warehousing solutions using Snowflake for optimal data storage and retrieval.

Data Ingestion and Integration:

Develop and implement data pipelines for efficient data ingestion into the Azure Data Lake and Snowflake.

Integrate data from various sources, including databases, APIs, and external systems.

Data Quality and PurpleCube Integration:

Implement data quality measures to ensure accuracy and reliability of financial data.

Leverage PurpleCube for enhanced analytics capabilities and advanced reporting.

Security and Compliance:

Implement security measures and access controls to protect financial data.

Ensure compliance with data governance and regulatory requirements in the Financial Services industry.

Optimization and Performance Tuning:

Optimize the performance and efficiency of the Azure Data Lake and Snowflake infrastructure.

Fine-tune data pipelines for optimal data processing and analytics.

Requirements:

· Proven experience as a Data Engineer with a focus on Cloud Data Lakes, Microsoft Azure, Snowflake, and PurpleCube.

· In-depth knowledge of Azure Data Lake Storage, Snowflake data warehousing, and PurpleCube analytics.

· Strong proficiency in designing and optimizing data pipelines for financial data.

· Experience with data security and compliance measures within Azure and Snowflake.

· Excellent problem-solving and analytical skills.