Description

Job Brief:
We are looking for a highly skilled Data Engineer with expertise in Hadoop, Informatica, Microsoft Azure Data Factory, and Talend. The ideal candidate will have at least 10 years of experience in the IT industry and a strong background in data engineering.

Roles:
1. Designing, building, and maintaining data pipelines using Hadoop, Informatica, Microsoft Azure Data Factory, and Talend.
2. Developing data integration solutions to enable data analytics and reporting.
3. Collaborating with data scientists and analysts to understand data requirements and deliver solutions.
4. Troubleshooting and resolving data engineering issues in a timely manner.
5. Ensuring data quality and integrity throughout the data lifecycle.

Responsibilities:
1. Designing and implementing scalable and efficient data processing systems.
2. Developing ETL processes to extract, transform, and load data from various sources.
3. Optimizing data storage and retrieval for performance and cost efficiency.
4. Collaborating with cross-functional teams to deliver data solutions that meet business requirements.
5. Monitoring and maintaining data pipelines to ensure data availability and reliability.
6. Documenting data engineering processes and best practices.
7. Staying current on industry trends and best practices in data engineering.

Skills:
1. Expertise in Hadoop, Informatica, Microsoft Azure Data Factory, and Talend.
2. Strong programming skills in languages such as Python, Java, or Scala.
3. Experience with relational and non-relational databases.
4. Knowledge of data modeling and schema design.
5. Familiarity with cloud computing platforms such as AWS or Azure.
6. Excellent problem-solving and analytical skills.
7. Strong communication and collaboration skills.
8. Ability to work independently and as part of a team.
9. Proven track record of delivering high-quality data solutions.