Job Overview

We are seeking a highly skilled and experienced Sr Data Engineer for our client located in Bangalore. As a Sr Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure and systems. You will collaborate with cross-functional teams to ensure the availability, integrity, and accessibility of our data assets. This is a full-time position located in Bangalore, Karnataka, India, and is ideal for someone with 7 to 10 years of experience in the field.

Qualifications and Skills

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 7 to 10 years of experience in data engineering roles.
• Strong proficiency in Shell Scripting, Python, and SQL.
• Experience with Data Warehouse technologies such as DWL.
• Knowledge of Big Data technologies and frameworks.
• Familiarity with data lake concepts and implementation.
• Proficiency in PySpark for data processing and analytics.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Experience with cloud platforms (e.g., AWS, Azure) is a plus.

Roles and Responsibilities

• Design, develop, and deploy scalable and efficient data pipelines and ETL processes.
• Collaborate with cross-functional teams to gather requirements and ensure data solutions meet business needs.
• Optimize and fine-tune data systems for performance, reliability, and scalability.
• Implement and maintain data governance and security measures.
• Troubleshoot and resolve data-related issues in a timely manner.
• Perform data analysis to identify trends, patterns, and insights.
• Stay up-to-date with industry trends and advancements in data engineering technologies.
• Provide guidance and mentorship to junior data engineers.