Senior Data Engineer
IDFC FIRST Bank — Bengaluru, BENGALURU
Apply Now
Job Description
Job Requirements About the Role
As a Senior Data Engineer in the New Age Data & Analytics team at IDFC FIRST Bank, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support advanced analytics and business intelligence. This role demands deep technical expertise in big data technologies, cloud platforms, and data architecture. You will also lead engineering initiatives, collaborate with cross-functional teams, and contribute to enterprise-wide data strategy and innovation.
Key Responsibilities
Primary Responsibilities
- Design and develop scalable data pipelines across the full data lifecycle—from ingestion and transformation to consumption.
- Work with large-scale data volumes (TBs/PBs) and ensure efficient data processing and storage.
- Collaborate with business stakeholders to identify high-impact problems and translate them into data solutions.
- Apply advanced knowledge of SQL, Spark, Python, Scala, and the Hadoop ecosystem.
- Implement and manage Data Lake/Lakehouse architectures using platforms like Cloudera, Hortonworks, and AWS.
- Develop APIs and integrate them into data workflows for seamless data access and usability.
- Utilize big data infrastructure tools including Spark Streaming, EMR, MapReduce, Hive, HDFS, YARN, HBase, and Oozie.
- Create and maintain technical design documentation (HLD/LLD) for data pipelines and architecture.
- Debug and resolve technical issues in data architecture and ensure high availability and performance.
Secondary Responsibilities
- Work independently and manage your own development efforts.
- Collaborate with BI analysts and engineers to prototype and implement analytical models.
- Identify key performance indicators and define strategies to meet analytical goals.
- Present data solutions and insights to stakeholders and leadership teams.
Managerial & Leadership Responsibilities
- Lead moderately complex data engineering initiatives aligned with enterprise strategy.
- Build and maintain optimized, highly available data pipelines to support analytics and reporting.
- Oversee data integration efforts, including modeling, warehousing, and analytics environments.
- Resolve complex data engineering issues while ensuring compliance with data governance policies.
- Collaborate with peers and managers to align on strategic goals and deliverables.
What We Are Looking For
Education
- Bachelor’s degree in computer science or information technology or engineering
Experience
- 6+ years of experience in data engineering, with at least 3 years in large-scale Data Lake ecosystems.
Skills and Attributes
- Proven expertise in SQL, Spark, Python, Scala, and big data tools.
- Strong understanding of Data Lake/Lakehouse architecture and cloud platforms (especially AWS).
- Experience with machine learning frameworks and real-time data processing.
- Deep knowledge of relational and non-relational databases and data mining techniques.
- Strong debugging and problem-solving skills.
- Excellent communication and documentation abilities.
- Ability to lead technical projects and mentor junior engineers.
Key Success Metrics
- Timely and error-free delivery of data engineering projects.
- Identification and resolution of data issues.
- Leadership in technical aspects of data initiatives.
- High performance and availability of data pipelines.
Frequently Asked Questions
What are the eligibility criteria for the Senior Data Engineer job at IDFC FIRST Bank?
Eligibility typically includes the qualifications and experience outlined in the job description above, with around 0-2 Years years of relevant experience expected for this role.
What are the primary responsibilities of a Senior Data Engineer at IDFC FIRST Bank?
The key responsibilities for this role are detailed in the Key Responsibilities section above, covering the core duties expected of a Senior Data Engineer at IDFC FIRST Bank.
Is prior experience required for this position?
This role requires around 0-2 Years years of relevant experience, as specified in the job listing. Please refer to the Qualifications & Experience section above for full details.
What skills are important for this role?
Skills relevant to this position are outlined in the Qualifications & Experience section above. In general, strong communication, domain knowledge, and the ability to meet role-specific targets are valued across similar BFSI positions.
How do I apply for the Senior Data Engineer role at IDFC FIRST Bank?
You can apply directly using the Apply Now button on this page, which will take you to IDFC FIRST Bank's application process for this role.
Chat us
Call us