Job Description

Role: Technical Lead for Data engineering

Job Summary:

We are seeking a skilled, experienced and motivated Data Engineer with expertise in AWS services such as S3, Redshift, Glue, Step Functions, and Lambda to join our support team. The ideal candidate will be responsible for managing, monitoring, and troubleshooting data pipelines and workflows, ensuring the seamless operation of data infrastructure, and providing ongoing support to maintain data availability and integrity.

Minimum 7 yrs in Data engineering with relevant skills

Mandatory Skills:

AWS Services (S3, Redshift, Lambda, Glue, Step function) Python

Technical Expertise:

Proficient in AWS services: S3, Redshift, Glue, Step Functions, Lambda.

Strong understanding of ETL/ELT processes and data transformation.

Experience with monitoring and debugging data pipelines in a production environment.

Database Knowledge:

Proficiency in SQL and hands-on experience with Redshift for data modeling and performance tuning.

Knowledge of other databases (e.g., PostgreSQL, MySQL) is a plus.

Programming Skills:

Proficiency in Python for scripting, data manipulation, and building serverless applications with Lambda.

Knowledge of PySpark or similar frameworks is a plus.

Key Responsibilities:

AWS Data Pipeline Maintenance: Monitor and troubleshoot data pipelines and workflows utilizing AWS Glue, Step Functions, and Lambda. Optimize existing data pipelines for performance and cost efficiency.

Data Storage Management: Manage and support data stored in Amazon S3 and ensure efficient storage policies (e.g., lifecycle rules, versioning, and encryption). Ensure optimal performance and availability of Amazon Redshift clusters, including schema maintenance and query tuning.

Issue Resolution: Respond to incidents related to data failures, latency, or data quality and provide timely resolutions. Debug and resolve issues in ETL jobs, data ingestion, and transformations.

Performance Optimization: Perform root cause analysis for recurring issues and implement solutions to enhance the reliability of the data ecosystem. Identify areas for process improvement and implement automation wherever feasible.

Data Quality and Governance: Implement monitoring tools and dashboards to track data pipeline health. Collaborate with stakeholders to ensure adherence to data security, governance, and compliance policies.

Documentation and Reporting: Maintain up-to-date documentation for data pipelines, workflows, and troubleshooting steps. Provide regular reports on system performance and key metrics.

Collaboration and Support: Work closely with data engineering, analytics, and operations teams to resolve issues and gather requirements for enhancements. Support ad-hoc data requests and ensure timely delivery of data to business users.

Qualification : Any Graduation

Certifications Needed: (please specify if no certifications are needed as well)

Work Location (Offshore) : Bangalore/Mumbai/Hyderabad/Chennai

Work Location (Onsite) : Mphasis location or client location or WFH (Hybrid)

About Mphasis

Mphasis applies next-generation technology to help enterprises transform businesses globally. Customer centricity is foundational to Mphasis and is reflected in the Mphasis’ Front2Back™ Transformation approach. Front2Back™ uses the exponential power of cloud and cognitive to provide hyper-personalized (C=X2C2TM=1) digital experience to clients and their end customers. Mphasis’ Service Transformation approach helps ‘shrink the core’ through the application of digital technologies across legacy environments within an enterprise, enabling businesses to stay ahead in a changing world. Mphasis’ core reference architectures and tools, speed and innovation with domain expertise and specialization are key to building strong relationships with marquee clients.

Equal Opportunity Employer:

Mphasis is an equal opportunity/affirmative action employer. We provide equal employment opportunities to applicants and existing associates and evaluate qualified candidates without regard to race, gender, national origin, ancestry, age, color, religious creed, marital status, genetic information, sexual orientation, gender identity, gender expression, sex (including pregnancy, breast feeding and related medical conditions), mental or physical disability, medical conditions military and veteran status or any other status or condition protected by applicable federal, state, or local laws, governmental regulations and executive orders. View the EEO in the law poster , view the EEO in the law supplement . To view the pay transparency nondiscrimination provision please click and to view the E-Verify posting click .

Mphasis is committed to providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of disability to search and apply for a career opportunity, please send an email to [email protected] and let us know your contact information and the nature of your request.