Instagram
youtube
Facebook

Data Engineer - Aws Pyspark

2+ years
Not Disclosed
10 Sept. 5, 2024
Job Description
Job Type: Full Time Education: B.Sc/ M.Sc/ B.E/ M.E./ B.Com/ M.Com/ BBA/ MBA/B.Tech/ M.Tech/ All Graduates Skills: Python, .net, React Native, Django, Javascript, HTML, CSS, Typescript, Communication Skills, Power Bi, Numpy Pandas, Sql, machine learning, Data Analysis, Coimbatore, Data Science, Java, Adobe XD, Figma, php, wordpress, Artificial Intelligence, Excel

Job Summary

We are seeking a highly skilled Technical Lead with a solid background in project planning, design, coding, and testing to join our team. This role requires expertise in AWS Big Data and AWS services, with additional knowledge in AWS Cloud, PySpark, and Python being advantageous. The ideal candidate will be responsible for overseeing the development process, ensuring high-quality deliverables, and guiding the technical team through various project phases.

Responsibilities

Project Planning and Setup:

  • Understand project scope and define activities, tasks, estimates, schedules, dependencies, and risks. Provide inputs to the Module Lead for review.
  • Contribute to testing strategies, configuration, deployment, and hardware/software requirements.
  • Review and provide feedback on project plans, timelines, and execution feasibility.
  • Participate in knowledge transfer (KT) sessions conducted by customers or other business teams, providing feedback on requirements.

Requirement Understanding and Analysis:

  • Analyze functional and non-functional requirements, seeking clarifications to ensure comprehensive understanding.
  • Provide feedback on gaps in requirements and the technical feasibility based on system integration and dependencies.

Design:

  • Prepare Low-Level Design (LLD) documents based on High-Level Design (HLD) and inputs from the Module Lead.
  • Collaborate with developers to finalize module designs and provide consolidated designs for review by Module Leads, Architects, or Designers.
  • Suggest design changes based on technical considerations and develop a components inventory aligning with non-functional requirements.
  • Perform data sampling to understand data quality and identify tools and technologies for the project.

Coding:

  • Follow coding standards and best practices to develop and review code quality.
  • Share code with supervisors for review, rework as needed, and perform complex integration tasks.
  • Guide developers in unit testing, defect fixing, and consolidate test results for review.
  • Provide periodic status updates to supervisors, highlight design challenges, and conduct technical troubleshooting and code reviews.

Testing Management:

  • Develop and guide unit test cases, conduct unit and integration testing, and address defects.
  • Review and approve code for testing environments and support QA teams during various testing phases.
  • Address QA queries, investigate critical defects, and report defect status in line with project standards.

Configuration Management:

  • Maintain code versions and support administrators with configuration, backups, and deployments.
  • Assess and create deployment/rollback plans, validate component migrations, and perform sanity checks post-deployment.

Project Execution Monitoring & Closure:

  • Monitor developer progress, provide guidance through the SDLC, and report status to leads.
  • Offer inputs for change requests and support project management activities.

Service Support and Maintenance:

  • Provide initial production support and transition to the maintenance team.
  • Identify and address service requests, defects during warranty, and support post-warranty transitions.

Knowledge Management:

  • Participate in project review calls, update knowledge articles, and guide developers in documentation.
  • Publish white papers, blogs, or articles as required.

People Management:

  • Conduct internal and external technical interviews, provide feedback on developers to module leads, and deliver training as needed.

Must-Have Skills:

  • AWS Big Data
  • AWS Services

Good-to-Have Skills:

  • AWS Cloud
  • PySpark
  • Python

The Cognizant Community

At Cognizant, we value and support one another in a collaborative, inclusive environment where everyone can thrive. With over 350,000 associates globally, we are committed to making a difference by taking care of our people, clients, company, communities, and climate. We foster innovation and offer opportunities to build a career path that aligns with your goals.

About Us

Cognizant (Nasdaq-100: CTSH) is a leading global professional services company, specializing in modernizing technology, reimagining processes, and transforming experiences to keep organizations ahead in a rapidly changing world.

Commitment to Diversity and Inclusion

Cognizant is an equal opportunity employer that embraces diversity, champions equity, and values inclusion. We are dedicated to creating a community where everyone feels valued and included, regardless of race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status, or any other protected characteristic.

Accommodations

If you need reasonable accommodation to search for a job or submit an application, please email CareersNA2@cognizant.com with your request and contact information.

Disclaimer

Compensation information is accurate as of the date of this posting and may be subject to change. Candidates may be required to attend interviews in person or via video conference and present a current state or government-issued ID.

Jobs in other cities