Instagram
youtube
Facebook

Big Data Pyspark

2+ years
Not Disclosed
10 Sept. 17, 2024
Job Description
Job Type: Full Time Education: B.Sc/ M.Sc/ B.E/ M.E./ B.Com/ M.Com/ BBA/ MBA/B.Tech/ M.Tech/ All Graduates Skills: Python, .net, React Native, Django, Javascript, HTML, CSS, Typescript, Communication Skills, Power Bi, Numpy Pandas, Sql, machine learning, Data Analysis, Coimbatore, Data Science, Java, Adobe XD, Figma, php, wordpress, Artificial Intelligence, Excel

Job Title: Sr. Big Data Developer

Locations: Bhubaneswar & Indore

Role Overview:

As a Sr. Big Data Developer, you will be responsible for designing and building Big Data configurations and pipelines independently. Your role involves high-level design, pipeline configuration, problem identification and resolution, and post-production support.

Key Responsibilities:

  • Design and configure Big Data pipelines according to specified designs.
  • Troubleshoot and resolve Big Data issues independently.
  • Collaborate with other Sr. Big Data Developers to report and address build issues.
  • Manage defect fixes during QA and UAT phases.
  • Oversee the entire lifecycle of code development from design to production and post-production support.

Required Capabilities:

  • Strong analytical and technical skills to address complex Big Data challenges.
  • Proficiency with the Spark software stack and experience using Spark with Python, Scala, Java, or PySpark.
  • Hands-on experience with various Big Data tools and technologies including HDFS, MapReduce, Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, MongoDB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, and Ambari.

Enterprise Competencies:

  • Ability to independently design and develop high-level solutions.
  • Strong communication skills.
  • Proficient in managing stakeholder expectations.

Technical Competencies:

  • Expertise in Big Data technologies (e.g., Spark, Hive, HBase, Apache Phoenix, Pig), Python, Scala, Kafka, Spark Streaming, Atlas, Java, SQL, Impala, Tej, Sqoop, Oozie, Cassandra, MongoDB.
  • Experience with CI/CD and DevOps concepts.
  • Knowledge of cloud environments (Azure, AWS, GCP) and Agile methodologies.

Job Title: Project Manager

Qualification: Bachelor’s degree in Science, Engineering, or a related field.

Responsibilities:

Project Planning and Setup:

  • Understand project scope and identify tasks, estimates, schedules, dependencies, and risks.
  • Contribute to testing strategy, configuration, deployment, and hardware/software requirements.
  • Review and provide feedback on project plans, gaps, and feasibility.
  • Participate in knowledge transfer sessions and provide feedback.

Requirement Understanding and Analysis:

  • Analyze functional and non-functional requirements and seek clarifications.
  • Provide feedback on requirement gaps and technical feasibility.

Design:

  • Prepare detailed design documents based on high-level designs and inputs from the Module Lead.
  • Consolidate design documents for review and suggest technical changes.
  • Identify tools and technologies, and reusable objects.

Coding:

  • Develop code following best practices and standards.
  • Share code for review and rework based on feedback.
  • Guide developers in unit testing and defect resolution.

Testing Management:

  • Develop unit test cases and oversee unit and integration testing.
  • Support the QA team, address queries, and manage defect resolution.

Configuration Management:

  • Maintain code versions and support configuration, backups, and deployments.

Deployment:

  • Create and validate deployment and rollback plans.
  • Perform post-deployment sanity checks and maintain deployment trackers.

Project Execution Monitoring & Closure:

  • Monitor developer work, provide guidance, and update leads on progress.
  • Manage change requests and support post-production maintenance.

Knowledge Management:

  • Participate in project reviews and update knowledge repositories.
  • Guide developers in documentation and publish relevant articles.

People Management:

  • Conduct training sessions and technical interviews.
  • Provide feedback on developer performance.

Must-Have Skills:

  • Kafka
  • SQL
  • Big Data technologies
  • Scala
  • Python

About Cognizant:

Cognizant (Nasdaq-100: CTSH) is a leading global professional services company, dedicated to helping organizations modernize technology, reimagine processes, and transform experiences. We are committed to diversity, inclusion, and providing a supportive and innovative work environment where everyone can thrive.

Diversity and Inclusion:

Cognizant is an equal opportunity employer committed to diversity, equity, and inclusion. We welcome applications from all individuals regardless of race, color, sex, religion, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.

Accommodation:

If you require reasonable accommodation to search for a job or submit an application due to a disability, please email CareersNA2@cognizant.com with your request.

Disclaimer:

Compensation details are accurate as of this posting and may be adjusted as needed. Candidates may need to attend interviews in person or via video conference and present a government-issued ID.

Jobs in other cities