Job Title: Data Engineer
Job ID: JR101845
Location: Bangalore, Karnataka, India
Experience: 3+ Years
Job Type: Full-Time
Role Overview
o9 Solutions is seeking a skilled Data Engineer to build, optimize, and maintain data pipelines that empower our AI-first enterprise planning platform. You’ll contribute to the architecture, scalability, and performance of data workflows that support global leaders like Google, PepsiCo, and Walmart.
Key Responsibilities
Design and develop data pipelines for capturing historical data snapshots of inputs and outputs.
Optimize data pipelines for performance using best industry practices.
Create batch orchestration flows with minimal system disruption.
Write scalable PySpark/Python code for data transformation and API-based data extraction.
Contribute to data architecture with a focus on performance, scalability, and maintainability.
Continuously learn and apply new technologies aligned with product goals.
Technical Requirements
3+ years of hands-on experience in PySpark programming.
Strong understanding of Spark components including Spark SQL, DataFrames, Datasets, and streaming data.
Experience with data lakes and Delta Lake table formats.
Proficient in building ETL pipelines and working with big data tools.
Strong Python skills (Pandas experience required; Scala is a plus).
Experience with production-level code, performance tuning, debugging, and root cause analysis.
Familiarity with software development best practices such as Git, CI/CD, and Unit Testing.
Ability to collaborate effectively in cross-functional and fast-paced environments.
Education
Bachelor’s / Master’s degree in Computer Science, Engineering, or related field (preferred).
Why Join o9 Solutions
Be part of a hyper-growth company valued at $3.7 billion with global impact.
Collaborate across boundaries—function, distance, and hierarchy.
Contribute to cutting-edge solutions that optimize supply chains and reduce global waste.
Thrive in a transparent, inclusive culture with social impact initiatives and global diversity.
Access professional development opportunities and volunteer programs.
