Requirements Summary

Strong focus on data platforms and/or distributed systems, hands-on expertise in Apache Spark or Scala or PySpark, strong programming skills in Java (preferred) / Scala / Python, experience building large-scale data pipelines (ETL/ELT), experience developing backend services or APIs (REST/microservices), deep understanding of distributed systems, data storage formats, data modeling, and schema evolution, experience with cloud platforms, workflow orchestration tools, and strong system design and performance optimization skills

Benefits

Education

Bachelor's degree

Full Job Description

Role Overview We are looking for a Senior Software Engineer to design, build, and scale our next-generation Data Platform and Data-Driven APIs. This role combines distributed data processing (Apache Spark) with platform and microservices engineering (Java) to enable reliable, scalable, and real-time data access. What You Will Do Key responsibilities include designing and developing scalable data pipelines using Apache Spark, building and maintaining data platform layers, optimizing Spark jobs for performance, cost, and reliability, and implementing data quality, observability, and lineage frameworks. Why It Might Be a Fit A successful engineer in this role will deliver high-quality, production-grade data pipelines and APIs that power real business outcomes, build systems that are scalable, observable, and resilient under load, and take ownership end-to-end, ensuring data flows reliably from source to consumer. Requirements 4+ years of software engineering experience with strong focus on data platforms and/or distributed systems Hands-on expertise in Apache Spark or Scala or PySpark Strong programming skills in Java (preferred) / Scala / Python Experience building large-scale data pipelines (ETL/ELT) Experience developing backend services or APIs (REST/microservices) Deep understanding of: Distributed systems (partitioning, shuffle, fault tolerance), Data storage formats (Parquet, ORC, Avro), Data modeling and schema evolution Experience with cloud platforms (Azure/AWS/GCP) Familiarity with workflow orchestration tools (Airflow, Dagster, etc.) Strong system design and performance optimization skills Benefits Flexible work environment Competitive salaries Paid vacation and holidays Robust professional development programs Comprehensive health, wellness, and financial packages

Skills and Technologies