Senior Python Engineer

About
Binariks is looking for a highly motivated and highly skilled Senior Python Software Engineer to serve as a core executor on a critical data platform migration project. This role is focused on the hands-on refactoring and systematic implementation of changes to modernize  large-scale pandas codebase to be compatible with Copy-on-Write (CoW) semantics and the Apache Arrow backend via PyArrow.

Project: An AI-powered platform that automates data wrangling tasks, helping teams transform messy and inconsistent data into clean, reliable feeds for Product Information Management (PIM) and e-commerce systems. 

What We’re Looking For:

• 5+ years of professional experience with Python


• Strong expertise in building scalable backend systems and data pipelines


• Production Pandas Proficiency


• Practical experience identifying and resolving SettingWithCopyWarning


• Strong proficiency with advanced indexing and method chaining for writing clean, efficient code


• Practical, hands-on experience using PyArrow in data processing pipelines


• Expertise in writing unit and integration tests with pytest


• Refactoring: Disciplined approach to refactoring with a strong focus on maintaining backward compatibility and minimizing regression risk


• Dependency Management: Proficiency with modern Python tooling (Poetry, Pipenv, or uv) to manage and resolve complex dependency conflicts in virtual environments


• Proven ability to tackle systematic, complex technical puzzles independently. We need engineers who are self-motivated problem-solvers, not just task completers


• Hands-on experience with cloud platforms (Azure, AWS, or GCP)


• Proficiency with databases (SQL and NoSQL)


• Solid understanding of system architecture, distributed systems, and integration patterns


• Upper-Intermediate English or higher

Will be a plus:

• Experience with other Arrow-based DataFrame libraries (Polars, cuDF)


• Familiarity with data validation libraries (Pandera, Pydantic) and an understanding of their integration challenges in a migrating codebase


• Experience with performance and memory profiling tools (e.g., memory_profiler, line_profiler) to quantitatively validate the benefits of the migration


• Experience in leading or mentoring other developers

Your Responsibilities:

• Refactoring Execution: Perform the bulk of the hands-on refactoring work for the analytics tool, including fixing chained assignment patterns, updating I/O operations, and ensuring CoW compatibility


• Testing & Validation: Develop and maintain a comprehensive test suite using pytest to validate functional correctness, data type integrity, and performance metrics post-migration


• Feature Development: build new data transformation features ("wrangles") that leverage PyArrow's complex data types and performance advantages


• Dependency Management: Investigate, troubleshoot, and resolve version conflicts arising from the introduction of PyArrow and other related dependency upgrades


• Collaboration: Work closely with the Technical Lead and other engineers to ensure consistent implementation of patterns and to proactively identify and communicate risks or complexities discovered during implementation