Full-Time | Remote (US or Canada) | $180 -220K

We are looking for a driven Staff Software Engineer with hands-on experience managing complex data ingestion pipelines and working on operational code for data systems. You should have expert-level proficiency in Python and SQL, with demonstrated experience in data processing, transformations, and troubleshooting. You should be comfortable processing, cleaning, and normalizing data from diverse, messy sources and have a track record of developing long-term solutions for platform stability.
 

What you'll do:

• Oversee the ingestion of hundreds of client data feeds to ensure accuracy, completeness, and quality.
• Debug and resolve complex, “messy” issues across both data feeds and code, maintaining stability and consistency in data ingestion processes.
• Develop and refine solutions to handle data complexities, allowing for efficient management and processing of incoming feeds.
• Collaborate with product, data engineering, and operations teams to identify bottlenecks in the current process and propose and implement improvements.
• Build and maintain robust documentation on ingestion workflows and debugging procedures.
• Collaborate with team members, fostering a culture of knowledge sharing and continuous improvement.

6+ years of experience in software engineering, with a focus on backend work and managing large scale operational data

Tech stack
Python, SQL, AWS, GCP, ETL frameworks, Git, JavaScript

Interview process

• Introductory Call (30 minutes)
• Infrastructure Software Interview (45 Minutes)
• System Design Interview (45 minutes)
• Final Interview