Staff Software Engineer, Modeling Platform Infrastructure

Do you have insights into how to improve spark? Are you thinking about how to move from batch to real-time? Do you get excited about data layout? Distributed fault tolerance and consistency? If so, this might be the team for you.

 

At Quantcast, data is king, and the Modeling Platform Infrastructure team knows how to process it. The unique features of our custom map-reduce implementation include a revolutionary petabyte sort mechanism, an efficient and flexible petabyte join and lookup, based on innovative data indexing and partitioning mechanisms, dynamic task size adjustment in running jobs, and a self-tuning system that learns and improve job performance without developer intervention. In the last 5 years, it has allowed Quantcast to scale from processing 400 to 40,000 terabytes of data per day. For a workload consisting primarily of ETL, analytics, and data mining, our processing platform is on average 4 to 5 times more efficient than the most popular open-source map-reduce system.

Responsibilities:

• You will design and develop high performance distributed computing systems
• Diagnose and produce system solutions to big data problems
• Perform design, architecture, and code reviews
• Mentor and grow more junior team members
• Innovate in the big data space: lead, not follow
• Provide technical feedback into product roadmaps for the team

Requirements:

• B.S. in Computer Science or equivalent experience
• 5+ years of industry experience in software development
• Experience working on large-scale distributed systems
• Experience optimizing the performance of large-scale distributed systems
• Deep understanding of distributed systems
• Proficient in C++ and/or Java
• Strong software development skills (version control, code review, testing, release, monitoring, debugging)
• Proficiency and high level of insight into Linux OS and running software systems on Linux

The expected base salary range for this position is $184,100 to $249,100 

 

Ultimately, in determining your offer, we will take into consideration your geographic location, relevant experience and expertise, and other job-related factors. Furthermore, this position is eligible for a bonus, equity, and benefits including hybrid work, flexible time off, medical, dental, and vision insurance, and 401(k). Please see our Careers page for additional information.

 

Quantcast is an advertising technology company and the creator of an innovative intelligent audience platform that empowers brands, agencies and publishers to know and grow their audiences online. Our solutions are leveling the playing field for our customers when it comes to effectively reaching audiences online and helping them power a thriving free and open internet for everyone. Founded in 2006 and headquartered in San Francisco, Quantcast has employees in 18 offices across 10 countries.

 

We are committed to building an inclusive and diverse environment where everyone can be their authentic self. We work to ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

 

Recognizing the importance of flexible work environments, Quantcast operates in a hybrid work model. This model gives employees the opportunity to work from home two days a week and work in the office for team collaboration for the remainder of the time. Our hybrid model may differ based on location or team, so please consult with your hiring manager for further information. All hybrid employees can also work remotely for two weeks each year or, if eligible, apply for our fully remote work program. We strongly encourage vaccination for all Quantcast employees as a way to stop the spread of COVID and protect yourself and others.