Software Engineer, Big Data Platform

San Francisco

We’re looking for a seasoned Big Data engineer to help us build and scale the next generation of big data platform and infrastructure at Pinterest. You'll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, etc.) in the world on hundreds of petabytes data to help hundreds of millions of people discover and do what they love.

#LI-VW1

What you’ll do :
  • Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
  • Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
  • Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
  • Contribute to the team’s technical vision and long-term roadmap
  • Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale
What we’re looking for :
  • 5+ years of experience on open-source Big Data technologies
  • Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
  • Experience with Hadoop, Spark, Hive, Presto, SQL, Kafka, Parquet, and HDFS
  • Proficiency in multiple systems languages (Java, Scala, Python)
  • AWS experience a plus

Apply for this job

Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptxOnly the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptxOnly the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx

Other information

If you haven't already, try it out! Understanding the product will help you work through some of our interview questions.

We’re looking for all kinds of people



To build an app that’s used and loved by people all around the world, we need a team with all kinds of different perspectives, experiences and backgrounds.



To put it legally: Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best people in every job. Pinterest policy prohibits unlawful discrimination based on race, color, religious creed, sex, gender identity, marital or veteran status, age, national origin, ancestry, citizenship, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member), sexual orientation, pregnancy or any other consideration made unlawful by federal, state or local laws. It also prohibits discrimination based on a perception that anyone has any of those characteristics, or is associated with a person who has or is perceived as having any of those characteristics. All such discrimination is unlawful.