Software Engineer, Big Data Platform

San Francisco

We’re looking for Big Data engineers (across levels) to help us build and lead the next generation of big data platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, YARN,, etc.), at the scale of hundreds of petabytes of data to help Pinners discover and do what they love.

#LI-KL1

What you’ll do :
  • Improve and customize the internals of open source big data technologies to meet our challenges at scale
  • Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
  • Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
  • Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
  • Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale
What we’re looking for :
  • Experiences in one or more open-source Big Data technologies (Hadoop, YARN, Spark, Hive, Presto, SQL, Kafka, Impala,  Parquet, HDFS, etc.)
  • Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Pluses: AWS experiences, internal knowledge or expertise of open source or related big data technologies   

Apply for this job

Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptxOnly the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx
Only the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptxOnly the following file extensions allowed: png gif jpg jpeg doc docx pdf pages pptx

Other information

If you haven't already, try it out! Understanding the product will help you work through some of our interview questions.

We’re looking for all kinds of people



To build an app that’s used and loved by people all around the world, we need a team with all kinds of different perspectives, experiences and backgrounds.



To put it legally: Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. Pinterest policy prohibits unlawful discrimination based on race, color, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member), or any other consideration made unlawful by applicable federal, state, or local laws. It also prohibits discrimination based on a perception that anyone has any of those characteristics, or is associated with a person who has or is perceived as having any of those characteristics. All such discrimination is unlawful. Pinterest is committed to compliance with all applicable laws providing equal employment opportunities. This commitment applies to all persons involved in the operations of Pinterest and prohibits unlawful discrimination by any employee of Pinterest.
Pinterest is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at pe@pinterest.com.
Pinterest will consider qualified applicants with arrest and conviction records for positions in accordance with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Ordinance, and other applicable state or local laws.
Pinterest also participates in the E-Verify program in certain locations, as required by law. See https://www.e-verify.gov/sites/default/files/everify/posters/EVerifyParticipationPoster.pdf and https://www.e-verify.gov/sites/default/files/everify/posters/IER_RighttoWorkPoster.pdf