Data Engineer – University Hire – Yahoo
Yahoo is one of the world's original internet pioneers and home to 900+ million monthly active users across Yahoo News, Yahoo Finance, Yahoo Sports, and Yahoo Mail — making it one of the world's largest digital media companies. Yahoo's engineering legacy in big data is legendary: the company invented Apache Hadoop, built one of the world's first distributed computing platforms, and trained many of the engineers who went on to build the modern data stack at Airbnb, LinkedIn, and Facebook. Yahoo's advertising technology platform processes billions of ad impressions daily for thousands of advertisers. We are hiring University Hire Data Engineers to modernize Yahoo's data infrastructure for the next decade.
Responsibilities
- Build and maintain Apache Spark data processing pipelines transforming Yahoo's 900M+ user event data into analytics datasets for editorial, advertising, and product teams
- Develop Yahoo's real-time stream processing pipelines using Apache Kafka and Apache Flink for user behavior tracking, ad impression logging, and anomaly detection
- Implement Yahoo's data lakehouse on AWS S3 using Apache Iceberg table format for efficient large-scale analytics with time-travel and schema evolution
- Build Yahoo Finance data pipelines ingesting real-time stock prices, financial statements, and news sentiment signals for Yahoo Finance's 80M+ monthly users
- Develop Yahoo's advertising data mart — transforming ad serving logs from Yahoo's DSP into performance reports for campaign managers and agency clients
- Optimize Apache Hive and Presto query performance for Yahoo's petabyte-scale analytical workloads across finance, news, and sports verticals
Requirements
- Bachelor's degree in Computer Science, Data Engineering, or Software Engineering
- Python or Scala proficiency for Spark data pipeline development
- SQL skills and understanding of distributed data processing at scale
- Familiarity with Hadoop ecosystem (Hive, HDFS, Spark) or cloud-native equivalents (EMR, Dataproc)
- Understanding of big data concepts and interest in large-scale media analytics
Benefits
- Competitive salary with Yahoo equity and annual bonus
- Yahoo Finance Premium, Yahoo Sports, and ad-free product access for employees
- Medical, dental, and vision benefits
- 401(k) with Yahoo matching
- Sunnyvale, CA campus with hybrid flexibility and big data engineering heritage