Principal Software Engineer - Ad Platform

工作 ID 10110229 地點格倫代爾, 加利福尼亚州, 美國 / 圣莫尼卡, 加利福尼亚州, 美國 / 旧金山, 加利福尼亚州, 美國 / 西雅圖, 华盛顿州, 美國 有意工作的公司 Disney Entertainment & ESPN Technology 日期已公佈 Feb. 05, 2025

申請

工作概要:

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The products and platforms the Ad Platforms group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more. We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Ad Platforms team is responsible for building and operating the technology that supports Disney’s industry-leading, multi-billion dollar global advertising business. Working across all of Disney’s streaming brands and linear channels, this team’s scope is wide ranging - they impact everything from core infrastructure development that powers Disney’s proprietary ad server, to reimagining viewer-first ad experiences and formats. This team’s award-winning, in-house built technologies are the backbone of Disney’s ad business and a critical element of the Company’s streaming future.

The Disney Ad Platforms Data team is at the forefront of building a modern advertising data platform to support our organization’s data, analytics and business intelligence needs. Our mission is to enable data engineers, data scientists, analysts, and decision-makers to derive value from our data ecosystem.

Job Summary:

We are seeking a Principal Software Engineer with extensive experience in the Databricks platform and advanced big data engineering practices. This role involves architecting and implementing scalable, secure, and high-performing data solutions to power the Ad Platforms Data platform and support mission-critical data initiatives, including real-time and batch processing pipelines.

As a hands-on technical leader, you will design data architectures that scale to handle terabytes-per-hour throughput, ensuring optimal performance, compliance, and alignment with business needs. You will play a pivotal role in guiding teams, collaborating across departments, and driving innovation.

Responsibilities:

Technical Leadership and Architecture

Architect and implement highly scalable, secure, and efficient ETL/ELT pipelines for both real-time and batch data processing.
Design complex, multi-source data ecosystems and ensure seamless integration with tools like Databricks, Delta Lake, and Snowflake.
Optimize data pipelines and workflows for performance, cost, and reliability, leveraging cutting-edge tools like Airflow, Spark, Flink, and Databricks Delta Sharing.
Lead the adoption of best practices in data warehousing, lakehouse architecture, and metadata management.
Champion data security, privacy, and governance, implementing frameworks for lineage tracking, cataloging, and compliance (e.g., SOx, GDPR, CCPA).
Drive implementation of Unity Catalog for data governance and cross-account querying.

Platform Development and Operational Excellence

Able to assist in the set up and manage AWS environments, including S3, IAM Roles, Network Peering, and other infrastructure components.
Oversee Airflow integration with Databricks Spark clusters, manage user access, and implement robust secret management solutions.
Lead the CI/CD process with gated code releases, ensuring code quality and scalable deployment processes.
Implement innovative solutions, from the exciting to the mundane; such as Databricks UniForm (Iceberg, Delta) format integration with Snowflake and basic tools to support cost projection, etc.

Data Engineering and Optimization

Optimize Spark Streaming and ETL workflows, leveraging deep expertise in Spark performance tuning.
Ensure best practices in data ingestion, transformation, and loading, focusing on highly performant and governed data models.
Drive improvements in Delta Lake ecosystems and lakehouse architecture, including Delta Sharing for distributed querying.

Collaboration and Communication

Collaborate closely with cross-functional teams, including Ad Server architects, to align on data strategies and designs.
Foster open communication during architectural discussions, confidently defending decisions while welcoming feedback.
Bridge the gap between diverse team requirements and technical capabilities to deliver cohesive, scalable solutions.

Innovation and Mentorship

Stay ahead of emerging trends in big data technologies, cloud platforms (AWS, Azure, GCP), and distributed computing.
Mentor engineers and architects, fostering a culture of innovation, knowledge sharing, and technical excellence.

Basic Qualifications

Bachelor’s or Master's degree in Computer Science, Software Engineering or related technical discipline is highly desirable
10+ years of experience in software engineering with a focus on big data platforms.
Proven expertise in building scalable systems capable of processing terabytes of data per hour.
Hands-on experience with Databricks, Spark, Flink, Airflow, and Delta Lake ecosystems.
Proficiency in Python (including PySpark), Java, or Scala.
Extensive knowledge of data warehousing, data lakes, and real-time streaming systems.
Hands-on experience with AWS cloud services and data solutions (e.g., S3, Redshift, Athena, IAM).
Deep understanding of data compliance (e.g., SOX, GDPR) and governance.
Strong skills in data lineage, cataloging, and metadata management.

Preferred Qualifications

Experience in the media advertising domain, including linear and digital Ad Sales.
Expertise with tools like ERStudio, ERWin, Alation, or Collibra for metadata management.
Familiarity with Iceberg format integration and other modern data formats.
Certifications in Databricks, AWS, or relevant big data technologies.
Ability to manage/lead a team of high-performing data engineers and architects.
Strong curiosity about how Disney delivers the Magic and a desire to be a part of it

#disneytech

The hiring range for this position in Los Angeles, CA is between $184,300 – $247,100 year and San Franscico, CA is between $201,900 - $270,700 and Seattle, WA is between $193,100 - $258,900. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

申請

關於Disney Entertainment & ESPN Technology:

Disney Entertainment 和 ESPN Technology (DE&E Technology) 為 Disney 的兩個媒體業務部門提供技術骨幹和產品開發，同時幫助公司處於創新尖端，使公司能夠不斷利用技術增強故事講述和創造力，同時為其業務提供可擴展性、靈活性和效率

關於 The Walt Disney Company:

Walt Disney Company 連同其子公司和聯營公司，是領先的多元化國際家庭娛樂和媒體企業，其業務主要涉及三個範疇：Disney Entertainment、ESPN 及 Disney Experiences。Disney 在 1920 年代的起步之初，只是一間卡通工作室，至今已成為娛樂界的翹楚，並昂然堅守傳承，繼續為家庭中每位成員創造世界一流的故事與體驗。Disney 的故事、人物與體驗傳遍世界每個角落，深入人心。我們在 40 多個國家/地區營運業務，僱員及演藝人員攜手協力，創造全球和當地人們都珍愛的娛樂體驗。

這個職位隸屬於 Disney Streaming Technology LLC，其所屬的業務部門是 Disney Entertainment & ESPN Technology。

Disney Streaming Technology LLC 是提供平等就業機會的僱主。求職者都會獲得聘僱考量的機會，不分種族、宗教、膚色、生理性別、性傾向、社會性別、性別認同、性別表達、原國籍、血統、年齡、婚姻狀態、軍人或退伍軍人身份、醫療狀況、遺傳資訊或殘疾狀況、或者聯邦、州級或地方法律所禁止的其他任何基本特徵。Disney 提倡讓所有人的想法和決策都有助我們發展、創新、創造最好故事的商業環境，並與瞬息萬變的世界息息相關。

就業申請的殘疾便利安排

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, visit the Disney candidate disability accommodations FAQs. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

遇到技術問題？查看常見問題以尋求協助。