Skip to main content

Senior Data Engineer - Identity Data

Apply Now
Job ID 10092609 Location Seattle, Washington, United States / Bristol, Connecticut, United States / Santa Monica, California, United States / San Francisco, California, United States / New York, New York, United States Business Disney Entertainment & ESPN Technology Date posted Jun. 28, 2024

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming platforms Disney+, Hulu, and ESPN+, and digital products & experiences across ESPN, Marvel, Disney Studios, NatGeo, and ABC News. The team drives innovation at scale for millions of consumers around the world across Apple, Android, Smart TVs, game consoles, and the web, with our platforms powering core experiences like personalization, search, messaging and data.

Job Summary:

We contribute to the Company’s success by partnering with business, analytics and infrastructure teams in designing and building data pipelines for our foundational data sets related to Identity, Account, Profile and Device data. We support downstream teams by providing data and data related services to consumers across all of the Disney companies. Collaborating across teams, we define technical requirements, identify internal/external data sources, design table structure, define ETL strategy, implement and automate data quality checks and alerting.

As a Senior Data Engineer within Identity Data Engineering, You will help build systems which can elastically scale to handle extensive amounts of data. You will be exposed to all phases of the software development process. From business use-case refinement, architecture, implementation, testing, deployment to support. In addition, You will partner with upstream/downstream providers of data from internal teams to external vendors. Work with other tech teams in architecture, infrastructure/platform, DevOps, SecOps, QA, data analysts and data science. Lastly, collaborate with Technical Project Manager(s) and Product Owners on task definition, estimation and refinement

Our team builds on cloud-based technology often pushing the edge of what is available and solving for scalability, reliability, resilience and performance. Our engineers have opportunities to work on challenges and problems not found in most companies due to volume, scale, near-real-time and latency requirements.

Responsibilities and Duties of the Role:

  • Design table structures and implement ETL pipelines to build performant data solutions that are reliable and scalable in a fast growing data ecosystem, including defining data quality checks and validations, orchestration of pipelines using Airflow
  • Writing code, researching, solving and resolving issues and improving applications
  • Support several legacy applications as we migrate functionality to new applications
  • Improve existing pipelines with optimizations, deprecations, new technology
  • Research data and data issues

Required Education, Experience/Skills/Training:

Basic Qualifications

  • 5+ years of relevant experience
  • 4+ years professional programming experience with w/Java, Python and/or Scala
  • 3+ years of data engineering experience developing large data pipelines with MapReduce/Spark/PySpark and hands-on experience with AWS
  • Strong communication skills – written and verbal presentations and able to communicate effectively at all levels

Preferred Qualifications

  • Ability to describe highly technical detail in terms the audience will understand
  • Familiarity with Agile Scrum principles and ceremonies
  • 4+ years experience using analytic SQL working with traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Snowflake/Redshift
  • 2+ years of experience with data orchestration/ETL tools such as Airflow, Nifi
  • Familiarity with data exploration / data visualization
  • Exposure to Graph Databases and query languages (Neptune, Janus, Neo4j, Gremlin/Cypher)
  • Experience with messaging and/or streaming systems (Kafka, Kinesis, Spark Streaming)
     

Required Education:

  • Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience
  • Master’s Degree a plus


The hiring range for this position in Santa Monica, California is $136,038 to $182,490 per year, in Bristol, Connecticut is $136,038 to $182,490 per year, in Seattle, Washington is $142,516 to $191,180 per year. in New York City, NY is $142.516 to $191,180 per year, and in San Francisco, California is $149,000 to $199,000 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

About Disney Entertainment & ESPN Technology:

Disney Entertainment and ESPN Technology (DE&E Technology) provides the technological backbone and product development for Disney’s two media business units, while helping to keep the company at the vanguard of innovation – enabling the Company to continuously leverage technology to enhance storytelling and creativity, while delivering scalability, flexibility, and efficiency for its businesses.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise that includes three core business segments: Disney Entertainment, ESPN, and Disney Experiences. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with Disney Streaming Technology LLC, which is part of a business we call Disney Entertainment & ESPN Technology.

Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

DISABILITY ACCOMMODATION FOR EMPLOYMENT APPLICATIONS

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email Candidate.Accommodations@Disney.com with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

Sign up to receive the latest news and company information

Be you. Be here. Be part of story.

Global Opportunities

US & Canada

The Walt Disney Company entertains, informs and inspires people around the globe through the power of unparalleled storytelling, reflecting the iconic brands, creative minds and innovative technologies that make ours the world’s premier entertainment company.

LATAM

The Walt Disney Company Latin America is the leading family entertainment company in Latin America and has been present in the region since the 1940’s when Walt Disney traveled to Brazil, Argentina and Peru.

EMEA

Disney EMEA aims to drive growth, innovation and brand affinity across an extremely diverse collection of countries with a team of over 6,000 employees operating in 59 markets with offices in 29 countries.

India

The Walt Disney Company entertains, informs and inspires people around the globe through the power of unparalleled storytelling, reflecting the iconic brands, creative minds and innovative technologies that make ours the world’s premier entertainment company.

APAC

For over 70 years, The Walt Disney Company has been entertaining consumers in Asia Pacific – and enriching people’s lives. Today’s consumer can discover new branded experiences in many ways and in many markets across the APAC region.

nighttime view of the Spaceship Earth attraction at Walt Disney World in Florida

The Walt Disney Company is a global community of unparalleled storytellers, creative minds, and innovative technologies, with offices located across the globe.

Sign Up for Job Alerts

Get the latest job opportunities as they become available.

Watch Our Jobs

Sign up to receive the latest news and company information based on your preferences. An asterisk indicates a required field.

Interested InSelect a job category from the list of options. Select a location from the list of options. Finally, click “Add” to create your job alert.

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window).

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window). If I have elected to receive marketing messages or newsletters, I may withdraw my consent for these marketing messages at any time.

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window), Cookies Policy (opens in new window) and EU Privacy Rights (opens in new window).

How we use your personal information and your rights:

  1. Your personal information is controlled by The Walt Disney Company Limited of 3 Queen Caroline Street, London, W6 9PE, United Kingdom.
  2. When you visit or shop with Disney or use any Disney product, service or mobile application, other members of The Walt Disney Company Family of Companies may also use your information to provide you these services, personalise your experience and send you service related updates and communications.
  3. You have a number of rights including the right to request access to, change, or remove your personal information, or to change your marketing preferences (including withdrawing your consent at any time.) Please see our Privacy Policy (opens in new window) to learn more about managing your marketing preferences or deleting your account.
  4. Our Data Protection Officer can be contacted by emailing: dataprotection@disney.co.uk.
  5. You have a right to lodge a complaint with the UK Information Commissioner's Office: https://ico.org.uk/ (opens in new window).
  6. For more information about Disney's data collection and use practices please read Disney's Privacy Policy (opens in new window).

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window) and Collection Statement (opens in new window).

For more information about our general data collection, use, and practices, including how to manage your preferences, please read our Privacy Policy (opens in new window). I have read and agree to the Terms of Use (opens in new window).