Senior Data Engineer - Identity Data
工作概要:
Disney Entertainment & ESPN Technology
On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.
A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology
- Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
- Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
- Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.
The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming platforms Disney+, Hulu, and ESPN+, and digital products & experiences across ESPN, Marvel, Disney Studios, NatGeo, and ABC News. The team drives innovation at scale for millions of consumers around the world across Apple, Android, Smart TVs, game consoles, and the web, with our platforms powering core experiences like personalization, search, messaging and data.
Job Summary:
We contribute to the Company’s success by partnering with business, analytics and infrastructure teams in designing and building data pipelines for our foundational data sets related to Identity, Account, Profile and Device data. We support downstream teams by providing data and data related services to consumers across all of the Disney companies. Collaborating across teams, we define technical requirements, identify internal/external data sources, design table structure, define ETL strategy, implement and automate data quality checks and alerting.
As a Senior Data Engineer within Identity Data Engineering, You will help build systems which can elastically scale to handle extensive amounts of data. You will be exposed to all phases of the software development process. From business use-case refinement, architecture, implementation, testing, deployment to support. In addition, You will partner with upstream/downstream providers of data from internal teams to external vendors. Work with other tech teams in architecture, infrastructure/platform, DevOps, SecOps, QA, data analysts and data science. Lastly, collaborate with Technical Project Manager(s) and Product Owners on task definition, estimation and refinement
Our team builds on cloud-based technology often pushing the edge of what is available and solving for scalability, reliability, resilience and performance. Our engineers have opportunities to work on challenges and problems not found in most companies due to volume, scale, near-real-time and latency requirements.
Responsibilities and Duties of the Role:
- Design table structures and implement ETL pipelines to build performant data solutions that are reliable and scalable in a fast growing data ecosystem, including defining data quality checks and validations, orchestration of pipelines using Airflow
- Writing code, researching, solving and resolving issues and improving applications
- Support several legacy applications as we migrate functionality to new applications
- Improve existing pipelines with optimizations, deprecations, new technology
- Research data and data issues
Required Education, Experience/Skills/Training:
Basic Qualifications
- 5+ years of relevant experience
- 4+ years professional programming experience with w/Java, Python and/or Scala
- 3+ years of data engineering experience developing large data pipelines with MapReduce/Spark/PySpark and hands-on experience with AWS
- Strong communication skills – written and verbal presentations and able to communicate effectively at all levels
Preferred Qualifications
- Ability to describe highly technical detail in terms the audience will understand
- Familiarity with Agile Scrum principles and ceremonies
- 4+ years experience using analytic SQL working with traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Snowflake/Redshift
- 2+ years of experience with data orchestration/ETL tools such as Airflow, Nifi
- Familiarity with data exploration / data visualization
- Exposure to Graph Databases and query languages (Neptune, Janus, Neo4j, Gremlin/Cypher)
- Experience with messaging and/or streaming systems (Kafka, Kinesis, Spark Streaming)
Required Education:
- Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience
- Master’s Degree a plus
The hiring range for this position in Santa Monica, California is $136,038 to $182,490 per year, in Bristol, Connecticut is $136,038 to $182,490 per year, in Seattle, Washington is $142,516 to $191,180 per year. in New York City, NY is $142.516 to $191,180 per year, and in San Francisco, California is $149,000 to $199,000 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
關於Disney Entertainment & ESPN Technology:
Disney Entertainment 和 ESPN Technology (DE&E Technology) 為 Disney 的兩個媒體業務部門提供技術骨幹和產品開發,同時幫助公司處於創新尖端,使公司能夠不斷利用技術增強故事講述和創造力,同時為其業務提供可擴展性、靈活性和效率
關於 The Walt Disney Company:
Walt Disney Company 連同其子公司和聯營公司,是領先的多元化國際家庭娛樂和媒體企業,其業務主要涉及三個範疇:Disney Entertainment、ESPN 及 Disney Experiences。Disney 在 1920 年代的起步之初,只是一間卡通工作室,至今已成為娛樂界的翹楚,並昂然堅守傳承,繼續為家庭中每位成員創造世界一流的故事與體驗。Disney 的故事、人物與體驗傳遍世界每個角落,深入人心。我們在 40 多個國家/地區營運業務,僱員及演藝人員攜手協力,創造全球和當地人們都珍愛的娛樂體驗。
這個職位隸屬於 Disney Streaming Technology LLC,其所屬的業務部門是 Disney Entertainment & ESPN Technology。
Disney Streaming Technology LLC 是提供平等就業機會的僱主。求職者都會獲得聘僱考量的機會,不分種族、宗教、膚色、生理性別、性傾向、社會性別、性別認同、性別表達、原國籍、血統、年齡、婚姻狀態、軍人或退伍軍人身份、醫療狀況、遺傳資訊或殘疾狀況、或者聯邦、州級或地方法律所禁止的其他任何基本特徵。Disney 提倡讓所有人的想法和決策都有助我們發展、創新、創造最好故事的商業環境,並與瞬息萬變的世界息息相關。
就業申請的殘疾便利安排
The Walt Disney Company 及其聯營公司是推動平等就業機會的僱主,歡迎所有求職者,包括殘疾人士及殘疾退伍軍人。如你是殘疾人士,並需要合理便利安排以搜尋職位空缺或申請職位,請將要求發送至Candidate.Accommodations@Disney.com。本電郵地址不擬用於一般僱傭查詢或通訊。我們只會回應與網上申請系統殘疾人士無障礙功能相關的要求。
遇到技術問題?查看常見問題以尋求協助。
招聘流程
-
您的故事從哪裡開始?
探索 Disney 職位空缺和 The Life at Disney 網誌,了解華特迪士尼公司有待發掘的所有精彩機會。
-
迪士尼的故事裏,有你更精彩成就迪士尼故事
有許多不同品牌和業務可供探索。當您找到適合您的機會後,請填寫您的申請,進行下一步。
-
下一章
申請後,您將收到一封電子郵件,讓您可存取應徵者控制面板。建立您的登入資料,並確保經常檢視您的控制面板,以查看申請進度。
探索此地點 紐約州紐約市
紐約市擁有全球知名的天際線,有 840 萬人稱之為家,她洋溢著多元化和興奮,從標誌性的景點到等待被發掘的隱世瑰寶,應有盡有。
相關工作
- Lead Software Engineer (Roku/BrightScript) Disney Entertainment & ESPN Technology 10106852 旧金山, 加利福尼亚州 / 布里斯托尔, 康乃狄克州 / 圣莫尼卡, 加利福尼亚州 / 格倫代爾, 加利福尼亚州 / 纽约, 纽约州 / 西雅圖, 华盛顿州 申請
- Senior Machine Learning Engineer Disney Entertainment & ESPN Technology 10103201 纽约, 纽约州 / 圣莫尼卡, 加利福尼亚州 / 旧金山, 加利福尼亚州 / 西雅圖, 华盛顿州 申請
- Software Engineer II Disney Entertainment & ESPN Technology 10103013 纽约, 纽约州 申請
我們的文化
相關內容
-
-
-
-
福利 我們的福利
-
-
-
員工故事 Life at Disney 網誌
-
-
-
-
-
-
事業發展 求職者資源
-
多元、公平與包容 文化與價值觀 員工故事 工作與創新 學生及應屆畢業生 Life at Disney: Hong Kong Disneyland Resort
-
-
工作機會 員工故事 學生及應屆畢業生 A Dream to Perform Comes True for a Disney Intern at Hong Kong Disneyland
-
-
工作機會 員工故事 學生及應屆畢業生 A Dream to Perform Comes True for a Disney Intern at Hong Kong Disneyland
-
-
員工故事 學生及應屆畢業生 From Disney Internships to Beyond: Meet Three Hong Kong Disneyland Resort Cast Members Making an Impact
-
員工故事 學生及應屆畢業生 Disney Internships Lead to Magical Friendships and Careers at Hong Kong Disneyland Resort
-
-
-
-
-
-
-
-
-
-
-
-
登記收取職缺通知
即時收到最新的工作機會的資訊。
分享
連結會在新分頁中開啟。