Apply Refer

Job ID: 5007

Sr. Data Engineer

Location: Santa Monica, CA

Project: 6 – 12 months +

Interview Process: Phone/Zoom + Onsite

Responsibilities:

  • Solve complex problems and have the curiosity to explore and learn new technologies for innovative solutions.
  • Design, architect, develop, scale, and improve the big data platform for the entirety of Company
  • Implement solutions using cutting-edge technologies like spark on Hadoop/Hbase/Hive and help to contribute back to the open source community
  • Invent novel solutions to challenging technical problems, introduce new technologies
  • Diagnose and debug issues in production environments
  • Collaborate with researchers, program managers, and product designers in an open, creative environment
  • Bug fixes
  • Daily operational tasks and supports
  • Development of new features/requests, and documentation of the changes
  • Support data quality issues pertain to content metadata, provide impact analysis and fixes
  • Support business stakeholders on content metadata related inquiries
  • Support on development effort, including ticket implementation, integration test, and documentation
  • Support on setting up production execution environment, including scheduled tasks, monitoring, alerting
  • Daily operational tasks and supports
  • Troubleshooting and investigation production issues, propose and execute solutions
  • Data Quality Issue Support
  • Perform analytical tasks on data quality issues, identify the root cause and the impact of the issue
  • Research and propose potential solution/mitigation from the pipeline side for data quality issues
  • Handle data revision, data backfill tasks as the result of data quality issues

Qualifications:

  • Strong programming (Scala/Java) and shell scripting skills
  • Experience with real-time processing technologies like Spark/Storm/Flink
  • BS/MS in Computer Science or related field
  • 3+ years of relevant industry experience
  • Strong knowledge of data architecture and data-warehousing concepts
  • Independent, energetic, highly technical, and capable of driving for results under pressure and ambiguity
  • Experience with Hadoop/Hbase/Hive
  • Strong SQL skill

 Nice-to-Haves

  • Experience of administering Hadoop cluster
  • Experience with Couchbase/MEMSQL

Apply for Job #5007

Refer