Cloud SRE Engineer

Paris, IDF, FranceFull-time

Company Description

We are music and tech fans hailing from all over the globe, working to make Deezer the most personal music streaming service. From data scientists to tech experts, artists & labels specialists to marketers, and even in-house music editors, our team is spreading the love for music to over 180 countries. Supporting local and international artists and bringing them closer to their fans is our mission - we believe music is about diversity, multiculturalism and togetherness.

Ready to join the team? We're all ears.

Job Description

 Responsibilities:

  • Participate in the cloud migration of our data warehouse.
    • Migrate Hadoop jobs on Google Cloud Platform (dataproc, bigquery etc.).
    • Resource monitoring and optimization.
    • Cost estimation and optimization.
    • Articulate between on-premise infrastructure and cloud (security, network issues).
  • Manage large scale Hadoop cluster environments including capacity planning, cluster setup, performance tuning, monitoring, and Alerting. 
  • Monitor Hadoop jobs and recommend optimization 
  • Work with Core Infrastructure team to automate the deployment and operation of the infrastructure. Manage, deploy, and configure infrastructure with Ansible or other automation toolsets.
  • Debug Infrastructure issues (Like - Underlying network issue or Issues with the nodes)
  • Test/Support for infrastructure component change.
  • Participate proof of concepts on scaling, reliability, performance, and manageability and help other data teams with PoC/Adhoc execution for debugging/cost analysis
  • Develop and apply patches for the data production system. 

Qualifications

  • 4+ years of experience of Spark/MapReduce(Pig, Hive etc.) in a production environment
  • A deep understanding of Hadoop design principals, cluster connectivity, security, and the factors that affect distributed system performance.
  • Experience in Cloudera/Hortonworks and Google Cloud Platform.
  • Knowledge of best practices related to security, performance, and disaster recovery.
  • Good collaboration & communication skills, the ability to participate in an interdisciplinary team.

Additional Information

 

  • Development experience in Java/Scala/Python.