Senior Software Engineer - Data Engineering

Job Description

At Careem we are led by a powerful purpose to simplify and improve lives in the Middle East, North Africa and Pakistan. Were pioneering the development of innovative services to aid the mobility of people, the mobility of things and the mobility of money.Were in the driving seat as we help to define how technology will shape progress in some of the fastest-growing countries in the world. Our teams are building tech to meet the needs of the future in areas including data and AI, e-commerce, technology-enabled logistics, maps, identity, and fintech.We?re well placed to solve complex and meaningful challenges at scale, with deep tech expertise, strong regulatory relationships, a local presence, and increasingly specialised global teams which are structured to operate as autonomous start-ups. Our team of over 400 engineers and developers are empowered to develop cutting-edge technology every day.Careem was established in July 2012, became a wholly-owned subsidiary of Uber Technologies, Inc. in January 2020, and today operates in over 100 cities across 12 countries.About the roleThe Careem Big Data Platform team?s mission is to provide a platform to abstract big data complexities and enable fast, reliable and secure access to data. As the leader of this team, you will be at the forefront of fulfilling this mission. You will be working with and leading the top talent of the region, leveraging modern big data tools and techniques to solve the region?s day to day problems, on top of our own in-house data platform, serving users in real-time.What youll do

• Define the architecture, scope and deliver various Big Data solutions.
• Build and maintain large scale deployment of Cassandra cluster.
• Support other teams by providing guidance on data modeling, data usage, processing and how they can best leverage the platform
• Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules.
• Leverage Spark/Hadoop ecosystem knowledge to design and develop capabilities to deliver innovative and improved data solutions.
• Provide insights on area of improvements including Data Governance, best practices, large scale processing
• Support the bug fixing and performance analysis along the data pipeline
• Collaborate, coach, and mentor colleagues in an energetic, growing team

What youll need

• 8+ years of experience as software engineer, with strong skills in at least one programming language is mandatory, preferably Scala or Java or Python
• 4+ years of experience with Cassandra Deployment/Maintenance and Cassandra Data Modelling
• Expertise with distributed systems and design/implementation for reliability, availability, scalability and performance
• Proven experience with AWS technologies like S3, EMR, Cloudformation.
• Creative and innovative approach to problem-solving
• 5+ years of experience as a Big Data Engineer or similar role
• 3+ year of experience with Hadoop and/or Spark
• Experience with CICD using Jenkins, Terraform or other related technologies
• Familiarity with containerized platform like Docker and Kubernetes
• Experience working with real time data processing using Kafka, Spark Streaming or similar technology
• Experience working with Hive, Presto or other querying frameworks.

Where youll be

• This role is part of a remote distributed team! This means you can be based in any of the countries where we currently have an engineering site. If you would like to join us in Dubai, Berlin, UK, Spain, Poland, Pakistan, Egypt, Lebanon or Jordan, thats fine with us (Visa permitting)!
• Even though we are working remotely, we are strong believers in collaboration and the power of building social connections with our teams. For that reason, our offices are still open and provide plenty of collaboration-friendly spaces at times when teams need it or if you need a quiet space to work outside of home.
• You?ll be working in the location you?re hired from. Due to legal and compensation considerations, you will need to be based out of the country you?re hired from as your primary work location.

What well provide youIn addition to a competitive long-term total compensation with salary and equity, we have a reward philosophy that expands beyond this.As a Careem colleague you will be able to:

• Be part of a Remote-First organisation
• Work from any country in the world for 60 days a year
• Use Unlimited Vacation days throughout the year
• Access fitness reimbursements for health activities including: gym, health club and training classes.
• Work and learn from great minds
• Create impact in a region with untapped potential
• Explore new opportunities to learn and grow every day

Keyskills :