| Job Location | Abu Dhabi, United Arab Emirates |
| Education | Not Mentioned |
| Salary | Not Mentioned |
| Industry | Other Business Support Services |
| Functional Area | Not Mentioned |
Big Data Engineer (Internal)Technology Abu Dhabi/Al Ain, Abu Dhabi Minimum ExperienceExperiencedAs an ALEF Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code . You will provide technical leadership, working closely with the wider team to ensure high quality code is delivered in line with the project goals and delivery cycles. You will work closely with other teams to deliver rapid prototypes as well as production code for which you will ensure high accessibility standards are upheld. We expect familiarity with modern frameworks and languages, as well as working practices such as Clean Code, TDD, BDD, continuous integration, continuous delivery, and DevOps. ? Participating in sprint planning to work with developers and project teams to ensure projects are deployable and monitorable from the outside. ? Work with third-party and other internal providers to support a variety of integrations. ? Outstanding ability to develop efficient, readable, highly optimized/maintainable and clear code. ? Knowledge of AWS Big Data/Analytics services - S3, EMR, Glue, Redshift, QuickSight, Kinesis. ? Experience of big data environments (also advising best practices/new technologies to Analytics team) ? Experience of handling large data sets and scaling their handling and storage. ? Experience of Storing Data in systems such as Hadoop HFDS, S3, Kafka. ? Experience of designing, setting up and running big data tech stacks such as Hadoop, Spark and distributed datastores such as Cassandra, DocumentDBs, MongoDB, Kafka. ? In depth knowledge of Hadoop technology ecosystem - HDFS, Spark, Impala, Hbase, Kafka, Flume, Sqoop, Oozie, SPARK, Avro, Parquet ? Experience debugging a complex multi-server service. ? In depth knowledge and experience in IaaS/PaaS solutions (eg AWS Infrastructure hosting and managed services) ? Familiarity with network protocols - TCP/IP, HTTP, SSL, etc. ? Knowledge of relational and non-relational database systems ? An ability to communicate technical concepts to a non-technical audience. ? Working knowledge of unix-like operating systems such as Linux and/or Mac OS X. ? Knowledge of the git version control system. ? Ability to quickly research and learn new programming tools and techniques. ? Experience of designing Batch Processing with Spark and Stream Processing with either Spark Streaming or Samza. ? Understanding and experience of Search Data applications/platforms such as ElasticSearch, Splunk and others. ? Experience mentoring or helping colleagues optimise their code.. ? System administration and configuration management skills. ? Experience presenting work at user groups, business and to peers. ? Experience of designing and maintaining public HTTP APIs. Location Abu Dhabi/Al Ain, Abu Dhabi Minimum Experience Experienced
Keyskills :
© 2023 HireeJobsGulf All Rights Reserved