| Job Location | AbuDhabi,UnitedArabEmirates |
| Education | Graduate |
| Salary | Not Mentioned |
| Industry | IT-Software |
| Functional Area | Not Mentioned |
Data Engineer For a Govt Client based in Abu DhabiRequirements :?must have GIS experience.?Minimum of 5 years of experience in a Data Engineer role?Preferred degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field?Experience in Big Data platforms such as AWS, Azure, Spark, CouchDB, Hive, Pig, etc.?Experience in integrating data into analytical platforms, ingestion technologies, data profiling, sourcetarget mappings, ETL development, SQL optimization, testing and implementation?Experience with building processes supporting data transformation, data structures, metadata, dependency and workload management?Experience supporting and working with crossfunctional teams in a dynamic environment?Strong analytic skills related to working with unstructured datasets?Support in the development of use cases and build the data models and data flows required to support analytical model development?Build and monitor the integrations with ADGEs including ETL / ELT?Build and deploy inference pipelines to productionize the models built and refactor code for new future algorithms as a reusable library?Set up of CI/CD (continuous integration and continuous deployment) pipelines required for the delivery of ADGEs data services (analytics, data mart, etc.) on their own data platform?Set up model monitoring capabilities and model retraining workflow to ensure continuous improvement of data models?Work with the data architect and external vendors in the implementation of any technology infrastructure or tools?Work closely with Data Architect to produce conceptual and logical data architecture design across the platform?Build, test and maintain data connectors and data pipelines required for data acquisition in the platform?Set up data management tools to ensure data is handled appropriately on the platform?Perform the relevant tests required to ensure data quality and perform holistic analysis of the datasets defined for the ADGE?Maintain the data quality of dashboards and reports consistently with the relevant internal and external stakeholders (e.g., Data Director, etc.)?Work with data owners, stewards and data governance and compliance team to understand the business rules and to deploy them into the ETL / ELTs as well as integrate them with the existing dashboards?Test the outcome of ETL integration, and initiate reconciliation between ETL outputs and ingestions inputs?Build the test automation rules relating to data ingestion, if applicable
Keyskills :
ExperienceinBigDataplatformssuchasAWSAzureSparkCouchDBHivePigetc.
© 2023 HireeJobsGulf All Rights Reserved
