Data Engineer

Job Description

techcarrot FZ LLC | Full timeData EngineerDubai, United Arab Emirates | Posted on 03/31/2022 {{getI18n( zr.cw.refertofrnd )}} {{getI18n(zr.careers.publicpage.meta.viewapplication)}} {{getI18n(data[0].applynow)}}Responsibilities:· You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness and business value. · You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences. · You participate in early state design and feature definition activities. · Responsible for implementing robust data pipeline using Microsoft,Databricks Stack · Responsible for creating reusable and scalable data pipelines · You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.Skills:· Advanced working knowledge and experience with relational and non-relational databases · Experience building and optimizing Big Data data pipelines, architectures and data sets · Strong analytic skills related to working with unstructured datasets · Strong experience in Azure Datafactory,Databricks, Eventhub, Python,PySpark ,Synapse and SQL · Azure Devops experience to deploy the ADF pipelines.Qualifications and Experience:* Minimum 3-5 years of relevant experience * Bachelors degree * Knowledge/Experience with Azure cloud stack. {{getI18n(zr.careers.publicpage.meta.viewapplication)}} {{getI18n(data[0].applynow)}} {{userData.full_name}} {{userData.role.name}}, {{userData.profile.name}}{{getI18n( crm.sme.skill.list.head.experience )}}{{getI18n(crm.auditlog.skillset)}} {{getI18n(crm.sme.skill.list.head.experience)}} {{getI18n(crm.sme.skill.list.head.last.used)}} {{getI18n(crm.sme.system.skill)}} {{getI18n(crm.auditlog.skillset)}} {{getI18n(zr.skillset.proficiency)}} {{getI18n(crm.sme.skill.list.head.experience)}} {{getI18n(crm.sme.skill.list.head.last.used)}} {{getI18n(zr.candidateportal.skillname.mandatory)}} {{getI18n(zr.candidateportal.skillname.unique)}} {{getI18n(zr.cl.iam.error.morethanmaxlength,255)}} {{getSkillProficiencyFromLevel(skill.body.level,i18n)}} {{getI18n(crm.contactus.option.None)}} {{getI18n(crm.sme.skill.level.master)}} {{getI18n(crm.sme.skill.level.intermediate)}} {{getI18n(crm.sme.skill.level.beginner)}} {{if(skill.body.exp,getI18n(crm.indeed.workexp.years,skill.body.exp),getI18n(-None-))}} 1 {{getI18n(crm.year.lower)}} {{getI18n(crm.indeed.workexp.years,exp)}} {{if(skill.body.lastUsed,skill.body.lastUsed,getI18n(-None-))}} {{getI18n(crm.contactus.option.None)}} {{year}}{{getI18n(crm.sme.refine.suggested)}}* {{suggSkill}} {{getI18n(zr.candidateportal.add.skills)}} {{getCombinedSkillNames(skills,30,is_skill_name_double_encode)}} * {{if(is_skill_name_double_encode,getTextContentFromHTML(unescape(skill.name)),skill.name)}} {{getI18n(zr.skillset.proficiency)}} - {{getSkillProficiencyFromLevel(skill.level,i18n)}} {{getI18n(Experience in years)}} - {{skill.exp}} {{getI18n(crm.sme.skill.list.head.last.used)}} - {{skill.lastUsed}} {{initializeFilterSkillsLength()}} {{initializeFilterSkillsLength()}} {{increaseFilterSkillsLength()}} * {{trimContent(skill.name,25)}} {{skill.name}} * +{{arithmetic(getFilterSkillsLength(skills),num_tags,-)}} {{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(location,25)}} {{location}}** {{trimContent(type,25)}} {{type}}{{unescape(sanitizeHTML(descriptionHTML))}} {{unescape(removeUnwantedCss(org_info.description))}} {{org_info.description}}

Keyskills :