Data Engineer

Job Description

Roles & ResponsibilitiesDesign, develop, and maintain data ingestion, transformation, and orchestration pipelines using Microsoft Fabric and Azure Data Factory (ADF).Build and manage ETL/ELT processes for structured and unstructured data sources.Develop and optimize data models, data lakes, and data warehouses within the Azure ecosystem.Integrate data from multiple on-premises and cloud-based systems.Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.Implement data quality, governance, and security best practices.Collaborate with business analysts, data scientists, and stakeholders to understand data requirements.Develop and maintain technical documentation, data dictionaries, and operational procedures.Support reporting and analytics platforms such as Power BI.Participate in data platform modernization and cloud migration initiatives.implementing improvements.Desired Candidate ProfileBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Minimum 4?6 years of experience in data engineering or related roles.Strong experience with Microsoft Fabric, including Data Factory, Lakehouse, Data Warehouse, and Dataflows.Hands-on experience with Azure Data Factory (ADF).Proficiency in SQL and data modeling concepts.Experience with Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL Database.Strong understanding of ETL/ELT design and implementation.Experience with REST APIs, data integration, and automation.Knowledge of CI/CD practices and version control tools such as Git.Strong analytical and problem-solving skills.Preferred QualificationsMicrosoft Azure Data Engineer certification (DP-203) or Microsoft Fabric certification.Experience with Python, PySpark, or Spark-based data processing.Experience with Power BI and analytics solutions.Knowledge of DevOps and Infrastructure-as-Code practices.Experience working in Agile environments.Technical SkillsMicrosoft FabricAzure Data Factory (ADF)Azure Data Lake Storage (ADLS Gen2)Azure Synapse AnalyticsAzure SQL DatabaseSQL ServerPySpark / SparkPythonPower BIGit / Azure DevOpsREST APIsKey CompetenciesData Integration & ETL/ELT DevelopmentData Modeling & WarehousingPerformance OptimizationProblem Solving & TroubleshootingStakeholder ManagementDocumentation & Knowledge SharingTeam Collaboration

Keyskills :