Senior Data Engineer: Data Modeling

Job Description

IntroductionIn this role, you?ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world.? Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.At IBM, work is more than a job ? it?s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you?ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world?s most challenging problems? If so, lets talk.Your Role and ResponsibilitiesAs Data engineer, you will develop and move data from the operational and external environments to the business intelligence environment using Ab Initio software. Skills include designing and developing extract, transform and load (ETL) processes.Responsibilities:

• Coordinate with multiple technical teams to ensure apt integration of functions to identify and define necessary system enhancements to deploy new products and process improvements
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
• Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
• Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
• Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions,

• 4-5 years of full-time working experience in Data Science
• Technology expertise of solutioning in Hadoop, Hive, Spark / PySpark, SQL, Oozie along Data Modeling in Hive
• Expertise in programming Languages- Java / Python / Scala
• Ability to demonstrate micro / macro designing and familiar with Unix Commands and basic work experience in Unix Shell Scripting
• Working knowledge in one NoSQL database like MongoDB/Cassandra/HBase/Couchbase
• Knowledge of various Big data architectures like Lambda / kappa with usage of automation / scheduling tool like Oozie or Cronacle or any other technology
• Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers

Keyskills :