Responsible for the Operations and maintenance of DWH systems (Teradata, Informatica (Extraction, Transformation and Loading) .
Responsible for reports development, deployment and making the analysis and design of the queries used in these reports .
Responsible for monitor, maintain and troubleshoot auto refresh process of DWH systems and software.
Analyze and Development of the Ad hoc queries required by Customer business users.
Monitor all processes are running, all data Feed are coming properly and parsing is done. And Ensure to clear the backlogs for normal processing .
Ensure dumps needed by BI systems are sent on time as per the requirements of the BI policy approved by Customer.
Responsible for administering Hadoop clusters (Cloudera) including activities like deploy Hadoop clusters, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability.
Perform Cluster tuning, cluster monitoring and troubleshooting. Backup, Snapshot and Recovery from node failure.
Responsible for Installing and configuring Hadoop Security using Kerberos and Sentry.
Good understanding of Spark, Hive, Kafka and HBase architecture.
Installing, configuring, maintaining and monitoring of HDFS, Yarn, Spark, Hive, Oozie, Kafka, Impala, Zookeeper and other Hadoop eco systems.
Responsible for Monitoring, Performance tuning of Hadoop clusters .
Create Snapshot policies and Recovery from node failures.
Perform Commissioning and Decommissioning of nodes and running balancer utility.
Experience in installation, configuration, and upgrade/migration of Cloudera platforms: CDH, CDP (private cloud and/or public cloud).
