Setting up production grade Hadoop clusters and its components through Cloudera
Manager and Apache Ambari in virtualized environments (AWS Cloud) and
? Installation, Configuration and Administration of Various Hadoop distributions like
Cloudera, Hortonworks and Apache Hadoop.
? Advanced Experience with Cloudera Distribution of Hadoop (CDH) and Knowledge
of different Hadoop Distributions such as Hortonworks (HDP).
? Experienced in Designing Hadoop Architecture AWS Cloud and with Production
ready features like High Availability, Scalability, Security.
? Configuring various components such as HDFS, YARN, MapReduce (MRI & MR2),
Sqoop, Flume, Pig,Hive, Zookeeper, Sentry.
? Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
? Kerberos, TLS/SSL installation and Configuration on HDP and CDH.
? AD, LDAP installation and Configuration on HDP and CDH.
? Setting up Linux users and groups, setting up Kerberos principals and testing HDFS,
and MapReduce access for the new users.
? Worked with system engineer team to plan and deploy new hadoop environments.
Analyze Namenode and Jobtracker Web UI.
? Involved in Analyzing system failures, identify root causes, and recommended course
? Implementing Hadoop security using ACL.
? Decommissioning and commissioning the Node on running cluster including
Balancing HDFS block data.
? Performing major and minor upgrades of Hadoop clusters in Cloudera distributions.
? Flume configuration to load log files into HDFS.
? Sqoop configuration to import/export data to/from Mysql databases.
? Setting Hadoop prerequisite on Linux server.
? Hand on experience in issue tracking tool Jira.
? Experience in Commissioning and Decommissioning, Trash configuration, node
Skills & Expertise
Administrative AssistantApacheApache HadoopCloud ComputingCluster AnalysisComponent DevelopmentData ManagementDesignEngineeringFeature WritingInstallation DesignKerberosLdapLikesLinux ProgrammingMicrosoft AccessMySQLNode.jsPerformance EngineeringPlanningQuality Assurance (QA) And TestingSystems EngineeringTeam ManagementWeb Development