AWS Hadoop Admin - Windsor Locks, United States - Diverse Lynx

Description

• Hadoop EMR Admin
• Big Data Management
• WS Services (EMR, S3, IAM and CloudWatch) and IAC tools such as such as Terraform, Cloudformation.

• Experience building and maintaining AWS EC2 instances preferably using any of the IAC tools such as Terraform, Cloudformation and configuring servers using Ansible.
• Experience in AWS EMR, S3, IAM and CloudWatch services.
• Experience with Python / R, strong shell scripting and SQL skills.
• Good understanding and experience in Hadoop / EMR and Spark architecture, coding in PySpark, Sqoop, Hive and HDFS.
• Proficient in Linux System Administration
• Proficient in Bash, basic Linux commands. Linux package installations, python package installations, managing Linux services,
• Good understanding of Linux Directory structure and Linux utilities such as awk, sed, top / htop, rsync and concepts such as SSH, SCP, HTTPD/NGINX webservers, PAM, Kerberos authentication.
• Good understanding of CI/CD processes using GitHub, Jenkins (mostly ZIP template), Udeploy and Nexus
• Experience with scheduling tools - CRON and Autosys
• GitHub knowledge and fluent in using git commands to fork and/or clone repositories, create/delete/switch/merge branches, commit changes, push changes to remote, create / merge pull requests, create / edit github wiki pages and files

All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.