Senior Cloudera Administrator SME with Cloudera Data Platform - Alexandria, United States - Cubicle Logic LLC

Cubicle Logic LLC Alexandria, United States

1 week ago

Description

Job Description

Job Description

Senior Cloudera

Administrator/Infrastructure

SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud)

Role & Responsibilities:
Will be responsible for the administration of Cloudera CDP on-prem and cloud infrastructure.
Leverage the CDP features to build the cloud-hybrid infrastructure for CDP (CDP Public Cloud).

Independently installs and maintains Big Data (Cloudera) clusters in high available, load balanced configuration across multiple (Production, QA and Development) environments in both on-prem and Cloud (AWS) environment.

Implement the Knox and Kerberos for Cluster security and integrate with enterprise and cloud IAM.
Develop scripts to automate and streamline operations and configuration
Manage and automate the installation process (use tools like Ansible) for CDP Manager, CDH, and the ecosystem projects

Activities include :
Set up a local CDH repository; Perform OS-level configuration for Hadoop installation; Install Cloudera Manager server and agents; Install CDH using Cloudera Manager; Add a new node to an existing cluster; Add a service using Cloudera Manager
Schedule the jobs using Apache Nifi or Air flow
Analyze, recommend and implement improvements to support

environment/infrastructure

management initiatives. Configure - Perform basic and advanced configuration needed to effectively administer a Hadoop cluster on-prem and on-cloud

Activities include :
Configure a service using Cloudera Manager; Create an HDFS user's home directory; Configure NameNode HA; Configure ResourceManager HA; Configure proxy for Hiveserver2/Impala
Maintain and modify the cluster to support day-to-day operations in the enterprise

Activities include :
Rebalance the cluster; Set up alerting for excessive disk fill; Define and install a rack topology script; Install new type of I/O compression library in cluster; Revise YARN resource assignment based on user feedback;

Commission/decommission

a node
Enable relevant services and configure the cluster to meet goals defined by security policies,

Activities include:
Configure HDFS ACLs; Install and configure Sentry; Configure Hue user authorization and authentication; Enable/configure log and query redaction; Create encrypted zones in HDFS
Benchmark the cluster operational metrics, test system configuration for operation and efficiency

Activities include:
Efficiently copy data within a cluster/between clusters; Create/restore a snapshot of an HDFS directory; Get/set ACLs for a file or directory structure; Benchmark the cluster (I/O, CPU, network)
Under general supervision, manage Big Data Administration activities, technical documentation, system performance support, and internal customer support. May provide input into the development of Systems Architecture for mission critical corporate development projects.
Research performance issues, configuring the cluster with Cloudera best practices, optimizing specifications and parameters to fine-tune and proactively avoid performance issues

Skills:
Must be Cloudera Certified Hadoop and/or Spark Administrator
Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration.
Must have infrastructure implementation experience on on-prem and Cloud (AWS).
Must have knowledge on CDP Containers and integration of on-prem clusters with Cloud clusters.
Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc
Must have knowledge on Cloudera SDX, Cloudera Public Cloud and Private Cloud infrastructures.

Experience administrating distributed applications:
Hadoop, Spark, Kafka, Map Reduce, Hive, Impala
Experience with large-scale high-performance distributed systems like Hadoop, NoSQL or Spark
Assist in preparing and scaling the cluster as required to execute mission critical data processing processes
Experience with setting up and configuring the YARN queues using the YARN queue manager
·

Deep understanding of IP, TCP, UDP, SSL/TLS protocols
Experience with Devops, scripting or other automation
Experience with Performance monitoring and tuning
Hadoop Cluster maintenance as well as creation and removal of nodes
Working knowledge of Networks, Linux OS and Unix Shell Scripting

Understanding working authorization mechanism for Ranger / Sentry

Systems implementation, operations, and its optimization as Hadoop Admin
Demonstrate ability to find the root cause of a problem in Spark/HDFS and CDP clusters, optimize inefficient execution, and resolve resource contention scenarios; Resolve errors/warnings in Cloudera Manager; Resolve performance problems/errors in cluster operation;Determine reason for application failure; Configure the Fair Scheduler to resolve application delays
Experience on Cloudera Data Science Workbench and Cloudera Data Flow products.
Experience working with Systems Operation Department in resolving variety of infrastructure issues

#J-18808-Ljbffr

Army Data and Analytics Platform Effort

1 week ago

UIC Government Services and the Bowhead Family of Companies Alexandria, United States

Overview · ARMY DATA, ANALYTICS PLATFORM (ARDAP): · Bowhead is seeking to network with qualified candidates for the upcommingArmy Data and Analytics Platform (ARDAP) effort located inthe Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter exp ...
Army Data and Analytics Platform Effort

1 day ago

UIC Technical Services Alexandria, United States

Overview · ARMY DATA, ANALYTICS PLATFORM (ARDAP): · Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter ...
Army Data and Analytics Platform Effort with Security Clearance

2 days ago

UICGS and Bowhead Family of Companies Alexandria, United States

Overview ARMY DATA, ANALYTICS PLATFORM (ARDAP): Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter exper ...
Senior Cloudera Administrator SME with Cloudera Data Platform

1 week ago

Cubicle Logic LLC Alexandria, United States

Job Description · Job DescriptionSenior Cloudera Administrator/Infrastructure SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud) · Role & Responsibilities: · Will be responsible for the administration of Cloudera CDP on-prem and clo ...
Data Platform Engineer

1 week ago

Booz Allen Hamilton Chantilly, United States Full time

Job Number: R0187172 · Data Platform EngineerThe Opportunity: · Are you looking for an opportunity to develop a data platform that will have an impact on rapid exploitation and sharing of multi-INT information across the intelligence community? Solid platform development is a cr ...
Staff Software Engineer, Data Platform

1 day ago

Social Finance Ltd Washington DC, United States

Employee Applicant Privacy Notice · Who we are: · Shape a brighter financial future with us. · Together with our members, we're changing the way people think about and interact with personal finance. · We're a next-generation financial services company and national bank using inn ...
Administrator, Cloud Data Platform- Remote

1 week ago

Booz Allen Washington DC, United States Part time

Cyber Infrastructure Administrator, Senior · Are you passionate about promoting new technology within an information technology (IT) enterprise? At the nexus of IT and mission support, your skills will be utilized to understand unique IT requirements and promote innovative solut ...
Administrator, Cloud Data Platform- Remote

1 week ago

Booz Allen Washington DC, United States Part time

Cyber Infrastructure Administrator, Senior · Are you passionate about promoting new technology within an information technology (IT) enterprise? At the nexus of IT and mission support, your skills will be utilized to understand unique IT requirements and promote innovative solut ...
Administrator, Cloud Data Platform- Remote

1 day ago

Booz Allen Washington DC, United States Part time

Cyber Infrastructure Administrator, Senior · Are you passionate about promoting new technology within an information technology (IT) enterprise? At the nexus of IT and mission support, your skills will be utilized to understand unique IT requirements and promote innovative solut ...
Sr. Manager/Data Platform Architect

1 week ago

Danaher Corporation Washington DC, United States Paid Work

At Cepheid, we are passionate about improving health care through fast, accurate diagnostic testing. Our mission drives us, every moment of every day, as we develop scalable, groundbreaking solutions to solve the world's most complex health challenges. Our associates are involved ...
Big Data Platform Engineer

9 hours ago

Crystal Management Quantico, United States

Job Description · Job DescriptionWho We Are. · At CMIT, we do more than provide real-world solutions. We deliver transformative results. Through cutting-edge technology and process innovations, we are changing how federal and commercial clients worldwide deliver their mission. A ...
Senior Director of Platform Data

2 weeks ago

AstraZeneca Gaithersburg, MD, United States

Are you ready to be part of the future of healthcare? Are you able to think big, be bold, and harness the power of digital and AI to tackle longstanding life sciences challenges? Then Evinova, a new health-tech business part of the AstraZeneca Group might be for you · At Evinova ...
Cloud Database Administrator

2 weeks ago

Dhara Consulting Group Alexandria, United States

Today · - Top Secret · - Mid Level Career (5+ yrs experience) · - IT - Database · - Alexandria, VA** (ON-SITE/OFFICE)**-Chantilly, VA** (ON-SITE/OFFICE)**-Saint Louis, MO** (ON-SITE/OFFICE)** · - Database Administrator · Top Secret · 170k · Alexandria, Chantilly or St Louis, MO. ...
Power BI and Qlik Data Analyst

1 week ago

ACES Group LLC Alexandria, United States

ACES is seeking a Data Analyst to support the Office of the Secretary of Defense (OSD) Chief Information Officer (DoD CIO)/ Command, Control, Communications, and Infrastructure (C3I) Directorate. As a member of our team, you will facilitate the development of dashboards and visua ...
Project Manager/scrummaster

1 week ago

Persistent Technology Alexandria, United States

Posted 29-Mar-2024 (EST)_ · - _85 S Bragg St, Suite 602, Alexandria, VA 22312, US_ · - _Full Time_ · **Project Manager/Scrum Master** · **Position Overview**: PTI is seeking a dynamic and experienced Project Manager/ScrumMaster to support our client, the U.S. Department of Health ...
Technology Sales Specialist

4 days ago

IBM Alexandria, United States

Introduction · A Technology Sales Representative role (what we internally call a, 'Brand Sales Specialist') in IBM's Data & AI brand means accelerating enterprises' success by improving their ability to understand their data. It means providing solutions that enable people across ...
Senior Director of Platform Data

1 week ago

AstraZeneca Gaithersburg, United States Full time

Are you ready to be part of the future of healthcare? Are you able to think big, be bold, and harness the power of digital and AI to tackle longstanding life sciences challenges? Then Evinova, a new health-tech business part of the AstraZeneca Group might be for you · At Evinova ...
Data Analytics Developer

2 weeks ago

Andrew Morgan Consulting Alexandria, United States

**Primary Responsibilities** · - Lead client projects and discussions in cloud data management/movement architecture, data modeling, ETL, big data, data analytics and optimal methods of visualizing the data. · - Design and execute the development of complex analytic solutions usi ...
Digital Marketing Content Specialist

3 hours ago

Reingold Inc Alexandria, United States

Reingold, a full-service marketing and communications firm, is hiring a content specialist to join our fast-paced digital marketing team. This is a unique opportunity to help bring our clients' digital campaigns to life. This is a hybrid role, requiring 2+ days on site at Reingol ...
Qlik Developer

5 days ago

Tallon Recruiting and Staffing Alexandria, United States

**Job Highlights**: · Advancing data analytics platform · **Qlik Developer - REMOTE**: · **VA, Alexandria 22310** · **Security Clearance**: U.S. Citizen, Current Security Clearance, Secret, Top Secret, TS/SCI · **Skills: Qlik, Developer, Cloud Native Services, DataBricks, JavaScr ...