Senior Cloudera Administrator SME with Cloudera Data Platform - Alexandria, United States - Cubicle Logic LLC

Cubicle Logic LLC Alexandria, United States

6 days ago

Description

Job Description

Senior Cloudera Administrator/Infrastructure SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud)

Role & Responsibilities:

Will be responsible for the administration of Cloudera CDP on-prem and cloud infrastructure.

Leverage the CDP features to build the cloud-hybrid infrastructure for CDP (CDP Public Cloud).
Independently installs and maintains Big Data (Cloudera) clusters in high available, load balanced configuration across multiple (Production, QA and Development) environments in both on-prem and Cloud (AWS) environment.
Implement the Knox and Kerberos for Cluster security and integrate with enterprise and cloud IAM.
Develop scripts to automate and streamline operations and configuration
Manage and automate the installation process (use tools like Ansible) for CDP Manager, CDH, and the ecosystem projects. Activities include : Set up a local CDH repository; Perform OS-level configuration for Hadoop installation; Install Cloudera Manager server and agents; Install CDH using Cloudera Manager; Add a new node to an existing cluster; Add a service using Cloudera Manager
Schedule the jobs using Apache Nifi or Air flow
Analyze, recommend and implement improvements to support environment/infrastructure management initiatives. Configure - Perform basic and advanced configuration needed to effectively administer a Hadoop cluster on-prem and on-cloud. Activities include : Configure a service using Cloudera Manager; Create an HDFS user's home directory; Configure NameNode HA; Configure ResourceManager HA; Configure proxy for Hiveserver2/Impala
Maintain and modify the cluster to support day-to-day operations in the enterprise. Activities include : Rebalance the cluster; Set up alerting for excessive disk fill; Define and install a rack topology script; Install new type of I/O compression library in cluster; Revise YARN resource assignment based on user feedback; Commission/decommission a node
Enable relevant services and configure the cluster to meet goals defined by security policies, Activities include: Configure HDFS ACLs; Install and configure Sentry; Configure Hue user authorization and authentication; Enable/configure log and query redaction; Create encrypted zones in HDFS
Benchmark the cluster operational metrics, test system configuration for operation and efficiency. Activities include: Efficiently copy data within a cluster/between clusters; Create/restore a snapshot of an HDFS directory; Get/set ACLs for a file or directory structure; Benchmark the cluster (I/O, CPU, network)
Under general supervision, manage Big Data Administration activities, technical documentation, system performance support, and internal customer support. May provide input into the development of Systems Architecture for mission critical corporate development projects.
Research performance issues, configuring the cluster with Cloudera best practices, optimizing specifications and parameters to fine-tune and proactively avoid performance issues

Skills:

Must be Cloudera Certified Hadoop and/or Spark Administrator
Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration.
Must have infrastructure implementation experience on on-prem and Cloud (AWS).
Must have knowledge on CDP Containers and integration of on-prem clusters with Cloud clusters.
Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc
Must have knowledge on Cloudera SDX, Cloudera Public Cloud and Private Cloud infrastructures.
Experience administrating distributed applications: Hadoop, Spark, Kafka, Map Reduce, Hive, Impala
Experience with large-scale high-performance distributed systems like Hadoop, NoSQL or Spark
Assist in preparing and scaling the cluster as required to execute mission critical data processing processes
Experience with setting up and configuring the YARN queues using the YARN queue manager

· Deep understanding of IP, TCP, UDP, SSL/TLS protocols

Experience with Devops, scripting or other automation
Experience with Performance monitoring and tuning
Hadoop Cluster maintenance as well as creation and removal of nodes
Working knowledge of Networks, Linux OS and Unix Shell Scripting
• Understanding working authorization mechanism for Ranger / Sentry
Systems implementation, operations, and its optimization as Hadoop Admin
Demonstrate ability to find the root cause of a problem in Spark/HDFS and CDP clusters, optimize inefficient execution, and resolve resource contention scenarios; Resolve errors/warnings in Cloudera Manager; Resolve performance problems/errors in cluster operation;Determine reason for application failure; Configure the Fair Scheduler to resolve application delays
Experience on Cloudera Data Science Workbench and Cloudera Data Flow products.
Experience working with Systems Operation Department in resolving variety of infrastructure issues

Army Data and Analytics Platform Effort

1 week ago

UIC Alaska Alexandria, United States

Overview · ARMY DATA, ANALYTICS PLATFORM (ARDAP): · Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter ...
Army Data and Analytics Platform Effort

1 week ago

UIC Government Services and the Bowhead Family of Companies Alexandria, United States

Overview · ARMY DATA, ANALYTICS PLATFORM (ARDAP): · Bowhead is seeking to network with qualified candidates for the upcommingArmy Data and Analytics Platform (ARDAP) effort located inthe Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter exp ...
Army Data and Analytics Platform Effort

1 week ago

UIC Technical Services Alexandria, United States

Overview · ARMY DATA, ANALYTICS PLATFORM (ARDAP): · Bowhead is seeking to network with qualified candidates for the upcomming Army Data and Analytics Platform (ARDAP) effort located in the Washington, DC/Northern Virginia region. This is a fast paced job managing subject matter ...
Senior Cloudera Administrator SME with Cloudera Data Platform

1 week ago

Cubicle Logic LLC Alexandria, United States

Job Description · Job Description · Senior Cloudera · Administrator/Infrastructure · SME with Cloudera Data Platform Experience (SDX and CDP – On-Prem, Public Cloud and Private Cloud) · Role & Responsibilities: · Will be responsible for the administration of Cloudera CDP on-p ...
Data Platform Engineer

3 days ago

Booz Allen Hamilton Chantilly, United States Full time

Job Number: R0187172 · Data Platform EngineerThe Opportunity: · Are you looking for an opportunity to develop a data platform that will have an impact on rapid exploitation and sharing of multi-INT information across the intelligence community? Solid platform development is a cr ...
Administrator, Cloud Data Platform- Remote

4 days ago

Booz Allen Washington DC, United States Part time

Cyber Infrastructure Administrator, Senior · Are you passionate about promoting new technology within an information technology (IT) enterprise? At the nexus of IT and mission support, your skills will be utilized to understand unique IT requirements and promote innovative solut ...
Administrator, Cloud Data Platform- Remote

1 week ago

Booz Allen Washington DC, United States Part time

Cyber Infrastructure Administrator, Senior · Are you passionate about promoting new technology within an information technology (IT) enterprise? At the nexus of IT and mission support, your skills will be utilized to understand unique IT requirements and promote innovative solut ...
Sr. Manager/Data Platform Architect

1 week ago

Danaher Corporation Washington DC, United States Paid Work

At Cepheid, we are passionate about improving health care through fast, accurate diagnostic testing. Our mission drives us, every moment of every day, as we develop scalable, groundbreaking solutions to solve the world's most complex health challenges. Our associates are involved ...
Senior Director of Platform Data

1 week ago

AstraZeneca Gaithersburg, MD, United States

Are you ready to be part of the future of healthcare? Are you able to think big, be bold, and harness the power of digital and AI to tackle longstanding life sciences challenges? Then Evinova, a new health-tech business part of the AstraZeneca Group might be for you · At Evinova ...
Power BI and Qlik Data Analyst

6 days ago

ACES Group LLC Alexandria, United States

ACES is seeking a Data Analyst to support the Office of the Secretary of Defense (OSD) Chief Information Officer (DoD CIO)/ Command, Control, Communications, and Infrastructure (C3I) Directorate. As a member of our team, you will facilitate the development of dashboards and visua ...
Cloud Database Administrator

1 week ago

Dhara Consulting Group Alexandria, United States

Today · - Top Secret · - Mid Level Career (5+ yrs experience) · - IT - Database · - Alexandria, VA** (ON-SITE/OFFICE)**-Chantilly, VA** (ON-SITE/OFFICE)**-Saint Louis, MO** (ON-SITE/OFFICE)** · - Database Administrator · Top Secret · 170k · Alexandria, Chantilly or St Louis, MO. ...
Project Manager/scrummaster

3 days ago

Persistent Technology Alexandria, United States

Posted 29-Mar-2024 (EST)_ · - _85 S Bragg St, Suite 602, Alexandria, VA 22312, US_ · - _Full Time_ · **Project Manager/Scrum Master** · **Position Overview**: PTI is seeking a dynamic and experienced Project Manager/ScrumMaster to support our client, the U.S. Department of Health ...
Technology Sales Specialist

21 hours ago

IBM Alexandria, United States

Introduction · A Technology Sales Representative role (what we internally call a, 'Brand Sales Specialist') in IBM's Data & AI brand means accelerating enterprises' success by improving their ability to understand their data. It means providing solutions that enable people across ...
Qlik Developer

2 days ago

Tallon Recruiting and Staffing Alexandria, United States

**Job Highlights**: · Advancing data analytics platform · **Qlik Developer - REMOTE**: · **VA, Alexandria 22310** · **Security Clearance**: U.S. Citizen, Current Security Clearance, Secret, Top Secret, TS/SCI · **Skills: Qlik, Developer, Cloud Native Services, DataBricks, JavaScr ...
Data Analytics Developer

1 week ago

Andrew Morgan Consulting Alexandria, United States

**Primary Responsibilities** · - Lead client projects and discussions in cloud data management/movement architecture, data modeling, ETL, big data, data analytics and optimal methods of visualizing the data. · - Design and execute the development of complex analytic solutions usi ...
Senior Director of Platform Data

1 week ago

AstraZeneca Gaithersburg, United States Full time

Are you ready to be part of the future of healthcare? Are you able to think big, be bold, and harness the power of digital and AI to tackle longstanding life sciences challenges? Then Evinova, a new health-tech business part of the AstraZeneca Group might be for you · At Evinova ...
Marketing and Bd Coordinator

2 days ago

Human Resource Certification Institute, Inc. Alexandria, United States

**Who we are**: · HRCI, headquartered in Alexandria, Virginia, is the premier credentialing and learning organization for the human resources profession. For more than 50 years, we have set the global standard for HR expertise and excellence through our commitment to the developm ...
Mfp Program Assistant

3 days ago

American Association For Marriage and Family Therapy Inc Alexandria, United States

**Reporting to the Associate Director of the Minority Fellowship Program, essential functions and responsibilities**: · - Completes data entry and verification requests. · - Assist with the fellowship eligibility verification process. · - Assist in developing marketing materials ...
Data Warehouse Administrator

1 week ago

The Salvation Army National Headquarters Alexandria, United States

**JOB SUMMARY**: · The Data Warehouse Administrator is responsible for managing and optimizing the performance of a data warehouse, ensuring the integrity, security, and efficient storage and retrieval of data. This role involves collaborating with database developers, data archi ...
Head of Cataloging Librarian

1 week ago

Northern VA Community College Alexandria, United States

**Title**:Head of Cataloging Librarian · **Agency**:Northern VA Community College · **Location**:Alexandria - 510 · **FLSA**:Exempt · **Hiring Range**:Hiring range is $75,535 to $85,000. Starting salary is commensurate based on experience, education and other appropriately qualif ...