Jobs
>
Reston

    Cloudera Big Data administrator - Reston, United States - Resource Informatics Group

    Resource Informatics Group
    Resource Informatics Group Reston, United States

    3 weeks ago

    Default job background
    Description
    Client CompanyCareFirst Client FEPOCJob Description

    Position Title:
    Cloudera Big Data administrator


    Location:
    Reston VA

    Duration : 12 months of contract with possibility of extension


    Experience Summary:
    This is a Cloudera Big Data administrator position and not a developer position. Experience with building Cloudera cluster, setting up Nifi, Solr, HBase, Kafka.

    Setting up the High Availability of the Services like Hue, Hive, HBase REST, SOLR and IMPALA on top of the all-new clusters that were built on the BDPaas Platform.

    Be able to write the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.

    Monitoring the health of all the services running in the production cluster using the Cloudera Manager. Performing/Accessing the databases, metastore tables and writing Hive, Impala queries using HUE. Responsible for monitoring the health of the Services on top of all clusters.

    Working closely with different teams like Application development team, Security team, Platform Support to identify and implement the Configurational changes that are needed on top of the cluster for better performance of the services.

    Experience with CDP Public Cloud is a PLUS.


    Skills Must Require:
    Cloudera CDP v7.x

    Apache Kafka - strong Administration & troubleshooting skills

    Kafka Streams API

    stream processing with KStreams & Ktables

    Kafka integration with MQ

    Kafka broker management

    Topic/ offset management

    Apache Nifi - Administration

    Flow management

    registry server management

    controller service management

    Nifi to kafka /Hbase /solr integration

    Hbase - administration

    database management

    troubleshooting

    Solr - administration

    managing Logging level

    managing shards & high availability

    Collection management

    Rectify resource intensive & long running solr queries


    Additional Skills includes:

    • Ensure Cloudera installation and configuration is at optimal specifications (CDP, CDSW, Hive, Spark, NiFi).
    • Perform critical data migrations from CDH to CDP.
    • Design and implement big data pipelines and automated data flows using Python/R and NiFi.
    • Assist and provide expertise as it pertains to automating the entire project lifecycle.
    • Perform incremental updates and upgrades to the Cloudera environment.
    • Assist with new use cases (i.e., analytics/Client, data science, data ingest and processing), Infrastructure (including new cluster deployments, cluster migration, expansion, major upgrades, COOP/DR, and security).
    • Assist in testing, governance, data quality, training, and documentation efforts.
    • Move data and use YARN to allocate resources and schedule jobs.
    • Manage job workflows with Oozie and Hue.
    • Implement comprehensive security policies across the Hadoop cluster using Ranger.
    • Configure and manage Cloudera Data Science Workbench using Cloudera Manager.
    • Troubleshoot potential issues with Kerberos, TLS/SSL, Models, and Experiments, as well as other workload issues that data scientists might encounter once the application is running.
    • Supporting the Big Data / Hadoop databases throughout the development and production lifecycle.
    • Troubleshooting and resolving database integrity issues, performance issues, blocking and deadlocking issues, replication issues, log shipping issues, connectivity issues, security issues, performance tuning, query optimization, using monitoring and troubleshooting tools.
    • Create, test, and implement scripting for automation support.
    • Experience in working with Kafka ecosystem (Kafka Brokers, Connect, Zookeeper) in production is ideal
    • Implement and support streaming technologies such as Kafka, Spark & Kudu
    #J-18808-Ljbffr
  • CyberTec

    Data Administrator

    1 week ago

    CyberTec Reston, United States

    Requisition Name - Data Administrator III · Quantity Requested 1 · Submission Deadline 08/25/2023 · Location Hybrid (3990 Fairview Industrial Dr SE Salem, Oregon · 1 Professional Reference + must be on your W2 · Description · Professional Reference Name Email Id Contact Num ...

  • Ageatia Global Solutions

    Big Data Administrator Lead

    1 week ago

    Ageatia Global Solutions Reston, United States

    PURPOSE · This is a Big Data Administrator Lead position and not a developer position. · The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise · infrastructure targeting big data and platform data management (e.g., data ...

  • Wipro Limited

    Data Administrator

    1 month ago

    Wipro Limited Reston, United States Full time, Part time, contract, training

    Job ResponsibilitiesDatabase Administration Architect and implement database applications/infrastructures typical of those required to support a large organization and capable of adapting to database structure changes in a dynamic business setting. Perform activities related to a ...

  • CareFirst BlueCross BlueShield

    Lead Data Engineer-Cloudera Administrator

    1 week ago

    CareFirst BlueCross BlueShield Reston, United States

    **Resp & Qualifications** · **PURPOSE:** · **This is a Big Data/Cloudera Administrator Lead position and not a developer position and need CDP7 experience.** · The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infra ...

  • Carefirst Bluecross Blueshield

    Lead Data Engineer-Cloudera Administrator

    1 day ago

    Carefirst Bluecross Blueshield Reston, United States

    Resp & Qualifications · PURPOSE: · This is a Big Data/Cloudera Administrator Lead position and not a developer position and need CDP7 experience. · The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targ ...

  • Carefirst Bluecross Blueshield

    Lead Data Engineer- Ab Initio Administrator

    1 day ago

    Carefirst Bluecross Blueshield Reston, United States

    Resp & Qualifications · PURPOSE: · This is an Ab Initio Administration Lead position and not a developer position. · The Lead Ab Initio ETL Administrator is responsible for leading all the tasks involved in administration of ETL tool (Ab-Initio) as well as migrating Ab Initio in ...

  • Virtual Health Informatics (VHI)

    Administrative and Data Specialist

    1 week ago

    Virtual Health Informatics (VHI) Frederick, United States

    Job Description · Job DescriptionWe are seeking an Administrative and Data Specialist to join our team You will perform administrative and data management functions to drive company success. · Responsibilities: · Document data management procedures and verify user compliance with ...

  • Abacus

    GIS Data Administrator

    3 weeks ago

    Abacus Arlington, United States

    TITLE: GIS Data Administrator DATE: August 2022 · EEO CATEGORY: Professional GRADE: 14 · FLSA: Exempt · BRIEF DESCRIPTION: · The purpose of this position is to administer and support enterprise geospatial applications and related databases that form part of the NCTCOG Geograp ...

  • Community of Hope

    housing data and administrative specialist

    2 weeks ago

    Community of Hope Washington, United States

    Duties and Responsibilities: · Maintains and enforces data standards for HMIS. · Communicates with The Community Partnership (TCP) regarding HMIS issues, processes, and reports when the Housing Data and Evaluation Manager is unavailable. · Provides ongoing training and technical ...

  • CoStar Group

    Senior HR Data Administrator

    1 week ago

    CoStar Group Washington, United States Full time

    RESPONSIBILITIES · : Manage and maintain HR data solution configuration, security mechanism, and access governance to ensure HR data integrity, reliability, and availability to authorized users. · Work collaboratively with appropriate Technology teams to ensure the seamless flow ...

  • DCS Corp

    Data Server Administrator/Developer

    3 weeks ago

    DCS Corp Alexandria, United States

    Location: · Location: · Data Server Administrator/Developer · in · Alexandria, VA · at · DCS · **Location:** · **Experience:** · Not Specified · **Job Description** · **DCS is seeking a web server adminstrator with experience in server configuration and maintenance as well ...

  • ICF

    Incorporated, LLC: Senior Systems Administrator – Reston VA

    2 weeks ago

    ICF Reston, United States Full time

    ICF Incorporated, LLC: Senior Systems Administrator – Reston VA · DUTIES: · Implement enhancements and roll out new features; execute solution design activities such as data model, object modeling, page layout design, and rule logic definition in the context of the Salesforce app ...

  • TekStream Solutions

    Senior ETL Administrator

    4 days ago

    TekStream Solutions Reston, United States

    Sr. ETL Administrator · Department: · Technology Services · Location: · Remote/Reston, VA · Description · We are currently seeking an Application Administrator to work within a team that provides Data Warehouse and Business Intelligence services to our government customer using A ...

  • Insight Global

    Compensation Manager

    3 weeks ago

    Insight Global Reston, United States

    Position: International Compensation Manager · Salary: $130k-$150k + 10% bonus · Location: Must sit out of Reston, VA, New York, NY, or Chicago, IL (Hybrid) · Start Date: ASAP · Qualifications: · Bachelor's degree · 5+ years of direct compensation experience · Extensive knowl ...

  • The Salvation Army National Headquarters

    Data Warehouse Administrator

    2 weeks ago

    The Salvation Army National Headquarters Alexandria, United States

    **JOB SUMMARY**: · The Data Warehouse Administrator is responsible for managing and optimizing the performance of a data warehouse, ensuring the integrity, security, and efficient storage and retrieval of data. This role involves collaborating with database developers, data archi ...

  • Commonwealth of Virginia

    Assessment Planner

    2 weeks ago

    Commonwealth of Virginia Fairfax, United States

    Department: Office of Institutional Effectiveness and Planning (OIEP) · Job Category: Administrative or Professional Faculty · Job Type: Full-Time · Work Schedule: Full-time (1.0 FTE, 40 hrs/wk) · Location: Fairfax, VA · Workplace Type: Hybrid Eligible · Salary: Salary comm ...

  • Mindlance

    Senior Data Engineer

    1 day ago

    Mindlance Reston, United States

    Position Title: Senior Data Engineer · Duration: 6-12 Months (Possible extension/conversion) · Location: Reston, VA (100% Remote) · Team: Interflow /DAP Reporting: DAP Reporting is responsible for reports, analytics data on the digital test administration. Interflow works on gene ...

  • ICF

    Incorporated, LLC: Energy Analyst – Reston, VA

    2 weeks ago

    ICF Reston, United States Full time

    DUTIES: · Implement energy efficiency programs for public utilities (electric and gas): Develop and execute strategies to improve energy efficiency in residential and commercial sectors, targeting reductions in energy consumption and greenhouse gas emissions. · Execute strategies ...

  • Leidos

    Data Analyst

    1 week ago

    Leidos Reston, United States Full time

    Description · Registrar/Data Specialist · The Registrar/Data Specialist works as part of a team of registrars who are responsible for the enrollment and tracking of students, coordination and communication of enrollment, record validation, reports generation, and entering and tr ...

  • Commonwealth of Virginia

    Administrative Assistant and Project Coordinator

    2 weeks ago

    Commonwealth of Virginia Fairfax, United States

    Department: Risk, Safety, & Resilience · Classification: Gen Admin Supv 1/Coord 1 · Job Category: Classified Staff · Job Type: Full-Time · Work Schedule: Full-time (1.0 FTE, 40 hrs/wk) · Location: Fairfax, VA · Workplace Type: On Site Required · Pay Band: 04 · Salary: Salary ...