Kafka Administrators - Jersey City, United States - Diverse Lynx

Diverse Lynx Jersey City, United States

1 week ago

Description

Mandatory Job Requirements

Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on-prem
Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery
Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, Ksql
Perform high-level, day-to-day administration and support functions
Upgrades for the Kafka Cluster landscape comprising of Development, Test, Staging and Production/DR systems
Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster.
Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.
Ability to work with various infrastructure, administration, and development teams across business units
Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team
Create topics, setup Apache Kafka MirrorMaker 2, Confluent Replicator to replicate the topics, create connect clusters, Schemas for the topics using Confluent Schema Registry
Configure various Opensource and licensed Kafka Source/Sink Connectors such as Kafka Connect for SAP HANA, Debezium Oracle and MySQL Connectors, Confluent JDBC source/sink, Confluent ADLS2 Sink connector and Confluent Oracle CDC source connector...
Develop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server
Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components (Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry ...) and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs
Experience with Confluent ksql to query and process Kafka streams
Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql
Availability to work in shifts, extended hours and to provide on-call support as required. There will be work over weekends at times depending on the project needs.
Must have excellent communications and interpersonal skills

Preferred but Optional skills

Linux (SLES or RHEL) system administration (basic or advanced), creating shell scripts ..
Working experience on docker and Kubernetes clusters (opensource, Rancher, RedHat OCP, Client Tanzu) involving administration of containers (Operator level skills), deployments, updates, integration with products running outside of the cluster
Working knowledge with container registry such as Harbor, Quay, Nexus etc. Exposure to Container/artifact scanners such as Trivy, Claire ...
Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations
Implemented and supported any enterprise product such as any well-known ERP products, Data warehouse, Middleware etc.
Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..
Exposure to SaaS based observability platform like New Relic
Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.
Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination.

All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.

We promote and support a diverse workforce across all levels in the company.

Kafka Administrator

2 weeks ago

Iris Software Inc. New York, United States

Iris's Fortune 100 direct client is looking for Kafka Administrator. Please find below Job description and share me your updated resume at . · Title: Kafka Administrator · Duration: Long term contract · Location: Alpharetta, GA OR NYC NY · Hybrid Model – Hybrid,3 days/week onsit ...
Kafka Administrator

2 weeks ago

Georgia IT New York, NY, United States

Kafka Administrator · NYC · Description · Setup new Confluent Kafka platform · Upgrade and maintain existing platform to latest version · Hands-on experience with Kafka Brokers · Hands-on experience with Schema Registry · Hands-on experience with KSQL DB and understanding of unde ...
Senior Kafka Administrator

1 week ago

NR Consulting Whippany, United States

Job Title : Senior Kafka Administrator Work Location: Whippany, NJ (Hybrid-2 days) Position Type: Contract Description: Experience with the Linux environments and Bash scripting. · Experience with Kafka operations and administration. The individual will be asked to lead the ...
Kafka Admin with Linux

1 week ago

Natsoft Corporation New York, United States

**Role: Kafka Admin with Linux** · **Location: NYC NY(3 days onsite in week)** · **Skills**: · - Develop shell scripts to automate routine tasks and system administration activities. · - Expertise on Linux OS and the commands · - Maintain and enhance existing shell scripts to imp ...
Kafka Admin

18 hours ago

BSL consulting LLC New York, United States

**Job Role: Kafka Admin** · **Location: New York, NY (Onsite)** · **Job Type: Full Time(Permanent)** · **Note**: Visa sponsorship/transfer not available · **Experience level**:8 Years · **Qualifications**: · - Develop Python-based Kafka consumers and producers to enable efficient ...
Splunk Engineer

3 days ago

Omni Inclusive Jersey City, United States

JD: · • Strong knowledge of Splunk, especially Enterprise Security (ES): · o Data onboarding activities, including custom parsing rules and custom Technology Add-On building according to Splunk's Common Information Model (CIM) · o Good understanding of SPL, Dashboard developme ...
IBM MQ Admin

3 days ago

The Dignify Solutions LLC Jersey City, United States

Must have an exp on MESH IQ ( This is the new name / Version of Nastel) · Must have an hands on exp and offshore/ onshore team handling exp. · Perform MQ Administration, UNIX Shell scripting, Infrastructure monitoring and alarming · Installation, configuration, and administration ...
Splunk Engineer@Jersey City, NJ

2 weeks ago

Diverse Lynx Jersey City, United States

Splunk Engineer · Location: Onsite at one of these locations - Jersey City, NJ; Plano, TX · JD: · Strong knowledge of Splunk, especially Enterprise Security (ES): · o Data onboarding activities, including custom parsing rules and custom Technology Add-On building according to Spl ...
Splunk Engineer@ Jersey City, NJ; Plano, TX

19 hours ago

Diverse Lynx Jersey City, United States

Splunk Engineer · Location: Onsite at one of these locations - Jersey City, NJ; Plano, TX · JD: · Strong knowledge of Splunk, especially Enterprise Security (ES): · o Data onboarding activities, including custom parsing rules and custom Technology Add-On building according to Spl ...
Sr. DevOps Engineer

3 days ago

MHK TECH INC Jersey City, United States

This is a DEVELOPER role; this position is very developer centric. · This is NOT an infrastructure role. · Share on · Job DescriptionWork daily with Ansible, Terraform, Git, and CICD pipelines. · Write Python code to build out data platform. · Build out containerization orchest ...
AWS Cloud Architect

4 days ago

Enterprise Engineering Jersey City, United States

Senior Cloud Engineer/Solutions Architect · Jersey City, NJ - 3 days a week onsite · Contract to hire role · **MUST HAVE AWS Solutions Architect Certification · Qualifications: · 15+ years of relevant experience · Must have AWS Professional Certification · Advanced cloud impleme ...
Cloud Architect

2 weeks ago

Enterprise Engineering Jersey City, United States

Senior Cloud Solutions Architect · Jersey City, NJ - 3 days a week onsite · Local Only · Heavy Financial experience- Investment Banking/Market Data · Qualifications: · 15+ years of relevant experience · Must have AWS Professional Certification · Advanced cloud implementation exp ...
Java with Python

3 days ago

Diverse Lynx Jersey City, United States Full time

Java with Python · Location: NJ · Job responsibilities Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems · Develops secure ...
Cloud Architect

1 week ago

ApTask Jersey City, United States

A Glimpse into the Daily Routine of a Cloud Architects · Design and document a system in AWS to meet customer requirements. · Meet with a customer or internal team member to troubleshoot, educate, and unblock implementation progress. · Partner with an Engagement Manager to craft ...
Java Developer with Python @ Jersey City, NJ

2 weeks ago

Diverse Lynx Jersey City, United States

Position : Java with Python · Location : New Jersey · Job responsibilities · Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical proble ...
Jr. Full Stack Engineer

3 days ago

City National Bank Jersey City, United States

FULL STACK ASSOCIATE ENGINEER · WHAT IS THE OPPORTUNITY? · As a member of the Digital Technologies Group, the Associate Full Stack Engineer is responsible for designing, developing and maintaining legacy and "Cloud First" applications written primarily in C# and focused on .Net C ...
Jr. Full Stack Engineer

3 days ago

City National Bank Jersey City, United States

**FULL STACK ASSOCIATE ENGINEER** · **WHAT IS THE OPPORTUNITY?** · As a member of the Digital Technologies Group, the Associate Full Stack Engineer is responsible for designing, developing and maintaining legacy and "Cloud First" applications written primarily in C# and focused ...
Head of Data Platforms

3 days ago

Brown Brothers Harriman Jersey City, United States

At BBH we value diverse backgrounds, so if your experience looks a little different from what we've outlined and you think you can bring value to the role, we will still welcome your application · What You Can Expect At BBH: · If you join BBH you will find a collaborative envir ...
Kafka Admin

5 days ago

Iris Software Inc. New Jersey, United States

IRIS direct end client which is one of the Global Leader in Financial Services is urgently looking to hire Kafka Admin - Atlanta, GA or Jersey City, NJ (Hybrid). This is a Contract opportunity. · Kafka Admin · Atlanta, GA or Jersey City, NJ (Hybrid/ 3 days office & 2 days work f ...
Kafka Admin with Linux

1 week ago

Genpact New York, United States

With a startup spirit and 115,000 + curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom ...