- Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on-prem.
- Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery
- Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, Ksql.
- Perform high-level, day-to-day administration and support functions.
- Upgrades for the Kafka Cluster landscape comprising of Development, Test, Staging and Production/DR systems.
- Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster.
- Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
- Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.
- Ability to work with various infrastructure, administration, and development teams across business units.
- Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team.
- Create topics, setup Apache Kafka MirrorMaker 2, Confluent Replicator to replicate the topics, create connect clusters, Schemas for the topics using Confluent Schema Registry
- Configure various Opensource and licensed Kafka Source/Sink Connectors such as Kafka Connect for SAP HANA, Debezium Oracle and MySQL Connectors, Confluent JDBC source/sink, Confluent ADLS2 Sink connector and Confluent Oracle CDC source connector...
- Develop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server
- Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components (Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry ...) and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs
- Experience with Confluent ksql to query and process Kafka streams
- Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql
- Availability to work in shifts, extended hours and to provide on-call support as required. There will be work over weekends at times depending on the project needs.
- Must have excellent communications and interpersonal skills.
- Preferred but Optional skills.
- Linux (SLES or RHEL) system administration (basic or advanced), creating shell scripts ..
- Working experience on docker and Kubernetes clusters (opensource, Rancher, RedHat OCP, Client Tanzu) involving administration of containers (Operator level skills), deployments, updates, integration with products running outside of the cluster
- Working knowledge with container registry such as Harbor, Quay, Nexus etc. Exposure to Container/artifact scanners such as Trivy, Claire ...
- Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations
- Implemented and supported any enterprise product such as any well-known ERP products, Data warehouse, Middleware etc.
- Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..
- Exposure to SaaS based observability platform like New Relic
- Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.
- Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.
- Worked in Public cloud environment such as Azure or AWS or GCP, preferably in Azure.
-
Kafka Administrator/Data Platform Engineer
Found in: Appcast US C2 - 3 days ago
Copart Dallas, United StatesCopart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire s ...
-
Kafka Administrator/Data Platform Engineer
Found in: Lensa US 4 C2 - 2 days ago
Copart Dallas, United StatesCopart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire s ...
-
Kafka Administrator/Data Platform Engineer
Found in: Lensa US 4 C2 - 2 days ago
Copart Dallas, United StatesCopart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire s ...
-
Kafka Admin
Found in: Lensa US 4 C2 - 14 hours ago
Diverse Lynx Irving, United StatesMandatory Job Requirements Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on-prem · Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and ...
-
Kafka Admin
Found in: Careerbuilder One Red US C2 - 3 days ago
Resource Informatics Group Irving, TX, United StatesKafka Admin · Location: Whippany NJ - Hybrid 3 Days/ Week · Note: It is a W2 requirement (Preference should be given to Second preference should be given to GCEAD/EAD) · Experience with the Linux environments and Bash scripting. · Experience with Kafka operations and administrati ...
-
Senior Hadoop Developer
Found in: Lensa US 4 C2 - 3 days ago
CapLeo Global Irving, United StatesRole: Senior Hadoop Developer with Spark · Locations: · Irving, TX / Jersey City, NJ / Charlotte, NC / Newark, DE - Onsite · Duration: Fulltime · The Senior Engineer is a hybrid role with experiences in database management, clustered compute, operating system integration, cloud ...
-
Applications Development Technical Lead Analyst
Found in: Lensa US 4 C2 - 6 days ago
Citigroup Inc Irving, United StatesCitibank, N.A. seeks an Applications Development Technical Lead Analyst for its Irving, Texas location. · Duties: Design, develop and implement real-time streaming solutions using Angular 6+ to transform batch process to real-time business and customer service interactions. Use S ...
-
Senior System Administrator
Found in: Lensa US 4 C2 - 14 hours ago
Cloud Analytics Technologies LLC Irving, United StatesWork Authorization: · US Citizen, Green Card, H-1B, GC-EAD, L2-EAD, TN Visa · Local Candidates Preferred. Non-local candidates must be willing to pay for your own interview travel expenses and relocation costs · **Candidates submitted over the max. bill rate will be automatical ...
-
Applications Development Technical Lead Analyst
Found in: Talent US C2 - 19 hours ago
Citi Irving, United States Full timeCitibank, N.A. seeks an Applications Development Technical Lead Analyst for its Irving, Texas location. · Duties: Design, develop and implement real-time streaming solutions using Angular 6+ to transform batch process to real-time business and customer service interactions. Use S ...
-
Linux System Engineer
Found in: Appcast US C2 - 1 day ago
Request Technology, LLC Dallas, United States***Hybrid, 3 days onsite, 2 days remote*** · ***We are unable to sponsor as this is a permanent full-time role*** · A prestigious company is looking for a Linux Engineer. This engineer will focus on design, support, engineering, and automation for the Linux Operating system. This ...
-
Cloud Engineer With Java Experience
Found in: Lensa US 4 C2 - 2 days ago
Global Jupiter Dallas, United StatesCloud Engineer with Java Experience · Rate: Depends on the experience · Location: Hybrid / Chicago, Dallas · Rate:DOE · Responsibilities · Act as a Subject Matter Expert to the organization for cloud and virtualization end-to-end architecture and IaaS, as well as PaaS and SaaS so ...
-
Databricks Admin
Found in: Appcast Linkedin GBL C2 - 4 days ago
Tiger Analytics Dallas, United StatesTiger Analytics is advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning and AI. Our business value and ...
-
Senior Site Reliability Engineer
Found in: Lensa US 4 C2 - 6 days ago
Apex Fintech Solutions LLC Dallas, United StatesApex enables modern investing and wealth management tools through an ecosystem offrictionless platforms, APIs, and services. · Apex Fintech Solutions (AFS) powers innovation and the future of digital wealth management by processing millions of transactions daily, to simplify, aut ...
-
Software Engineering AWS DevOps
Found in: Lensa US 4 C2 - 1 day ago
Spero Technology Dallas, United StatesSummary · Provide subject matter expertise for ongoing support of applications deployed to non production AWS environments and supporting 3rd party applications. Identify root causes and automate solutions in support of development. Work under general supervision; typically repo ...
-
Middleware Systems Administrator
Found in: Lensa US 4 C2 - 6 days ago
The Clearing House Dallas, United StatesThe Middleware Systems Administrator role will be responsible for architecting, implementing, and the day-to-day activities related to the Technology Infrastructure and Platform Systems portfolio within TCH Operations and Technology with oversight and governance for key systems a ...
-
Python Developer Job ID 20240425
Found in: ZipRecruiter Test10S US C2 - 2 days ago
Phoenix Cyber Dallas, United StatesJob Description · Job DescriptionPhoenix Cyber is looking for security focused Python programmers to help develop custom plugins and 3rd party integrations for a commercial-off-the-shelf cybersecurity software product. The work involves designing, developing, and implementing dat ...
-
Senior Lead Software Engineer
Found in: Appcast US C2 - 3 days ago
Leap Metrics Dallas, United StatesOverview · We are accepting applications for the Lead Software Engineer position to work on a product that helps improve the health of our population. · Do you enjoy working with leading-edge technologies? · Be part of a fast-moving, fast-growing, innovative technology team. · Di ...
-
Data Engineer-Platform Engineering, Austin, San Antonio or Dallas
Found in: Lensa US 4 C2 - 6 days ago
H-E-B Dallas, United StatesResponsibilities: · Since H-E-B Digital Technology's inception, we've been investing heavily in our customers' digital experience, reinventing how they find inspiration from food, how they make food decisions, and how they ultimately get food into their homes. This is an excitin ...
-
Software Engineering Manager
Found in: Appcast US C2 - 4 days ago
Leap Metrics Dallas, United StatesOverview · We are accepting applications for our Software Engineering Manager position to work on a product that helps improve the health of our population. · Do you enjoy working with leading-edge technologies? · Be part of a fast-moving, fast-growing, innovative technology team ...
-
Python Developer Job ID 20240425
Found in: ZipRecruiter Standard US C2 - 2 days ago
Phoenix Cyber Dallas, United StatesJob Description · Job DescriptionPhoenix Cyber is looking for security focused Python programmers to help develop custom plugins and 3rd party integrations for a commercial-off-the-shelf cybersecurity software product. The work involves designing, developing, and implementing dat ...
Kafka Administrator - Irving, United States - LTI - Larsen & Toubro Infotech
Description
About LTIMindtree
LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies.
As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world.
Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit
Salary-$100-$110k
Job Description:
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.