Kafka Architect - New York, United States - TEKsystems

    TEKsystems
    TEKsystems New York, United States

    1 month ago

    Default job background
    Full time
    Description

    Description:

    The ideal candidate will be a Kafka Architect with experience setting up best practices in Cloud/DevOps environments related to data pipelines to databases, servers (front and backend), and security systems to ensure reliable system massaging and communication. Also, skilled in solutioning centralized processes using Kalfa as a centralized messaging center for real-time business discussions. Must have skills setting up Architecting and setting up Kafka, setting Clusters, and spark components.

    Responsibilities:

    • Create plans and drawings which clearly outline the architectural design of projects.
    • Make design improvements/recommendations to Kafka infrastructure.
    • Making sure the Kalfa clusters are running and remain running smoothly.
    • Identifying gaps in Kafka services and writing user stories to address gaps.
    • Analyze the reliability of Kalfa infrastructure.

    Qualifications:

    • Bachelor's in Computer Science or other engineering or technical discipline is required.
    • 7+ years' experience in information technology and/or professional services, with emphasis on subject matter expertise
    • At least 3 years of experience as a DevOps Architect or equivalent role
    • At least 4 years of experience as a Kafka architect / Subject matter expert.
    • At least 2 years of experience as a Mongo DB architect is preferred.
    • Hands-on experience in provisioning, configuring, and operating a container orchestration system such as Kubernetes, RedHat OpenShift Container Platform, or VMWare Tanzu on-prem or in the cloud
    • Deep experience with container configuration, management, security configurations, and at least one container platform.
    • Hands-on experience in provisioning, configuring, and operating Kafka clusters in on-premise or cloud-based hosting environments (Confluent Cloud, Azure, GCP, AWS, Kubernetes).
    • Hands-on experience implementing partitioning strategies and configuring brokers, topics, producers, consumers, schema registry, and KSQL.
    • Expertise in Kafka security and encryption.
    • Expertise in Kafka performance optimization and tuning.
    • Experience with data visualization and monitoring tools such as Splunk, Grafana, Dynatrace, Datadog, New Relic, Oracle Enterprise Manager, etc.
    • Prior experience in Multi-cluster Kafka replication with mirror maker.
    • Solid knowledge and experience with Confluent KAFKA development in a container environment
    • Experience configuring and managing continuous integration servers (e.g., Jenkins, Bamboo, TeamCity, Travis CI, Circle CI).
    • Strong scripting skills (e.g., Python, Bash, Groovy).
    • Knowledge of IP networking, VPNs, DNS, load balancing, and firewalling.
    • Strong practical Linux and Windows-based systems administration skills in a Cloud or Virtualized environment.
    • Develop innovative solutions to complex business and technology problems.
    • Ability to travel to client locations to deliver professional services as needed.

    Certifications:


    • Candidate must have professional-level certifications in either AWS or Azure cloud platform.


    • Good to have any of the below Kafka certifications:


    • Confluent Certified Administrator for Apache Kafka


    • Confluent Certified Developer for Apache Kafka

    We offer comprehensive Benefits:

    Medical, Dental & Vision

    Health Savings

    Paid Time-Off

    Short & Long-Term Disability

    Dependent Care Flexible Spending Account

    Transportation Benefits

    401(k)

    Life & AD&D & Supplemental Life

    Send resume to

    About TEKsystems:



    We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

    The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.