- Lead, Design and Develop all Copart's Data Platforms
- Deploy, manage, and monitor data platforms and data movement solutions.
- Build scalability, fault-tolerance, security, and performance into our data platforms to meet the growing needs of our customers.
- Partner with agile data development teams and use DevOps methodologies to create automated, efficient CI/CD processes to reduce the time to promote, test and deploy code.
- Partner with Information Security professionals to ensure data is secure both at-rest and in-flight.
- Develop, test, deploy and maintain efficient reusable patterns of streaming and batch data ingestion pipeline architectures for our data engineers to use.
- Document and maintain key architecture and coding standards for supported platforms.
- Act as first line support for data platforms to maintain peak operating efficiency and ensure maximum uptime.
- Ensure data platforms remain current to take advantage of the latest features and support.
- Communicate status of assigned work to management and follow agile practices and procedures covered by precedents, standards, or policies.
- Seek guidance when direction is needed and speak up about technology risks identified and own addressing them with the team.
- Influence peers on the team with questions and insight
- Be open to learn, train and develop as a team.
- Experience required minimum 8 years.
- Extensive Experience with Kafka and related technologies (Hive, Hadoop, Spark, Storm, Zookeeper)
- Experience managing Kafka with Confluent Platform and Confluent Cloud
- Experience with Solr and related technologies (Solr, Elastic Search, Lucene API, etc.)
- Experience with deploying, configuring, scaling, and troubleshooting data and search infrastructure.
- Experience with alerting, monitoring, and auto-remediation in a large-scale distributed environment
- Programming experience in Java, Python, or similar languages
- Experience in support of stream processing solutions in Big Data and Kafka, Kinesis
- Strong Knowledge of messaging/events architecture Concepts and PUB/SUB Pattern
- Solid knowledge of Java SE, Java EE, XML, XML Schema, XSD, XSLT/XPath and JSON technologies
- Experience in building and deploying Micro Services on containers such as Pivotal Foundry Cloud, Docker, or Kubernetes etc.
- Experience with designing and supporting Enterprise Redis Platforms
- Experience with Source control/Bug Tracking/Automated Build tools Jira, Jenkins, and Git
- Experience with http web servers and load balancers
- Experience with Reporting and ETL platforms
-
Sr. Cloud Platform Engineer
1 day ago
STA Worldwide Dallas, United StatesSr. Cloud Platform Engineer · Rate: DOE · Duration: 1 year · Location: Dallas, TX Requirement is to have a candidate in US, able to work NAM hours. If a candidate is local to a client location, they would be expected to be onsite a few days a week. Local travel to client site off ...
-
Backend Platform Engineer
5 days ago
Strategic Employment Partners (SEP) Dallas, United StatesGrowing cryptocurrency startup in Dallas is looking to hire a new Backend Platform Engineer. They are a startup focused on fulfilling the mission of crypto by providing true financial and economic freedom to its users. · In this role, you'll play a key role in building out appli ...
-
DevOps Platform Engineer
14 hours ago
Tail Light • Bouncie Dallas, United StatesWe are seeking a skilled and experienced DevOps Platform Engineer to join our team at Tail Light, LLC [Bouncie]. As a DevOps Platform Engineer, you will play a key role in designing, building, and maintaining our infrastructure and deployment pipelines to ensure the reliability a ...
-
Analytics Platform Engineer
2 weeks ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and t ...
-
ERP Platform Engineer
1 week ago
The Resource Collaborative Dallas, United StatesOur client is a captive Managed Services organization offering core business services to over 200 global companies within the portfolio of an Investment firm. · The ERP Platform Engineer Dynamics D365 F&O, ensures the optimal use of our ERP systems to meet our global business and ...
-
Analytics Platform Engineer
5 days ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Analytics Platform Engineer
4 days ago
G-Research Dallas, United States Full timeDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and t ...
-
Client Platform Engineering
1 week ago
BlueHorizon Solutions Carrollton, United StatesYour tasks · Trusted Shops develops SaaS solutions for over 30 million users and businesses throughout Europe. Our product range includes products such as the trustmark, buyer protection, and the customer review platform eTrusted. For over 20 years, our mission has been to enable ...
-
Analytics Platform Engineer
1 week ago
G-Research Dallas, TX, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Analytics Platform Engineer
1 week ago
G-Research Dallas, TX, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Principal Platform Engineer
1 week ago
DTCC Dallas, United StatesTitle - Principal Platform Engineer - Mainframe z/OS · Are you ready to explore a world of possibilities? · Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the ...
-
DevOps Platform Engineer
1 day ago
Tail Light, LLC [Bouncie] Dallas, United StatesJob Description · Job DescriptionDevOps Platform EngineerWe are seeking a skilled and experienced DevOps Platform Engineer to join our team at Tail Light, LLC [Bouncie]. As a DevOps Platform Engineer, you will play a key role in designing, building, and maintaining our infrastruc ...
-
Sr. Cloud Platform Engineer
1 week ago
Net2Source Inc. Dallas, United StatesJob-Sr. Cloud Platform Engineer · Location-Dallas, TX (Hybrid-Onsite) · Only W2 Contract · Description Of Services · Job Summary: · We are seeking a highly skilled and experienced Senior Platform Engineer to join our team. As a Senior Platform Engineer, you will be responsible fo ...
-
Database Platform Reliability Engineer
5 days ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Senior Platform Reliability Engineer
5 days ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Database Platform Reliability Engineer
1 week ago
G-Research Dallas, TX, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Database Platform Reliability Engineer
1 week ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and t ...
-
Database Platform Reliability Engineer
1 day ago
G-Research Dallas, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and t ...
-
Senior Platform Reliability Engineer
5 days ago
G-Research Dallas, TX, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
-
Database Platform Reliability Engineer
1 week ago
G-Research Dallas, TX, United StatesDo you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to ...
Kafka Administrator/Data Platform Engineer - Dallas, United States - Copart
Description
Copart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire system. An ideal candidate brings curiosity, passion for data, and a deep understanding of the technologies behind data pipelines, big data, analytics, and deep understanding of the software development life cycle.
Responsibilities: