- Experienced and proven track record working on multiple cloud platforms (AWS, GCP, Azure etc.)
- Worked on business critical and high traffic applications.
- Track record of scaling ETL on big data platforms
- Well versed working with varied forms of Data Infrastructure
- Strong understanding of different Data Sources, been involved in design and able to suggest best practices.
- Solid programming skills with one of the following languages (Golang, Python, C++, Typescript etc...)
- Experience using Docker and Kubernetes
- Experience working with Apache Atlas
- Knowledge of Map related technologies
- Experience with Apache Kafka/Pulsar technologies
- Experience with relational databases, especially Postgres
- Experience with deploying Machine Learning or Mapping Algorithms
Senior Cloud Data Engineer - Somerville, United States - CSG Talent
Description
*No sponsorship provided - must be as Green Card Holder or US Citizen*
Senior Cloud Data Engineer
Data Lake, AWS, Big Data Platforms, Programming (Golang/Python/C++/Typescript) Boston, Somerville, MA (onsite)
Up to $150,000
Working with a Start-up that is developing groundbreaking RADAR solutions for Autonomous Vehicles, making self-driving more reliable in harsh and tricky conditions. They are growing, and now looking for a Senior Clod Data Engineer to join the team.
What will you be doing:
You will be responsible for designing, developing, deploying, and maintaining the data infrastructure, including a distributed big data platform, data lake on top of cloud storage system (S3), metadata systems, data catalogues, data governance, data search, and discovery and related services.
Additionally, you will take full ownership for the data pipeline for my client's next-generation HD-MAP data process.
Key Requirements:
Nice to haves:
If this sounds like something you want to learn more about, please apply.
*No sponsorship provided - must be as Green Card Holder or US Citizen*