Sr. Data Engineer - Salem, United States - Mavensoft Technologies

Description

Position:

Senior Data Engineer

Duration
:
3 Months

Location:

Salem, OR (Fully Remote)

Key Skills

Proficiency in building and managing scalable, real-time data lake solutions utilizing AWS services such as EMR, S3, Hive, and Spark
Extensive experience with cloud warehouse platforms, particularly Snowflake
Expertise in messaging, streaming, and complex event processing tools and frameworks, with a focus on Spark Streaming or Structured Streaming and Apache Nifi

Top 3 Skills

Demonstrated ability to architect and develop cloud-scalable data solutions using AWS, EMR, S3, Hive, and Spark
Hands-on experience with Snowflake and proficiency in utilizing cloud warehouse tools
Proficiency in messaging/streaming/complex event processing tooling, particularly with Spark Streaming or Structured Streaming and Apache Nifi
ATTN ADDITIONAL ASSIGNMENT INFORMATION***candidate; 6-7 years preferred. industry does not matter as much as applied exp.
AWS Tech Stack experience; any experience with Databricks; Spark & Python for coding
Manager is looking at the quality of the Experience a Candidate has, What types of projects they've worked on, candidates that are accustomed to a complex environment, & level of coding experience

Qualifications

Bachelor's or Master's degree in Computer Science or related field
6+ years of experience in data engineering development
4+ years of experience implementing scalable data architectures
3+ years of experience in large-scale software development with a focus on data analytics and high-volume data processing
3+ years of experience with AWS and related services such as EC2, S3, DynamoDB, Kinesis Streams, etc.
Expertise in Python is a must, with proficiency in other data-centric programming languages considered advantageous
5+ years of experience in database development, including relational and non-relational databases; SQL experience preferred
Experience with CI/CD tools like Jenkins/Terraform and Docker for deploying containerized solutions in AWS

Job Description

Lead the engineering efforts on modern, cloud-based data processing technology stack
Develop robust data pipelines, validation frameworks, and job schedules with a focus on automation and scalability
Contribute to the design and architecture of systems for storing and processing high volumes of data
Ensure timely delivery of product and technical features according to specifications
Collaborate closely with product owners, reporting analysts, data analysts, and business partners within an Agile/Scrum methodology
Proactively build solutions that are automated, scalable, and sustainable to maintain product health and minimize defects and technical debt

Excellent communication skills, ability to work effectively in a remote team environment using tools like Zoom, and demonstrate flexibility and adaptability.

Please Apply Online.

To learn more about Mavensoft visit us at

Neeraja

Mavensoft Technologies

| 15248 NW Greenbrier Parkway, Beaverton, OR

Office:

| Fax:

Email:

|

Website:

:

#J-18808-Ljbffr