Data engineer - Cary, United States - eTeam

eTeam Cary, United States

3 weeks ago

Description

Job Title :- Data engineer (10+ years candidate required)
Job Location :- Remote

Job Description :-

LinkedIn is Mandatory

Description:-

Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required
7+ years of experience in working with data solutions.
3+ years of experience coding in Python, or Scala or similar scripting language.
3+ years of experience in developing data pipelines in AWS Cloud Platform (preferred), Azure, or Snowflake at scale.
2+ years Experience in designing and implementing data ingestion with real-time data streaming tools like Kafka, Kinesis or any similar tools.SAP/Client or other cloud integrations are preferred.
3+ years experience working with MPP databases such as Snowflake (Preferred) , Redshift or similar MPP databases.
2+ years experience working with Serverless ETL processes (Lambda, AWS Glue, Matillion or similar)
1+ years experience with big data technologies like EMR, Hadoop, Spark, Cassandra, MongoDB or other open source big data tools.
Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
Experience designing, documenting, and defending designs for key components in large distributed computing systems
Demonstrated ability to learn new technologies quickly and independently
Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment
Ability to handle multiple competing priorities in a fast-paced environment
Excellent verbal and written communication skills, especially in technical communications
Strong interpersonal skills and a desire to work collaboratively

Experience participating in an Agile software development team, e.g. SCRUM

Job Responsibilities :

Responsible for the building, deployment, and maintenance of critical scalable Data Pipelines to assemble large, complex sets of data that meet non-functional and functional business requirements
Work closely with SMEs, Data Modeler, Architects, Analysts and other team members on requirements to build scalable real time/near real time/batch data solutions.
Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading into Data Lake/Cloud Data Warehouse/MPP (Snowflake/Redshift/similar Technologies ) .
Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platforms quality, robustness, maintainability, and speed.
Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.
Interacts with technical teams across and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
Keep up with current trends in big data and Analytics , evaluate tools and pace yourself for innovation.

Mentor Junior engineers ,create necessary documentation and Run-books while still being able to deliver on goals

Data Engineer

3 weeks ago

Computer Task Group Morrisville, United States

· CTG is seeking to fill a Data Engineer opening for our client in Morrisville, NC. · Location: Morrisville, NC (hybrid remote) · Duration: 12 months · Duties: · We are excited to offer multiple data engineer positions in Large Language Model and Multi-modality LLM field. Th ...
Azure Data Engineer

3 weeks ago

Tata Consultancy Services Cary, United States

Role: Azure Data Engineer · Type : Full time · Location : Cary, North Carolina, United States- onsite · Roles & Responsibilities : · Data Engineering · Data pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE · Data automation / processing using ...
Senior Data Platform Engineer

2 weeks ago

B264 DB Global Technology, Inc. Cary, United States Full time

Description · : Job Title Senior Data Platform Engineer (m/f/x) – Corporate Banking (CB) Data Platform · Corporate Title Vice President · Location Cary, NC · Who we are · In short – an essential part of Deutsche Bank's technology solution, developing applications for key bu ...
Cloud Data Platform Engineer

2 weeks ago

Deutsche Bank Cary, United States

Job Title: Cloud Data Platform Engineer · Corporate Title: Assistant Vice President · Location: Cary, NC · Who we are · In short – an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technologists drive Cloud, Cyber and ...
Big Data Engineer

2 weeks ago

eTeam Cary, United States

This role requires a seasoned developer having 6+ years of experience in Big Data, Java. · The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. · The role also required to optimize existing machine learning jobs and o ...
Data Engineer

3 weeks ago

Diverse Lynx Cary, United States

Role: Data Engineer · Location: Cary, NC (Hybrid) · Position Type: Contract · Job Description: We are looking for skilled data engineer with 4-7 years of experience in following technologies: · SSIS, SQL and Azure Data Factory (ADF) · Candidate should have background in da ...
Data Engineer

6 days ago

Diverse Lynx Cary, United States

Developer/Data Engineer · Contract · Locations: Cary, NC (Hybrid) · Job Description (JD): · We are looking for skilled data engineer with 4-7 years of experience in following technologies: · SSIS, SQL and Azure Data Factory (ADF)Candidate should have background in data integr ...
Product Engineer, Data Focus

2 days ago

Cielo Projects Cary, United States

Company Description · Cornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel. · At Cornerstone Building Brands we provide our residential and commercial customers with a comprehens ...
Product Engineer, Data Focus

3 days ago

Cielo Projects Cary, United States

Company DescriptionCornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel.At Cornerstone Building Brands we provide our residential and commercial customers with a comprehensive por ...
Product Engineer, Data Focus

4 days ago

Cornerstone Building Brands Cary, United States

Job Description · Job DescriptionCompany Description · Cornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel. · At Cornerstone Building Brands we provide our residential and commer ...
Analytics Data Engineer, Core

2 days ago

Epic Games Cary, United States

WHAT MAKES US EPIC? · At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually s ...
Lead Cloud Data Engineer

3 weeks ago

MetLife Cary, United States

Lead Cloud Data Engineer · Location(s) · Posting Location:Cary, North Carolina · Country · United States · Working Schedule · Full-Time · Work Arrangement · Hybrid · Relocation Assistance Available · No · Posted Date · 16-May-2024 · Job ID · 1281 · Description and Requirements · ...
Cloud Data Platform Engineer

1 week ago

Deutsche Bank Cary, United States

Job Description:Job Title Cloud Data Platform EngineerCorporate Title Assistant Vice PresidentLocation Cary, NCWho we areIn short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas.Our Technologists drive Cloud, Cyber and bu ...
Cloud Data Platform Engineer

1 week ago

Deutsche Bank Cary, United States

Job Description: · Job Title Cloud Data Platform Engineer · Corporate Title Assistant Vice President · Location Cary, NC · Who we are · In short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technologists d ...
Clinical Data Engineer

2 weeks ago

Applab Systems Inc Morrisville, United States

Hi, · Hope you are doing good... · I am Baiju represented to Applab Systems, and I have an excellent job opportunity for you. Please find the below job description and if you are comfortable, please reply or contact me for further discussion. · Job Title: Clinical Data Engineer ...
Data Center Engineer

2 weeks ago

Fidelity TalentSource LLC Morrisville, United States

Job Description: · As a key member of Fidelity s Data Center Operations team, you will coordinate, lead, and finish critical maintenance activities and be directly responsible for the Uptime of the facility or campus · Working with the Engineering Manager, you ll be self-perfor ...
Data Field Service Engineer

3 weeks ago

Abb Holdings Inc Cary, United States

Data Field Service Engineer · Take your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future. At ABB, we have the clear goal of driving diversity and inclusion across all dimensi ...
Data Field Service Engineer

1 day ago

Abb Holdings Inc Cary, United States

Data Field Service EngineerTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future. At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: ...
Data Field Service Engineer

3 days ago

Abb Holdings Inc Cary, United States

Data Field Service EngineerTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future. At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: ...
Sr. Data Engineer

3 weeks ago

eTeam Morrisville, United States

Experience in clinical data and analytics solutions. · Clinical / pharma experience. · Hands-on experience implementing data migration and data processing using Azure services, Serverless Architecture, Azure Storage, Data Factory, Azure Stream Analytics, Databricks Azure Data C ...