Azure Data Engineer - Cary, United States - Tata Consultancy Services

Tata Consultancy Services Cary, United States

1 month ago

Show more Collapse job

Description

Role: Azure Data Engineer

Type : Full time

Location : Cary, North Carolina, United States- onsite

Roles & Responsibilities :

Data Engineering

Data pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPE

Data automation / processing using lens

Data pipeline automation using ADF

Data Engineering support

Data Preparation, Exploration and Sustenance

1. Investigate and understand business questions

2. Explore data, identify the right sources; performing data extraction and transformation

3. Perform data validation Experimentation: Control Tower and Scorecards: Knowledge of how Control Tower works How to update metrics Update scorecard layouts Run Scorecard Validation

Run exploratory analysis Skills needed for this:

Python (only for investigations)

XML

Git

PySpark (only for investigations)

4. Implement and provide support for data pipelines and reports

5. Implement monitoring on all critical data pipelines

6. Support migration to Azure Lens Orchestrator from Xflow

Self Service/Datawarehouse Support ADF /lens pipelines to ingress into Synapse on a regularly basis (performance,reprocessing and monitoring)

2. Support visualization/reporting on top of data via Cube, PowerBI premium (based on cost/size needs), excel or Spark Rhythm of Business

1. Maintenance and Sustenance of existing Data Pipelines

2. Workflow Monitoring and Fixes

3. Maintained and monitored existing data

We have other current jobs related to this field that you can find below

Data engineer

4 days ago

eTeam Cary, United States

Job Title :- Data engineer (10+ years candidate required) · Job Location :- Remote · Job Description :- · LinkedIn is Mandatory · Description:- Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study requ ...
Data Engineer

4 days ago

Diverse Lynx Cary, United States

Role: Data Engineer · Location: Cary, NC (Hybrid) · Position Type: Contract · Job Description: We are looking for skilled data engineer with 4-7 years of experience in following technologies: · SSIS, SQL and Azure Data Factory (ADF) · Candidate should have background in da ...
Azure Data Engineer

1 week ago

Tata Consultancy Services Cary, United States

Technical/Functional Skills · Bachelor's degree in Computer Science, Engineering, or related field. · Proven experience as a data engineer or similar role, with a focus on Microsoft SQL Server, Azure, and related technologies. · Strong proficiency in Microsoft SSIS, SSAS, and SS ...
Cloud Data Platform Engineer

4 weeks ago

Deutsche Bank Cary, United States

Job Title: Cloud Data Platform Engineer · Corporate Title: Assistant Vice President · Location: Cary, NC · Who we are · In short – an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technologists drive Cloud, Cyber and ...
Data Field Service Engineer

1 day ago

Abb Holdings Inc Cary, United States

Data Field Service Engineer · Take your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future. At ABB, we have the clear goal of driving diversity and inclusion across all dimensi ...
Senior Data Platform Engineer

4 weeks ago

B264 DB Global Technology, Inc. Cary, United States Full time

Description · : Job Title Senior Data Platform Engineer (m/f/x) – Corporate Banking (CB) Data Platform · Corporate Title Vice President · Location Cary, NC · Who we are · In short – an essential part of Deutsche Bank's technology solution, developing applications for key bu ...
Analytics Data Engineer, Core

1 week ago

Epic Games Cary, United States Full time

WHAT MAKES US EPIC? · At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually ...
Senior Data Engineer

6 days ago

Epic Games Cary, United States

WHAT MAKES US EPIC? · At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually s ...
Cloud Data Engineer

1 week ago

MetLife Cary, United States

Role Value Proposition: · As a Cloud Data Engineer on the team, you will be responsible for leading the technical design and development of cloud-enabled, DevOps, multi-platform, and cross-functional applications that solve complex business problems. The role will be a highly vis ...
Azure Data Engineer

4 days ago

The Dignify Solutions LLC Cary, United States

Experience with Azure: Data Factory, Synapse, Blob Storage , ADLS , Azure SQL, Logic Apps · Solid knowledge of data processing languages, such as SQL, Python, or Scala. · Data Migration · Azure DevOps · ETL Experience with SSIS ,informatica · ...
Sr. Data Engineer

1 week ago

eTeam Cary, United States

xperience: 7+ years working as part of an agile development team, preferably with at least one of those years in a 100% remote capacity · Bachelors Degree in computer science or related field preferred or Associates degree with relevant work experience. · 7+ years of writing high ...
Data Engineer

2 weeks ago

Diverse Lynx Cary, United States

Developer/Data Engineer · Contract · Locations: Cary, NC (Hybrid) · Job Description (JD): · We are looking for skilled data engineer with 4-7 years of experience in following technologies: · SSIS, SQL and Azure Data Factory (ADF)Candidate should have background in data integr ...
Product Engineer, Data Focus

2 weeks ago

Cielo Projects Cary, United States

Company DescriptionCornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel.At Cornerstone Building Brands we provide our residential and commercial customers with a comprehensive por ...
Analytics Data Engineer, Core

1 week ago

Epic Games Cary, United States

WHAT MAKES US EPIC? · At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually ...
Product Engineer, Data Focus

2 weeks ago

Cornerstone Building Brands Cary, United States

Job Description · Job DescriptionCompany Description · Cornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel. · At Cornerstone Building Brands we provide our residential and commer ...
Cloud Data Platform Engineer

3 weeks ago

Deutsche Bank Cary, United States

Job Description: · Job Title Cloud Data Platform Engineer · Corporate Title Assistant Vice President · Location Cary, NC · Who we are · In short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technologists d ...
Lead Data Security Engineer

5 days ago

Deutsche Bank Cary, United States

Job Description: · Job Title · Lead Data Security Engineer · Corporate Title · Assistant Vice President · Location · Cary NC · Who we are · In short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technolo ...
Cloud Data Platform Engineer

1 week ago

Deutsche Bank Cary, United States

Job Title: Cloud Data Platform Engineer · Corporate Title: Assistant Vice President · Location: Cary, NC · Who we are · In short – an essential part of Deutsche Bank's technology solution, developing applications for key business areas. · Our Technologists drive Cloud, Cyber ...
Product Engineer, Data Focus

1 week ago

Cielo Projects Cary, United States

Company Description · Cornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel. · At Cornerstone Building Brands we provide our residential and commercial customers with a comprehens ...
Cloud Data Platform Engineer

3 weeks ago

Deutsche Bank Cary, United States

Job Description:Job Title Cloud Data Platform EngineerCorporate Title Assistant Vice PresidentLocation Cary, NCWho we areIn short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas.Our Technologists drive Cloud, Cyber and bu ...