Azure Data Engineer - Ashburn, United States - teamworkonline

teamworkonline Ashburn, United States

2 weeks ago

Description

Job Title:
Azure Data Engineer / Azure Cloud Data Engineer

Overview:
We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database administration, Azure services, and proficiency in C# programming for Azure Functions development.

Responsibilities:

Assessment and Planning:

Evaluate existing on-site SQL Server environment.
Collaborate with stakeholders to gather requirements for Azure SQL migration.
Develop a comprehensive migration plan, considering downtime, data transfer, and compatibility.

Database Migration:

Utilize Azure Database Migration Service (DMS) or relevant tools for seamless migration to Azure SQL.
Ensure data integrity and consistency during the migration process.
Minimize downtime and disruptions to ongoing operations.

Azure SQL Configuration:

Configure Azure SQL databases, servers, and related services based on requirements.
Optimize Azure SQL performance and scalability.
Implement security measures, including access controls and encryption.

Replication of Processes:

Replicate existing on-premises SQL Server processes and jobs in Azure SQL.
Ensure scheduled tasks, backups, and maintenance plans are transferred and configured appropriately.

Data Ingestion from 3rd

Party Vendors:· Understand APIs provided by various 3rd party vendors.· Design and implement robust data ingestion processes tailored to each vendor's API.· Develop efficient workflows for the extraction, transformation, and loading (ETL) of external data into Azure SQL databases.· Implement SQL replication when necessary for data synchronization.· Ensure the security and integrity of ingested data from external sources.

Azure Services Integration:

Utilize Azure Data Factory, Logic Apps, or other relevant services to seamlessly integrate external data sources into the Azure SQL environment.
Leverage Azure Data Bricks or similar tools for large-scale data processing and transformation.
Design and implement Azure Functions for specific tasks or processes.
Integrate Azure Functions into workflows for data processing and transformation.

Performance Monitoring and Optimization:· Implement monitoring solutions for Azure SQL to track performance metrics and ensure the completion of data migration functions/jobs. Enable the ability to restart these functions/jobs in case of errors and configure SMS/Email notifications for severe issues.· Identify and address performance bottlenecks; optimize queries for efficiency.

Troubleshooting and Support:

Provide support during and after migration to address any technical issues.
Collaborate with Azure support services when needed.

Qualifications:

Bachelor's degree in computer science, Information Technology, or a related field.
3-4 years of experience as an Azure Data Engineer or in a similar role.
Strong background in database administration, particularly with SQL Server and Azure SQL.
Experience with Azure services, including Azure Functions and Azure Queues.
Proficiency in C# programming language, with a focus on developing Azure Functions for specific tasks or processes.
Proven expertise in data ingestion from 3rd party vendors using REST APIs and SQL replication.
Knowledge of data engineering tools, ETL processes, and data warehousing.
Azure certifications (e.g.

, Microsoft Certified:

Azure Data Engineer Associate) are a plus.· Excellent communication and collaboration skills.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, age, disability, gender identity, marital or veteran status, or any other protected class.

Data Automation Engineer

5 days ago

GovFirst Herndon, United States

We are actively seeking a talented and experienced Data Automation Engineer (Cyber Security Systems) to join our team in supporting our customer's Division level Authorization and Accreditation (A&A) projects. The ideal candidate will have a minimum of 16 years of experience and ...
Data Engineer

1 week ago

Infinitive Ashburn, United States

*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technol ...
Data Engineer

1 week ago

Infinitive Ashburn, United States

*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolo ...
Data Engineer

1 week ago

Infinitive Inc Ashburn, United States

Job Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
Data Engineer

1 week ago

Infinitive Inc Ashburn, United States

Job Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
Data Engineer

1 week ago

BizFirst Alexandria, United States

Job Title: Data Engineer · Company: Client of BizFirst · Location: Crystal City/Alexandria, VA (Onsite requirement: 3 days per week) · Employment Type: Full-time W-2 Employee · Contract Length: 5 years · Security Clearance: Secret clearance required; TS/SCI clearance preferred · ...
Data Engineer

1 week ago

Eclipse Enterprises Cabin John, United States

Be Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
Data Engineering Fellow

2 days ago

BlueLabs Analytics, Inc. Washington, United States

**About BlueLabs** · BlueLabs is a leading provider of analytics services and technology for a variety of industry clients: including government, business, and political campaigns. We help our clients optimize their engagements with individual customers, supporters, and stakehold ...
SME Data Engineer

1 week ago

CMCI Ashburn, United States

Job Description · SME Data Engineer · Location: Ashburn, VA · Why CMCI? · CMCI provides management consulting and IT services that empower enterprises to achieve their business goals in today's highly competitive market. Our goal is to seamlessly integrate into each customer' ...
Azure Data Engineer

2 days ago

AEG Ashburn, United States

Job Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview:We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
Data Center Engineer

1 week ago

ConvergeOne Ashburn, United States

C1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer netwo ...
Data Center Engineer

2 weeks ago

Insight Global Ashburn, United States

The Engineer-I position is a contributing member to the site level Data Center Operations team assigned to one or more of our data center properties reporting directly to the Manager of Facility Engineering. The Engineer-I will have experience in mission critical infrastructure, ...
SME Data Engineer

1 week ago

ManTech Ashburn, United States Full time

Secure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
Data Center Engineer

5 days ago

ConvergeOne Ashburn, United States

C1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer networ ...
Data Center Engineering Technician

15 hours ago

Amazon Web Services Chantilly, United States

AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment ...
Data Operations Engineer

1 week ago

Comcast Corporation Ashburn, VA, United States Full time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning tec ...
Data Center Engineer

2 weeks ago

RIT Solutions, Inc. Ashburn, United States

This is 100% onsite role - Must be local in DMV area · Duration: 6+ months · Must have a valid LinkedIn profile · Extensive layer 1 knowledge · Hardware/ Cable troubleshooting · Racking/stacking/ cabling · Ability to work night shift · ...
Remote SME Data Engineer

1 week ago

Shuvel Digital Ashburn, United States

Job Description: · Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings requ ...
Data Center, Service Engineer

1 week ago

Knewin Ashburn, United States

Job Req ID: 23192 · About Supermicro: · Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing ...
Data Center, Service Engineer

1 week ago

Super Micro Computer Ashburn, United States

Job Req ID: 23192 · About Supermicro: · Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing ...