- Design, develop, and maintain data pipelines using Azure Data Factory to ingest data from various sources such as SQL Server, MongoDB, and Blob Storage into Azure SQL Database and Azure Cosmos DB and Kafka.
- Build data transformation logic using Databricks and Spark for data processing and analytics. Experience in tuning Databricks environments.
- Design / implement data models for data warehousing on Azure SQL DB.
- Configure and manage Hadoop and Spark clusters in Azure HDInsight for big data processing.
- Create and manage data storage solutions using Azure Blob and Data Lake.
- Implement data governance and security measures to protect sensitive data.
- Collaborate with cross-functional teams to ensure successful delivery of projects and support business objectives.
- Mentor junior data engineers and developers and stay up-to-date with emerging technologies and trends in Azure data engineering.
- BS or MS degree in Computer Science or related fields
- Minimum of 3 years of experience in managing data platforms and architecture using Azure services such as Azure Data Factory, Azure SQL Database, Azure Cosmos DB, and Azure HDInsight.
- Strong experience in data warehousing, data integration, and ETL tools.
- Proficient in programming languages such as Python, SQL, and C#.
- Familiarity with NoSQL databases such as MongoDB and Cassandra.
- Experience in version control tools such as Git and Bitbucket.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- bility to work independently and in a team environment.
-
Data Engineer
4 days ago
Amida Technology Solutions Washington, United StatesAmida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intel ...
-
Data Engineer
1 day ago
Analytica Washington, United StatesAnalytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data mode ...
-
Data Engineer
4 days ago
Goldbelt Incorporated Washington, United StatesOverview: · Goldbelt Apex, a part of the Healthcare Technology Transformation Group, is a data-focused company dedicated to process and quality in every aspect. As experts in healthcare IT experts, Apex is committed to building systems for healthcare organizations to seamlessly ...
-
Data Engineer
3 days ago
Booking Washington, United StatesAt , we want to empower everyone to experience the world. Through our products, partners, and people is how we do it. There's a whole planet of possibilities out there, and we bring it all together, in one place. (USA), Inc, one of the support companies in the United States, is ...
-
Data Engineer
4 days ago
Allen Integrated Solutions LLC Washington, United StatesData Engineer - Senior · Location: · Springfield, VA · Position Responsibilities · : · Data Engineer: The Data Engineer shall ensure the integration and interoperability of mission/intelligence data for consumption of the community for peace and crisis situations. · Develop ...
-
Data Engineer
4 days ago
Motion Recruitment Washington, United StatesOur client is an innovative federal consulting agency dedicated to harnessing the power of artificial intelligence (AI) to enhance the capabilities of the defense and intelligence communities. Their mission is to provide innovative, secure, and scalable AI solutions that support ...
-
Data Engineer
11 hours ago
Middle Seat Washington, United StatesMiddle Seat is a full-service media and fundraising firm. We support campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, c ...
-
Data Engineer
2 days ago
Carlyle Group Washington, United StatesBasic information · Job Name: · Data Engineer · Location: · Washington, DC · Line of Business: · Global Technology & Solutions · Job Function: · Investor Services · Date: · Thursday, May 16, 2024 · Position Summary · As a Senior Data Engineer at Carlyle, you will join ...
-
Data Engineer
4 days ago
Barbaricum Washington, United StatesBarbaricum is seeking a skilled Data Engineer to aid in the development of a robust Mission Assurance risk management process and data platform within the Envision Enterprise Data Platform. The ideal candidate will contribute to the creation of a comprehensive system capable of f ...
-
Data Engineer
4 days ago
The American College of Obstetricians and Gynecologists Washington, United StatesOverview: · We are seeking a highly skilled and motivated Data Engineer to join our dynamic team to contribute technical expertise in transforming raw data into meaningful insights, fostering data-driven decision-making within an innovative and collaborative environment. The ide ...
-
Data Engineer
4 days ago
Syntelligent Analytic Solutions Washington, United StatesSyntelligent Analytic Solutions, LLC provides uniquely qualified personnel with the expertise and tools needed to fulfill our customers' management and technical requirements in the intelligence, defense, homeland security and commercial market space. · Our customers' and Syntel ...
-
Data Engineer
4 days ago
ManTech Washington, United StatesSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech, you'll help protect our national security while working on innovative projects that offer opportunitie ...
-
Data Engineer
4 days ago
JobRialto Washington, United States: · Key Responsibilities: · Lead the development of cutting-edge solutions for data streaming platforms, specializing in AWS services for data lake creation, orchestration, and analytics. · Apply advanced statistical analysis to develop intricate algorithms that optimize custo ...
-
Data Engineer
3 days ago
Amida Technology Solutions Washington, United StatesAmida Technology Solutions is a DC-based technology company focused on solutions for data interoperability, data utility, and data security. We create open-source solutions that collect, reconcile, transform, and standardize data for business intelligence, predictive analytics, d ...
-
Data Engineer
3 days ago
System One Washington, United StatesPlease note - must have Active DOD Secret clearance to qualify for being considered · Title: Data Engineers (Mid/Sr) SQL, Big Data/ETL, Python/Java, AWS) · Location: Washington DC 20001 · SECURITY CLEARANCE: Active DOD Secret clearance (interim-secret ok) · Base Salary: OPEN ...
-
Data Engineer
4 days ago
American College of Obstetricians and Gynecologists (ACOG) Washington, United StatesWe are seeking a highly skilled and motivated Data Engineer to join our dynamic team to contribute technical expertise in transforming raw data into meaningful insights, fostering data-driven decision-making within an innovative and collaborative environment. The ideal candidate ...
-
Data Engineer
3 days ago
Visualsoft Washington, United StatesVisual Soft, Inc is seeking qualified candidates to work on our efforts with a Prime for their end customer, a federal agency. · Position: Data Engineer - (50% REMOTE and 50% ONSITE) · Location: Washington, DC or Crystal City, Arlington, VA · Shift time: 8 am to 5 pm · JOB DESCR ...
-
Data Engineer
4 days ago
Analytica Washington, United StatesAnalytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data mode ...
-
Data Engineer
4 days ago
Jobs for Humanity Washington, United StatesCompany Description · Jobs for Humanity is collaborating with Booking to build an inclusive and just employment ecosystem. We support individuals coming from all walks of life. · Company Name: Booking · Job Description · At , we want to empower everyone to experience the world ...
-
Data Engineer
4 days ago
Guidehouse Washington, United StatesJob Family · IT Architecture/Cloud · Travel Required · Up to 10% · Clearance Required · None · What You Will Do · As an experienced data engineer, you will be joining a collaborative IT development team as we bring together Guidehouse's data to address our internal clients ...
Azure Data Engineer - Washington, United States - Ampcus
Description
The Azure Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data models, and data storage solutions using Azure services.
The ideal candidate should have a strong technical background in managing data platforms and architecture using Azure services and experience in data warehousing, data integration, and ETL tools.
Responsibilities:
Qualifications:
Desirable:
familiarity with Aveva/OSISoft PI system and SCADA system
#J-18808-Ljbffr