- Work with source system owners to understand integration needs
- Work with business users to understand reporting needs
- Implement Databricks and Azure Data Factory components to transform the data into business facing datasets
- Perform unit and integration testing of business facing datasets
- Document business use cases
- Monitor data pipeline job status and troubleshoot issues
- Work with source system owners and business owners to incorporate business changes into data pipeline (i.e., updating metadata file to add new object, update curated layer query, etc.)
- Perform automated data quality checks on data pipelines
- Experience in a production Data Lake or Data Warehouse environment
- Data Lake Design Patterns – Familiar
- Ability to develop programming components to build complex business use cases
- Ability to prioritize and manage multiple job duties, including personal time management and organization skills
- Ability to diagram and understand technical workflows
- Cloud Infrastructure (Azure) - Foundational
-
Data Engineer
1 week ago
ManTech International Corporation Columbia, United StatesThe Data Engineer designs, implements, and maintains data infrastructure and systems. They collaborate with Data Scientists and Analysts to understand their data needs and create efficient solutions to extract, transform, load, link, and/or visualize Data Engineer, Engineer, Data ...
-
Data Engineer
3 weeks ago
Techizee Inc Columbia, United StatesJob Description · Job DescriptionPosition Title: Data Engineer · Key Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics. · Position Description · Collaborate with Solutio ...
-
Data Engineer
1 day ago
Techizee Inc. Columbia, United StatesJob Description · Position Title: Data Engineer Key Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics. Position Description Collaborate with Solution & Enterprise Archit ...
-
Data Engineer Data Fabric
1 week ago
Ernst & Young Washington, United StatesJob Description · En EY, tendrás la oportunidad de construir una carrera tan única como tú, con alcance global, apoyo, una cultura de inclusión y tecnología para convertirte en la mejor versión de ti. Contamos con tu talento y perspectiva para que EY también sea mucho mejor. Únet ...
-
Sr. Data Engineer
2 weeks ago
Dice Columbia, United StatesDice is the leading career destination for tech experts at every stage of their careers. Our client, Apex Systems, is seeking the following. Apply via Dice today · Job#: · Job Description: · Apex Systems is looking for a FULL TIME Senior Data Engineer who is a technical powerh ...
-
Data Processing Engineer
2 weeks ago
Belay Technologies Columbia, United StatesJob Description · Job DescriptionBelay Technologies has been voted Baltimore Business Journal's (BBJ) Best Places to Work 2019, runner up in 2020 and a finalist in 2021 · Belay Technologies is seeking a Data Processing Engineer - Junior Level to join our intel team. The ideal ca ...
-
Data Engineer
2 weeks ago
The Squires Group, Inc Columbia, United StatesOverview · The Squires Group has an opening for a CLEARED Mid-Level Data Engineer to work a HYBRID schedule out of our client site in Columbia, MD. The ideal candidate has worked with big data systems, complex structured and unstructured data sets, and has supported government ...
-
Data Engineer
4 weeks ago
Thought storm Columbia, United StatesJob Description · Job DescriptionJob Title : Data Engineer · Location- Either Columbia, MD, Sterling, VA or San Antonio, TX. All positions will involve Hybrid work.Visa- USC · Employment Type : Direct Hire/FT · Account Manager Description : Must be certified DoD IAT II or higher ...
-
Data Engineer
3 weeks ago
Merit 321 Columbia, United StatesPosition: Data Engineer · Location: Columbia, MD (Hybrid) · Clearance: Current active PLACEMENT MANAGER, SCI eligible · Summary · We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate w ...
-
Data Engineer
1 week ago
The Squires Group Columbia, United StatesOverview : · The Squires Group has an opening for a CLEARED Mid-Level Data Engineer to work a HYBRID schedule out of our client site in Columbia, MD. The ideal candidate has worked with big data systems, complex structured and unstructured data sets, and has supported government ...
-
Data Engineer
1 week ago
The Squires Group Columbia, United StatesOverview :The Squires Group has an opening for a · CLEARED · Mid-Level Data Engineer · to work a HYBRID schedule out of our client site in Columbia, MD. The ideal candidate has worked with big data systems, complex structured and unstructured data sets, and has supported gover ...
-
Staff Analytics Data Engineer
2 weeks ago
Pfizer Belgium Columbia, United StatesThe Analytics Engineering team in the Commercial Analytics & AI (CAAI) organization serves as the backbone of our data-driven organization, delivering the foundation upon which transformative insights and innovation thrive. With a focus on integration, curation, and quality assur ...
-
Data Engineer with Security Clearance
1 week ago
Markesman Group Columbia, United StatesTitle Data Engineer Location Columbia Description Markesman Group is looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missio ...
-
Mid Data Processing Engineer
2 weeks ago
Belay Technologies Columbia, United StatesJob Description · Job DescriptionBelay Technologies has been voted Baltimore Business Journal's (BBJ) Best Places to Work 2019, runner up in 2020 and a finalist in 2021 · Belay Technologies is seeking a Mid-Level Data Processing Engineer to join our intel team. The ideal candida ...
-
Director, Data Engineering
2 weeks ago
Enterprise Community Partners Columbia, United StatesEnterprise is a national nonprofit that exists to make a good home possible for the millions of families without one. We support community development organizations on the ground, aggregate and invest capital for impact, advance housing policy at every level of government, and bu ...
-
Data Flow Engineer
1 week ago
TekSynap Columbia, United StatesResponsibilities & Qualifications · RESPONSIBILITIES: · Implement registry updates · Configure Niagara Files (NiFi) processor/processor groups · Route, transform and enrich ad-hoc dataflows · Manage NiFi clusters · Reverse Engineer customer dataflows and troubleshoot · Respond t ...
-
Director, Data Engineering
3 weeks ago
Enterprise Community Partners Columbia, United StatesEnterprise is a national nonprofit that exists to make a good home possible for the millions of families without one. We support community development organizations on the ground, aggregate and invest capital for impact, advance housing policy at every level of government, and bu ...
-
Data Engineer/Integrator
1 week ago
Boeing Intelligence & Analytics Elkridge, United StatesData Engineer/Integrator · Why This is an Exciting Role: · As a Data Engineer/Integrator at Boeing Intelligence & Analytics your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using ...
-
Data Engineer/Integrator
4 weeks ago
Boeing Intelligence & Analytics Elkridge, United StatesDate Engineer/Integrator · Why This is an Exciting Role: · As a Date Engineer/Integrator at Boeing Intelligence & Analytics your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using ...
-
Data Engineer
6 days ago
Trident Consulting Baltimore, United StatesTrident Consulting is seeking a "Data Engineer" for one of our clients in Baltimore, MD/ Onsite. A global leader in business and technology services · Role: Data Engineer · Location: Baltimore, MD/ Onsite · Type: Contract · Responsibilities · Extract, transform, and load data fro ...
Azure Data Engineer - Columbia, United States - Lambentwit Technologies Inc
Description
Reports Directly To:
CRISP Insights Project Manager
Location:
Columbia, MD
Job Summary
The Data Engineer will be responsible for supporting HIT activities in the Baltimore/Washington region. The successful candidate will work to design, develop, and maintain a data analytics platform solution.
CRISP is currently running an Azure Data Lake 2 / Azure Data Factory / Spark / Databricks infrastructure with approximately 300 production use cases that consolidate several streams of healthcare data.
This role will primarily focus on the creation of new use cases through Databricks programming including communication, technical proficiency, collaboration, and willingness to learn new things.
This role assists a senior data engineer to implement new ingestion pipelines and troubleshoot production issues.This position will have a base salary.
This position requires the candidate to be in the Columbia office 1-2 days a week.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Include the following. Other duties may be assigned.
Create new business data sources from the available data in the data platform:
To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Required Skills
