- Pennsylvania
- Arizona
- Washington
- Illinois
- Massachusetts
- Florida
- Georgia
- North Carolina
- Colorado
- Tennessee
- Texas
- Virginia
- The AI & Analytics product team delivers data driven business analytic solutions leveraging artificial intelligence (AI), Big Data architecture and machine learning expertise to deliver business intelligence (BI) and analytics insight for the professional consulting market.
- The Senior Data Engineer is a key member of the AI & Analytics team, providing domain expertise and leadership to deliver data-related products, features, and functionality that serves business and technical leaders.
- The Senior Data Engineer must have a thorough knowledge of the Microsoft Big Data solutions. This individual will be responsible for defining high volume data processing pipelines in a multi-tenant environment, verifying data integrity and curating data for consumption by data warehouse, third-party data analytics tools and machine learning models.
- The ideal candidate is an exceptional critical thinker with strong business acumen that is adept at solving complex problems and creating elegant business solutions. You will be involved in the design and development efforts for our big data solutions including data lake, Business Intelligence Solutions, Machine Learning, Data Pipeline and cloud-based data warehouse products.
- Strong analytical skills, able to translate complex business requirements into sound data management and data governance solutions
- Work with clients to understand data analytics requirements.
- Analyze data to ensure it meets specific data management, data governance, and data quality assurance requirements before processing the data within the Data Lake and data warehouse
- Work with the Product Managers, Database Architect or BI Architect to understand data pipeline and data life cycle processing requirements and patterns
- Install and configure data sources for use by the data pipelines
- Work with the Database Architect to define data management, data governance, and data quality assurance requirements to manage the entire data processing life cycle
- Acts as a key contributor to all phases of the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
- Curates data for analyses, business reviews, and operational data analysis demands
- Use an agile approach to define requirements, design and develop data pipeline solutions to enable near real-time change data capture (CDC) and data consumption
- Proficient in applying data management, data governance, and data quality processes and tools to correlate disparate sources
- Strong business acumen and proven experience in solving complex problems and creating elegant business solutions
- Adept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of action
- Advanced SQL development skills, broad exposure to all language constructs
- Experience with Microsoft On-premise SQL Server (2017 or higher) and Azure SQL Server technologies including broad experience with SQL Server capabilities and tools (e.g., CDC, Columnstore Index, In-memory Table, SSAS Tabular, DAX, T-SQL, SSIS)
- Experience in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow
- Experience with Azure products and services including Azure Data Lake Gen2, Azure Databricks, Azure Databricks Unity Catalog, Databricks API, Databricks Row-level security, Databricks error logging, Azure SQL Server, and Azure Analysis Services.
- Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
- Experience with data integration through APIs, Web Services, SOAP, and/or REST services
- Experience with Lakehouse architecture and design for multi-tenant, OLTP data modeling, dimensional data modeling, composite modeling, data transformation, row-level security, and designing the most optimal analytical data structures for near real-time data analytics
- Additional programming experience is a plus (preferably.NET) or other languages such as Python, Scala, R.
- Bachelor's degree in CS
- 10+ years of experience with designing and developing complex data analytics solutions
- 5+ years of experience with Microsoft Big Data solutions
-
Senior Data Engineer
20 hours ago
Capital One Virginia, United States Full timeLocations: VA - Richmond, United States of America, Richmond, Virginia · Senior Data Engineer · Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environme ...
-
Lead Data Engineer
20 hours ago
Capital One Virginia, United States Full timeWest Creek , United States of America, Richmond, Virginia · Lead Data Engineer · Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital ...
-
Senior Data Engineer
20 hours ago
Capital One Virginia, United States Full timeWest Creek , United States of America, Richmond, Virginia · Senior Data Engineer · Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capita ...
-
Data Pipeline Engineer
1 week ago
CommIT Enterprises Charleston, United StatesOverview: · CommIT Enterprises, Inc. is seeking an · Data Pipeline Engineer · to join the team in · Charleston, SC- *this contingent position is remote We are looking for a talented and forward-facing Data Pipeline Engineer who will be a critical part of a fast-moving Marine ...
-
OBIEE Data Engineer
1 day ago
Diversant Virginia, United StatesInnova Solutions is seeking an OBIEE Data Engineer to work Onsite in Alexandria, VA for one of our growing clients. · Position Type: Contract-to-Hire · Duration: 6 Month - Contract-to-hire · Location: Alexandria, VA - 100% onsite. · ***Must have a Secret Clearance This is more of ...
-
Senior Data Engineer
5 hours ago
Spring Oaks Capital, LLC Virginia, United StatesPosition Overview: · As a Senior Data Engineer at Spring Oaks Capital, you will be responsible for designing, building, and maintaining the infrastructure and data pipelines that support our data-driven decision-making process, with a particular focus on enhancing our digital com ...
-
Data Applications Engineer
1 week ago
Hartzell Propeller Charleston, United StatesHartzell Aviation · With a history dating back to the Wright Brothers, Hartzell Aviation is a growing family of brands committed to innovation and the continuous improvement of general aviation and is owned by Arcline Investment Management, a growth oriented private equity firm w ...
-
Data Engineering Lead
5 days ago
SAIC Virginia, United StatesDescription · SAIC is a leading global technology integration company specializing in cutting-edge Artificial Intelligence solutions. We are committed to delivering innovative AI solutions that transform industries and empower businesses. SAIC is seeking a Data & AI Services Lead ...
-
Data Cloud M365 Solution Engineer
6 days ago
Veeam Charleston, United StatesDate of publication: 01 March 2024 · Remote / USA · Veeam, the #1 global market leader in data protection and ransomware recovery, is on a mission to empower every organization to achieve radical resilience through data security, data recovery, and data freedom for their hybrid c ...
-
Amazon Charleston, United StatesSr. Physical Security Engineer, Data Center Design Engineering · Job ID: | Amazon Data Services, Inc. · Amazon Web Services (AWS) is seeking a Sr. Physical Security Engineer to join its data center design team. Position is available for any of the following locations: · • Seattl ...
-
TS/SCI w/poly-Data Engineer
1 day ago
Leading Path Consulting Northern Virginia, United StatesJob Description · Job DescriptionPosition is with the VA McLean Customer and requires an active TS/SCI with Full Scope Poly clearance. · The Data Engineer will manipulate data and data flows for both existing and new systems. Additionally · they will provide support in the areas ...
-
Research Technician
4 days ago
Massachusetts General Hospital(MGH) Charlestown, United States**Research Technician** · GENERAL SUMMARY: · Position involves working in a fast-paced biomedical optics group within a computational neuroimaging lab. Our group develops novel optical imaging techniques, including optical coherence tomography (OCT) and multi-photon microscopy, a ...
-
Phlebotomist
22 hours ago
Actalent Charleston, United States Full timeDescription: · Collect specimens according to established procedures. This includes, but not limited to: drug screens, blood samples, processing pathology and cytology samples. · Research test/client information and confirm and verify all written and electronic orders by utilizi ...
-
Certified Pharmacy Technician
4 days ago
Actalent Charleston, United States Full timeLooking for a pharmacy technician who is interested in working in the hospital setting This position is a great move for someone who is looking to move up from retail pharmacy and gain new expereince in an exciting setting with a large team. · Description: · -A pharmacy technicia ...
-
Propulsion Installations Analyst
1 day ago
BOEING North Charleston, United StatesAt Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity and inclusion are shared values. We're committed to fostering an environment for every teammate ...
-
Subject Matter Experts Sis
1 day ago
Dhara Consulting Group Charleston, United StatesToday · - Top Secret/SCI · - Unspecified · - Unspecified · - Charleston, SC** (ON-SITE/OFFICE)** · VNE has earned a reputation for exceptional performance, innovation, agility, and responsiveness in the Intelligence Community (IC). We attack our mission with a comprehensive under ...
-
Management Analyst Ii
3 days ago
Resource Management Concepts, Inc. Charleston, United StatesResource Management Concepts, Inc. (RMC) provides high-quality, professional services to government and commercial sectors. Our mission is to deliver exceptional management and technology solutions supporting the protection and preservation of the people and environment of the Un ...
-
Parking Ambassador
3 days ago
ABM BNILS Parking - NEW Charleston, United StatesThe **Parking Ambassador/Valet** is responsible to park and retrieve vehicles. The **Parking** **Ambassador** will drive customer vehicles. They will comply with all traffic laws, facility policies and any pedestrian regulations. The **Parking Ambassador** will always approach an ...
-
Technical Writer/editor 3
1 day ago
Dhara Consulting Group Charleston, United StatesToday · - Secret · - Unspecified · - Unspecified · - IT - Tech Writing · - Charleston, SC** (ON-SITE/OFFICE)** · VNE has earned a reputation for exceptional performance, innovation, agility, and responsiveness in the Intelligence Community (IC). We attack our mission with a compr ...
-
Home Inspector
3 days ago
Ellingwood Pro Charles Town, United States**Job Title**: Certified Home Inspector - Territory Specialist · **Company**: Ellingwood Pro Home Inspection · **Location**: Winchester, VA 22602 · **About US**: Ellingwood Pro Home Inspection · Ellingwood Pro Home Inspection is a rapidly expanding and highly respected home inspe ...
Senior Data Engineer - Virginia, United States - The Crox Group
Description
***********************ONLY USC & GC CANDIDATES*************FULL TIME ONLY************
Hi,
I have a direct client open for Sr. Data Engineer on Full Time with 100% Remote. Please see the JD below and let me know if you are interested.
Title: Senior Data Engineer
Work Location/s: Remote for below location only.
Summary of Duties & Responsibilities:
Essential Functions
Skills & Competencies:
Education or Prior Work Experience: