- 15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks
- Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security.
- Designed, Development and implemented Datamesh using DeltaLake.
- Provide technical leadership and guidance to the Databricks development team, ensuring best practices are followed throughout the project lifecycle.
- Collaborate with cloud infrastructure teams to design and optimize the underlying infrastructure for Databricks workloads on platforms such as AWS or Azure
- Develop efficient data ingestion and ETL pipelines using Databricks, Apache Spark, and other relevant technologies.
- Integrate Databricks with data lakes and data warehouses to ensure seamless data access and analytics.
- Continuously monitor and optimize Databricks workloads for performance and cost-effectiveness.
- Implement and maintain security measures, including access controls, encryption, and compliance standards, to protect sensitive data.
- Create documentation and provide training to internal teams on Databricks best practices and usage.
- Stay up-to-date with the latest developments in Databricks and related technologies to recommend and implement improvements.
- Good knowledge on SQL Queries & Stored Procedures.
- Strong programming skills in Pyspark, Python, writing complex queries in T-SQL
- Experience in transferring data from RDBMS to Data bricks using ADF.
- Expertise in using Spark SQL with various data sources like JSON, Parquet and XML.
- Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Python.
- Experience with Insurance Domain
-
Data Architect
3 weeks ago
Booz Allen Hamilton McLean, United States Full timeJob Number: R0188274 · Data ArchitectThe Opportunity: · For an organization to transform in today's digital world, it needs to properly collect, store, and organize its data. Effective data management can enable more efficient operations, yielding more growth. As a data architec ...
-
Azure Data Architect
4 days ago
Zachary Piper Solutions McLean, United StatesPiper Companies is seeking an Azure Data Architect for a world leading technology organization. The Azure Data Architect will lead the architecture needs for the Data Warehouse and Analytics team and will be responsible for building out the analytics platform. The Azure Data Arch ...
-
Azure Data Architect
2 weeks ago
Zachary Piper Solutions McLean, United StatesPiper Companies is seeking an Azure Data Architect for a world leading technology organization. The Azure Data Architect will lead the architecture needs for the Data Warehouse and Analytics team and will be responsible for building out the analytics platform. The Azure Data Arch ...
-
Data Architect, Director
3 weeks ago
Booz Allen Hamilton McLean, United States Full timeJob Number: R0194186 · Data Architect, DirectorKey Role: · Initiate data architecture (DA) activities, including extract-transform-load (ETL) processes and data warehouse solutions design, through business needs analysis and routine issue resolution. Apply advanced theories, prin ...
-
Data Architect
3 weeks ago
Arkhya Tech Inc. Mclean, United States Full time, contractRole Data ArchitectLocation McLean VARequired Skill -This team is on an Enterprise team supporting use cases across multiple lines of business; wide diversity of type of data architecting needs. Main tech stack and skills – Sr. Data Architect who has a lot of modeling experience ...
-
Chief Data Architect
4 weeks ago
SAIC Career Site MCLEAN, United StatesDescription · SAIC, a leading provider of systems development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the Intelligence Community, is seeking creative and dedicated professionals to fulfill th ...
-
Chief Data Architect
2 weeks ago
SAIC Career Site MCLEAN, United StatesDescription · SAIC, a leading provider of systems development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the Intelligence Community, is seeking creative and dedicated professionals to fulfill th ...
-
MuleSoft Architect
1 week ago
Buchanan & Edwards McLean, United States Full timeDescription · MuleSoft Architect · Description · Buchanan & Edwards is seeking a MuleSoft Architect to join our team of qualified, diverse individuals. This position will be located in Herndon, VA. The qualified applicant will become part of Buchanan & Edwards Department of S ...
-
Full Performance Data Analyst/Scientist
3 weeks ago
LMI McLean, United StatesOverview · LMI is seeking a Full PerformanceData Scientist to support a U.S. Federal Government Agency working with classified media. This position will work with a team of developers, architects, and data scientists to build new capabilities for our client, bringing innovative i ...
-
Solution Architect
3 weeks ago
Booz Allen Hamilton McLean, United States Full timeJob Number: R0195033 · Solution ArchitectThe Opportunity: · A well-designed secure network is critical to move data and enable the DoD to achieve their mission, but how can an organization make sure their network will fit their evolving needs? Crafting the right network, with the ...
-
Snowflake Admin
6 days ago
Dexian McLean, United StatesTitle: Snowflake Admin · Duration: 7 Months + Possible extensions · Location: Mclean VA · Responsibilities: · Develop data filtering, transformational and loading requirements · Define and execute ETLs using Apache Sparks on Hadoop among other Data technologies · Determine approp ...
-
Senior Software Engineer
3 weeks ago
LMI McLean, United StatesOverview · LMI is seeking a Senior Software Engineer to support a U.S. Federal Government Agency working with classified media. This position will work with a team of developers, architects, and data scientists to build new capabilities for our client, bringing innovative ideas ...
-
Software Engineer
1 hour ago
NeoMax McLean, United States Full timeJob Description · We are looking for a software engineer to support an organization that builds full stack software system solutions that increases the speed at which data is acquired and exploited by hundreds of individuals on mission critical systems as well as provide mission ...
-
Elasticsearch Engineer
2 weeks ago
Leading Path McLean, United StatesThe Software Engineer will design, develop, configure, support, and maintain Elasticsearch clusters and support the · development teams around that ecosystem. The ideal candidate is a hands-on platform builder with significant · experience in developing scalable data platforms, w ...
-
Azure Cloud Architect and Engineer
1 week ago
Booz Allen Hamilton McLean, United States Full timeAzure Cloud Architect and Engineer The Opportunity: · Everyone is trying to "harness the cloud," but not everyone knows how. As a cloud computing infrastructure architect, you know how to take advantage of cloud capabilities. On our team of experienced professionals, you'll us ...
-
Cybersecurity Zero Trust Architect, Lead
3 weeks ago
Booz Allen Hamilton McLean, United States Full timeJob Number: R0193422 · Cybersecurity Zero Trust Architect, LeadThe Opportunity: · Everyone knows security needs to be "baked in" to a system architecture, but you know how to bake it in. You can identify and implement ways to harden systems and reduce their attack surface. What ...
-
Booz Allen Hamilton McLean, United States Full timeJob Number: R0189937 · Commercial Cybersecurity Zero Trust Architect, Senior ManagerThe Opportunity: · Everyone knows security needs to be "baked in" to a system architecture, but you actually know how to bake it in. You can identify and implement ways to harden systems and reduc ...
-
Senior Software Engineer
2 weeks ago
LMI McLean, United StatesOverview · LMI is seeking a Senior Software Engineer to support a U.S. Federal Government Agency working with classified media. This position will work with a team of developers, architects, and data scientists to build new capabilities for our client, bringing innovative idea ...
-
Senior Network Engineer
4 days ago
Maximus McLean, United States Full timeGeneral information · Job Posting Title Senior Network Engineer Date Thursday, May 23, 2024 City Mclean State VA Country United States Working time Full-time Description & Requirements · This position is the Senior Network Engineer for a contract supporting a Federal resear ...
-
Director, Federal Workday Technical PM
1 week ago
KPMG McLean, United StatesThe KPMG Advisory practice is currently our fastest growing practice. We are seeing tremendous client demand, and looking forward we don't anticipate that slowing down. In this ever-changing market environment, our professionals must be adaptable and thrive in a collaborative, te ...