- Data Pipeline Development: Designing and implementing scalable and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. This involves understanding data requirements, identifying relevant data sources, and building automated workflows to ensure data quality and integrity.
- Data Modeling and Integration: Developing and maintaining data models, schemas, and integrations to facilitate data ingestion, transformation, and aggregation. This includes designing database schemas, defining data structures, and establishing efficient data integration processes between different systems.
- Data Quality Assurance: Implementing and maintaining data quality checks and validation procedures to ensure accuracy, completeness, and consistency of data. This involves developing data profiling techniques, anomaly detection mechanisms, and data cleansing routines to identify and resolve data quality issues.
- Performance Optimization: Monitoring and optimizing the performance of data pipelines, databases, and data processing systems. This includes identifying and resolving bottlenecks, improving query performance, and implementing caching strategies to enhance overall data processing efficiency.
- Data Security and Governance: Collaborating with the data governance and security teams to establish data access controls, data encryption mechanisms, and data privacy measures. Ensuring compliance with data protection regulations and best practices in data management and security.
- Collaboration and Documentation: Working closely with cross-functional teams to understand their data requirements and provide technical guidance on data-related matters. Documenting data pipelines, data flows, and data infrastructure architectures to facilitate knowledge sharing and maintain system documentation.
- Emerging Technologies: Keeping up-to-date with the latest trends and advancements in data engineering, big data technologies, cloud platforms, and distributed computing frameworks. Evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and infrastructure.
- Bachelor's degree in computer science, Information Systems, or 3-5 years of relevant job experience.
- Proven experience as a Data Engineer or a similar role, preferably in a large-scale data-driven environment.
- Strong programming skills in languages, specifically Databricks and Pyspark, and others such as Python, Java, or Scala.
- Experience with data integration tools, ETL frameworks, and workflow management systems (e.g., Apache Airflow).
- Proficiency in working with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Familiarity with distributed computing frameworks (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure, GCP).
- Knowledge of data modeling concepts, data warehousing, and dimensional modeling.
- Understanding of data governance, data security, and data privacy principles.
- Strong analytical and problem-solving skills, with attention to detail.
- Excellent communication and collaboration abilities, with the capacity to work effectively in cross-functional teams.
-
Data Engineer Data Fabric
1 week ago
Ernst & Young Washington, United StatesJob Description · En EY, tendrás la oportunidad de construir una carrera tan única como tú, con alcance global, apoyo, una cultura de inclusión y tecnología para convertirte en la mejor versión de ti. Contamos con tu talento y perspectiva para que EY también sea mucho mejor. Únet ...
-
Data Engineering Fellow
2 weeks ago
BlueLabs Analytics, Inc. Washington, United States**About BlueLabs** · BlueLabs is a leading provider of analytics services and technology for a variety of industry clients: including government, business, and political campaigns. We help our clients optimize their engagements with individual customers, supporters, and stakehold ...
-
Data Engineer
2 weeks ago
Carnegie Mellon University Arlington, United States Full timeWhat We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense c ...
-
Data Engineer
1 day ago
Booz Allen Hamilton Arlington, United StatesData EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal in ...
-
Data Engineer
3 weeks ago
iO Associates - US Arlington, United StatesA DMV based technology start-up is looking for an experienced Data engineer with 5+ experience to come in and work on their latest project. The firm has recently received Series B funding and are looking to grow out their team. · The main responsibilities of the position will be ...
-
Data Engineer
1 week ago
CNA Arlington, United StatesCNA fosters an inclusive culture that values diverse backgrounds and perspectives. Our flexible and engaging work environment encourages iterative and creative collaboration at every stage of the problem solving process. Our employees are committed to helping clients develop effe ...
-
Data Engineer
3 weeks ago
Booz Allen Hamilton Arlington, United States Full timeJob Number: R0195194 · Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big dat ...
-
Data Engineer
2 weeks ago
@Orchard Arlington, United StatesJob Description · Job DescriptionData Engineer (Advana System)Must hold an active Secret Clearance (Top Secret preferred) · Arlington, VA – Hybrid is working with a fast-growing Service-Disabled Veteran-owned Small Business (SDVOSB) focused on delivering a range of solutions to ...
-
Data Engineer
1 week ago
ManTech Washington, United States Paid WorkSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech, you'll help protect our national security while working on innovative projects that offer opportunities ...
-
Data Engineer
4 days ago
Orangetheory Fitness Washington, United States Full timeJob Duties: · Design, implement and maintain stable data ingestion pipelines using ETL best practices. · Responsible for transforming and optimizing raw data sets into modeled datasets tailored to business needs. · Collaborate with BI Analysts and Data Scientists to ensure data a ...
-
Data Engineer
2 days ago
Booz Allen Hamilton Washington, United States Full timeData EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal in ...
-
Data Engineer, Mid
3 weeks ago
Booz Allen Hamilton Arlington, United States Full timeJob Number: R0192042 · Data Engineer, MidThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing b ...
-
Data Engineer, Senior
5 days ago
Booz Allen Hamilton Arlington, United StatesData Engineer, SeniorThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pi ...
-
Data Engineer
2 weeks ago
VXForward Washington, United States Full timeJoin our innovative team and help us in shaping the future of Technology · About Us: · VXForward is a leading technology solutions provider that helps to create a business value with innovative and cost-effective services across different industries. · Why Join Us: · Exciting Pro ...
-
DoD Data Engineer
4 days ago
RM Advisory Services Arlington, United StatesMinuteman Data Engineer (Full-time) · Location: Arlington, VA – Hybrid Model (1-2 days in office per week) · Clearance Requirement: Active Secret or higher · This is a full-time opportunity with a DoD organization in the Washington, DC area. Strong compensation offered for the r ...
-
OBIEE Data Engineer
3 weeks ago
Innova Solutions Arlington, United StatesInnova Solutions is seeking an OBIEE Data Engineer to work Onsite in Alexandria, VA for one of our growing clients. · Position Type: Contract-to-Hire · Duration: 6 Month - Contract-to-hire · Location: Alexandria, VA - 100% onsite. · ***Must have a Secret Clearance This is more o ...
-
Data Architect/ Data Engineer
1 week ago
Gridiron IT Arlington, United StatesGridiron IT is seeking a Data Architect/Data Engineer to support a federal program on a 100% remote basis. · Help maintain and work within client's existing AWS environment. Coordinate with data science team for needs on data storage access. Support automation of analytic pipeli ...
-
Data Engineer
3 weeks ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
Data Engineer
1 week ago
Piper Companies Washington, United StatesPiper Companies · is looking for a · Data Engineer · to join an elite environmental industrial engineering firm in Washington, DC, to · cluster large datasets across various container and data platforms. · Responsibilities of the Data Engineer · include: · Achieve and maintain pr ...
-
Azure Data Engineer
3 weeks ago
Marathon TS Arlington, United StatesPosition Title: Azure Data Engineer · Location: Remote in Washington, DC · Clearance: Candidate must be a U.S. Citizen with an active clearance or able to obtain a clearance. DOT cleared or Public Trust Cleared is preferred. · Marathon TS is seeking an experienced Azure Data E ...
Data Engineer - Arlington, United States - Intelligent Waves
Description
OverviewSince 2006, Intelligent Waves has delivered mission-focused multi-domain operational expertise and innovation to the Government through high-impact technology solutions in cybersecurity, data science, enterprise network engineering, software development, and platform mission support. Anytime. Anywhere. Any domain.
Advana is a multi-domain technology platform which offers military and business decision makers, analysts, and users at all levels unprecedented access to authoritative enterprise data and structured analytics in a scalable, reliable, and secure environment. It offers platform-, data analytics-, and data science-as-a-service tools to complete analysis and data exploration and data visualization capabilities. Using one central data platform with right-time data, data tools, and other self-service products, the goal of Advana is to simplify solutions and put the power of analytics in the pocket of every analyst and decision-making authority within the DOD.
Location & Travel: The Data Engineer position will be a Hybrid role based in Crystal City, VA with the ability to be in the office 2-3/days p/week and attend onsite meetings as needed.
Security Clearance: The Data Engineer must be a United States Citizen and hold a current DoD Secret security clearance.
Mission - ADVANA
Employees are required to follow all company and customer site COVID-19 protocols.
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure and systems within an organization. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the efficient flow, storage, and accessibility of data for analytical and reporting purposes.
Responsibilities
Intelligent Waves LLC is an equal opportunity employer. We are committed to providing equal opportunity to all applicants and employees in full compliance with all applicable state and federal laws prohibiting discrimination on the basis of race, color, age, gender, religion, national origin, disability, sexual orientation and gender identity protected veteran status and individuals with disabilities, or any other class protected by applicable state or federal law.
As an Affirmative Action and Equal Opportunity Employer, IW is committed to the full inclusion of all qualified candidates and current employees. As part of this commitment, IW will ensure that those in need are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact
A Veteran Friendly Organization#IW
#CJ