Jobs
>
Washington, D.C.

    ETL Data Engineer - Washington, United States - Serigor Inc.

    Default job background
    Description

    Job Description

    Job DescriptionJob Title: ETL Data Engineer (ONSITE)
    Location: Washington, DC
    Duration: 12 Months+

    Job Description:
    The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.

    The ETL data engineer will support the client Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:

    Responsibilities:
    • Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
    • Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District's data systems.
    • Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
    • Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
    • Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
    • Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
    • Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
    • Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
    • Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
    • Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
    • Automates, monitors, alerts, and manages data pipelines and workflows.
    • Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
    • Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
    • Develops complex programs and reports in database query language.
    • Familiarity/experience with data visualization tools.
    • Familiarity/experience handling and securing sensitive data based on the level of the sensitivity

    Responsibilities:
    • Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.
    • Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.
    • May require coordination of programming activities being conducted by the application development team
    • Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
    • Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.
    • Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.
    • May coordinate activities of application developers.11-
    • Able to identify best practices and standards for the use of the product.
    • Proven track record of hands-on technical design and code work within large complex systems.
    • Proven hands-on technical work with a variety of technologies.
    • Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.
    • Delivers support and design for industry specific applications that require integration with statewide systems or applications.
    • Interacts with executive level business users or technical experts.
    • Advanced experience in the required technical subject matter.
    • May function as a niche technical SME (Subject Matter Expert).
    • Has proven experience across large and complex implementations and systems.

    Minimum Education/Certification Requirements:
    • Bachelor's degree in Information Technology or related field or equivalent experience

    Skills:
    SkillsRequired / DesiredAmountof ExperienceStrong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sourcesRequired15YearsAbility to gather and document requirements for data extraction, transformation and load processesRequired15YearsUnderstanding of data warehousing, data lake, business intelligence and information management concepts and standards.Required15YearsAbility to advise internal and external customers on appropriate tools and systems for complex data processing challenges.Required15YearsKnowledge and use of SQL for relational databasesRequired11YearsExperience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO)Required11YearsContribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliabilityRequired7YearsStrong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob StorageRequired5YearsExperience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FMERequired5YearsExperience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGISHighly desired3YearsStrong communication skills, both oral and writtenRequired3YearsAbility to provide excellent customer service to external partnersRequired3YearsAbility to work independently or as part of a larger teamRequired3YearsExperience performing data functions with DatabricksHighly desired3Years

    Powered by JazzHR

    FQELR0DUzX



  • Ernst & Young Washington, United States

    Job Description · En EY, tendrás la oportunidad de construir una carrera tan única como tú, con alcance global, apoyo, una cultura de inclusión y tecnología para convertirte en la mejor versión de ti. Contamos con tu talento y perspectiva para que EY también sea mucho mejor. Únet ...

  • ManTech

    Data Engineer

    1 week ago


    ManTech Washington, United States Paid Work

    Secure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech, you'll help protect our national security while working on innovative projects that offer opportunities ...

  • Booz Allen Hamilton

    Data Engineer

    2 days ago


    Booz Allen Hamilton Washington, United States Full time

    Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal in ...

  • Orangetheory Fitness

    Data Engineer

    4 days ago


    Orangetheory Fitness Washington, United States Full time

    Job Duties: · Design, implement and maintain stable data ingestion pipelines using ETL best practices. · Responsible for transforming and optimizing raw data sets into modeled datasets tailored to business needs. · Collaborate with BI Analysts and Data Scientists to ensure data a ...

  • VXForward

    Data Engineer

    2 weeks ago


    VXForward Washington, United States Full time

    Join our innovative team and help us in shaping the future of Technology · About Us: · VXForward is a leading technology solutions provider that helps to create a business value with innovative and cost-effective services across different industries. · Why Join Us: · Exciting Pro ...

  • Piper Companies

    Data Engineer

    1 week ago


    Piper Companies Washington, United States

    Piper Companies · is looking for a · Data Engineer · to join an elite environmental industrial engineering firm in Washington, DC, to · cluster large datasets across various container and data platforms. · Responsibilities of the Data Engineer · include: · Achieve and maintain pr ...

  • Leyden Solutions Inc

    Data Engineer

    3 weeks ago


    Leyden Solutions Inc Washington, United States

    Job Description · Job DescriptionLeyden Solutions has an immediate opening for a skilled Data Engineer to support a federal law enforcement client's financial crime program. The Data Engineer will possess proficiency in manipulating financial data to support criminal investigatio ...

  • Carnegie Mellon University

    Data Engineer

    2 weeks ago


    Carnegie Mellon University Arlington, United States Full time

    What We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense c ...

  • Booz Allen Hamilton

    Data Engineer

    1 day ago


    Booz Allen Hamilton Arlington, United States

    Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal in ...

  • Booz Allen Hamilton

    Data Engineer

    3 weeks ago


    Booz Allen Hamilton Arlington, United States Full time

    Job Number: R0195194 · Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big dat ...

  • CNA

    Data Engineer

    2 weeks ago


    CNA Arlington, United States

    CNA fosters an inclusive culture that values diverse backgrounds and perspectives. Our flexible and engaging work environment encourages iterative and creative collaboration at every stage of the problem solving process. Our employees are committed to helping clients develop effe ...

  • iO Associates - US

    Data Engineer

    3 weeks ago


    iO Associates - US Arlington, United States

    A DMV based technology start-up is looking for an experienced Data engineer with 5+ experience to come in and work on their latest project. The firm has recently received Series B funding and are looking to grow out their team. · The main responsibilities of the position will be ...

  • GEICO

    Senior Data Engineer

    4 weeks ago


    GEICO Washington, United States Full time

    GEICO is seeking an experienced Senior Data Engineer with a passion for transforming existing technology to new Open Source technologies. You will help drive our insurance business transformation as we transition from a traditional IT model to a tech organization with engineerin ...

  • Serigor Inc

    ETL Data Engineer

    3 weeks ago


    Serigor Inc Washington, United States

    Job Title: ETL Data Engineer (ONSITE) · Location: Washington, DC · Duration:12 Months+ · Job Description: · The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to per ...

  • CAVA - Support Center

    Lead Data Engineer

    3 weeks ago


    CAVA - Support Center Washington, United States Full time

    Company Profile: · At CAVA we make it deliciously simple to eat well and feel good every · day. We are guided by a Mediterranean heritage that's been · perfecting how to eat and live for four thousand years. We prioritize · authenticity, curiosity and the pursuit of excellence in ...

  • Citian

    Senior Data Engineer

    3 weeks ago


    Citian Washington, United States

    Citian is seeking a passionate and self-motivated Senior Data Engineer with expertise in architecting and building data pipelines to join our dynamic team You will contribute to developing secure, scalable, and efficient data-driven solutions to tackle pressing needs in our trans ...

  • Booz Allen Hamilton

    Data Engineer, Lead

    4 days ago


    Booz Allen Hamilton Washington, United States Full time

    Data Engineer, Lead The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield p ...


  • National Endowment for Democracy Washington, United States Full time

    Position Summary: · The Data Integration Engineer contributes extensive expertise to deliver high-quality data integration jobs that enable data exchange among NED cloud systems and extract data from these systems and databases for analytics, visualization, and AI. The position ...

  • Booz Allen Hamilton

    Data Engineer, Lead

    2 days ago


    Booz Allen Hamilton Washington, United States

    Data Engineer, LeadThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivo ...

  • ECS

    Sr Data Engineer

    2 days ago


    ECS Washington, United States

    ECS is seeking a Sr Data Engineer (Top Secret Cleared) to work in our Washington, DC office. · Job Description: · ECS is seeking a TS-cleared Sr. Data Engineer to support one of our mission critical programs for the Department of Justice. We offer the chance to support the world' ...