Jobs

    Data Engineer - Washington, United States - AHU Technologies Inc

    AHU Technologies Inc
    AHU Technologies Inc Washington, United States

    3 weeks ago

    Default job background
    Description

    Job Description


    Job Description

    Short Description : The Enterprise Data team at Client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.

    **Complete Description:

    **

    The ETL data engineer will support the Client Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:

    Responsibilities:

    1. Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.

    2. Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District's data systems.

    3. Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.

    4. Establishing the cloud and on-premises connectivity in different systems like ADLS, ADF, Synapse, Databricks

    5. Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.

    6. Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.

    7. Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)

    8. Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, QuickBase), text formats (CSV, XML) and Binary (Parquet, AVRO)

    9. Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.

    10. Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.

    11. Automates, monitors, alerts, and manages data pipelines and workflows.

    12. Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.

    13. Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.

    14. Develops complex programs and reports in database query language.

    15. Familiarity/experience with data visualization tools.

    16. Familiarity/experience handling and securing sensitive data based on the level of the sensitivity

    **CONTRACT JOB DESCRIPTION

    **

    **Responsibilities:

    **

    1. Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.

    2. Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.

    3. May require coordination of programming activities being conducted by the application development team

    4. Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.

    5. Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.

    6. Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.

    7. May coordinate activities of application developers.11-

    8. Able to identify best practices and standards for the use of the product.

    9. Proven track record of hands-on technical design and code work within large complex systems.

    10. Proven hands-on technical work with a variety of technologies.

    11. Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.

    12. Delivers support and design for industry specific applications that require integration with statewide systems or applications.

    13. Interacts with executive level business users or technical experts.

    14. Advanced experience in the required technical subject matter.

    15. May function as a niche technical SME (Subject Matter Expert).

    16. Has proven experience across large and complex implementations and systems.

  • A3 Consulting LLC

    Data Engineer

    4 weeks ago

    A3 Consulting LLC Washington, United States

    Data Engineer · A qualified candidate is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The candidate will have extensive experience supporting software developers, datab ...

  • The Job Network

    Data Engineer

    3 weeks ago

    The Job Network Washington, United States

    Piper Companies is looking for a Data Engineer to join an elite environmental industrial engineering firm in Washington, DC, to cluster large datasets across various container and data platforms. · Responsibilities of the Data Engineer include: · Achieve and maintain proficienc ...

  • Amida Technology Solutions

    Data Engineer

    3 weeks ago

    Amida Technology Solutions Washington, United States

    Amida Technology Solutions is a DC-based software services company focused on the most difficult problems in data interoperability, exchange, governance, and security. We design, develop, and deploy software solutions that collect, reconcile, and transform data for business intel ...

  • Leyden Solutions Inc

    Data Engineer

    2 weeks ago

    Leyden Solutions Inc Washington, United States

    Benefits: · 401(k) · 401(k) matching · Bonus based on performance · Competitive salary · Dental insurance · Vision insurance · Paid time off · Parental leave · Profit sharing · Signing bonus · Stock options plan · Leyden Solutions has an immediate opening for a skilled Data Engin ...

  • Mechanicode

    Data Engineer

    3 weeks ago

    Mechanicode Washington, United States

    We are looking for a Data Warehouse Engineer who has experience in data warehousing, data modeling, and database administration of highly scalable data management systems. · Possesses a proven track record of successfully managing large datasets and delivering scalable data ware ...

  • DCI Solutions

    Data Engineer

    3 weeks ago

    DCI Solutions Washington, United States

    DCI Job Requirement for: · *Data Engineer* · Location: Washington, D.C. · *Job Description:* · Serves as a Software Production and Data Engineer · Build, operate, and maintain high-performance services for platforms, and products · Write code to build and maintain enterpris ...

  • The American College of Obstetricians and Gynecologists

    Data Engineer

    2 weeks ago

    The American College of Obstetricians and Gynecologists Washington, United States

    Overview · We are seeking a highly skilled and motivated Data Engineer to join our dynamic team to contribute technical expertise in transforming raw data into meaningful insights, fostering data-driven decision-making within an innovative and collaborative environment. The idea ...

  • Leyden Solutions Inc

    Data Engineer

    4 weeks ago

    Leyden Solutions Inc Washington, United States

    Benefits: · 401(k) · 401(k) matching · Bonus based on performance · Competitive salary · Dental insurance · Vision insurance · Paid time off · Parental leave · Profit sharing · Signing bonus · Stock options plan · Leyden Solutions has an immediate opening for a skilled Data Eng ...

  • CompQsoft

    Data Engineer

    4 weeks ago

    CompQsoft Washington, United States

    Position: Data Engineer · Location: Washington, DC · Clearance: Active Secret Clearance · Duration: Full Time · Client: CompQsoft/Federal · Certification: Any IAT III certification · Job Description: · Data Engineering. This activity provides data engineering support acros ...

  • Shatterproof

    Data Engineer

    3 weeks ago

    Shatterproof Washington, United States

    Data Engineer · DEPARTMENTDIRECT REPORT(S) IT n/a TRAVEL REQUIREDLOCATION n/a Hybrid – DC Area TERMSALARY Full-Time, Permanent $85,000 – 100,000 · ABOUT SHATTERPROOF · Shatterproof was founded in 2013 to fill the gap for a well-funded, national, coordinated effort to reverse the ...

  • BRMi

    IT Data Engineer

    2 weeks ago

    BRMi Washington, United States

    Overview · BRMi is seeking a IT Data Engineer (ETL) To design, develop, implement and maintain new IT solutions, or changes/enhancements to existing solutions that align with business initiatives and corporate strategies. · Can be 100% remote in TX, NJ, NC, WV, AL, VA, MD, MO, DC ...

  • Blu Omega

    Data Engineer

    2 weeks ago

    Blu Omega Washington, United States

    We are looking for a Data Engineer to interpret business needs and select appropriate technologies and have experience in implementing data governance of shared and/or master sets of data. · Responsibilities: · Define and communicate a clear product vision for our client's soft ...

  • Esolvit

    Data Engineer

    3 weeks ago

    Esolvit Washington, United States

    Title: Data Engineer (LOCAL) · Location: Washington, DC · Duration: Long Term · You may either create a user id and sign up under the arytic link or go in without signing up to access the job/open roles on our Arytic platform. · Job Description: · The Data Engineer provides t ...

  • OnDek Solutions

    Data Engineer

    2 weeks ago

    OnDek Solutions Washington, United States

    Job Description · As a Data Engineer, this role focuses specifically on the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. The ideal candidate for this position will be able to apply advanced consulting skills, ext ...

  • IBM

    Data Engineer

    3 weeks ago

    IBM Washington, United States

    Introduction · A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. · You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable compan ...

  • IBM

    Data Engineer

    2 weeks ago

    IBM Washington, United States

    Introduction · A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. · You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companie ...

  • AHU Technologies Inc

    Data Engineer

    3 weeks ago

    AHU Technologies Inc Washington, United States

    Job Description · Job Description · Short Description · : The Enterprise Data team at Client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation t ...

  • Association of American Medical Colleges

    Data Engineer

    4 weeks ago

    Association of American Medical Colleges Washington, United States

    Who We Are · The Association of American Medical Colleges is a not-for-profit association · Benefits · dedicated to transforming health care by supporting the entire spectrum of medical education, medical research, patient care, and community collaborations conducted by our me ...

  • Citian

    Senior Data Engineer

    2 weeks ago

    Citian Washington, United States

    Citian is seeking a passionate and self-motivated Senior Data Engineer with expertise in architecting and building data pipelines to join our dynamic team You will contribute to developing secure, scalable, and efficient data-driven solutions to tackle pressing needs in our trans ...

  • Circle

    Senior Data Engineer, Financial Data

    2 weeks ago

    Circle Washington, United States

    Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data - globally, nearly instantly and less expensively than legacy settlement systems. This ground-breaking new internet layer opens up p ...