Senior Data Engineer - Virginia, United States - Smart Synergies

    Smart Synergies
    Smart Synergies Virginia, United States

    3 weeks ago

    Default job background
    Description

    JOB DESCRIPTION
    The Data Engineer will manipulate data and data flows for both existing and new systems.

    Additionally, they will provide support in the areas of data extraction, transformation and load (ETL), data mapping, analytics, operations, databases, and maintenance of data and associated systems.

    As a member of the team, candidate will work in a multi-tasking, quick-paced, dynamic, process-improvement environment that requires experience with the principles of large-scale (terabytes) database development, large-scale file manipulation, data modeling, data mapping, data testing, data quality, and documentation preparation.


    KEY RESPONSIBILITIES
    Provide support in the areas of data extraction, transformation and load (ETL), data mapping, analytics, operations, databases, and maintenance of data and associated systems
    Develop and manage complex data flows, or makes significant enhancements to existing pipelines
    Troubleshoot complex problems and provide customer support for the ETL process
    Resolve complex hardware/software compatibility and interface design considerations
    Conduct investigations and tests of considerable complexity
    Research emerging technologies to determine impact on application execution
    Communicate clearly and effectively with teammates, customers, and external partners
    Prepare written and verbal communications on analyses, findings, and project progress
    Write and maintain technical documentation
    Advise hardware engineers on machine characteristics that affect software systems, such as storage capacity, processing speed, and input/output requirements
    Provide guidance and work leadership to less-experienced engineers
    May serve as a technical team or task leader


    EDUCATION AND EXPERIENCE
    Bachelor's degree in a related business or technical discipline, or the equivalent combination of education, technical training, or work/military experience


    REQUIRED QUALIFICATIONS
    3+ years of related software engineering and ETL experience
    Demonstrated experience building and maintaining data flows in NiFi or Pentaho or Java
    Excellent organizational, coordination, interpersonal and team building skills


    DESIRED QUALIFCATIONS
    Demonstrated experience with the following languages: Java/J2EE, C, C++, SQL, XML, XQuery, XPath, HTML/XHTML, CSS, Python, Shell Scripting, JSON, JavaScript
    Demonstrated experience translating data insights into tools or analytic capabilities that inform operational decisions and/or improve processes
    Demonstrated experience with relational databases (ex - Oracle / MySql)
    Demonstrated experience with GPU processing
    Demonstrated experience with search architecture and data visualization tools (ex -ElasticSearch, OmniSci)
    Demonstrated experience applying machine learning methodologies to build high-quality prediction models
    Familiar with servers operating systems; Windows, Linux, Distributed Computing, Blade Centers, and cloud infrastructure
    Familiar with database methodologies
    Familiar with Source code management and integration (ex - GitHub/GitLab, Jenkins, RunDeck)
    Familiar with Data Science frameworks such as Keras, Tensorflow, or Theano
    Ability to work well in a fast-paced, constantly evolving work environment with a focus on continual process improvement and a proactive approach to problem solving
    Active FS Poly

    #J-18808-Ljbffr