Jobs
>
Portland

    Sr. Data Engineer - Portland, United States - IT Vision Group

    Default job background
    Description

    Job Description

    Job Description

    Title : Sr. Data Engineer

    Location: Oregon

    Duration: 12 Months+

    Roles & Responsibilities

    • Perform data analysis according to business needs
    • Translate functional business requirements into high-level and low-level technical designs
    • Design and implement distributed data processing pipelines using Apache Spark, Apache Hive, Python, and other tools and languages prevalent in a modern analytics platform
    • Create and schedule workflows using Apache Airflow or similar job orchestration tooling
    • Build utilities, functions, and frameworks to better enable high-volume data processing
    • Define and build data acquisitions and consumption strategies
    • Build and incorporate automated unit tests, participate in integration testing efforts
    • Work with teams to resolve operational & performance issues
    • Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed.

    Tech Stack

    1. Apache Spark
    2. Apache Spark Streaming using Apache Kafka
    3. Apache Hive
    4. Apache Airflow
    5. Python
    6. AWS EMR and S3
    7. Snowflake
    8. SQL
    9. Other Tools & Technologies :: PyCharm, Jenkin, Github.
    10. Apache Nifi (Optional)
    11. Scala (Optional)

  • VanderHouwen

    Data Engineer

    3 weeks ago


    VanderHouwen Portland, United States

    JOB ID# 65072 · Data Engineer · As a Data Engineer, you will design, implement, and maintain data pipelines and infrastructure on the Azure cloud platform, utilizing Fabric technology. Your primary focus will be collecting, processing, and analyzing large datasets to support our ...

  • WebMD

    Data Engineer

    3 days ago


    WebMD Portland, United States

    Help guide the future of the WebMD Health Services data platform, including architecture design and implementation. Monitor and improve data services, including solving reliability and data quality problems across the data platform. Help establish an Data Engineer, Data Architect ...

  • WebMD

    Data Engineer

    2 hours ago


    WebMD Portland, United States

    · Position at WebMD · WebMD Health Services is part of the WebMD family. We have been designing well-being programs for employers and health plans for over 20 years. Our mission is to empower organizations and their populations to improve well-being through personalized, strate ...


  • Sulzer Portland, United States

    Services_AME-E516 · Engineering Data Coordinator - Full Time - Portland (OR), United States · Join our Services_AME team within Services division in United States as Engineering Data Coordinator to help us take our organization to the next level. · Your main tasks and responsibi ...


  • Horizon Dynamics River Bottom, United States

    Welcome to the team at BASF Schwarzheide GmbH · JOIN OUR TEAM · Are you looking for an employer who offers exciting challenges and long-term perspectives? At our production site in Schwarzheide, 2000 colleagues work together to ensure that everything runs smoothly. We focus on in ...


  • MercuryTechnologies Portland, United States

    In the 1840s, Charles Babbage and Ada Lovelace worked on an early version of the computer known as the "Analytics Engine". In the words of computing historian Doron Swade, "What Lovelace that numbers could represent entities other than quantity" and together they laid the founda ...

  • Powin Corporation

    Data Engineer, Sr

    3 weeks ago


    Powin Corporation Portland, United States

    We're Building the Future Ever want to do hard work that will make a REAL difference in the world? Do you want to solve some of the most difficult problems with a team of exceptional players at a company that does not believe in impossible? · About Powin: · Powin Energy is a l ...


  • Malarkey Roofing Products Portland, United States

    Everyone Belongs at Malarkey · Malarkey takes pride in selecting our most important asset, our employees. Become a part of our mission to manufacture and deliver innovative, performance-driven building products with service and integrity that is unparalleled. · The · Data Solu ...


  • SkyPoint Cloud Inc. Portland, United States

    **Data Warehouse Engineer** · Portland, OR or Remote (US Only) / Engineering Data Engineer / Full-time Data is messy. It is pervasive, sensitive, and highly valuable when utilized at its maximum potential. For businesses across every industry, the explosion of customer data repr ...


  • Astreya Partners, LLC Portland, United States Full time

    What this Job Entails: · The Data Center Engineer III will be heavily involved in the design of the datacenter collocations, infrastructure hardware, and provide technical consultations. The incumbent will build/create all drawings for datacenter POP's and develop/write Scopes ...

  • Remotely

    Junior Data Engineer

    2 weeks ago


    Remotely Portland, United States

    This is a remote position. · Junior Data Engineer (1 year experience, remote) · Be part of our future This job posting builds our talent pool for potential future openings. We'll compare your skills and experience against both current and future needs. If there's a match, we'll ...

  • Siri InfoSolutions Inc

    Lead Data Engineer

    2 weeks ago


    Siri InfoSolutions Inc Portland, United States

    Job Description · Job DescriptionLead Data Engineer · Portland, OR (day 1 Onsite) · Exp Min 10+ Years · Job Description · Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc. · Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark · Experience in w ...

  • CBTS

    Data Engineer

    3 weeks ago


    CBTS Portland, United States

    CBTS is currently seeking a Data Engineer for a position located in Portland, OR. · Responsibilities: · Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications. · Accurately estimat ...

  • ITC Infotech

    Data Engineer

    2 weeks ago


    ITC Infotech Portland, United States

    ITC Infotech is looking for a Data Engineer to join our Team in United States . · Location: Portland, OR. The candidate needs to be at office premises 2-3 days in a week. · What you'll do: · You will be responsible for overseeing database design, performance optimization and th ...

  • CBTS

    Data Engineer

    2 weeks ago


    CBTS Portland, United States

    CBTS is currently seeking a Data Engineer for a position located in Portland, OR. · Find out if this opportunity is a good fit by reading all of the information that follows below. · Responsibilities: · Collaborate with fellow data engineering and cross-functional data teams t ...

  • NerdPine

    Data Engineer

    3 weeks ago


    NerdPine Portland, United States

    Job Description · Job DescriptionNerdPine, a leading marketing and advertising company, is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuri ...

  • ITC Infotech

    Data Engineer

    2 weeks ago


    ITC Infotech Portland, United States

    ITC Infotech is looking for a · Data Engineer · to join · our Team in United States . · Location: · Portland, OR. The candidate needs to be at office premises 2-3 days in a week. · What you'll do: · You will be responsible for overseeing database design, performance optimiz ...

  • ITC Infotech

    Data Engineer

    2 weeks ago


    ITC Infotech Portland, United States

    ITC Infotech is looking for a Data Engineer to join our Team in United States . · Location: Portland, OR. The candidate needs to be at office premises 2-3 days in a week. · What youll do: · You will be responsible for overseeing database design, performance optimization and t ...

  • Marcus & Millichap

    Data Engineer

    1 week ago


    Marcus & Millichap Portland, United States

    This position will support Data and Analytics by working with technology and key business stakeholders to move and calculate data for numerous analytic tools. · Essential Functions: · Collaborate with cross-functional teams, such as data analysts, software engineers, and busine ...

  • CareOregon

    IS Data Engineer

    1 week ago


    CareOregon Portland, United States

    Candidates hired for remote positions must reside in Oregon, Washington, Utah, Idaho, Arizona, Nevada, Texas, Montana, or Wisconsin. · Position Title: IS Data Engineer · Exemption Status: Exempt · Department: Business Intelligence · Title of Manager: IS Development Manager · ...