Jobs
>
Columbus

    Senior Data Engineer - Columbus, United States - g2o

    g2o
    g2o Columbus, United States

    2 days ago

    Default job background
    Full time
    Description

    Your future starts here

    Imagine being part of a team that helps clients build better relationships with customers. When you join us, you'll help top-notch clients to execute the digital strategies of the future. Every day, we collaborate with clients and each other to provide technology expertise, human-centered design and industry experience to deliver real business results.

    Position description

  • Work collaboratively with technical team members to develop, deploy and production support data engineering jobs and pipelines - spark structured stream processing jobs across one or more streams, persisted to a data lake.
  • Work with leads and architects to prototype designs and technologies.
  • Design and develop data engineering jobs with an eye on quality attributes (and trade-offs) such as simplicity, reliability, scalability, extensibility, performance. Build or reuse common frameworks where possible.
  • Set and adhere to coding and style guides to ensure consistency. Ensure code quality through mechanisms including code coverage, peer reviews, pair programming.
  • Create and deploy streaming data quality checks with remediation runbooks. Adhere to data governance and compliance requirements and standards.
  • Provide recommendations for and help curate technical backlogs for technical debt management and continuous improvement.

    • Required qualifications

  • 5+ years of total experience working with data and data pipeline technologies at scale.
  • 3+ years of solid Python development experience – including: Robust unit and integration testing and Git driven CI/CD to production
  • 2+ years of proven experience developing streaming data processing tasks using pySpark and SparkSQL
  • Solid understanding of Spark, preferably Databricks Spark and Apache Delta
  • Read streaming data from Kafka, Apache Delta or similar, merge /enrich /qualify data inline, capture operations metrics, persist to target, debug and optimize
  • At scale and in production
  • Experience leveraging public cloud data and analytics services. Azure preferred, but AWS/GCP also works.
  • Nice to have: Super user experience with reporting tools such a PowerBI.

    • Required education and experience

  • College/University Degree or equivalent.
  • The Ohio State University

    Data Engineer

    2 weeks ago

    The Ohio State University Columbus, United States Full time

    Current Employees and Students · : If you are currently employed or enrolled as a student at The Ohio State University, please log in to Workday to use the internal application process. · Welcome to The Ohio State University's career site. We invite you to apply to positions ...

  • InsideHigherEd

    Data Engineer

    2 weeks ago

    InsideHigherEd Columbus, United States

    Screen reader users may encounter difficulty with this site. For assistance with applying, please contact hr- If you have questions while submitting an application, please review these frequently asked questions. · Current Employees and Students:If you are currently employed or e ...

  • JMT

    Data Engineer

    1 week ago

    JMT Columbus, United States Full time/Regular

    Technology Group/GIS · Columbus, OH · • ID: 21031 · • Full-Time/Regular · JMT is an award winning, employee-owned firm, focused on providing infrastructure services to better our clients, communities, environment, and employee owners. Our diverse workforce revolves around a cu ...

  • KEMBA Financial Credit Union

    Data Engineer

    1 week ago

    KEMBA Financial Credit Union Columbus, United States

    Title: Data Engineer · Reports to: Enterprise Data Architect · Supervises: None · Status: Exempt · Objective · The Data Engineer position will play a crucial role in building and maintaining the data infrastructure necessary for effective business intelligence and analytics. ...

  • VeeRteq Solutions Inc.

    Data Engineer

    6 days ago

    VeeRteq Solutions Inc. Columbus, United States

    Job Description · Job DescriptionData Engineer · Columbus OH · hybrid · Must have · teradata, DBMS knowledge · - Cloud knowledge - AWS preferably- ETL knowledge- CICD and data warehouse concept- Java & SparkNice To Have- Abinitio- postgres DB knowledge- python Job responsibiliti ...

  • KEMBA Financial Credit Union

    Data Engineer

    1 week ago

    KEMBA Financial Credit Union Columbus, United States

    Job Description · Job DescriptionTitle: Data Engineer · Reports to: Enterprise Data Architect · Supervises: None · Status: Exempt · Objective · The Data Engineer position will play a crucial role in building and maintaining the data infrastructure necessary for effective business ...

  • AllSTEM Connections

    Data Engineering

    1 week ago

    AllSTEM Connections Columbus, United States

    Job Description · Job DescriptionAllSTEM Connections is looking for a Data Engineer/ Database located in Columbus OH, · Job Title: Data Engineer/ Database · Work Permit: Applicants must be legally authorized to work in the U.S. without sponsorship. The Company is unable to spons ...

  • Kimball Midwest

    Data Engineer

    1 day ago

    Kimball Midwest Columbus, United States

    Job Description · Job DescriptionKimball Midwest, a national distributor of maintenance, repair, and operation products, is searching for a Data Engineer to join our IT team. · As a Kimball Midwest associate, you will experience why we have been recognized as one of the Top Workp ...

  • Infinity Consulting Solutions

    Data Engineer

    2 weeks ago

    Infinity Consulting Solutions Columbus, United States

    We have partnered with our client in their search for a Data Engineer in Columbus, OH · Responsibilities · 4 to 7 years of Spark on Cloud development experience · •4 to 7 years of strong SQL skills; Teradata is preference but experience in any other RDBMS · •Proven experience in ...

  • Kimball Midwest

    Data Engineer

    2 days ago

    Kimball Midwest Columbus, United States

    Kimball Midwest, a national distributor of maintenance, repair, and operation products, is searching for a Data Engineer to join our IT team. · As a Kimball Midwest associate, you will experience why we have been recognized as one of the Top Workplaces in Columbus TWELVE years i ...

  • SoftPathTechnologies

    Data Engineer

    2 weeks ago

    SoftPathTechnologies Columbus, United States

    Job Description · Job DescriptionData Engineer (Java/Spark/AWS/ETL)Position ResponsibilitiesData Engineer (Java/Spark/AWS/ETL) · Work Location: Columbus, OH ( need local to OH) Hybrid (3 days onsite 2 days Remote) · Experience: looking for a junior profile Minimum 2+ years Requir ...

  • Matlen Silver

    Data Engineers

    1 day ago

    Matlen Silver Franklin, United States Full time

    Description · Job Title: Data Engineer · Duration: 12-18 months · Location: Charlotte NC, or Jersey City NJ · Required Pay Scale: 70 · ***Due to client requirements this role is only open to USC or GC candidates*** · Job Summary: · Project Details: · These roles will be p ...

  • Ringside Talent

    Data Warehouse Engineer

    6 days ago

    Ringside Talent Columbus, United States

    Our client located in Columbus is seeking a Data Warehouse Engineer. The ideal candidate aligns with the responsibilities and qualifications outlined below. · Responsibilities: · Design, develop, and maintain data warehouse architecture to meet business requirements. · Implement ...

  • VBeyond Corporation

    Lead Data Engineer

    3 days ago

    VBeyond Corporation Columbus, United States

    Hope you are doing Great . · I am Harinath from VBeyond Corporation. · I came across your profile and would like to discuss about the below role. · Title: Lead Azure Data Engineer · Location: Columbus, OH. (Hybrid) · Duration: 6+ Months. · Candidate should have experience in Cla ...

  • Avance Consulting

    Data Modeler/Data Engineer

    3 weeks ago

    Avance Consulting Franklin, United States

    Job Description · Job DescriptionData Architecture Design: Develop and maintain data models that organize and structure data for efficient storage, retrieval, and analysis, ensuring scalability and performance. · ETL Development: Design and implement Extract, Transform, Load (ETL ...

  • AA2IT

    Cloud Data Engineer

    2 weeks ago

    AA2IT Columbus, United States

    Pay Rate: $65-$75/HR on W2 · Job Summary · We are looking for an experience Cloud Data Engineer for an automotive manufacturing company in Columbus, OH. The ideal candidate will have at least 2 years of experience with ETL and Data Modeling on an AWS Cloud platform. The Cloud Dat ...

  • TEKsystems

    Big Data Engineer

    1 week ago

    TEKsystems Columbus, United States

    Job Description · Job Description · TEKsystems just received a new position supporting a huge initiative for a Major Technology Company on their Enterprise applications, headquartered in Columbus, OH. · Our Client is seeking Big Data Engineers to come in and support multiple diff ...

  • Resource Informatics Group

    Senior Data Engineer

    2 weeks ago

    Resource Informatics Group Columbus, United States

    The client is looking for a solid Senior Data Engineer with strong zure Data Factory (ADF) , zure Data Lake (ADLS), Azure Databricks, SQL Server, Data Warehouse and REST API call and SFTP. Please let me know if you have anyone else that has at least the 10 years of required exper ...

  • CoverMyMeds

    Director Data Engineering

    1 week ago

    CoverMyMeds Columbus, United States

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...

  • Seamless

    Principal Data Engineer

    2 weeks ago

    Seamless Columbus, United States

    Job Description · Job DescriptionThe Opportunity:At Seamless.AI, we're seeking a highly skilled and experienced Principal Data Engineer with expertise in Python, Spark, AWS Glue, and other ETL (Extract, Transform, Load) technologies. The ideal candidate will have a proven track r ...