Jobs
>
Columbus

    Senior Data Engineer - Columbus, United States - DevCare Solutions

    DevCare Solutions
    DevCare Solutions Columbus, United States

    5 days ago

    Default job background
    Description


    DevCare Solutions is looking for Senior Data Engineers to work in Westerville, OH and various unanticipated locations throughout the U.S.

    Requires a Master's degree or foreign equivalent in Computer Information Systems or related field and exp. in Hive, Python, Hadoop, Pig, HBase, Kafka, Spark, Jenkins and Java.

    Send resumes, REF to Job Duties:

    Design and develop an API for TSI Prioritization Program objects thru Python; Design and implemented a pipeline to GET/POST data from .Net applications using Python; Extract geometry/maps data from ARCGIS Pro and transformed the dataframe data using geopandas, pandas and numpy to get TSI Scores; Created, managed , and shared the geographic maps using ARCGIS Pro and analyzed the same using python objects; Design and implemented identifying the source and the target files responsible and dependencies for intersection scoring ad location refinement and targeted the outputs towards the topic; Work on processing Intersection scores, intersection segments, address points, intersection segment psi refined data using python objects; Validate the final TSI Scores generated data manually; Schedule all the python application using windows task scheduler in the production environment; Create an hive table when required to ingest the final TSI Scores data in the HDFS environment; Create and update TSI Prioritization Model technical documents on the applications developed and provided to the team; Work on GITHub to move the code from local to Stage and to Prod; Work on Jenkins to move the code from Stage to Prod; Monitor windows task scheduler jobs on the runs and fixed if there were any failures; Working in building scheduling applications and the multi node clusters from the scratch with Hadoop/System admins and architects.

    Use of Hive, Python, Hadoop, Apache, Spark, Jenkins and Java. Position may require travel.


    Minimum Requirements:

    Education:
    Master's degree or foreign equivalent in Computer Information Systems or related field


    Experience:
    6 months experience in the position offered or in a related position


    Special Requirements:

    Aforementioned 6 months of experience must include use of the following: Hive, Python, Hadoop, Apache, Spark, Jenkins and Java.

  • Stellar Enterprises

    Data Engineer

    1 week ago

    Stellar Enterprises Franklin, United States

    freenet offers a comprehensive portfolio of mobile, internet, and TV entertainment services. With over 520 own shops and online presence, every customer can find the perfect solution for their digital life. We provide personal, independent, and individual consultations nationwide ...

  • SilverLinx

    Working student: Data Science and Engineering

    2 weeks ago

    SilverLinx Franklin, KY, United States Freelance

    We are currently looking for a student worker in Data Science and Engineering (m/f/d) for 10-20 hours per week in Franklin, KY. · Your tasks · - You will implement, maintain and develop algorithms for data processing and modeling · - You will support the data science team in data ...

  • Revel IT

    Data Engineer

    6 hours ago

    Revel IT Columbus, United States

    Our Columbus, Ohio client is looking for a Data Engineer (Python focused) contractor to help support the IT organization's data strategy in support of business customers, as well as internal initiatives. If you are a "Data Person," who knows how to build data pipelines, aggregate ...

  • Revel IT

    Data Engineer

    1 week ago

    Revel IT Columbus, United States

    This is a contract-to-hire opportunity. · Preference is that candidates are local to Columbus or at least in the MidWest region. · Fully remote. · Our direct client is looking for a Data Engineer to help support the IT organization's data strategy in support of their business cus ...

  • FlightSafety International

    Data Engineer

    5 days ago

    FlightSafety International Columbus, United States

    Data Engineer needed by FlightSafety International Inc. in Columbus, OH (& various unanticipated locations throughout the US; may work from home) to partner with Business Stakeholders, Business Analysts, Data Engineers, and Developers to design enterprise data warehouse component ...

  • CapTech

    Data Engineer

    1 week ago

    CapTech Columbus, United States

    Company Description · CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founder ...

  • Revel IT

    Data Engineer

    2 weeks ago

    Revel IT Columbus, United States

    This is a contract-to-hire opportunity. · Preference is that candidates are local to Columbus or at least in the MidWest region. · Fully remote. · Our direct client is looking for a Data Engineer to help support the IT organizations data strategy in support of their business c ...

  • KEMBA Financial Credit Union

    Data Engineer

    5 days ago

    KEMBA Financial Credit Union Columbus, United States

    Title: Data Engineer · Reports to: Enterprise Data Architect · Supervises: None · Status: Exempt · Objective · The Data Engineer position will play a crucial role in building and maintaining the data infrastructure necessary for effective business intelligence and analytics. ...

  • Matrix Fitness

    Data Engineer

    2 weeks ago

    Matrix Fitness Columbus, United States

    This is a remote position. · Data Engineer (Entry Level) - Work from Home · Full-time · $65K - $75K per annum · 1+ Year Experience Required · Visit to learn more & apply with your resume and cover letter. · Introduction: · FitnessMatrixInc is an unique approach to health ...

  • Addison Group

    Data Engineer

    2 weeks ago

    Addison Group Franklin, United States

    Data Engineer - Franklin, TN · 6 month Contract-to-Hire · $70-100k/yr · Hybrid - 3 days onsite and 2 days remote · Required Tech/Experience · 3+ years of Data/BI experience · Healthcare Data experience · SQL development and Database experience · ETL development · Azure Cloud ex ...

  • Keylent Inc

    Data Engineer

    5 days ago

    Keylent Inc Columbus, United States

    Team Need Stron PySpark and AWS profiles. Request-ID:29643-1 · BFS · *THIS ROLE IS HYBRID IN COLUMBUS, OH. 3 DAYS ONSITE* · MAX BILL RATE: $65 · Job Title: Data Engineer · Experience: 6 to 8 Yrs. · Job Summary: Seeking a highly skilled Data Engineer with 6-8 years of experience ...

  • NetJets

    Data Engineer

    2 weeks ago

    NetJets Columbus, United States

    Purpose of Position · Under the direction of the Data Engineering Manager, The Data Engineer is responsible for the design, development, testing, and on-going management of the NetJets data pipeline processes. With limited guidance from senior team members, this role will utiliz ...

  • KEMBA Financial Credit Union

    Data Engineer

    6 days ago

    KEMBA Financial Credit Union Columbus, United States

    Job Description · Job DescriptionTitle: Data Engineer · Reports to: Enterprise Data Architect · Supervises: None · Status: Exempt · Objective · The Data Engineer position will play a crucial role in building and maintaining the data infrastructure necessary for effective business ...

  • MM International

    Data Engineer

    1 week ago

    MM International Columbus, United States

    Job Description · Job DescriptionData Engineer IN Columbus, OH (GC, USC, GCEAD), (can submit non-local) · Data pipeline work, sending data to data warehouse, etc Currently set up on Java/Spark (MUST HAVE Java/Spark) · Must have Teradata, DBMS knowledge · Must have good ETL knowle ...

  • Allied Mineral Products

    Data Engineer

    1 week ago

    Allied Mineral Products Columbus, United States

    **Data Engineer** · **Allied Mineral Products** is a leading manufacturer of monolithic refractories worldwide. We are seeking a **Data Engineer** in our Columbus, Ohio location. This Data Engineer will design and implement data engineering solutions to increase efficiency, lowe ...

  • Lambdanets Inc

    Data Engineer

    3 days ago

    Lambdanets Inc Columbus, United States Full time

    Detailed Job Description – Data Engineer Position Title: Data Engineer Location: Columbus, OH Job Description: Data application design and development, Installation and Configuration, Customization of application, functional testing of software applications, perform business anal ...

  • Revel IT

    Cloud Data Engineer

    1 week ago

    Revel IT Columbus, United States

    Our Columbus, Ohio client has a contract opportunity for a Cloud Data Engineer who will be responsible for developing, expanding, and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. · On-site 2-3 days/week in C ...

  • Emerald Resource Group

    Senior Data Engineer

    5 days ago

    Emerald Resource Group Columbus, United States

    Job Title: Senior Data Engineer · Location: Columbus, Ohio (United States) - Remote · Position Summary: · We are looking to add a Senior Data Engineer to join our pursuit of excellence, providing ownership of data analytics and reporting. This includes the creation of detailed ...

  • ComResource

    Data Center Engineer

    1 week ago

    ComResource Columbus, United States

    The Senior Data Center Engineer is tasked with efficiently managing data center hardware, software, and associated systems. Responsibilities include researching and implementing processes to enhance data center performance and reliability while ensuring adherence to organizationa ...

  • AA2IT

    Cloud Data Engineer

    1 week ago

    AA2IT Columbus, United States

    Job Description · Job Description · Job Summary · We are looking for an experience Cloud Data Engineer for an automotive manufacturing company in Columbus, OH. The ideal candidate will have at least 2 years of experience with ETL and Data Modeling on an AWS Cloud platform. The Cl ...