Jobs
>
Fort Worth

    Data Engineer - Fort Worth, United States - Motion Recruitment

    Motion Recruitment background
    Description

    Responsibilities:

    About the role:

    ABS Data Engineer II, Finance is a critical technical role within the North America Securitization and Conduit Reporting team. This position will be helping ABS reporting team in building and maintaining reliable and scalable data pipelines. This position will leverage your expertise in Python, SQL, and Azure cloud technologies to extract, transform, and load data efficiently, enabling seamless data access and analysis for accounting business users. This position involves a high level of coordination with other departments and third-party software vendors.

    JOB DUTIES


    • Code, test, deploy, Orchestrate, monitor, document and implement data pipelines utilizing the Microsoft azure data bricks platform


    • Utilize technologies like Spark, Delta Lake and Unity Catalog for Efficient data processing and governance


    • Implement the Medallion architecture pattern for robust and modular data pipelines


    • Implement CI/CD pipelines for automated testing and deployment of data pipelines using azure devops.


    • Configure and manage Azure Data Lake Storage for secure and scalable data storage.


    • Collaborate and work closely with ABS data analysts, accounting business partners to identify, capture, collect and format data from the external sources, Internal systems and data warehouse to extract features of interest


    • Monitor and optimize data pipelines for performance and reliability


    • Stay up-to-date with the latest advancements in Databricks, Azure, and big data technologies


    • Educate and Develop ETL developers on data engineering cloud based initiatives so as to enable transition to data engineer and practice


    • Monitor the production reporting environment on daily and monthly basis Data Analytics to analyze data and make business decisions on the data

    Qualifications:

    What makes you a dream candidate?


    • Experience with Databricks platform on Microsoft Azure


    • Experience with processing large datasets using Hadoop, Spark, Kafka or similar distributed systems


    • Experience with PySpark and distributed data processing frameworks


    • Understanding of cloud computing technologies, business drivers and emerging computing trends


    • Experience with ingesting various source data formats such as JASON, Parquet, Sequencefile, Cloud databases, MQ, Relational databases such as Oracle


    • Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, ADLS etc.


    • Working knowledge of unity catalog and data governance principles


    • Working knowledge of Agile development /SAFe, Scrum and Application Lifecycle Management


    • Strong background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/ Continuous Deployment (Azure DevOps)


    • Experience with Python and SQL


    • Creating and maintaining ETL processes and data pipelines


    • Knowledgeable of best practices in information technology governance and privacy compliance


    • Knowledge on auto finance industries core business functions


    • Ability to establish priorities and meet tight deadlines.


    • Ability to interact collaboratively with internal customers


    • Demonstrated quantitative skills and data analytical skills


    • Solid design, coding, testing and debugging skills

    Experience and Education


    • 4-6 years of hands-on experience with data engineering required


    • 3-5 years of hands-on experience with processing large data sets required


    • 3-5 years of hands-on experience with SQL, data modeling, relational databases and/or no SQL databases required


    • Bachelor's Degree in related field or equivalent work experience required


  • Motion Recruitment

    Data Engineer

    6 days ago


    Motion Recruitment Fort Worth, United States

    3-4+ years of Data Engineering experience. · Strong Azure and Databricks · Strong SQL Skills. · Resume Keywords: Azure, Spark, Delta Lake, CI/CD, ABS, Databricks, PySpark · Required Skills & Experience · • Experience with Databricks platform on Microsoft Azure · • Advanced SQL Sk ...

  • System Soft Technologies

    Data Engineer

    1 week ago


    System Soft Technologies Fort Worth, United States

    System Soft Technologies is helping their client hire a Data Engineer for their Fort Worth, TX office. This is a direct hire role with a strong preference for individuals to work fully onsite, but hybrid schedules will be considered. · **NOTE: The client does not offer visa spons ...

  • System Soft Technologies

    Data Engineer

    2 weeks ago


    System Soft Technologies Fort Worth, United States

    System Soft Technologies is helping their client hire a Data Engineer for their Fort Worth, TX office. This is a direct hire role with a strong preference for individuals to work fully onsite, but hybrid schedules will be considered. · Please double check you have the right leve ...

  • Motion Recruitment

    Data Engineer

    2 weeks ago


    Motion Recruitment Fort Worth, United States

    Data Engineer · Fort Worth Texas (HYBRID) · Contract to perm role · Job Description · JOB DUTIES · • Code, test, deploy, Orchestrate, monitor, document and implement data pipelines utilizing the Microsoft azure data bricks platform · • Utilize technologies like Spark, Delta Lake ...

  • Vantage Bank

    Data Engineer

    1 week ago


    Vantage Bank Fort Worth, United States

    JOB CLASSIFICATION · Full / Part-time: Full-time · Hours Per Week: 40 · Location: 3131 West 7th Street Suite 200, Fort Worth TX 76107 · The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining ...

  • Koddi

    Data Engineer

    2 weeks ago


    Koddi Fort Worth, United States

    If you are passionate about big data and data lakehouse concepts, want to be part of a great team, and love solving complex problems, we want to speak with you. As a Data Engineer, you will work with our technology team to build and maintain our suite of data pipelines, stores, a ...

  • Brushfire

    Data Engineer

    1 week ago


    Brushfire Fort Worth, United States

    Job Description · Job DescriptionCompany Description · At Brushfire, it's our goal to be the go-to ticketing and registration platform our customers deserve. We're an event management software-as-a-service platform that provides solutions for ticketing & registration, virtual eve ...

  • Motion Recruitment

    Data Engineer

    3 weeks ago


    Motion Recruitment Fort Worth, United States CONTRACT

    Fort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity. · Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term ...

  • System Soft Technologies

    Sr. Data Engineer

    5 days ago


    System Soft Technologies Fort Worth, United States

    Over five years of Data Engineering experience · Demonstrated experience with data and software engineering best practices and implementing data and software development lifecycles. · Demonstrated experience with designing and implementing data models (conceptual, logical, physic ...

  • Mindlance

    Azure Data Engineer

    1 week ago


    Mindlance Fort Worth, United States

    Data Governance and Privacy: Informatica Axon and EDC, BigID, Anomalo or Montecarlo or other Data Quality tools · 5+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engi ...

  • Odyssey Information Services

    Sr. Data Engineer

    6 days ago


    Odyssey Information Services Fort Worth, United States

    DataOdyssey is working with a Texas-based hospital system to find a Sr. Date Engineer. *This is a hybrid role and will require one day a week onsite in Fort Worth.* · *Candidates need to have prior experience working with data in a hospital setting. Epic certification/experience ...


  • ScaleneWorks People Solutions LLP Fort Worth, United States

    Job role : Data Governance Engineer · Location : Fort Worth, TX · Job Type: Contract · Description: · Work closely with source data application teams and product owners to design, implement and support analytics and data governance solutions that provide insights to make better d ...


  • INSPYR Solutions Fort Worth, United States

    Role: Data Governance Engineer · Job Type: Contract · Expectation: Hybrid · What you'll doAdminister and Support one or more Data Governance platforms for Marketplace, Stewardship, Catalog, Quality and Literacy · Supporting the research, review, recommendation, purchase, install ...


  • VSG Business Solutions LLC Fort Worth, United States

    Job Description · Job DescriptionIMPORTANT INFORMATION: This position will be hybrid onsite 60% in Dallas. . There will be 1 virtual and 1 onsite interview *mandatory*. Glider is required. · Key projects: Data Marketplace roll out Data Catalogue and Quality tool roll out Data Go ...


  • Mindlance Fort Worth, United States

    Work closely with source data application teams and product owners to design, implement and support analytics and data governance solutions that provide insights to make better decisions · • Administer and Support one or more Data Governance platforms for Marketplace, Stewardshi ...

  • Aditi Consulting

    Senior Data Engineer

    2 weeks ago


    Aditi Consulting Fort Worth, United States

    Collaborative team environment · Wants to be on the cutting edge, working with cutting edge technologies, open to new ideas and strategies · Team access and collaboration · The reason for hiring is they have expanded and restructured- taken the old BI team and moved into Data Eng ...


  • ScaleneWorks People Solutions LLP Fort Worth, United States

    Job role : Data Governance Engineer · Location : Fort Worth, TX · Job Type: Contract · Apply promptly A high volume of applicants is expected for the role as detailed below, do not wait to send your CV. · Description: · Work closely with source data application teams and pro ...

  • Epsilon

    Senior Data Engineer

    2 weeks ago


    Epsilon Hurst, United States

    Is this your location? If not, update now for the most accurate results · front runner · Manager: in Software Team (d/f/m) · Danaher · Bodman-Ludwigshafen, Baden-Württemberg 78351 · posted 04/27/2024 · More... · front runner · Ausbildung zum Hörakustiker (m/w/d) · GEERS · ...


  • Pyramid Consulting, Inc Fort Worth, United States

    Immediate need for a talented Azure Data Governance Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Fort Worth, TX (Onsite). Please review the job description below and contact me ASAP if you are interested. · Job ID: · Pay Range: $ ...


  • Venusgeo Fort Worth, United States

    · • Minimum Qualifications- Education & Prior Job Experience · • Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training · • 3 years software solution ...