Big Data Engineer/ AWS Data Engineer - Dallas - Appex Innovation

    Appex Innovation
    Appex Innovation Dallas

    1 week ago

    Description
    Job Description

    Job Details:
    Sr Software Engineer
    Preferably in Dallas, TX, or Atlanta, GA, but open to any US location.

    Job Description:


    The Software Engineer is responsible for the design and development of software applications and reusable software components for the Payment BU, in compliance with predefined coding standards and technical design.

    Closely working with other architects and senior engineers, this individual will help assess existing applications, produce detailed designs for hadoop components, and drive the implementation of scalable, secure, and reusable solutions on Hadoop and AWS.


    Responsibilities:
    Design and develop high quality, maintainable software modules for Payment BU product.

    Conduct unit and integration testing using appropriate methodology and techniques Evaluate and integrate complementary technologies, where appropriate (Eg Aws cloud technologies such as step function, EMR and Glue) Review software engineering approach to proposed solutions to ensure adherence to best practice Provide technical mentorship, conduct code/design reviews, and promote a culture of engineering excellence.

    Complete all responsibilities as outlined on annual Performance Plan Complete all special projects and other duties as assigned. Must be able to perform duties with or without reasonable accommodation.

    Qualifications:
    Bachelor's Degree in Computer Science, Information Technology, Information Systems, or related field.

    • 10 years of experience with enterprise and application design patterns such as GoF
    • 10 years of experience with data pipeline design patterns for batch processing, stream, lambda, data mesh and lakehouse
    5 years of proficiency with Scala spark and a scripting language such as Python, PySpark and Linux shell scripting Working knowledge of RDBMS such as SQL Server, MySQL, Oracle with SQL programming skills

    • 5 years' experience with software engineering best practices such as continuous integration, unit testing, refactoring, and code reviews Strong understanding of agile development practices, preferably SAFe
    • Ability to deliver in a dynamic, fast paced environment within estimated timelines Strong analytical, organizational, and interpersonal skills
    • Good written and verbal communication skills
    Additional skills Demonstrated proficiency in developing programs using Scala.

    Hands-on experience with Hadoop ecosystem components such as Hive, YARN, Sqoop, Oozie and Groovy 4-5 years of experience with platform engineering tools such as Bitbucket, Gradle, Octopus, Artifactory.

    4-5 years of experience with building complex components using Spark SQL, MySql, HiveQL. 2-3 year of experience with AWS cloud technologies complementing Hadoop stack including hands-on development experience with S3, Lambda functions, Api gateway, EMR Working knowledge of AWS components such as IAM, KMS, Glue, Athena

  • Data Engineer

    2 weeks ago

    Only for registered members Dallas, TX

    This is a full-time hybrid role for a Data Engineer based in Dallas, TX, with flexibility for some work-from-home arrangements. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    We are seeking an experienced Data Engineer to design and maintain scalable data pipelines in Databricks. · Build and optimize pipelines in Databricks (PySpark, SQL, Delta Lake). · Ingest data from databases, APIs, PDFs, Excel, flat files, · Implement data quality checks validati ...

  • Data Engineer

    1 week ago

    Only for registered members Dallas, TX Remote job

    We are seeking a Data Engineer to join our centralized Data & Analytics team. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX Remote job

    We're searching for a skilled Data Engineer to design, develop, and optimize data pipelines and architectures. · Design, develop, and maintain scalable data pipelines and ETL processes. · Build and optimize data architectures for data collection, storage, processing, and retrieva ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    This role involves designing and implementing data engineering solutions using Python and Azure Data Factory within the Azure Data Factory ADF skill family. · ...

  • Only for registered members Dallas, Texas, United States

    Market Data Engineering is part of the firm's Data Engineering group handling global access to financial market data sourced both internally and externally from the firm. The team is currently undertaking a project to revolutionize data ingestion, curation and distribution. · ...

  • Data Engineer

    3 days ago

    Only for registered members Dallas, Texas, United States

    We are expanding our Data Engineering toolset and need an experienced AWS, Python and SQL Data Engineer. · Implement and manage AWS tools and environment. · Using Python/Pyspark in databricks build write complex scripts to transform ingested data meet business requirements. · ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dallas, TX

    The Data Engineer supports the design, build, and operation of data pipelines and models that power Hershey's enterprise data products. · This role develops reliable, scalable data transformations that enable analytics, reporting, and AI across Hershey's business domains. The Dat ...

  • Data Engineer

    6 days ago

    Only for registered members Dallas, TX

    We are looking for a skilled Data Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology. · This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth pote ...

  • Data Engineer

    2 weeks ago

    Only for registered members Dallas, TX

    We are a leading commercial real estate company specializing in buying selling developing and managing properties. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    Design and implement data engineering solutions using Python and Azure Data Factory. · ...

  • Only for registered members Dallas, Texas, United States

    At Goldman Sachs, our Engineers don't just make things – we make things possible. · Design & develop data management tools to curate our most important data sets, · ...

  • Only for registered members Dallas

    Dice is the leading career destination for tech experts at every stage of their careers. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    This is a Contract hybrid role for a Data Engineer, · based in Dallas, TX, with flexibility · for some remote work. · Expertise in Data Engineering · Proficient in Extract Transform Load ETL processes · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    +h2>Job summary · We are looking for a Data Engineer to work on large-scale batch pipelines, data serving, data lakehouse, and analytics systems. · Develop new or improve and maintain existing large-scale data infrastructures and systems for data processing or serving · Create an ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    ++Transforma datos en modelos precisos para informes y decisiones. · Built scalable and reliable data pipelines that transform raw learning data into analytics-ready models, · Create data models that provide clear visibility into learner progress and performance. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX

    We have a need within our Chief Data Office for a strong to specialize in building high-performance real-time data pipelines using Apache Kafka & Flink. · ...

  • Data Engineer

    4 days ago

    Only for registered members Dallas

    We leverage cutting-edge data engineering technologies to build scalable, reliable, and high-performance data platforms. · ...

  • Data Engineer

    1 month ago

    Only for registered members Dallas, TX Remote job

    Lensa promotes jobs on behalf of UnitedHealth Group. Optum delivers care aided by technology to help millions live healthier lives. The PI Analytics team looks for data-focused engineers to quickly develop fraud detection software. · Support software development lifecycle · Lead ...

  • Data Engineer

    3 days ago

    Only for registered members Dallas, TX

    Data engineer needed to design and build database for Big Data analytical systems.Dallas TX. · Design data integration pipeline architecture. · Build robust applications using SQL and Spark. · ...

  • Data Engineer

    4 days ago

    Only for registered members Dallas, TX

    Bright Vision Technologies is seeking a Data Engineer to join their dynamic team and contribute to their mission of transforming business processes through technology. · ...

Jobs
>
Dallas