Jobs
>
Irving

    Sr Data Engineer Lead - Irving, United States - Diverse Lynx

    Default job background
    Description
    Sr Data Engineer Lead
    Onsite - Irving, TX

    Perform the Data Engineer activities
    Experience 10to14Yrs 4.Required Skills , Hive, PySpark, Cloud Dataproc,
    Unix Shell Scripting, GCP

    Roles & Responsibilities
    • Analyzes complex data structures from disparate data sources and design large scale data engineering pipeline
    • Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs .
    • Collaborates with product business and data science team to collect user stories and translate into technical specifications
    • Uses knowledge in Cloud & Hadoop architecture, HDFS commands and experience designing & optimizing queries to build data pipelines
    • Uses strong programming skills in PySpark, Python, Java or any of the major languages to build robust data pipelines and dynamic systems
    • Builds highly scalable and extensible data marts and data models to support Data Science and other internal customers on Cloud.
    • Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
    • Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions
    • Experiments with available tools and advice on new tools to determine optimal solution given the requirements dictated by the model/use case Required Qualifications
    • 3+ years of progressively complex related experience in cloud data engineering and data analysis
    • Knowledge in programing languages such as PySpark, Java, Python, Hive, SQL
    • Knowledge in Cloud Technology, Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment
    • Strong knowledge of large-scale search applications and building high volume data pipelines, preferably using Dataproc, composer services on GCP or other Cloud Platforms Preferred Qualifications
    • Ability to leverage multiple tools and programming languages to analyze and manipulate datasets from disparate data sources
    • Ability to understand complex systems and solve challenging analytical problems
    • Experience with bash shell scripts, UNIX utilities & UNIX Commands
    Top three skills
    • Pyspark, Java, Python, Hive, SQL
    • Hadoop architecture and commands
    • Dataproc, Composer services on GCP
    Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Epsilon

    Lead Software Engineer

    10 hours ago


    Epsilon Irving, United States Full time

    Company Description · Epsilon is the leader in outcome-based marketing. We enable marketing that's built on proof, not promises. Through , the marketing platform for personalizing consumer journeys with performance transparency, Epsilon helps marketers anticipate, activate and p ...

  • 00002 Citibank, N.A.

    Engineering Team Lead

    4 weeks ago


    00002 Citibank, N.A. Irving, United States Full time

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications syste ...

  • Resource Informatics Group Inc

    Lead Data Engineer

    3 weeks ago


    Resource Informatics Group Inc Irving, United States

    Job Description · Job DescriptionPlease help us with Lead Data engineers with 12+ yrs of exp into ETL. Ask here is strong Lead who can also do coding, lead the team and take care of Deliverables. · Please help us with Lead Data engineers with 12+ yrs of exp in to ETL. Ask here is ...


  • Resource Informatics Group Irving, United States

    Role: Lead role Software Engineer (Python/Java) · Location: Remote · Duration: 12+ Months · LOOKING FOR INDEPENDENT CONSULTANTS · completely hands on role and individual contributor, candidate should have both Java and Python. · 7+ years of experience required. · DevOps/Sof ...

  • Alcority

    Lead Data Engineer

    3 weeks ago


    Alcority Irving, United States

    About the Role: · The Lead Data Engineer is the senior software engineer in the Business Intelligence and Data Warehousing team. This role develops data ingestion to enable high-value business intelligence products. This is a senior individual contributor role with a focus on han ...


  • Resource Informatics Group Irving, United States

    Job Title: - Lead Software Engineer · Work Location: St. Louis, MO - 100% remotely · Duration: 6+ Months · Experience: years · PURPOSE OF POSITION: · Lead Software Engineer in Test will play a key role in leading the team through planning and delivering Infrastructure and Se ...


  • InterSources Irving, United States

    Responsibilities · Position: Automation Lead Engineer · Location: Irving TX · Duration: Long Term · Required Skills: · qTest · React, , Python · Visualization tool is Grafana · GCP, AWS and other environments · Senior QA Engineer and qTest (nodejs api testing, postman) · QA with ...


  • Caterpillar Financial Service Corp Irving, United States

    Career Area: · Business Technologies, Digital and Data · Job Description: · Your Work Shapes the World at Caterpillar Inc. · When you join Caterpillar, you'rejoining a global team who cares not just about the work we do – but also about each other. We are the makers, problem sol ...


  • Caterpillar Irving, United States

    **Career Area:** · Business Technologies, Digital and Data · **Job Description:** · **Your Work Shapes the World at Caterpillar Inc.** · When you join Caterpillar, you're joining a global team who cares not just about the work we do · but also about each other. · We are the ...


  • Gartner Irving, United States

    Gartner's core asset is its people. Our people develop insights, share advice and create experiences that help our clients be more successful. The People Analytics & Operations team derives actionable insight from data to recommend and implement better ways of attracting, develop ...


  • Gartner Irving, United States

    Hiring near our Irving, TX Center of Excellence. · Hybrid, flexible environment. · About Gartner IT: · Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. We make a broad organizational impact by delivering c ...


  • Gartner Irving, United States

    Hiring near our Irving, TX Center of Excellence.Hybrid, flexible environment.About Gartner IT:Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. · We make a broad organizational impact by delivering cutting-ed ...


  • Sidram Technologies LLC Irving, United States

    Senior QA Engineer with WebdriverIO and qTest · QA with and qTest for FinOps project - monitoring and reporting tool developed in React, , Python, SQL. · DB is MS Aurora. · GCP, AWS and other environments. · Visualization tool is Grafana, Looker · Sr QA Engineer will be required ...


  • Resource Informatics Group Irving, United States

    Job Title: Lead Network ACI Engineer · Location: Cleveland, OH (onsite) · Duration: 6+ months · Experience: 10+ years · It's more of a lead ACI role for the Cisco engineer to help build skillset on the team. · Senior Engineer will be preforming Cisco ACI environment support a ...


  • InfoVision Inc. Irving, United States

    Hi · We have an immediate Openings with Our Direct Client for a Long-term contract position · Job Title: Sr Lead Fullstack Engineer (NodeJS) · Location: Irving TX – 3 days office every week · Duration: 12 Months · Required Qualifications: · Bachelor's degree or foreign equivalent ...


  • 7-Eleven Irving, United States

    About This Opportunity: · We are looking for a dedicated and experienced Software Engineer Lead to help design, develop, and implement solutions for Order Fulfilment within our Retail Supply Chain capabilities. The individual in this role will work closely with the Value Chain bu ...


  • Wells Fargo Irving, United States

    About this role: · Wells Fargo is seeking a motivated Lead Information Security Engineer to join an exciting, fast paced team working on cutting edge encryption, tokenization and key management technologies that are leveraged to protect information companywide. This role will pr ...


  • McKesson Irving, United States

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...


  • Caterpillar Irving, United States

    **Career Area:** · Business Technologies, Digital and Data · **Job Description:** · **Your Work Shapes the World at Caterpillar Inc.** · When you join Caterpillar, you're joining a global team who cares not just about the work we do but also about each other. We are the maker ...


  • Hispanic Technology Executive Council Irving, United States

    Brief Description of the Organization: · Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of finan ...