Jobs
>
Chicago

    Lead Data Engineer - Chicago, United States - Top Prospect Group

    Top Prospect Group
    Top Prospect Group Chicago, United States

    1 week ago

    Default job background
    Description

    The Lead Data Engineer holds the primary responsibility for skillfully designing, developing, implementing, and supporting enterprise Microsoft Azure Data Warehouse. This role assumes accountability for ensuring the dependable, efficient, and secure operation and advancement of On-Premise and Cloud Data Warehouses to effectively meet crucial business needs.

    Onsite / Bonus / Azure Data Studio

    Essential Duties and Responsibilities:

    • Provide support in designing and overseeing enterprise-grade data pipelines and data stores, essential for the development of advanced analytics programs, machine learning models, and statistical methods.
    • Implement automation and streamline processes to optimize the entire data and analytics platform, ensuring efficient throughput and high-performance outcomes.
    • Recognize, devise, and execute internal process enhancements, including automation of manual tasks, optimizing data delivery, and redesigning architecture or infrastructure to enhance scalability.
    • Collate large, intricate datasets that align with functional and non-functional business demands.
    • Develop processes that facilitate data transformation, manage data structures, metadata, dependencies, and workload management.
    • Collaborate with business users to understand functional and data requirements, contributing to the enhancement of data models and pipelines.
    • Apply expert-level analytical and problem-solving skills to diagnose and resolve intricate technical issues.
    • Create, maintain, and continuously enhance scalable data pipelines, while also developing new data source integrations to accommodate the growing volume and complexity of data.
    • Designing, implementing, and managing data extraction, transformation, and loading (ETL) processes.
    • Creating comprehensive technical specification documents and application interface designs.
    • Creating data processing and integration solutions for both batch and real-time scenarios, proficiently handling structured and unstructured data.

    Qualifications/Competencies:

    Key Technical Knowledge, Skills, and Abilities:

    • Exhibit a thorough understanding of Data Lake architectures, including raw, enriched, and curated layer concepts, and ETL/ELT operations.
    • Exhibit a solid understanding of database design, data warehousing concepts, big data platforms, and ETL operations.
    • Experience working with data integration techniques & self-service data preparation.
    • Experience in requirements analysis, design, and prototyping.
    • Experience deploying modern data solutions leveraging components like Azure functions, Azure Data Factory, Data Flows, Azure Data Lake, Azure SQL, Azure Synapse, Streaming Analytics or equivalent on another cloud provider such as AWS or Google Cloud.
    • Experience with DevOps tools like Azure DevOps, Jenkins, Maven etc.
    • Experience in building/operating/maintaining fault tolerant and scalable data processing integrations.
    • Demonstrated experience of turning business use cases and requirements into technical solutions.
    • Strong level of understanding on Azure Data Factory, SQL/Synapse, ADLS, and Azure DevOps.
    • Ability to conduct data profiling, cataloging, and mappings for technical design and construction of data flows.]

    Education and Experience:

    • Bachelor's degree with a minimum of 10 years of related experience.
    • 10+ years of hands-on Data Warehouse architecture and development experience
    • Demonstrated expertise in Microsoft SQL Server and/or Azure development.
  • PDX

    Manager, Data Engineering

    4 days ago

    PDX Chicago, United States

    **Company Description** · A division of Publicis Groupe, Publicis Digital Experience is a network of top-tier agencies designed to develop capabilities and solutions to enable growth and provide scaled access to the digital capabilities of Publicis Groupe in service of our client ...

  • Radiant Innovations

    Data Engineer

    2 days ago

    Radiant Innovations Chicago Ridge, United States

    Ahoy Captain · Are you a Data Engineer with a passion for food? Then we may be a perfect match. · Join the team behind Germany's most successful cooking app and help hundreds of thousands of users live happier and healthier lives. · As a Data Engineer for our mobile food app with ...

  • Stellar Enterprises

    Data Engineer

    3 days ago

    Stellar Enterprises Melrose, United States

    What to expect at Melrose? · You will lead the design, construction, and maintenance of the back-end data infrastructure, including data collection and pipelines for data warehousing · You will be responsible for data mining and integration, developing and maintaining data connec ...

  • Planet Technology

    Data Engineer

    1 week ago

    Planet Technology Chicago, United States

    No Sponsorship Available · No C2C available · We are working with our Chicago based client who is embarking on a greenfield data migration to Azure. They are searching for a talented Azure Data Engineer with like experience to join the project from the beginning. There is an oppo ...

  • The LaSalle Group

    Data Engineer

    6 days ago

    The LaSalle Group Chicago, United States

    Want to grow your career with one of the fastest growing industries? LaSalle Network is partnered with a top Chicago-based client looking to hire a Data Engineer their team. · The Data Engineer will be responsible for delivering strategic and tangible solutions through data. We a ...

  • AHEAD

    Data Engineer

    6 days ago

    AHEAD Chicago, United States

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation. · At AHEAD, we prioritize creating a culture of belonging, wh ...

  • Georgia IT Inc

    Data Engineer

    6 days ago

    Georgia IT Inc Chicago, United States

    Job Title : Data Engineer · Location : Chicago, IL - Remote · Position Type : Contract · US Citizen, Green Card, TN, GC EAD and H4 EAD only No Third-party agencies corp to corp. · Job Description: 5+ years of experience in a Data Engineer role, with a Graduate degree in ...

  • McDonald's

    Data Engineer

    1 day ago

    McDonald's Chicago, United States

    McDonald's evolving Accelerating the Arches growth strategy puts our customers and people first and demonstrates our competitive advantages to strengthen our brand. We are recognized on lists like Fortune's Most Admired Companies and Fast Company's Most Innovative Companies. · Do ...

  • Tekgence Inc

    Data Engineer

    6 days ago

    Tekgence Inc Chicago, United States

    Hi · Hope your doing good · Data Engineer · Location: Chicago, Wabash Location · Data Engineer Req Notes · need to have scalability experience/leverage cloud and build interfacing applications · need people who have built reliable applications for finance domain · understand nonf ...

  • BAI

    Data Engineer

    6 days ago

    BAI Chicago, United States

    Data Engineer Reports To: Director, Product Development & Operations BAI is the financial services industry's leading provider of powerful tools, relevant content, and meaningful connections. Our mission is to give financial services leaders the confidence to make smart business ...

  • Amazon

    Data Engineer

    6 days ago

    Amazon Chicago, United States

    · People Analytics, Technology, Operational Excellence team (PATOE) is looking for an experienced Data Engineer to maintain and enhance current data environment while providing, maintaining, and distributing data to a global team. · As a Data Engineer, you will need to review te ...

  • Dexian

    Data Engineer

    2 days ago

    Dexian Chicago, United States

    Job Summary: · Dexian is seeking a Data Engineer for an opportunity with a client located in Chicago, IL. · Responsibilities: · Analyze and organize raw data · Build data systems and pipelines · Evaluate business needs and objectives · Interpret trends and patterns · Conduct com ...

  • NinjaTrader

    Data Engineer

    5 days ago

    NinjaTrader Chicago, United States

    NinjaTrader is an investor-backed, growth-stage FinTech company with an award-winning platform and over 1 million users. We are building products and services which empower active traders to easily analyze and react to data from the world's leading financial markets. Located in C ...

  • HexawareAvance Consulting

    Data Engineer

    6 days ago

    HexawareAvance Consulting Chicago, United States

    The data engineer considers themselves an expert in data management with cloud technologies. The data engineer leads the definition and implementation of data pipelines, data storage, and data access/security for a complex Azure hosted application environment. They are responsibl ...

  • Jet Support, Inc.

    Data Engineer

    6 days ago

    Jet Support, Inc. Chicago, United States

    About JSSI For more than 35 years, Jet Support Services, Inc. (JSSI) has been the leading independent provider of maintenance support, advisory services, software, and financial tools to the business aviation industry. With 6,000+ aircraft supported by maintenance programs and so ...

  • Independence Pet Group

    Data Engineer

    1 week ago

    Independence Pet Group Chicago, United States

    Independence Pet Group (IPG) is one of North America's largest pet insurance and services organizations. Our impressive family of brands supports insurance for more than 1,000,000 pets in the U.S. and Canada and provides well-being, safety, resources, and business solutions to th ...

  • NinjaTrader

    Data Engineer

    5 days ago

    NinjaTrader Chicago, United States

    Job Description · Job DescriptionNinjaTrader is an investor-backed, growth-stage FinTech company with an award-winning platform and over 1 million users. We are building products and services which empower active traders to easily analyze and react to data from the world's leadin ...

  • Publicis Groupe

    Data Engineer

    2 days ago

    Publicis Groupe Chicago, United States

    Company Description · Publicis Media harnesses the power of modern media through global agency brands CJ, Performics, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith. A key business solution of Publicis Groupe ([Euronext Paris FR , CAC 40], Publicis ...

  • Saxon Global

    Data Engineer

    6 days ago

    Saxon Global Chicago, United States

    Key Accountabilities: · Contributions include python and AWS development to build,enhance and maintain monitoring capabilities. · Develop datasets and microservices in support of new monitoring solutions and automations to accelerate issue detection and correction. · Transforma ...

  • Darwill

    Data Engineer

    1 week ago

    Darwill Chicago, United States

    Overview : Darwill is a nationally recognized print and marketing communications firm based in the west suburbs of Chicago. As a premier provider of complex marketing products, including direct mail, employee communications and marketing collateral, we influence excellent results ...