Jobs
>
New York City

    Principal Engineer, Data Streaming - New York, United States - Index Exchange

    Index Exchange
    Index Exchange New York, United States

    4 weeks ago

    Default job background
    Description

    We shaped the earliest forms of ad tech, and we're looking for technical expertise to help shape its future. Our customers have unique problems that can only be solved at an internet scale, and that's where the technical skills of our team make a real difference.

    Our exchange handles over 350 billion requests every day (for comparison Google serves an estimated 9 billion searches a day), all running in our own global data centers. Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale. Through the transparency of our technology, dedication to innovation and integrity, and long-standing customer relationships, we lead through change.

    What's it like to work at Index?

    We have more than 550 Indexers around the globe dedicated to building a safe and transparent marketplace that provides a trusted experience for consumers.

    Index is an exciting and fast-paced place to work. We're built on our values of change, support, learning and teaching, trust, and intention. We pride ourselves on our independence and openness, not only in our technology but in our teams, too. Our diverse and inclusive culture celebrates how we can leverage our unique differences to help drive Index forward.

    Our culture of success is truly supportive and collaborative. In working together across our teams, we're continually investing in the people and technology to solve the industry's most complex problems. As we extend the promise of ad tech to every channel, we're looking for talented engineers to help advance Index, and the industry, forward.

    Are you ready to join the programmatic evolution?

    Index Exchange funds the open web. Content and journalism across the internet are funded through advertising, and we are the engine that helps to make that happen transparently, safely, and efficiently. Handling hundreds of billions of auctions per day within milliseconds requires an intense understanding of the exchange and the ecosystem that we live in.

    Our business is growing significantly every year and is poised to grow even faster. Our people and our platforms are the foundation and enablers of that growth. We are significantly expanding our technology teams, and are looking for technologists with a passion for high-performance software development, and a drive to deliver software products and platforms that enable and empower industries at a global scale.

    About The Role

    Join our global organization at the forefront of innovation in the Ad-Tech industry. We are seeking a dynamic and experienced Principal Engineer, Data Streamingto lead across data domains and teams, driving strategic outcomes for our organization. The ideal candidate will be equal parts responsible for driving initiatives at deep technical level and ensuring robust operational rigor to achieve stability and scale in our data environments.

    Here's What You'll be Doing

    • Leadership Across Domains:
    • Provide strategic leadership across multiple domains, collaborating with cross-functional teams such as product, operations, infrastructure, and platform engineering to achieve business objectives.
    • Foster a culture of innovation, continuous improvement, and collaboration within the data systems team.
    • Advocate for strategic directions that reduce our complexity and tech stack footprint.
    Technical Depth:
    • Demonstrate deep expertise in our core data streaming components, including Kafka, Spark, Hadoop, Presto/Trino, Flink and Redis in a low latency environment.
    • Architect relational data structures for performance, scale, and continuity.
    • Drive technical excellence by staying abreast of industry trends, evaluating emerging technologies, and making recommendations for adoption.
    • Lead initiatives with other cross-functional Principal engineering staff that are supporters and consumers of your data systems.
    Operational Rigor:
    • Ensure robust operational processes are in place to guarantee stability and scalability of database environments.
    • Develop and implement best practices for database administration, monitoring, and maintenance using open-source observability and instrumentation tools.
    • Develop and enhance testing and production release procedures with an automation-first core principle to end-to-end delivery.
    Collaboration and Communication:
    • Collaborate effectively with cross-functional teams, including developers, system administrators, and data scientists, to optimize database performance and functionality.
    • Communicate complex technical concepts to non-technical stakeholders, fostering understanding and alignment across the organization.
    • Participate in quarterly planning events to present your roadmaps and ensure strong alignment with the objectives and the broader technology teams.
    Problem Solving and Troubleshooting:
    • Lead efforts in problem identification, troubleshooting, and resolution to minimize downtime and enhance our Exchange reliability.
    • Lead retrospective/rca engagements for data systems to ensure we are on a continuous improvement path.
    Technology Stack:
    • Deep understanding of streaming data components, including Kafka, Spark, Hadoop, Presto/Trino, Flink and Redis.
    • Possess strong working knowledge of Ansible, Terraform, Kubernetes, Grafana, Prometheus, ELK
    • Exposure and understanding of on-premise data center operations
    • Exposure to other key database technologies is a plus (e.g. MySQL, MariaDB, Galera, PostgreSQL, Vertica, Aerospike).
    Here's What You Need:
    • 3-5 years of proven experience as a Principal Engineer or similar role.
    • In depth expertise with streaming data components Kafka, Spark, Flink
    • Hadoop, Presto/Trino, Redis
    • Demonstrated leadership, mentoring, and collaboration skills balancing strategic and tactical needs.
    • Excellent problem-solving and troubleshooting abilities, diagnosing at depth for a globally distributed infrastructure with low-latency requirements.
    • Effective communication skills, both technical and non-technical audiences
    If you are a seasoned Data Systems Engineer with a passion for driving strategic outcomes and ensuring technical excellence, we invite you to apply and be a key player in shaping the future of our global data environments.

    The base salary for this role is USD 236,000 to 320,000. The total compensation package may vary depending on job related knowledge, skills and experience.

    Why You'll Love Working Here:
    • Comprehensive health, dental, and vision plans at no cost to you
    • Time off and flexible work schedules
    • Retirement plan with a 5% company match
    • Stock options and equity packages
    • Generous parental leave
    • Monthly wellness stipend plus fitness discounts and quarterly wellness group activities
    • Community engagement opportunities and donation-matching program
    • Annual virtual company retreats and regular community-led team events
    • One day off per year to volunteer
    • A workplace that supports a diverse, equitable, and inclusive environment - learn more here
    Notification

    Index Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers.

    Please be vigilant and do not accept interview requests, job offers, or other hiring-related documents from anyone other than our dedicated recruitment team, from the domain of Our interview process consists of several steps, including phone screens and video interviews. We do not conduct interviews via an email questionnaire or request money at any point in the process.

    We remain dedicated to resolving this matter and we appreciate your support.

    Equal employment opportunity

    At Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification-diversity is the human experience. For those who show grit, passion, and humility-Index will welcome you.

    Accessibility for applicants with disabilities

    Index Exchange is committed to working with and providing access and reasonable accommodations to applicants with disabilities. Please let us know if you'd like to request a reasonable accommodation.

    Index Everywhere, Index Anywhere

    Our corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be.

    #LI-ONSITE

    #LI-LP1
  • CrowdStrike, Inc.

    Principal Software Engineer, Backend

    3 weeks ago

    CrowdStrike, Inc. N/A, United States

    About the Role: · You will be a Principal Engineer within Data Platform, both leading/guiding design and development as well as contributing in a quite hands-on capacity with Spark/Flink data processing and Java/Scala microservices development, owning much of the launch of a new ...

  • S&P Global

    Business Owner, Structured Finance: Ratings

    2 weeks ago

    S&P Global New York, United States Full time

    About the Role · : The Team: · The practices business owner team is a global team that is the voice of the practices and advocates for Ratings users in order to prioritize investments in technology, process, and people. The team works with partners across the organization to ...

  • TelevisaUnivision

    Senior Data Science Engineer

    3 weeks ago

    TelevisaUnivision New York, United States Full time

    ABOUT THE ROLE & TEAM: · TelevisaUnivision is the leading Spanish-language media company in the world We're investing in our content, our people, and our properties, which span digital, streaming, social, audio, linear and live events. We're growing our offerings, building on th ...

  • The Walt Disney Studios

    Sr Manager, Marketing Planning

    6 days ago

    The Walt Disney Studios New York, United States Regular

    Job Summary: · Disney+ is the dedicated streaming home for movies and shows from Disney, Pixar, Marvel, Star Wars, and National Geographic, along with The Simpsons and much more In select international markets, it also includes the general entertainment content brand, Star. The ...

  • Disney Direct to Consumer

    Senior Data Analyst

    3 weeks ago

    Disney Direct to Consumer New York, United States

    About the Role & Team · The Subscriber Lifecycle Analytics team is looking for a Senior Data Analyst to join the Commerce Analytics function supporting global fraud analytics across Disney's streaming service offerings (Disney+, Hulu, ESPN+). The Commerce Analytics function part ...

  • Brooksource

    Experimentation Manager

    6 days ago

    Brooksource New York, United States

    Lead, International Product Experimentation · Company Description: · The company owns and operates over 20 different businesses across 30 countries including a valuable portfolio of news and entertainment television networks, a premier motion picture company, significant televisi ...

  • NBCUniversal

    Senior Director, Distribution

    6 days ago

    NBCUniversal New York, United States Full time

    Job Description · Our Direct-to-Consumer (DTC) portfolio is a powerhouse collection of consumer-first brands, supported by media industry leaders, Comcast, NBCUniversal and Sky. When you join our team, you'll work across our dynamic portfolio including Peacock, NOW, Fandango, Sky ...

  • VeeAR Projects

    Business Process Consultant

    4 weeks ago

    VeeAR Projects Newark, United States

    Responsibilities: Conduct needs analysis, value stream mapping, current state process mappings, and identify solutions to business challenges. · Compile business data using knowledge specific to sales and marketing teams to gain insight into a business organization and current ...

  • Paramount Global

    Senior Director, Digital Marketing, SMB Marketing, Paramount Advertising

    1 day ago

    Paramount Global New York, United States Full time

    At Paramount, we're revolutionizing how small and medium businesses advertise on TV and Connected TV (CTV). Our groundbreaking Self-Serve Ads Platform empowers, businesses of all sizes to effortlessly build impactful advertising campaigns, reaching audiences through the power of ...

  • Paramount Global

    Group Chyron Specialist, CBS News

    1 day ago

    Paramount Global New York, United States Full time

    CBS News and Stations is seeking a skilled and thorough Chyron Specialist to join our Chyron Hub for our CBS Owned and Operated station group across 17 markets This position will work with a decentralized Group Creative team that works hand-in-hand with our design teams in each l ...

  • Roku

    Business Operations Manager

    2 weeks ago

    Roku New York, United States

    Teamwork makes the stream work. · Roku is changing how the world watches TV · Roku is the #1 TV streaming platform in the US, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform ...

  • WarnerMedia Services, LLC

    Staff Analytics Engineer

    2 weeks ago

    WarnerMedia Services, LLC New York, United States Full time

    Who We Are... · When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the bringing our characters to l ...

  • Roku

    Solutions Engineer

    5 days ago

    Roku New York, United States

    Teamwork makes the stream work. · Roku is changing how the world watches TV · Roku is the #1 TV streaming platform in the US, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform ...

  • Disney Entertainment & ESPN Technology

    Sr Software Engineer

    4 weeks ago

    Disney Entertainment & ESPN Technology New York, United States

    Résumé du poste: · On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming our media business for the future. Whether that's evolving our streaming and d ...

  • Mondrian Alpha

    Senior Java Software Engineer

    1 week ago

    Mondrian Alpha New York, United States

    Our client, a prestigious multi-strategy hedge fund, is seeking an accomplished Senior Java Developer / Software Engineer to be based in New York. This role is tailored for individuals with strong academia, a deep understanding of problem spaces, and a proven track record in exec ...

  • Energy Baltimore Env_Natural Resource

    Environmental Scientist I

    4 weeks ago

    Energy Baltimore Env_Natural Resource Newark, United States Full time - Temporary

    Job Description · McCormick Taylor has an immediate opening for an Environmental Scientist to join our growing Energy/Utilities group. The ideal candidate will thrive in a collaborative team environment. We are seeking an individual who can handle multiple projects, meet deadlin ...

  • Avenues The World School

    Operations Analyst

    6 days ago

    Avenues The World School New York, United States

    About the Role · The Operations Analyst will partner with campus service leaders across Avenues to build, design, and sharpen their current data system/organizing tools so that NAE reporting is accurate and efficient (in less time) across functional areas including Admissions and ...

  • Visionet Systems Inc.

    Salesforce Lead

    1 week ago

    Visionet Systems Inc. New York, United States

    Visionet is a Product, Solutions and IT services organization serves multiple Fortune 500 companies across BFSI, Retail, CPG, Manufacturing etc. and over 200 leading organizations across 5 countries. With the flagship products like CogniXL, HauteLogic and Loangility the company i ...

  • NBCUniversal

    Sr. Director, Data Governance

    6 days ago

    NBCUniversal New York, United States Full time

    Job Description · At Peacock, we know life is complicated but believe entertainment shouldn't be. We envision a more human streaming experience that embraces the entertainment you love. Backed by 100+ years of NBCUniversal legacy, we know how to entertain. We combine this legacy ...

  • Disney Entertainment & ESPN Technology

    Lead Software Engineer

    2 weeks ago

    Disney Entertainment & ESPN Technology Church Street, United States

    On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products ...