Jobs
>
San Francisco

    Principal Engineer, Central Data Lake Lead - San Francisco, United States - Autodesk

    Default job background
    Description

    **Job Requisition ID #**

    24WD77185

    Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Software Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable data platform used by numerous teams across the company. Reporting to our Software Engineering Manager for Platform Infrastructure, you'll help us tackle tough problems and improve our platform's reliability, resiliency, and scalability. If you enjoy developing high quality and resilient systems and want to make a big impact with data at Autodesk, we want to meet you

    As a Lead for our Central Data Lake, you will:

    + Design, develop, and operate highly reliable large-scale data lake

    + Partner closely with Product teams to understand requirements and design new capabilities that go directly into customer's hands

    + Build and scale data infrastructure that powers batch and real-time data processing of billions of records daily

    + Automate and administer big data applications and services on cloud

    + Help drive observability into the health of our data infrastructure and understanding of system behavior

    + Guide initiatives to enable best practices across infrastructure, deployments, automation, and accessibility

    + Set technical directions and influence cross-functional teams

    + Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance

    + Develop and implement security best practices at the data, application, infrastructure, and network layers

    **Minimum Qualifications**

    + 10+ years of hands-on direct internal experience in large-scale data intensive distributed systems, especially in query engines, object storage, data warehouse, data lake, data analytics, SQL/NoSQL databases, distributed file systems and data platform infrastructure

    + Experience with Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, and Avro

    + Experience provisioning and managing orchestration tools like Airflow

    + Excellent coding skills and experience in Python, Unix shell scripting

    + Experience building, implementing and automating APIs

    + Experience building code-driven infrastructure on AWS through end-to-end automation including integration tests and unit tests

    + Experience with Self-service platform offering by building APIs to deploy Cloud resources

    + Demonstrated experience with EKS, EMR, S3, IAM, Networking and other AWS services

    + Experience with observability tools (such as, Hive, Spark, Presto, Jenkins, CloudOS, Datadog)

    + Experience communicating solutions and resolutions with technical and non-technical audiences

    + Willingness to participate in professional development activities to stay current on industry knowledge and excitement about breaking the status quo by seeking innovative solutions

    + Experience with public clouds (AWS, Azure, GCP)

    + Computer Science degree (or equivalent experience will be considered)

    **Learn More**

    **About Autodesk**

    Welcome to Autodesk Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

    We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

    When youre an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us

    **Benefits**

    From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

    **Salary transparency**

    Salary is one part of Autodesks competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidates experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

    **Equal Employment Opportunity**

    At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

    **Diversity & Belonging**

    We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here:

    **Are you an existing contractor or consultant with Autodesk?**

    Please search for open jobs and apply internally (not on this external site).

    Welcome to Autodesk Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

    We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

    When youre an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us

    Not quite ready to apply? Join our talent community ) to stay up to date on new job opportunities and the latest Autodesk news.



  • Autodesk San Francisco, United States

    **Job Requisition ID #** · 24WD77185 · Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Software Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and sc ...


  • My3Tech San Francisco, United States

    Job Title: AWS Data Lake Technical LeadJob Location: REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expenses will be reimbursed)Duration: 3+ Years Contract · Job Description:Background:Client is seeking to improve statewide law enforcement data access. The purpose ...


  • My3Tech San Francisco, United States

    Job Title: AWS Data Lake Technical LeadJob Location: REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expenses will be reimbursed)Duration: 3+ Years Contract · If you want to know about the requirements for this role, read on for all the relevant information. · Job D ...


  • Autodesk San Francisco, United States

    Principal Engineer, Central Data Lake Lead page is loaded · Principal Engineer, Central Data Lake Lead · Apply · locations · San Francisco, CA, USA · time type · Full time · posted on · Posted 2 Days Ago · job requisition id · 24WD77185 · Job Requisition ID # · 24WD771 ...


  • Autodesk San Francisco, United States

    Job Requisition ID # · 24WD77185 · Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Software Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable ...


  • HelloFresh SE West Valley City, United States

    The Warehouse Associate will be responsible for assisting in the receiving of freight, breakdown of pallets, scanning, and sortation of boxes by driver routes, loading of vehicles, and helping to direct traffic in the facility. Theyll report to the Warehouse Lead, Lead, Warehouse ...


  • Faire Inc West Valley City, United States

    **Senior Customer Experience Team Lead** · at Faire Salt Lake City, UT **About Faire** · Faire is an online wholesale marketplace built on the belief that the future is local there are over 2 million independent retailers in North America and Europe doing more than $2 trillion ...


  • Databricks San Francisco, United States

    Req ID: GAQ125R71 · You will partner with multiple teams and lead vendor negotiations for all IT, Product, and Engineering indirect spend categories. The focus for this role is to become a trusted partner to the business to improve spend under management, develop and standardize ...

  • Logicon

    Lead Data Architect

    2 days ago


    Logicon California City, United States

    **Lead Data Architect** · **RESPONSIBILITIES** · - Serve as the technical domain expert on foundational data and integration technologies. · - Provide support to business partners and development teams in leveraging data and integration solutions effectively. · - Steer technology ...


  • Shake Shack West Valley City, United States

    ** Restaurant Shift Manager / Team Lead - Salt Lake City** · Email Location: Fashion Place Job Type: Full Time **Restaurant Shift Manager** · **Bringin' It - Together** · Teamwork isn't just practiced at the Shack - it's perfected. We make each day great - together. We create ...

  • Hyatt Regency Salt Lake City

    Banquet Chef

    2 weeks ago


    Hyatt Regency Salt Lake City West Valley City, United States

    Are you ready to join a GORGEOUS, and COOL hotel in the heart of downtown Salt Lake City?If so, we are seeking the BEST; individuals who are energetic, passionate to serve/help others, and enjoy interacting with people from all over the globe Our ideal team player is one who will ...

  • Darden

    Sous Chef

    2 weeks ago


    Darden West Valley City, United States

    Sous Chef 40 East 100 South, Salt Lake City UT The Sous Chef is responsible for supporting the Executive Chef in leading a team of culinary professionals that deliver high-quality, great-tasting food; proper food safety and sanitation procedures, and profitability. The Sous Chef ...


  • Darden West Valley City, United States

    Executive Chef Partner 40 East 100 South, Salt Lake City UT The Executive Chef Partner is responsible for leading a team of culinary professionals that deliver high-quality, great-tasting food; proper food safety and sanitation procedures, and profitability. The Executive Chef co ...


  • Sutter Health Medical San Francisco, United States

    Company Description · Sutter Health is one of the nation's leading not-for-profit healthcare systems, which includes award-winning physician organizations, acute care hospitals, surgery centers, medical research facilities and specialty services. Our team of 68,000 doctors, emplo ...

  • The Westerner

    Sous Chef

    2 weeks ago


    The Westerner West Valley City, United States

    The Westerner in West Valley City, UT is looking to hire a full-time Sous Chef to supervise the preparation of all in-house food while under the direction of our executive chef. Do you have knowledge and skill in the culinary arts? Are you interested in joining a restaurant that ...

  • Kyo, LLC

    Behavior Technician

    2 days ago


    Kyo, LLC West Valley City, United States Part time

    *Nice to meet you We're Kyo.* · Kyo is a leading provider of Applied Behavior Analysis (ABA), an evidence-based therapy for individuals with autism. Kyo serves thousands of children and teens across ten states. Every day, we seek to Make Every Moment Count for our clients and fo ...

  • Grand America Co

    Restaurant Chef

    2 weeks ago


    Grand America Co West Valley City, United States

    **Restaurant Chef** · Salt Lake City, Utah (GA) · Food & Beverage · Active F/T · 548868 · **We are seeking a driven and passionate Restaurant Chef to lead our team of food nerds and to execute the perfect dining experience in a soon to be opened brasserie and bar located in ...


  • COGS West Valley City, United States

    About COGS' Client: · We are partnered with a leading organization within the luxury real estate and hospitality industry located in Salt Lake City, UT, and they are seeking to fill a Director of Purchasing position for its development and construction arm within one of its larg ...


  • GSPANN Technologies, Inc San Francisco, United States

    About the Company : · Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in reta ...


  • Alchemy San Francisco, United States

    is to bring blockchain to a billion people. The Alchemy Platform is a world class developer platform designed to make building on the blockchain easy. We've built leading infrastructure in the space, powering over $105 billion in transactions for tens of millions of users in 99% ...