Jobs
>
Bellevue

    Lead Data Azure Engineer with Databricks - Bellevue, United States - Smart IT Frame

    Default job background
    Description

    IT Experience Level: 14 Years

    Data Engineer: Min 9 to 10 years

    Azure: Min 6 years

    ADF: Min 6 years

    DataBricks: Min 6 years

    Spark (PySpark, SparkSQL): Min6 years

    Domain: Telecom

    Must: Azure + Databricks Lakehouse

    Azure experience - ADF for orchestration, ADLS for storage, AzureDevOps for CI/CD

    Databricks experience - all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL)

    PowerShell experience - this is our scripting language of choice

    SQL proficiency - it's used everywhere (TSQL, PostgreSQL)

    Proficiency with parquet and delta formats

    Additionally - they will need experience in:

    SDLC + CI/CD - we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.

    Should have a deep understanding of indexes and partitioning.

    Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)

    Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)



  • Diverse Lynx Bellevue, United States

    1.Proficient in Python and PySpark. · 2. Strong knowledge of SQL. · 3.Experience in building and optimizing complex data pipelines in Azure. · 4.Hand on experience on Azure Databricks. · 5.Strong working knowledge on Azure components and services such as Storage Account, Azure Da ...


  • Intellectt Inc Seattle, United States

    · • Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces. · • Define and organize data assets (structured and unstructured) within the Unity Catalog. · • Design and implement Azure cl ...


  • Sonata Software Seattle, United States

    Sonata Software Overview · Sonata is a global technology company specializing in platform-based digital transformation, supporting businesses to become connected, open, intelligent and scalable. Sonata's Platformation methodology brings together industry expertise, platform tech ...


  • Sonata Software Seattle, United States

    Sonata Software Overview · Sonata is a global technology company specializing in platform-based digital transformation, supporting businesses to become connected, open, intelligent and scalable. Sonatas Platformation methodology brings together industry expertise, platform techn ...


  • Sonata Software Seattle, United States

    Sonata Software Overview · Sonata is a global technology company specializing in platform-based digital transformation, supporting businesses to become connected, open, intelligent and scalable. Sonata's PlatformationTM methodology brings together industry expertise, platform tec ...


  • Sonata Software Seattle, United States

    Sonata Software Overview · Take the next step in your career now, scroll down to read the full role description and make your application. · Sonata is a global technology company specializing in platform-based digital transformation, supporting businesses to become connected, o ...


  • ClifyX Seattle, United States

    Java SDET + Databricks · Work Location: Seattle (Remote for Now) · Contract duration: 6+ Months · Infosys/Starbucks · Detailed Job Description · • Databricks and Java SDET automation testing experience. · • Hands on Java coding is must with data testing expertise with minimum 8y ...


  • Insight Global Seattle, United States

    Top 3 Hard Skills Required + Years of Experience · 1. Minimum 3 years experience in Databricks · 2. Minimum 3 years experience with Azure, · 3. Minimum 3 years experience Spark knowledge and coding · Designing and implementing highly performant data ingestion pipelines from multi ...


  • Smart IT Frame Bellevue, United States

    Hello Professionals, · We are looking for a Data Engineer at Bellevue, WA for a contract opportunity. Please find the below job description and apply for the job if you are interested. · Role: Data Engineer · Location: Bellevue WA ( Hybrid) · Mode: Contract · Data Engineer : 8-10 ...


  • iLink Digital Issaquah, United States

    Job Description · About The Company: · iLink is a Global Software Solution Provider and Systems Integrator, delivers next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, rea ...


  • DataBricks Seattle, WA, United States

    RDQ325R14At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data an ...


  • Sogeti Seattle, United States

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world ...


  • Couloir technology group,Inc Seattle, United States

    Data Platform Engineer with Databricks and Unity Catalog. · Location – Seattle, WA – remote ok – must be willing to work PST. · Experience – 9+ years · Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra. · De ...


  • Resource Informatics Group Seattle, United States

    Job Description · Job Description · Title: Senior Spark SQL Developer with Databricks · Location: · Seattle, WA · # of Positions: 1 · Duration: · 6 months · Rates: DOE · Primary Skills: · Spark, SQL, Databricks · Job Description: · Must Have Skills (Top 3 technical skills ...


  • Capgemini Seattle, United States

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world ...


  • Resource Informatics Group Inc Seattle, United States

    Job Description · Job Description · Title: Senior Spark SQL Developer with Databricks · Location: Seattle, WA · # of Positions: 1 · Duration: 6 months · Rates: DOE · Primary Skills: Spark, SQL, Databricks · Job Description: · Must Have Skills (Top 3 technical skills only) * · Sp ...


  • Databricks Bellevue, United States

    P-188 · Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new archi ...


  • Databricks Bellevue, United States

    P-955 · Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new archi ...

  • Databricks

    Software Engineer

    2 weeks ago


    Databricks Bellevue, United States

    P-974 · At Databricks, we are passionate about helping data teams solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI ...


  • Diamondpick Bellevue, United States

    Prinipal/Lead Azure Data Engineer · Bellevue, WA (Hyrbid) · Contract · 14+ years in IT and 8+ years in Data Engineering & Expert Level Azure Data skills · Job descriptions for the Sr data engineering for DSnA support: · We operate in an Azure + Databricks Lakehouse. We'll need ...