Azure Data Lake Architect - Texas, United States - Concord

Description

Concord isn't your typical consulting firm; we are an execution company with a passion for making things happen. Our mission is to help clients enhance customer experiences, optimize operations, and revolutionize their product offerings through seamless integration, optimization, and activation of technology and data.

We are seeking a highly skilled Databricks expert to design and implement a robust Data Lake on Microsoft Azure. You will play a pivotal role in defining the architecture, selecting the appropriate technologies, ensuring a scalable and secure data platform, and establishing the foundational capabilities for the platform.

Responsibilities

• Lead the design and implementation of the Azure Data Lake architecture using Databricks, with a focus on foundational platform capabilities.
• Select and configure appropriate Azure services (ADLS, VMs, etc.) for data storage and processing specific to the client's needs.
• Develop data ingestion pipelines for structured, semi-structured, and unstructured data relevant to the client's data landscape.
• Design data transformation and cleansing processes to ensure data quality for the client's data lake.
• Implement security best practices and access controls for the client's data lake.
• Collaborate with the program manager and development team to ensure seamless integration with the client's existing systems.
• Document the architecture, design decisions, and configuration details for the client's data lake platform.
• Optimize the performance and scalability of the data lake platform for the client's specific use case.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum 7 years of experience designing and building cloud-based data lake solutions (Azure is a big plus).
• Proven expertise in Apache Spark and Databricks, with a focus on building data lake solutions.
• In-depth knowledge of data warehousing concepts, data modeling, and data governance principles.
• Experience with data integration tools and technologies for data lake implementations.
• Strong understanding of cloud security best practices.
• Excellent analytical and problem-solving skills.
• Effective communication and collaboration skills.
• Previous experience in consulting is a plus.

Additional information

• Duration: 3-6 months contract
• Type of contract: contractor (C2C or w2 hourly)
• Location: Remote (USA only). Preferably Dallas, TX area.
• Timezone: Central time
• Requirements: must be authorized to work legally in the US without sponsorship