Data Engineer - Dallas, United States - LTK USA

Description

Position Title:
Data Engineer


About the role:

LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world.

As a

Data Engineer , you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers.

We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.

Responsibilities

Contribute to the technical definition, prototyping, and production-ready enablement of LTK's data lakehouse, optimizing efficiencies, performance, scale, and cost

Support the governance of LTK's data lakehouse

Participate in the overall strategic direction of the data engineering technology stack

Stay abreast of data engineering technical trends and emerging approaches

Evaluate new technologies and/or custom solutions

Facilitate on-time delivery of technical work products

Effectively communicate and gain alignment both within team and with interdependent teams and stakeholders

Produce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams

Build required infrastructure for optimal ETL/ELT processes for data from various data sources using AWS, SQL and orchestration technologies.

Ensure the reliability and quality of data across the data lake (at rest) and in the pipelines (in motion)

Qualifications

2-5 years experience in building data pipelines, coding for data management, data warehousing, or other data environments, including, but not limited to Spark.

Bachelor's degree in information systems, computer science, or a related field; Master's preferred

Experience in system design and application architecture for data platforms;

Experience driving end to end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics and other data consumer teams

Experience in application design and implementation, using agile practices;

Experience with Data management and Data governance processes and standards;

Strong experience in Python programming at minimum, with demonstrated real-world experience building out data tools in Cloud environments

Extensive knowledge in SQL fine tuning, optimizers and execution plans;

Experience building complex data models to handle millions of transactions;

Proven experience working with AWS cloud computing environment.

Profound knowledge of AWS Data services (eg:
Redshift, S3, EMR, Glue, RDS, Kinesis, etc.)

Demonstrated expertise in at least 2 of the following:

Batch data ingestion

Big data pipeline engineering and optimization

Analytic/MPP data warehouse optimization

Analytical data modeling

Event streaming data processing

Data pipeline metadata observability

Data Platform Cost Optimization

DataOps

Specialized experience designing and working with at least 2 of the following data domains:

Retail product data

Ecommerce data

Consumer profile data

Clickstream data

Consumer event data

Marketing channel/campaign data

Affiliate data

Retailer/Brand data

Preferred Qualifications

AWS Certified Data Analytics - Specialty Certification

Experience with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)

#LI-MM3

#J-18808-Ljbffr