- 8 years of Big Data development experience
- 3 Years of Experience in GCP/Azure cloud platforms
- 3 years of experience building streaming pipeline using spark streaming or similar.
Senior, Data Engineer - Little Rock, United States - Walmart
Description
Position Summary...What you'll do...
As a Sam's Club Tech - Senior Data Engineer, you will diginto ourmammothscale ofdata to helpunleashthe power of retaildata science byimagining, developing, and maintaining data pipelinesthat our Data Scientists and Analysts can rely on.
You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way.
You willpartnerwithData Scientists, Analysts, other engineers,and business stakeholders tosolve complexand excitingchallengesso thatwe canbuild out capabilities thatevolve theretail business model while making a positive impact on customer's lives.
About Team:
Sam's Club is our membership warehouse club, a business model that provides our members with high-quality products at prices that are unrivaled by traditional retail.
Sam's Club provides a carefully curated assortment of items, as well as developing and leading technologies and services such as Scan & Go, Club Pickup, and home delivery service in select markets.
Sam's Club also provides travel, auto purchasing, pharmacy, optical, hearing aid centers, tire and battery centers, and a portfolio of business operations support services.
What you'll do:
Consolidate and standardize all connections to external systems and programmatic exchanges. (DFP/GAM, ANX, TTD, LiveIntent, Adobe, Pinterest, LiveRamp etc)
Provide a unified create/read/update/delete API for operations across all of the third-party systems
Provide a normalized view of campaigns and metrics from these different sources for other systems to use.
Generate insights and reports for advertiser campaigns in both real-time and batch mode
Collect and aggregate ad delivery metrics (real-time impression, viewability etc.).
Partner with DS to build and enhance sales lift methodologies, including synthetic control, ghost ads etc.
Build and operate a data warehouse for analytics and business operations
Expose all reports via reporting APIs and data tables
Collaborate with engineering and infra teams to build a ML and experimentation platform
Ownership of ML models for audience targeting. Build and improve relevance and ranking models for ad serving
Ownership of lift measurement methodology, and support enhancement of attribution models and buyer analytics
What you'll bring:
Architect, Design, develop, implement, and tune distributed data processing pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
Exposure to Data Governance (Data Quality, Metadata Management, Security, etc.)Experience with Java, Scala and/or Python to write data pipelines and data processing layers
Demonstrates expertise in writing complex, highly optimized queries across large data sets
Proven working expertise with Big Data Technologies Spark Scala/PySpark, and SQL
Knowledge and experience in Kafka, Storm, Druid and Presto
Experience with the integration tools like Automic, Airflow
About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people.
That's what we do at Walmart Global Tech.We're a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption.
People are why we innovate, and people power our innovations. We are people-led and tech-empowered.We train our team in the skillsets of the future and bring in experts like you to help us grow.
We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career.
Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work:
We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs.
This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives.
Benefits:
Benefits:
Beyond our great compensation package, you can receive incentive awards for your performance.
Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice.
We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them.
That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role.It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job.
The full Job Description can be made available as part of the hiring process.Minimum Qualifications...
Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Option 1:
Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field.
Option 2: 5 years' experience in
software engineering or related field.
Option 3:
Master's degree in Computer Science and 1 year's experience in software engineering or related
field.
2 years' experience in data engineering, database engineering, business intelligence, or business analytics.
Preferred Qualifications...
Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master's degree in Computer Science or related field and 3 years' experience in software engineering
Primary Location...
2101 SE SIMPLE SAVINGS DR,
BENTONVILLE, AR , United States of America
#J-18808-Ljbffr