Data Engineer for eCommerce Data Pipeline
1 month ago
Job summary
We are seeking an experienced Data Engineer or BI-focused development team to build a reliable data pipeline and reporting system. The project involves centralizing eCommerce operational data using Spark Shipping, a custom database,Metabase.
- Connect to Spark Shipping API
- Extract key datasets orders products SKUs brands vendors shipping data timestamps Normalize and store data in a structured database Design schema optimized for reporting aggregation Support scheduled syncs hourly daily Connect database to Metabase Build clean intuitive dashboards reports including Top selling SKUs Top brands cross-channel aggregation Revenue over time date filtering required Order volume trends Vendor performance Ensure dashboards Fast-loading Filterable by date range Easy for non-technical users Clean documented work eCommerce data experience Shopify eBay Amazon etc Experience with Looker Studio BigQuery future phases Automation ETL tooling experience Familiarity with Spark Shipping webhooks Fully functional API Database pipeline Documented database schema Metabase connected configured Dashboards filters date sorting Basic documentation maintenance future expansion
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
We are seeking a Software Development Engineer – Data Pipeline to design and build advanced data and machine learning pipelines that support real-time systems, analytics, and AI-driven applications. · Design and implement advanced data engineering and data science pipelines using ...
4 weeks ago
We are seeking a Software Development Engineer – Data Pipeline to design and build advanced data and machine learning pipelines that support real-time systems, analytics, and AI-driven applications. · ...
4 weeks ago
This is a long-term contract opportunity to design architect and maintain scalable data pipelines that support reporting and downstream applications.We are seeking an experienced Data Pipeline Engineer to build support cloud-based data lake architectures for both operational anal ...
6 days ago
Data Pipeline Engineer A well-known Financial Services Company is looking for a Data Pipeline Engineer in Irving TX or Charlotte NC (Hybrid). We are seeking an experienced Data Pipeline Engineer to design architect and maintain scalable data pipelines that support reporting and d ...
1 month ago
We are seeking an experienced Data Pipeline Engineer to design, · architect and maintain scalable data pipelines that support reporting and downstream applications. · ...
1 month ago
A well-known Financial Services Company is looking for a Data Pipeline Engineer in Irving TX or Charlotte NC. The ideal candidate will bring strong expertise in cloud-based and open-source data technologies. · ...
2 weeks ago
We are seeking a Software Development Engineer – Data Pipeline to design and build advanced data and machine learning pipelines that support real-time systems, analytics, and AI-driven applications. · Design and implement advanced data engineering and data science pipelines using ...
4 weeks ago
The Pipeline Data Analyst is responsible for reviewing and validating post-ILI excavation data for pipeline assets. · ...
1 month ago
We're seeking a Data Pipeline Analyst to join our dynamic team at AscellaHealth where innovation meets patient care and where your expertise will directly contribute to improving health outcomes for patients with complex chronic conditions and rare diseases. · This role offers th ...
3 weeks ago
We're seeking a Data Pipeline Analyst to join our dynamic team at AscellaHealth where innovation meets patient care and your expertise will directly contribute to improving health outcomes for patients with complex chronic conditions and rare diseases. · This role combines techni ...
3 weeks ago
We are seeking an experienced Data Pipeline Engineer to design, architect, and maintain scalable data pipelines that support reporting and downstream applications.This is a long-term contract opportunity that includes a competitive benefit package Our client has been around for o ...
2 weeks ago
Leidos Office of the Chief Information Officer is seeking a skilled and detail-oriented Data Pipelines Engineer to join our team. · ...
2 weeks ago
Data pipeline engineer responsible for centralizing data sources into centralized platforms with expertise in AWS Spark Kafka and ETL frameworks. ...
1 month ago
This position will last for at least one year, comes with benefits, and requires passing a drug and background screening. The Data Pipeline Technicians execute and maintain data pipeline processes designed by engineers, ensuring timely and accurate data delivery for AI developmen ...
1 month ago
Work with the brightest minds at one of the largest financial institutions in the world. · ...
2 weeks ago
The client is a high-end Safari operator looking for a Data Engineer/Tracking Specialist. The goal is to fix the data pipeline and CRM automation. · Audit & Fix Zapier/ · ...
1 month ago
The Pipeline Data Analyst is responsible for reviewing and validating post-ILI excavation ('dig') data for pipeline assets. · ...
1 month ago
Data pipeline engineer role requires experience in data engineering, specifically with Databricks, Azure SQL Server, Docker and AKS. · ...
1 month ago
+Data Pipeline Engineer position at TCS in Dublin, OH. · +Databricks (Python and SQL/PySpark) · Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs) · Data modeling and ETL/ELT design patterns · Docker and Azure Kubernetes Service (AKS) for select automation · +Quali ...
1 month ago
We are seeking a hands-on Senior Data Engineer (Data Pipelines) to own the flow, · transformation and quality of data within Gather Health's next-generation data platform.Build & Orchestrate Pipelines: Design build and maintain end-to-end data pipelines using Dagster and dbt acro ...
1 month ago
You design build and operate reliable ETL pipelines Your work turns raw data into usable trusted datasets for analytics and products · Develop and maintain ETL ELT pipelines from multiple sources · Model clean and transform data for analytics operational use · Monitor data quali ...
1 month ago