Data Engineer II - Lamar, United States - Money Fit by DRS
Description
The Data Engineer II plays an important role within Dataworks, focused on delivering engineering innovation within Dataworks, helping to execute the delivery of key business initiatives.
The Data Engineer II will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components.
S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing.
Day-to-day, s/he will be deeply involved in code development and medium-scale deployments. Under general supervision, supports the design, build, test, and maintenance of data pipelines at big data scale. Assists with updating data from multiple data sources.Other functionalities under general supervision include working on batch processing of collected data and matching its format to the stored data, making sure that the data is ready to be processed and analyzed.
Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and providing L3 support.
Provides recommendations to moderately complex issues.Responsibilities:
Utilize data analysis skillset for adhoc and planned data analysis and visualization
Perform data engineering pipeline integration supporting Data Scientists
Building tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisions
Scaling up from "laptop-scale" to "cluster scale" problems, in terms of both infrastructure and problem structure and technique
Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines
Following best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases
Interacting with peer technologists from the broader enterprise and outside of FedEx (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systems
Skills:
Experience with Data Governance offerings such as: Collibra, Ab Initio, Purview or similar tools
Technical background in computer science, software engineering, database systems, distributed systems
Experience with distributed and cloud environments and an adequate understanding of how to balance computational considerations with theoretical properties
Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferred
Experience with designing and deploying large scale technical solutions, which deliver tangible, ongoing value
Direct experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scale
Ability to context-switch, to provide support to dispersed teams which may need an "expert hacker" to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined
Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value
An 'engineering' mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact
Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews
Ability to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access
Use of agile and devops practices for project and software management including continuous integration and continuous delivery
Demonstrated expertise working with some of the following common languages and tools:
Apache Spark (Scala and PySpark), Azure Databricks, SQL, Python, Data Visualization, Knowledge in exploratory data analysis skillset will be a plus.
Springboot, AKS, HDFS, Kafka and other high volume data toolsADO pipelines, Storage tools, such as MySQL and Postgres.
Log Analytics, terraform, APIM, Maven, TensorFlow, Jupyter and other Python data tools
Data Engineer II Minimum Qualifications:
Bachelor's Degree in Computer Science, Information Systems, a related quantitative field such as Engineering or Mathematics or equivalent formal training or work experience.
Two to three (2-3) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics.
Strong knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines.
Strong knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies like Springboot, AKS, Azure Databricks, Redis and ADO pipelines. Experience as a member of multi-functional project teams using Log Analytics, PostgreSql, terraform, APIM and Maven. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements.Sponsorship is not available for Data Engineer II role.
Data Engineer I Minimum Qualifications:
Bachelor's Degree in Computer Science, Information Systems, a related quantitative field such as Engineering or Mathematics or equivalent formal training or work experience.
Strong knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines.
Strong knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies like Springboot, AKS, Azure Databricks, Redis and ADO pipelines. Experience as a member of multi-functional project teams using Log Analytics, PostgreSql, terraform, APIM and Maven. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements.Sponsorship is not available for Data Engineer I role.
Domicile Information:
This position can be domiciled anywhere in the United States. The ability to work remotely within the United States may be available based on business need.
Application Criteria:
Upload current copy of Resume (Microsoft Word or PDF format only) and answer job screening questionnaire by March 26, 2024.
Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Compensation:
Monthly Salary:
$6, $8, This compensation range is provided as a reasonable estimate of the current starting salary range for this role. Factors that may be used to determine your actual salary may include but are not limited to your specific skills, your work location, how many years of experience you have, and comparison to other employees already in this role.
Born out of FedEx, a pioneer that ships nearly 20 million packages a day and manages endless threads of information, FedEx Dataworks is an organization rooted in connecting the physical and digital sides of our network to meet today's needs and address tomorrow's challenges.
We are creating opportunities for FedEx, our customers, and the world at large by:Exploring and harnessing data to define and solve true problems;
Removing barriers between data sets to create new avenues of insight;
Building and iterating on solutions that generate value;
Acting as a change agent to advance curiosity and performance.
At FedEx Dataworks, we are making supply chains work smarter for everyone.
Employee Benefits:
medical, dental, and vision insurance; paid Life and AD&D insurance; tuition reimbursement; paid sick leave; paid parental leave, paid vacation, paid military leave, and additional paid time off; geographic pay ranges; 401k with Company match and incentive bonus potential; sales Incentive compensation for selling roles.
Dataworks does not discriminate against qualified individuals with disabilities in regard to job application procedures, hiring, and other terms and conditions of employment.
Further, Dataworks is prepared to make reasonable accommodations for the known physical or mental limitations of an otherwise qualified applicant or employee to enable the applicant or employee to be considered for the desired position, to perform the essential functions of the position in question, or to enjoy equal benefits and privileges of employment as are enjoyed by other similarly situated employees without disabilities, unless the accommodation will impose an undue hardship.
If a reasonable accommodation is needed, please contact#J-18808-Ljbffr