- Experience in designing and hands-on development in cloud-based analytics solutions.
- Expert-level understanding of Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
- Designing and building data pipelines using API ingestion and Streaming ingestion methods.
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
- Experience in developing NO SQL solutions using Azure Cosmos DB is essential.
- Thorough understanding of Azure Cloud Infrastructure offerings.
- Strong experience in common data warehouse modeling principles including Kimball, and Inmon.
- Experience in additional Modern Data Platforms technologies such as Snowflake, Matillion, BryteFlow, and Tableau are a distinct advantage.
- Knowledge of Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, and Power BI is desirable.
- Knowledge of Microsoft BI Stack (SSRS/SSAS (Tabular with DAX & OLAP with MDX) SSIS) is desirable.
- Working knowledge of Python is desirable.
- Create and maintain optimal data pipeline architecture,
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
-
Data Engineer
5 days ago
Lawrence Harvey Boston, United StatesData Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline for ...
-
Data Engineer
2 weeks ago
Whitridge Associates Boston, United StatesOur ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...
-
Data Engineer
1 week ago
Aptonet Inc Boston, United StatesSenior Data Engineer · Location- Onsite in Boston · Top 3 skills: SQL, Data Analysis, Capital Markets, Snowflake · JD- Ability to analyze and organize raw data. Transform large, complex sets of data to meet non-functional and functional business requirements · Versed in extractio ...
-
Data Engineer
1 week ago
Lawrence Harvey Boston, United StatesData Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline for ...
-
Data Engineer
5 days ago
Jellyfish Boston, United StatesAs a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, t ...
-
Data Engineer
1 week ago
StartUs GmbH Boston, United StatesWe are looking for a data engineer that will build data-driven solutions to deliver podcast experiences to our 170+ million active users by analysing our on-platform usage data, understanding our data from an off-platform perspective and improving the accuracy and precision of ou ...
-
Data Engineer
5 days ago
Datadog Boston, United StatesMetering Platform creates the data processing pipelines that measure our customers' usage across all Datadog products, providing vital insights to a broad variety of users and internal stakeholders. The team is at the leading edge of any new product we release at Datadog. As a Da ...
-
Data Engineer
1 week ago
Found Energy Boston, United StatesCompany Overview: · Found Energy is building clean energy delivery platforms capable of replacing fossil fuels for heavy industries ranging from aluminum production (4% of global CO2 emissions) to fertilizer production (2% of global CO2 emissions) to maritime shipping (3% of glo ...
-
Data Engineer
2 weeks ago
Activate Global, Inc. Boston, United StatesBenefits Overview: · Health, dental, 20 days PTO, 11 holidays, 12 weeks paid parental leave, stock options, professional development budget, and more. · Job Overview: · Found Energy is seeking a talented Data Engineer with a minimum of 2 years of industry experience to join ou ...
-
Data Engineer
1 week ago
Lawrence Harvey Boston, United StatesData Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline f ...
-
Data Engineer
2 weeks ago
Lawrence Harvey Boston, United StatesData Engineer (Energy) · Apply promptly A high volume of applicants is expected for the role as detailed below, do not wait to send your CV. · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Dat ...
-
Data Engineer
5 days ago
OneSource Regulatory Boston, United StatesCompany Introduction · OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team · Job Description · ...
-
Data Engineer
5 days ago
Northeastern University Boston, United StatesAbout the Opportunity · The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in h ...
-
Data Engineer
1 week ago
Selby Jennings Boston, United StatesA top Quantitative Asset Manager in Boston is seeking a Data Engineer to create and deploy SQL and Python solutions tailored for their Portfolio Management, Operations, Marketing, and Client Reporting teams. · Qualifications: · Possess 2-5 years of experience in SQL and Python pr ...
-
Data Engineer
1 week ago
Diverse Lynx Boston, United StatesTitle: Data Engineer - Neo4J Graph DB · Location: Boston, MA (Remote) · Type : Contract · Job Description: · Data Engineer - Neo4J Graph DB · Job Description : John Hancock US D ta Office is looking for an exceptional data engineer (Neo4j Graph DB) to lead the discovery of h ...
-
Data Engineer
5 days ago
Drum Associates Boston, United StatesWe're looking for a Data Engineer to join a Fortune 100, mission-driven team in Boston, MA who has a passion for building reliable and scalable systems. In this role, you will be part of an innovative technology group who's focused on creating their next generation of leaders. · ...
-
Data Engineer
1 week ago
TEKsystems Boston, United States: · THIS IS A 100% ONSITE ROLE 5 DAYS A WEEK IN THE GREATER BOSTON AREA. · The customer is actively seeking an Azure Data Engineer to design, building, and manage data solutions on the Microsoft Azure cloud platform. You will oversee creating and maintaining data pipelines, dat ...
-
Data Engineer
6 days ago
Veeva Boston, United StatesVeeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth pot ...
-
Data Engineer
2 weeks ago
Whitridge Associates Boston, United StatesOur ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...
-
Data Engineer
1 week ago
Whitridge Associates Boston, United StatesOur ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...
Data Engineer - Boston, United States - TEKsystems
Description
:THIS IS A 100% ONSITE ROLE 5 DAYS A WEEK IN THE GREATER BOSTON AREA.
The customer is actively seeking an Azure Data Engineer to design, building, and manage data solutions on the Microsoft Azure cloud platform.
You will oversee creating and maintaining data pipelines, data storage solutions, data processing, and data integration to enable data-driven decision-making inside the organization as well as maintaining the infrastructure that supports data storage, processing, and retrieval.
They will work with large data sets and develop data pipelines that move data from source systems to data warehouses, data lakes, and other data storage and processing systems.
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the data architecture and data-driven solutions.
Skills:Data Management and Storage:
Microsoft Azure offers a variety of data storage options, including Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, and more.
The Azure Data Engineer will work with these and other solutions.
Will need experience in designing data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.
ETL:
To extract, transform, and load (
ETL) data from various sources into data warehouses or data lakes, data engineers develop and implement data integration processes, frequently using Azure Data Factory.
Will handle and analyze enormous volumes of data, Azure Data Engineers use big data technologies like Azure Databricks and Apache Spark.
To support data analytics, machine learning, and other data-driven applications, they create data processing workflows and pipelines.Additional Skills & Qualifications:
automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity.
We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.
As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change.
That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
