- Develop, deploy, and maintain data pipelines using Azure Data Factory and other Azure data services to support business intelligence and analytics needs
- Design, implement, and optimize SQL queries and stored procedures to ensure high performance and data accuracy
- Write efficient, scalable Python code for data processing, transformation, and analysis tasks
- Build and maintain Spark and PySpark workflows for large-scale data processing in distributed environments
- Collaborate with data engineers, data scientists, and business stakeholders to define data requirements and design data models
- Ensure data security and governance by implementing best practices using Azure Security services and managing access controls in Azure Portal
- Monitor, troubleshoot, and optimize the performance of data infrastructure and workflows
- Work with relational and non-relational databases such as MS SQL, PostgreSQL, and Redshift to manage and analyze data
- Support the creation of data visualizations and reports using PowerBI to provide actionable insights
- Stay updated with the latest technologies in data engineering and cloud services; recommend and implement improvements
- 5+ years of expert-level SQL experience
- 3+ years of strong hands-on Python engineering experience
- 2+ years of practical experience with Azure data services, especially Azure Data Factory or Microsoft Fabric
- 2 years of practical experience with Apache Spark, especially PySpark
- Experience working with Azure Security services and managing via Azure Portal
- Knowledge and practical experience in data warehousing, data governance, and data management
- Practical experience with MS SQL
- Practical experience with PostgreSQL
- Practical experience with Amazon Redshift
- Experience with Java and Scala
- Experience with PowerBI
-
Data Engineer
1 month ago
Only for registered members New YorkWe are seeking a Senior Data Engineer to design scalable data pipelines.Our ideal candidate will have experience working with large datasets. · ...
-
Data Engineer
2 weeks ago
Only for registered members New YorkWe are seeking a Senior Data Engineer with strong MongoDB Atlas and Azure data engineering experience to support government clients. · Design, store, and optimize data in MongoDB Atlas, including indexing and performance tuning · Build and maintain ETL pipelines using Azure data ...
-
Data Engineer
1 month ago
Only for registered members New YorkWe are looking for a Data Engineer for our client in New York City. · ...
-
Data Engineer
1 week ago
Only for registered members New YorkAaratech Inc. · is seeking a results-driven Data Engineer – Retail / E-Commerce to support customer, · sales, and product data platforms. · The role focuses on building scalable pipelines that enable real-time and batch analytics for business growth. ...
-
Data Engineer
2 weeks ago
Only for registered members New YorkThis role is central to the firm's data and analytics capability, · supporting investment decision-making, portfolio performance, · and the delivery of data-driven insights across the organisation. · The successful candidate will join a collaborative technology team · and play a ...
-
Data Engineer
1 month ago
Only for registered members New YorkAaratech Inc. is seeking a reliable Data Engineer – Banking & Finance to support financial data platforms and analytics initiatives. · This role focuses on building secure, scalable data pipelines for transactional and financial datasets. · Data Pipeline Development · Data Archit ...
-
Data Engineer
1 month ago
Only for registered members New YorkThe data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. · Designs, develops optimizes maintains data architecture pipelines adhere ELT principles business goals. · Solves complex d ...
-
Data Engineer
1 month ago
Only for registered members New YorkWe are seeking an experienced Senior Data Engineer to build and configure batch and real-time entity resolution solutions on Google Cloud Platform. · Design, develop, and configure Quantexa modules for batch and real-time entity resolution · Build and maintain scalable data pipel ...
-
Data Engineer
1 day ago
Only for registered members New YorkMedReview Innovation and Development team is seeking a data engineer to function as the primary architect and operator of our data infrastructure. Design, implement, and maintain end-to-end data pipelines on Azure; · Manage and optimize ClickHouse as our primary analytical engine ...
-
Data Engineer
1 week ago
Only for registered members New YorkDune Security is seeking a Data Engineer to design and scale the data infrastructure that powers our real-time cybersecurity platform. · ...
-
Data Engineer
2 days ago
Only for registered members New York $150,000 - $160,000 (USD)A Data Engineer will work with various data sets to design prototype and deploy analytical models applications and data visualizations for internal users and customers. · Experience in data engineering/science is required including hands-on development experience using programmin ...
-
Data Engineer
1 month ago
Only for registered members New YorkData engineer responsible for designing developing and maintaining ETL pipelines using AWS Glue glue studio and glue catalog ingest transform and load large datasets into AWS data lakes warehouses build optimize PySpark Scala scripts within AWS Glue implement data quality checks ...
-
Data Engineer
6 days ago
Only for registered members New YorkAll Generation Tech seeks mid-senior Data Engineer/Analytics Engineer with strong hands-on dbt and Snowflake experience to support sustainability-focused team and internal engineering stakeholders by translating business requirements into scalable data models and transformation p ...
-
Data Engineer
1 month ago
Only for registered members New YorkData Engineer responsible for designing building and optimizing high-performance Spark-based data pipelines using Python/PySpark. Develops ETL/ELT workflows for structured semi-structured data deploys manages data workloads on AWS ECS implements ingestion transformation governanc ...
-
Data Engineer
3 weeks ago
Only for registered members New YorkWe are working with a global investment firm building a modern data platform to support research, analytics, · and decision-making across the business.The team designs and operates the core data infrastructure used by engineers and internal users, · with a strong focus on reliabi ...
-
Data Engineer
1 week ago
Only for registered members New YorkYou will work with a variety of data sets to design prototype and deploy analytical models applications and data visualizations for both internal users and customers. · ...
-
Data Engineer
3 weeks ago
Only for registered members New York Full time $120,000 - $160,000 (USD)We are seeking a Data Engineer to join our growing engineering team. You'll be responsible for designing, building and scaling the data infrastructure that powers product insights. · ...
-
Data Engineer
3 weeks ago
Only for registered members New YorkThe team is seeking a Data Engineer to design and scale blockchain data extraction pipelines, integrate with on-chain protocols, and enhance decentralized data infrastructure. · ...
-
Data Engineer
1 day ago
Only for registered members New York $11,458 - $16,041 (USD)We are a builder-led, client-first culture that prizes ownership and shipping high-impact work. · Blue Orange Digital is seeking an experienced Data Engineer with a Financial Services background for a 3–6 month staff augmentation engagement to support existing data workflows and ...
-
Data Engineer
1 week ago
Only for registered members New YorkJoin a team that turns information into insight. · This global investment platform combines fundamental analysis with data science and quantitative techniques. · You will help transform massive datasets into actionable insights for investment professionals. · ...
-
Data Engineering
6 days ago
Only for registered members New York $181,100 - $272,100 (USD)The Data Engineering team at Apple Ads is seeking an ambitious and versatile Data engineer to help lead the design and scale of key data systems delivering data products that solve exciting business problems. · ...
Python Data Engineer - New York - DataArt
Description
ClientOur client is a US-based investment management company listed in the Fortune Global 500. It offers insurance, investment management, and other financial products and services to retail and institutional clients across the United States and over 40 other countries.
Position overview
We are seeking a Python Data Engineer (Azure) to join our team. In this role, you will be responsible for creating Microsoft Fabric pipelines and organizing ETL/ELT processes supporting a leading investment management company. The estimated salary range for this position is 160,000 to 180,000 USD per year. The role is hybrid and requires the ability to visit client office in the Newark, NJ minimum 3 times per week.
Responsibilities
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Full time Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineer
Only for registered members New York
-
Data Engineering
Only for registered members New York