- Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc
- Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics and reporting requirements
- Build and maintain orchestration workflows using Apache Airflow to automate data pipeline execution, scheduling, and monitoring
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions
- Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies
- 8+ years of experience building and deploying large-scale data processing pipelines in a production environment
- Hands-on experience in designing and building data pipelines on AWS cloud infrastructure
- Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc
- Strong experience with Databricks and Apache Spark for data processing and analytics
- Hands-on experience with Apache Airflow for orchestrating and scheduling data pipelines
- Solid understanding of data modeling, database design principles, and SQL
- Experience with version control systems (e.g., Git) and CI/CD pipelines
- Excellent communication skills and the ability to collaborate effectively with cross-functional teams
- Strong problem-solving skills and attention to detail
-
Data Engineering
1 week ago
Understood New York, United States**About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...
-
Engineering Contractor, Data
1 day ago
EQUINOX New York, United States Freelance**Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...
-
Data Engineering Director
4 days ago
FanDuel New York, United States**ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...
-
Specialist - Data Engineering
5 days ago
LTIMindtree New York, United States**Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...
-
Senior Data Engineer
2 weeks ago
Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United StatesDas kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...
-
IT Data Center Engineer
1 week ago
CBRE New York, United StatesTeilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...
-
Data Engineer
2 weeks ago
Lord Abbett & Co. Jersey City, United StatesLord Abbett is looking for a talented and experienced developer to join our development team to support the continued development of our analytics platforms. Besides regular individual contributions, Data Engineers are expected to be deep technical e Data Engineer, Data Architect ...
-
Data Engineer
1 week ago
Expedite Technology Solutions LLC Jersey City, United StatesProvide technical design and develop Extract/Transform/Load (ETL), ELT applications that interface with Datametica's customer applications. · Lead and implement data driven solutions and collaborate with larger development teams · Lead and Develop Test Strategy, Test Plan, Test C ...
-
Data Engineer
1 week ago
Diverse Lynx Jersey City, United StatesJob Title: Data Engineer ( Python + AWS) · Location : Jersey City , NJ (Onsite, Local s only) · Job responsibilities : Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to bui ...
-
Data Engineer
1 week ago
iPivot, LLC Jersey City, United StatesRole: Data Engineer · Fulltime/Contract · Location: New Jersey City, NJ · Hybrid · ...
-
Data Engineer
1 week ago
A.M. Best Jersey City, United StatesOverview · The Data Engineer will build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse. They will develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-arch ...
-
Data Engineer
1 week ago
Jarvis Walker Jersey City, United StatesData Engineer · We are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lin ...
-
Data Engineer
17 hours ago
SANS Jersey City, United StatesJob Title - Data Engineer - Snowflake · Location - Jersey City, NJ (Hybrid) · Duration - 12+ Months · Requirements: · 8 to 10 Yrs IT experience on Data driven initiatives with recent 2-3 Yrs experience in snowflake is mandatory · SQL, Data Warehousing, Data Modeling, Cloud based ...
-
Data Engineer
1 week ago
ClifyX Jersey City, United StatesJob title : Data Engineer - Databricks · Location : New Jersey (Remote) · Duration : Contract / Fulltime · Health Care Company · $75/Hr (Contract) · salary K/Annum (Fulltime) · Job Description: · • Experience with PySpark or Python · • DataBricks experience is mandatory · • Ex ...
-
Data Engineer
1 week ago
Hire Talent Jersey City, United StatesPGIM Fixed Income - Data Engineer · PGIM is the diversified asset management business of Prudential Financial, Inc. (NYSE: PRU). With $1.4 trillion in assets under management, and 38 offices spanning 16 countries, PGIM is among the world's top-10 largest asset managers. Comprised ...
-
Data Engineer
1 week ago
Tradeweb Markets LLC Jersey City, United StatesThe Billing Technology team is responsible for the overall ownership of our internal billing and invoicing systems including the development, quality assurance and operations of the platform. · As a member of this team, you will be able to take in a set of complex requirements a ...
-
Data Engineer
2 weeks ago
EmergiTel Jersey City, United States5+ years of Hands on experience in developing custom connectors and plugins for CyberArk PSM and CPM. · Work on design and development activities for privileged access management function by using programming and scripting languages such as python, PowerShell, TCL, AutoIT, Cyber ...
-
Data Engineer
1 week ago
ICONMA Jersey City, United StatesAbility to find the root cause of the issue and come up with a solution and to use business requirements to document clear and concise technical design. · Hands-on experience in integration development, testing, and deployment experience · Exposure to disparate databases like T ...
-
Data Engineer
1 week ago
EmergiTel Jersey City, United States5+ years of Hands on experience in developing custom connectors and plugins for CyberArk PSM and CPM. · Work on design and development activities for privileged access management function by using programming and scripting languages such as python, PowerShell, TCL, AutoIT, CyberA ...
-
Data Engineer
2 weeks ago
Themesoft Inc. Hoboken, United StatesPosition: Data Engineer · Location: Hoboken, NJ (Hybrid - On-site 2-3 days per week) · Employment Type: Full-time · Requirements: · Proficiency in Python for data manipulation, analysis, and scripting. · Experience with Spark for big data processing and analytics · . · Nice-to-Ha ...
Data Engineer - Jersey City, United States - Tiger Analytics
Description
Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.As an AWS Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on AWS cloud infrastructure. You will work closely with cross-functional teams to support data analytics, machine learning, and business intelligence initiatives. The ideal candidate will have strong experience with AWS services, Databricks, and Apache Airflow.
Key Responsibilities:
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.