- Designing, developing, and maintaining automated data pipelines using Python, Spark, PySpark, and related technologies
- Ensuring data quality by being proactive in catching and rectifying quality issues in underlying data
- Collaborating with data scientists and other engineers to define data requirements and structures
- Writing unit tests and conducting system testing to ensure the reliability and integrity of data
- Optimizing data pipelines for maximum speed, scalability, and accuracy
- Staying up to date with emerging trends and technologies in data engineering, data processing, distributed computing, and data quality assurance
- Bachelor's degree in computer science, software engineering, or a related field
- Experience with Spark, PySpark, or other data processing frameworks
- Experience with SQL and NoSQL database technologies
- Experience with automating data processing through Python libraries like Airflow
- Strong problem-solving and analytical skills with keen attention to detail
- Experience with AWS or other cloud platforms
- Ability to manage multiple projects simultaneously and meet tight deadlines
- Competitive salary and equity package, and holistic perks and benefits, including:
- 100% health insurance coverage, with ability to join group dental and vision for a nominal fee
- Team lunches every Thursday in NYC office
- 4% 401K matching
- 20 paid time off days
- 5 paid sick days
- 12 weeks of paid parental leave
- 10+ annual company holidays
- Opportunities for professional development and growth within a dynamic environment
- A supportive and inclusive company ethos where your ideas are valued, your contributions are recognized, and your impact is tangible
- The chance to be part of a small but mighty team that's making waves in the industry and shaping the future of technology
- Beautiful HQ in Soho, NYC with the opportunity to work in-office, if desired
-
Data Engineering
2 weeks ago
Understood New York, United States**About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...
-
Engineering Contractor, Data
1 week ago
EQUINOX New York, United States Freelance**Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...
-
Data Engineering Director
1 week ago
FanDuel New York, United States**ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...
-
Specialist - Data Engineering
1 week ago
LTIMindtree New York, United States**Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...
-
Junior Data Engineering Specialist
6 days ago
STV Group New York, United StatesWe are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...
-
Senior Data Engineer
3 weeks ago
Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United StatesDas kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...
-
IT Data Center Engineer
2 weeks ago
CBRE New York, United StatesTeilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...
-
Data Engineer
4 days ago
Hunter Bond New York, United StatesJob title: Data Engineer · Client: Elite Fintech · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes ...
-
Data Engineer
2 weeks ago
ESB Technologies New Jersey, United StatesOnly apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...
-
Data Engineer
2 weeks ago
Beauty by Imagination (BBI) New York, United StatesBeauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...
-
Data Engineer
6 days ago
iCapital New York, United StatesiCapital is powering the world's alternative investment marketplace. Our financial technology platform has transformed how advisors, wealth management firms, asset managers, and banks evaluate and recommend bespoke public and private market strategies for their high-net-worth cli ...
-
Data Engineer
2 weeks ago
Benchmark IT - Technology Talent New York, United StatesOur direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer to join the Data and Analytics team. This role will help build the infrastructure to make data a central part of the firm. Data driven decisions are very critical for the business, as ...
-
Data Engineer
2 days ago
Hunter Bond New York, United StatesJob title: Data Engineer · Client: Elite Quantitative Trading Firm · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loadin ...
-
Data Engineer
3 weeks ago
Social Capital Resources New York, United StatesData Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...
-
Data Engineer
2 weeks ago
OTG New York, United StatesYOUR NEXT OPPORTUNITY IS NOW BOARDING: · Join OTG as the Data Engineer – FLO Solutions now at PAS( Home Office) and drive a new type of hospitality. Explore career opportunities in a unique hospitality environment with some of the industry's best compensation and benefits, includ ...
-
Data Engineer
2 weeks ago
Jane Street New York, United States Full timeAbout the Position · We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. · Using our mix of in-house and op ...
-
Data Engineer
1 week ago
Atlantic Group New York, United StatesOur client, a high-profile equities investment management firm with over $400B in AUM with offices in San Francisco, NYC, Shanghai, Hong Kong, Tokyo and London, is hiring · They are looking for a talented full-time Data Developer/Engineer to work out of their NYC office (hybrid c ...
-
Data Engineer
2 weeks ago
Sisense New York, United StatesDRIVE TECHNICAL OUTCOMES FOR OUR CLOUD CUSTOMERS · Data Engineers at Sisense partner with our customers to ensure successful implementation, build meaningful business value to enable retention and expansion by providing professional consulting services. We're looking for an excep ...
-
Data Engineer
2 weeks ago
Net2Source Inc. New York, United StatesW2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...
-
Data Engineer
2 weeks ago
Blackbird New York, United StatesBlackbird.AI helps organizations discover emergent threats and stay one step ahead of real-world harm through our AI-powered Narrative and Risk Intelligence Platform. Our commitment is to prioritize safety and security, providing the tools to identify potential risks and ensure a ...
Data Engineer - New York, United States - Qloo Inc.
Description
The Company You'll Join
At Qloo, our cutting-edge Taste AI technology leverages extraordinary amounts of data-over half a billion records of public figures, places, and things, plus a globe-spanning consumer behavior and sentiment database-to unearth deep insights about consumer preferences.
From understanding global travel trends to curating the perfect restaurant recommendation based on your unique tastes, our Taste AI engine sifts through the noise to find the signals that matter.
And the best part? Qloo's API suite is powered by cultural entities, not personal identities, ensuring our insights are derived without relying on personally identifiable information.
Read more about our recent Series C funding here.The Team You'll Work With
Reporting to the Director of Data Engineering, you'll work cross-functionally across the Engineering organization to emphasize designing and optimizing data processing systems for maximum performance, efficiency, and accuracy.
Our team is composed of top-notch engineers and scientists who are passionate about creating data-driven solutions that make a lasting impact.
We are a growing team dedicated to advancing Taste AI.
Hear what the team has to say - "The team culture at Qloo is highly collaborative and supportive, with a strong emphasis on mutual assistance.
Each team member is approachable and committed to lending a hand, creating an environment where everyone feels supported and valued..." - Sreekant, VP of API Engineering.
The Impact You'll Have
Playing a pivotal role in optimizing data processing systems and emphasizing design, you'll be responsible for architecting, developing, and improving our automated data pipelines.
You understand the intricacies of data quality and have a keen eye for catching and rectifying quality issues in the underlying data.
This position involves utilizing a robust background in data engineering, a solid grasp of data processing technologies like Spark and PySpark, and a passion for ensuring the integrity and accuracy of the data that drives our solutions.
Our ideal candidate will immediately provide value by: