- Design, construct, install, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
- Implement data ingestion routines both real-time and batch using best practices in data modeling, ETL/ELT processes, SQL, and Oracle.
- Work collaboratively with data scientists to design and develop datasets for analysis and operational use.
- Optimize data pipelines and architect scalable and performant databases.
- Monitor data performance and modify infrastructure as needed.
- Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
- Work closely with team members to identify ways to improve data reliability, efficiency, and quality.
- Deploy sophisticated analytics programs, machine learning, and statistical methods.
- Bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Demonstrated interest or experience in a Data Engineering role.
- Advanced working SQL knowledge and experience working with relational databases, as well as working familiarity with a variety of databases.
- Experience building and optimizing 'big data' data pipelines, architectures, and data sets.
- Strong analytic skills related to working with unstructured datasets.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Proficient in scripting languages (Python, Java, Scala)
- Expertise in SQL and database design
- Experience with big data technologies (Hadoop, Spark, Kafka)
- Familiarity with cloud services (AWS, Azure, GCP)
- Knowledge of ETL techniques and frameworks (Airflow, NiFi)
- Strong analytical and problem-solving abilities
- Excellent communication and teamwork skills
- Attention to detail
- Ability to handle multiple projects and prioritize tasks
- Adaptable and willing to learn new technologies
- Competitive salary and bonus structure
- Comprehensive health, dental, and vision insurance
- 401(k) plan with company match
- Generous paid time off and flexible working conditions
- Professional development opportunities
- Remote work options
-
Data Engineering
1 day ago
Understood New York, United States**About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...
-
Senior Data Engineer
1 week ago
Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United StatesDas kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...
-
IT Data Center Engineer
5 days ago
CBRE New York, United StatesTeilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...
-
Data Engineer
1 day ago
ESB Technologies New Jersey, United StatesOnly apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...
-
Data Engineer
1 week ago
Stealth AI Startup New York, United StatesAre you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...
-
Data Engineer
1 week ago
Social Capital Resources New York, United StatesData Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...
-
Data Engineer
3 days ago
Beauty by Imagination (BBI) New York, United StatesBeauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...
-
Data Engineer
5 days ago
Oxford Knight New York, NY, United States Full timeData Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...
-
Data Engineer
2 days ago
Open Systems Technologies New York, United StatesA financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...
-
Data Engineer
3 days ago
Codex Tech-it New York, United StatesJob Description · Job DescriptionCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a st ...
-
Data Engineer
3 days ago
NR Consulting New York, United StatesData Engineer SME · Location: NYC / Charlotte (Candidate should be open for hybrid work model) · Duration: 12 months · Responsibilities: · A background in financial services, investment banking, regulated sectors and large enterprise · DevOps and Agile engineering practitioner w ...
-
Data Engineer
3 days ago
Oakridge Staffing New York, United StatesGlobal hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...
-
Data Engineer
3 days ago
Benchmark IT - Technology Talent New York, United StatesOur direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer to join the Data and Analytics team. This role will help build the infrastructure to make data a central part of the firm. Data driven decisions are very critical for the business, as ...
-
Data Engineer
1 day ago
ExodusPoint New York, United StatesABOUT EXODUSPOINT · ExodusPoint Capital, founded in 2017 by Michael Gelband and Hyung Lee, began managing investor capital in 2018. The firm employs a global multi-strategy investment approach, seeking to deliver compelling asymmetric returns by combining complementary liquid str ...
-
Data Engineer
3 days ago
Net2Source Inc. New York, United StatesW2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...
-
Data Engineer
3 days ago
iO Associates - US New York, United StatesAn exciting Cloud Cybersecruity start up is looking for a talented Data Engineer to join their team based in New York City. The firm has recently secured new seed funding and are working on not just detecting cloud cybersecurity problems but solving them as well. · The ideal cand ...
-
Data Engineer
4 days ago
OTG New York, United StatesYOUR NEXT OPPORTUNITY IS NOW BOARDING: · Join OTG as the Data Engineer – FLO Solutions now at PAS( Home Office) and drive a new type of hospitality. Explore career opportunities in a unique hospitality environment with some of the industry's best compensation and benefits, includ ...
-
Data Engineer
6 days ago
The New York Public Library New York, United StatesOverview · This is a temporary four-year grant-funded position. · The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you'll have the opportunity to contribute to new and existing data pipelines that help the library unde ...
-
Data Engineer
5 days ago
Numeus New York, United StatesNumeus is a diversified digital asset investment firm built to the highest institutional standards, combining synergistic businesses across Trading, Alpha Strategies, Asset Management, and Venture Capital . · Numeus was founded by successful executives with decades of experience ...
-
Data Engineer
1 week ago
Qloo Inc. New York, United StatesThe Company You'll Join · At Qloo, our cutting-edge Taste AI technology leverages extraordinary amounts of data-over half a billion records of public figures, places, and things, plus a globe-spanning consumer behavior and sentiment database-to unearth deep insights about consum ...
Data Engineer - New York, United States - augmentjobs
Description
Job Description
Job DescriptionLocation: United States (Remote option available)
Job Type: Full-time
Salary Range: $90,000 - $130,000 per year
Company Overview:We are a leading technology firm that specializes in big data solutions and advanced analytics to drive business transformations. Our company is dedicated to innovation, quality, and providing state-of-the-art data services to our clients across various industries.
Job Summary:As a Data Engineer, you will be integral to our operations, focusing on optimizing our data management and pipeline architecture. This role requires someone who is proficient in building scalable data platforms, ensuring efficient data integration and maintaining the overall architecture. You will collaborate closely with data scientists and analysts to support our analytics platform and contribute to our strategic data initiatives.
Responsibilities:Please submit a detailed resume and a cover letter that highlights your experience and skills in data engineering, specifically your work with large data sets, real-time processing, and cloud-based infrastructure. Applications should be submitted through our company's career portal.
We are an equal opportunity employer and value diversity. All employment is decided based on qualifications, merit, and business need.