Jobs
>
Étreux

    Data Engineer - Boston, United States - OneSource Regulatory

    OneSource Regulatory
    OneSource Regulatory Boston, United States

    5 days ago

    Default job background
    Description

    Company Introduction

    OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team

    Job Description

    OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.

    We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases. The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data. This role requires extreme attention to detail to ensure data quality is top priority.

    Responsibilities

    • Well versed in parsing and synthesizing of XML and/or JSON documents.
    • Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
    • Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
    • Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
    • Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
    • Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
    • Must have experience extracting text and images from PDF files
    • Knowledge of Puppeteer or other automatable web client technologies
    • Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)
    Skills
    • Solid experience with Python and Python Libraries such as Pandas, requests, etc
    • Skill set should match up with required responsibilities listed above
    • Strong English skills (e.g. grammatical analysis and rhetorical structure)
    • Team Player
    • Great communication skills
    Bonus Skills
    • Experience within the Pharmaceutical Space
    • Ability to expose data via C# NETCore and/or GraphQL
    • Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
    • Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
    • Python BeautifulSoup
    • Scrapy
    • Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
    • Multithreading concepts
  • Whitridge Associates

    Data Engineer

    2 weeks ago

    Whitridge Associates Boston, United States

    Our ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...

  • Lawrence Harvey

    Data Engineer

    5 days ago

    Lawrence Harvey Boston, United States

    Data Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline for ...

  • Jellyfish

    Data Engineer

    5 days ago

    Jellyfish Boston, United States

    As a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, t ...

  • Lawrence Harvey

    Data Engineer

    1 week ago

    Lawrence Harvey Boston, United States

    Data Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline for ...

  • Aptonet Inc

    Data Engineer

    1 week ago

    Aptonet Inc Boston, United States

    Senior Data Engineer · Location- Onsite in Boston · Top 3 skills: SQL, Data Analysis, Capital Markets, Snowflake · JD- Ability to analyze and organize raw data. Transform large, complex sets of data to meet non-functional and functional business requirements · Versed in extractio ...

  • Activate Global, Inc.

    Data Engineer

    2 weeks ago

    Activate Global, Inc. Boston, United States

    Benefits Overview: · Health, dental, 20 days PTO, 11 holidays, 12 weeks paid parental leave, stock options, professional development budget, and more. · Job Overview: · Found Energy is seeking a talented Data Engineer with a minimum of 2 years of industry experience to join ou ...

  • Drum Associates

    Data Engineer

    5 days ago

    Drum Associates Boston, United States

    We're looking for a Data Engineer to join a Fortune 100, mission-driven team in Boston, MA who has a passion for building reliable and scalable systems. In this role, you will be part of an innovative technology group who's focused on creating their next generation of leaders. · ...

  • TEKsystems

    Data Engineer

    1 week ago

    TEKsystems Boston, United States

    : · THIS IS A 100% ONSITE ROLE 5 DAYS A WEEK IN THE GREATER BOSTON AREA. · The customer is actively seeking an Azure Data Engineer to design, building, and manage data solutions on the Microsoft Azure cloud platform. You will oversee creating and maintaining data pipelines, dat ...

  • Datadog

    Data Engineer

    5 days ago

    Datadog Boston, United States

    Metering Platform creates the data processing pipelines that measure our customers' usage across all Datadog products, providing vital insights to a broad variety of users and internal stakeholders. The team is at the leading edge of any new product we release at Datadog. As a Da ...

  • StartUs GmbH

    Data Engineer

    1 week ago

    StartUs GmbH Boston, United States

    We are looking for a data engineer that will build data-driven solutions to deliver podcast experiences to our 170+ million active users by analysing our on-platform usage data, understanding our data from an off-platform perspective and improving the accuracy and precision of ou ...

  • TEKsystems

    Data Engineer

    5 days ago

    TEKsystems Boston, United States

    : · THIS IS A 100% ONSITE ROLE 5 DAYS A WEEK IN THE GREATER BOSTON AREA. · The customer is actively seeking an Azure Data Engineer to design, building, and manage data solutions on the Microsoft Azure cloud platform. You will oversee creating and maintaining data pipelines, data ...

  • Found Energy

    Data Engineer

    1 week ago

    Found Energy Boston, United States

    Company Overview: · Found Energy is building clean energy delivery platforms capable of replacing fossil fuels for heavy industries ranging from aluminum production (4% of global CO2 emissions) to fertilizer production (2% of global CO2 emissions) to maritime shipping (3% of glo ...

  • Lawrence Harvey

    Data Engineer

    1 week ago

    Lawrence Harvey Boston, United States

    Data Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline f ...

  • Lawrence Harvey

    Data Engineer

    2 weeks ago

    Lawrence Harvey Boston, United States

    Data Engineer (Energy) · Apply promptly A high volume of applicants is expected for the role as detailed below, do not wait to send your CV. · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Dat ...

  • Northeastern University

    Data Engineer

    5 days ago

    Northeastern University Boston, United States

    About the Opportunity · The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in h ...

  • Diverse Lynx

    Data Engineer

    1 week ago

    Diverse Lynx Boston, United States

    Title: Data Engineer - Neo4J Graph DB · Location: Boston, MA (Remote) · Type : Contract · Job Description: · Data Engineer - Neo4J Graph DB · Job Description : John Hancock US D ta Office is looking for an exceptional data engineer (Neo4j Graph DB) to lead the discovery of h ...

  • Veeva

    Data Engineer

    6 days ago

    Veeva Boston, United States

    Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth pot ...

  • Selby Jennings

    Data Engineer

    1 week ago

    Selby Jennings Boston, United States

    A top Quantitative Asset Manager in Boston is seeking a Data Engineer to create and deploy SQL and Python solutions tailored for their Portfolio Management, Operations, Marketing, and Client Reporting teams. · Qualifications: · Possess 2-5 years of experience in SQL and Python pr ...

  • Whitridge Associates

    Data Engineer

    2 weeks ago

    Whitridge Associates Boston, United States

    Our ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...

  • Whitridge Associates

    Data Engineer

    1 week ago

    Whitridge Associates Boston, United States

    Our ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop ...