- Well versed in parsing and synthesizing of XML and/or JSON documents.
- Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
- Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
- Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
- Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
- Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
- Must have experience extracting text and images from PDF files
- Knowledge of Puppeteer or other automatable web client technologies
- Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)
- Solid experience with Python and Python Libraries such as Pandas, requests, etc
- Skill set should match up with required responsibilities listed above
- Strong English skills (e.g. grammatical analysis and rhetorical structure)
- Team Player
- Great communication skills
- Experience within the Pharmaceutical Space
- Ability to expose data via C# NETCore and/or GraphQL
- Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
- Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
- Python BeautifulSoup
- Scrapy
- Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
- Multithreading concepts
-
Data Engineering Manager
1 week ago
MyFitnessPal Austin, United StatesAt MyFitnessPal, we believe health starts with what you eat. We provide tools, resources and support to enable users to reach their health goals. The Marketing team at MyFitnessPal collaborates with all business units to help drive our business forward and help our users achieve ...
-
Data Research Engineering/scientist Associate Ii
2 weeks ago
University of Texas at Austin Austin, United StatesJob Posting Title: · Data Research Engineering/Scientist Associate II, Department of Population Health, Dell Medical School · - Hiring Department: · Department of Population Health · - Position Open To: · All Applicants · - Weekly Scheduled Hours: · 40 · - FLSA Status: · Exempt · ...
-
Data Engineer
3 weeks ago
Smart IT Frame LLC Austin, United StatesDear Partner, · Greetings from Smart IT Frame, Hope you are doing well · About Our Company · Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it's for permanent staffing, contract staffing, contract-to-hire or executive search, we unde ...
-
Data Engineer
2 weeks ago
XeoMatrix Austin, United StatesData Engineer · We are currently seeking an experienced data engineer with 5 - 7 years with hands-on data engineering experience. This candidate must possess technical, business analysis, and communication skills. This position offers an opportunity to work directly with clients ...
-
Data Engineer
2 weeks ago
X-Bow Systems Austin, United StatesJob Description · Job DescriptionCompany Overview: · X-Bow Launch Systems, Inc. is a cutting-edge aerospace technology company at the forefront of revolutionizing space launch and transportation. With a commitment to innovation and a mission to advance space exploration, we are a ...
-
Data Engineer
2 weeks ago
Vaco Austin, United StatesResponsibilities: · Assembling mixed sets of data that meet non-functional and functional business requirements. · Identifying, designing, and implementing internal process improvements including re-designing · infrastructure for greater scalability, optimizing data delivery, and ...
-
Data Engineer
1 week ago
Russell Tobin Austin, United StatesJob Description · Job DescriptionLocation: Remote/Prefers someone to work in the central time zone · Pay Range: $ /hour W2 · Contract Duration: 12+ Potential to extend · Summary: · Client Commerce Engineering Operations is building next-generation business analytics and decision ...
-
Data Engineer
3 weeks ago
Teacher Retirement System of Texas Austin, United StatesLocation: · 1000 Red River · Austin, Texas, 78701 · United States · Data Engineer (intermediate or Senior) - Hybrid · Requisition ID: · req1056 · Employment Type: · Unclassified Regular Full-Time (URF) · Division: · Enterprise Data & Analytics · Compensation: · 85, ,6 ...
-
Data Engineer
2 weeks ago
Dropbox Austin, United StatesCompany Description · Dropbox is a special place where we are all seeking to fulfill our mission to design a more enlightened way of working. We're looking for innovative talent to join us on our journey. The words shared by our founders at the start of Dropbox still ring true to ...
-
Data Engineer
2 weeks ago
Loxo Austin, United StatesAs an early hire to our engineering team, you will be responsible for managing Loxo's data integration function. You will be primarily responsible for migrating new clients' legacy data from their previous recruitment platform to Loxo and will work closely with the Customer Succe ...
-
Data Engineer
4 weeks ago
VMC Soft Technologies, Inc Austin, United StatesTitle: Data Engineer (Spark and Scala) · Location: Austin, TX / Sunnyvale, CA · W2 CONTRACT · JOB DESCRIPTION: · Required Qualifications: · Bachelor's degree or foreign equivalent required from an accredited institution. · At least 8 years of experience in Information Technology. ...
-
Data Engineer
2 weeks ago
VMC Soft Technologies, Inc Austin, United States· Title: Data Engineer (Spark and Scala) · Location: Austin, TX / Sunnyvale, CA(Hybrid-3 days in a week) · W2 Contract · Required Qualifications: · Bachelor's degree or foreign equivalent required from an accredited institution. · NO C2C · At least 8 years of experience in Infor ...
-
Data Engineer
2 weeks ago
Gunderson Dettmer Austin, United StatesJob Description · Job DescriptionGunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, ...
-
Data Engineer
2 weeks ago
Pitney Bowes Austin, United StatesAt Pitney Bowes, we do the right thing, the right way. As a member of our team, you can too. · We have amazing people who are the driving force, the inspiration and foundation of our company. Our thriving culture can be broken down into four components: Client. Team. Win. Innovat ...
-
Data Engineer
3 weeks ago
Teacher Retirement System of Texas Austin, United StatesLocation: · 1000 Red River · Austin, Texas, 78701 · United States · Data Engineer (intermediate or Senior) - Hybrid · Requisition ID: · req1056 · Employment Type: · Unclassified Regular Full-Time (URF) · Division: · Enterprise Data & Analytics · Compensation: · 85, ,6 ...
-
Data Engineer
4 weeks ago
Apple Austin, United StatesSummary · Posted: Apr 24, 2024 · Weekly Hours: 40 · Role Number: · At Apple, we work every day to create products that enrich people's lives Our Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on ...
-
Data Engineer
3 weeks ago
Trident Consulting Austin, United StatesTrident Consulting is seeking a "Data Engineer" for one of our clients in "Austin, TX - Hybrid 3 days office in a week " A global leader in business and technology services. · Role: Data Engineer · Location: Austin, TX - Hybrid 3 days office in a week · Duration: Contract · Q ...
-
Data Engineer
2 weeks ago
Diverse Lynx Austin, United StatesRole : Data Engineer · Location: Austin/ Sunnyvale, CA (Onsite) · Contract · Key skills: Python, Kube, Big Data, AlgoCD and AirFlow · * Experience in monitoring and troubleshooting large scale data platforms, data pipelines, complex backend services · * Able to effectively ...
-
Data Engineer
3 weeks ago
SailPoint Technologies Holdings, Inc. Austin, United StatesFull-time role for recent or upcoming graduates who have graduated in 2023 until June 2024. · About the Sail-U Program: · Sail-U is a multi-week immersive program held at our HQ in Austin, TX where you can expect to learn about Identity Access Management and SailPoint's produ ...
-
Data Engineer
4 weeks ago
Vaco Austin, United StatesTitle: Data Engineer - Remote · Pay/Salary/Benefits/Perks: Up to $150k/yr · Work from Home Policy: Fully Remote · Interview Process: Streamlined process, 3 interviews · Key Skills: 6+ years of experience in data engineering, Azure, ETL · Responsibilities: · Lead a team of enginee ...
Data Engineer - Austin, United States - OneSource Regulatory
Description
Job Description
Job DescriptionSalary:Company Introduction
OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team
Job Description
OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.
We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases. The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data. This role requires extreme attention to detail to ensure data quality is top priority.
Responsibilities
Skills
Bonus Skills