- Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
- Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
- Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
- Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
- Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.
- Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
- Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
- Knowledge of asynchronous programming, multithreading, and distributed scraping.
- In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
- Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.
- Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
- Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
- Active participation in open-source projects related to web scraping, data processing, or similar fields.
-
Web Scraping Specialist
2 weeks ago
Wynd Labs New York, United StatesJob Description · Job DescriptionWeb Scraping Specialist$75k – $125k · • 0.06% – 3.0% · Wynd is an early-stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such as our first product, Grass. ...
-
Painter and varnisher
3 weeks ago
Aurora Technologies Hallett, United StatesReference: To strengthen our team, we are looking for a painter and decorator (m/f/d) as a renovation specialist in full-time for our Saarbrücken branch starting as soon as possible in the department of renovation technology. · Your responsibilities: · - Exclusively reconstructio ...
-
Apprentice Butcher
2 weeks ago
FRESH DIRECT, LLC Bronx, United StatesResponsibilities and Working Conditions: · - Cut, trim, scrape and boat various cuts of meat or poultry · - Prepare special cuts of meats ordered by customers · - Shape, lace and tie roasts, using boning knife, skewer and twine · - Prepare marinated value-added items, and prepare ...
-
Machine Operator 3
3 weeks ago
Haworth Holland, United StatesCompany Overview · We Look Forward to Meeting You · We know finding the right job that fits your life is important. If you're looking for a manufacturing role in a company that offers a diverse and inclusive work environment, stability, competitive wages, and growth opportunities ...
-
Inventory Specialist
2 weeks ago
Synovos New York, United StatesInventory Specialist · Job Description · **WHAT WE DO:** · Synovos is a rapidly growing leader and global provider of comprehensive supply chain services that drive increased productivity and profitability for our clients, including: Supply Chain Services, Asset Services, Mast ...
-
systems integration specialist
2 weeks ago
Crown Cork & Seal USA, Inc. , PA, United StatesCrown Cork & Seal, Inc. - Yardley Corporate Office · Good Things Come in Our Packages... · Crown Cork & Seal, Inc. is a Fortune 500 Manufacturing Company with a rich history dating back to 1892. As a global leader in the packaging industry, we operate in over forty-five countries ...
-
Technical Account Manager
1 week ago
Data Dome Inc New York, United States☆ About the team: Welcome to the DataDome Customer Delivery department Our mission is to provide a white-glove onboarding experience on Day 1 and ensure customers are properly enabled to operate the product alongside us Day 2 and beyond. Thanks to a fantastic international team, ...
-
Technical Account Manager
3 weeks ago
Data Dome Inc New York, United States☆ About the team: Welcome to the DataDome Customer Delivery department Our mission is to provide a white-glove onboarding experience on Day 1 and ensure customers are properly enabled to operate the product alongside us Day 2 and beyond. Thanks to a fantastic international team, ...
-
Specialist Metrics and Analytics
1 week ago
THE BANK OF NEW YORK MELLON CORPORATION New York, United StatesThe Bank of New York Mellon seeks a Specialist, Metrics and Analytics in New York, NY to define, create, and maintain a meaningful set of metrics and analyze business intelligence data to inform business and product decisions. Establish relationships to obtain data needed for met ...
-
Tiler (m/f/d)
2 days ago
NovaWorks Solutions Suffern, United StatesReference: To strengthen our team, we are looking for a tile layer (m/f/d) as a renovation specialist in full-time for our new branch in Berlin II in the department of renovation technology. · Your responsibilities: · - Exclusively reconstruction activities at constantly changing ...
-
Senior Software Engineer, Data Strategy
3 weeks ago
Guy Carpenter New York, United States OTHERGuy Carpenter is searching for a Senior Software Engineer, who can be based in our New York City office in a hybrid schedule. · What can you expect? · The Senior Software Engineer position in the Data Strategy team at Guy Carpenter ("GC") presents a chance to create and execute ...
-
United Nations Development Programme New York, United States InternshipSHIPUnited Nations Development Programme · Background · UNDP is the knowledge frontier organization for sustainable development in the UN Development System and serves as the integrator for collective action to realize the Sustainable Development Goals (SDGs). · The UNDP Sustainable ...
-
Automotive Lot Attendant
5 days ago
Bedfordjeep New York, United States**Automotive Lot Attendant - Bedford Hills, New York, United States** · Job Type: Full Time · Category: Automotive,Detail,Lot Attendant,Porter · Published: · Job Location: Bedford Hills, New York, United States · **Job Description** · **Automotive Porter Lot Attendant** · ...
-
move2usajobs Inc New York, United StatesWe are sourcing IT professionals for our Partner AI recruiting Job Portal. All the IT techies with at least 3 years of correspondent exrerience are welcome. To get the application link please send an email to admin at work-visa-usa-jobs dot com with a subject "IT JOB" and you wil ...
-
Wildland Fire Suppression Specialist
1 week ago
State of Oregon Astoria, United StatesJob Description: · Real Jobs. Real Impact. Are you up to the Challenge? · Click here: · Our Mission – To serve the people of Oregon by protecting, managing, and promoting stewardship of Oregon's forests to enhance environmental, economic, and community sustainability. · You'll ...
Web Scraping Specialist - New York, United States - Wynd Labs
Description
Job Description
Job DescriptionWeb Scraping Specialist$75k – $125k
• 0.06% – 3.0%
Wynd is an early-stage startup empowering access to public web data. Wynd Labs enables access to public web data through decentralized data scraping tools such as our first product, Grass.
Grass is a network sharing application that allows users to sell their unused internet bandwidth.
Your day-to-day:
What experience you'll need:
Technical requirements:
Bonus points:
Apply
Our hiring process prioritizes a paid work trial over a traditional interview process.