Jobs
>
New York City

    Web Scraping Specialist - New York, United States - Wynd Labs

    Wynd Labs
    Wynd Labs New York, United States

    3 days ago

    Default job background
    Description

    Job Description

    Job DescriptionWeb Scraping Specialist

    $75k – $125k
    • 0.06% – 3.0%

    Wynd is an early-stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such as our first product, Grass.

    Grass is a network sharing application that allows users to sell their unused internet bandwidth.

    Your day-to-day:

    • Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
    • Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
    • Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
    • Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
    • Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.

    What experience you'll need:

    • Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.

    Technical requirements:

    • Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
    • Knowledge of asynchronous programming, multithreading, and distributed scraping.
    • In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
    • Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.

    Bonus points:

    • Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
    • Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
    • Active participation in open-source projects related to web scraping, data processing, or similar fields.

    Apply

    Our hiring process prioritizes a paid work trial over a traditional interview process.

  • Wynd Labs

    Web Scraping Specialist

    1 day ago

    Wynd Labs New York, United States

    Job Description · Job DescriptionWeb Scraping Specialist$75k – $125k · • 0.06% – 3.0% · Wynd is an early-stage startup empowering access to public web data. Wynd Labs enables access to public web data through decentralized data scraping tools such as our first product, Grass. · ...

  • Aurora Technologies

    Painter and varnisher

    1 week ago

    Aurora Technologies Hallett, United States

    Reference: To strengthen our team, we are looking for a painter and decorator (m/f/d) as a renovation specialist in full-time for our Saarbrücken branch starting as soon as possible in the department of renovation technology. · Your responsibilities: · - Exclusively reconstructio ...

  • Haworth

    Machine Operator 3

    1 week ago

    Haworth Holland, United States

    Company Overview · We Look Forward to Meeting You · We know finding the right job that fits your life is important. If you're looking for a manufacturing role in a company that offers a diverse and inclusive work environment, stability, competitive wages, and growth opportunities ...

  • Synovos

    Inventory Specialist

    3 days ago

    Synovos New York, United States

    Inventory Specialist · Job Description · **WHAT WE DO:** · Synovos is a rapidly growing leader and global provider of comprehensive supply chain services that drive increased productivity and profitability for our clients, including: Supply Chain Services, Asset Services, Mast ...

  • Crown Cork & Seal USA, Inc.

    systems integration specialist

    4 days ago

    Crown Cork & Seal USA, Inc. , PA, United States

    Crown Cork & Seal, Inc. - Yardley Corporate Office · Good Things Come in Our Packages... · Crown Cork & Seal, Inc. is a Fortune 500 Manufacturing Company with a rich history dating back to 1892. As a global leader in the packaging industry, we operate in over forty-five countries ...

  • Data Dome Inc

    Technical Account Manager

    1 week ago

    Data Dome Inc New York, United States

    ☆ About the team: Welcome to the DataDome Customer Delivery department Our mission is to provide a white-glove onboarding experience on Day 1 and ensure customers are properly enabled to operate the product alongside us Day 2 and beyond. Thanks to a fantastic international team, ...

  • NovaWorks Solutions

    Tiler (m/f/d)

    1 week ago

    NovaWorks Solutions Suffern, United States

    Reference: To strengthen our team, we are looking for a tile layer (m/f/d) as a renovation specialist in full-time for our new branch in Berlin II in the department of renovation technology. · Your responsibilities: · - Exclusively reconstruction activities at constantly changing ...

  • Guy Carpenter

    Senior Software Engineer, Data Strategy

    6 days ago

    Guy Carpenter New York, United States OTHER

    Guy Carpenter is searching for a Senior Software Engineer, who can be based in our New York City office in a hybrid schedule. · What can you expect? · The Senior Software Engineer position in the Data Strategy team at Guy Carpenter ("GC") presents a chance to create and execute ...

  • United Nations Development Programme

    UNDP Internship, Sustainable Finance Data Analyst

    1 day ago

    United Nations Development Programme New York, United States InternshipSHIP

    United Nations Development Programme · Background · UNDP is the knowledge frontier organization for sustainable development in the UN Development System and serves as the integrator for collective action to realize the Sustainable Development Goals (SDGs). · The UNDP Sustainable ...