Jobs
>
Dallas

    Spark/Big Data Developer - Dallas, United States - Theron Solutions

    Default job background
    Description

    JOB DESCRIPTION:

    • The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform.
    • Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment.

    RESPONSIBILITIES:

    • Technical expertise with distributed Spark or other distributed data processing technologies
    • Work with large, complex data sets and high throughput data pipelines that meet business requirements.
    • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
    • Build data and analytics tools that utilize the data pipeline to provide actionable insights to operational efficiency and other key business performance metrics.
    • Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.
    • Collaborate with data scientists and architects on several projects.
    • Solve various complex problems.
    • Designing processes to integrate data from multiple sources to facilitate client centric advanced analytics.
    • Developing efficient, scalable and repeatable processes to transform data into insight on regular basis.

    QUALIFICATIONS:

    • Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering
    • Previous experience as a data engineer or in a similar role
    • 5+ years of Python development experience is necessary.
    • Hands-on experience with database technologies (e.g. SQL and NoSQL)
    • Experience building high throughput data pipelines.
    • Technical expertise with distributed Spark or other distributed data processing technologies
    • Experience with machine learning techniques.
    • Great numerical and analytical skills
    • Ability to write reusable code components.
    • Open-minded to the new technologies, frameworks
    • Thorough business analysis skills
    • Understanding Blockchain system mechanism
    • Knowledge of data preparation techniques to aid statistical analysis.
    • Results-oriented self-starter who is confident in defending his/her critical thinking abilities.

    Must have:

    • Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering
    • Ability to write reusable code components
    • 5+ years of Python development experience
    • Technical expertise with distributed Spark
    • Spark Batch Processing
    • Spark Stream processing
    • Data warehousing in advanced NoSQL datastores
    • Building high throughput data pipelines
    • Machine Learning techniques
    • Great numerical and analytical skills
    • Knowledge of data preparation techniques to aid statistical analysis

    Nice to have:

    • Understanding Blockchain system mechanism

    Equal Opportunity Employer:

    Our client is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: We are committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at our client are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. We will not tolerate discrimination or harassment based on any of these characteristics.



  • Midas Consulting Dallas, United States

    Role: Data Architect and Developer · Location: Centennial, CO, Onsite) · Salary: $100,000 - $130,000/year · Client: Hireify · Required: Experience with a variety of SDLC tools and software development languages including Java (Spring framework), JavaScript, HTML5, CSS, Angular ...


  • Vsion Technologies Inc Dallas, United States

    Position : Data Stage Developer (Control M Exp) Location: Dallas, TX/Chicago, IL/Memphis, TN Duration : Long term Rate: $60/Hr on C2C · Required: · Having 8+ yrs. of total experience in data warehouse projects and 4-5 yrs as in Control-M · Strong understanding of job scheduling ...


  • Midas Consulting Dallas, United States

    Role: Data Architect and Developer · Location: Centennial, CO, Onsite) · Salary: $100,000 - $130,000/year · Client: Hireify · Required: · Experience with a variety of SDLC tools and software development languages including Java (Spring framework), JavaScript, HTML5, CSS, Angular, ...


  • JobRialto Dallas, United States

    · Must have's: · Python (or maybe Scala) · SQL · Big data · Cloud (can be other cloud although AWS is nice) · Space:Multiple teams are hiring-example, surveillance algorithm team , ETL heavy team, etc. The work is similar. · Interview process: L1 (45+min: Will be technical ...


  • ApTask Dallas, United States

    Job Description · 15+ years of Overall experience · 6-8 years of data migration experience preferably with some Telcom data migration experience Having earlier experience as a Business Analyst on Telcom domain · Ability to present senior management with an overall status and abi ...


  • NR Consulting Dallas, United States

    Job Title: Big Data Engineer Tech Lead · Duration: FTE / Permanent Hiring · Location: Dallas TX · Description: · Education: Minimum Bachelor's degree in Computer Science, Engineering, Business Information Systems, or related field. Masters in Computing related to scalable and d ...


  • Diverse Lynx Dallas, United States

    Position: Spark/Big Data Developer · Location: Dallas, TX · Duration: Full Time (Permanent Position) · JOB DESCRIPTION: Expertise in Data Engineering . Hands-on experience in design and development of big data platform . · Deep understanding of modern data processing techn ...


  • American Auto Shield Dallas, United States

    ** Jr Data Warehouse Developer** · **Job Category****:** Data Governance **Requisition Number****:** JRDAT002011 Showing 1 location **Job Details** · **Description** · **Azure. SQL Server. BI.** · If this grabbed your attention, come grow with us · American Auto Shield (AAS) ...


  • Saxon Global Dallas, United States

    USC/ GC / H4ead · Buying-60 · The role is 100% remote, and is a 12 month contract to extend. The rate for this position is about $70/hr C2C. Please let me know if you have any questions, and I am looking forward to reviewing potential candidates. Thank you · Job Description: ...


  • Syntricate Technologies Dallas, United States

    Required Technical Skills: · Power BI, SSRS, Strong SQL, (good to have SSAS and SSIS) · Roles and Responsibilities: · Build and maintain Power BI and SSRS Reports ,Optimize SQL queries · Engineer scalable, reliable, and performant systems to manage reports · Develop, implemen ...


  • Unidor Consulting LLC Dallas, United States Full time

    Unidor Consulting is a premier staffing and consulting company with a dedicated team of professionals ready to help clients find the right talent and job seekers find their dream jobs. With our deep industry knowledge and innovative strategies, we serve a wide range of sectors, s ...


  • Snaphunt Dallas, United States Full time

    The Offer · Hiring for a Reputed Company · The Job · Hadoop: · Data extraction, Data Science/modeling, someone who can mentor junior developers. 9+ years of experience on pure Hadoop. Understand concept of HDFS, map reduce, Scala, big data architecture. Working knowledge of Tabl ...


  • PIH Health Dallas, United States

    Do you enjoy food service and are passionate about animals, education or conservation? This could be the perfect position for you As a Foods Team Member, your mission provides a great guest experience to our guests through all food and beverage activities. You will be responsible ...


  • Tekfortune Inc Dallas, United States

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the ...


  • Phaxis Dallas, United States

    Big Data Developer and Analysis Engineer · Dallas TX-Hybrd · MANDARIN SPEAKING is preferred · $85,000-110,000 Base + Great Benefits · We are seeking a Big Data Developer and Analysis Engineer to join our team based in the Dallas, TX, United States. You will be responsible for de ...


  • CSG Talent Dallas, United States

    Our Client is a leading player in the Data Centre sector, committed to driving innovation and sustainability. · Role Overview: As the Technical Program Director (Generation), you will spearhead self-generation projects across North America, playing a pivotal role. You will be re ...


  • Aggreko Dallas, United States

    At Aggreko, we provide energy solutions so communities can thrive, and businesses can grow. We bring power, heat, and cooling to customers and communities wherever they need it.We are immediately hiring a Business Development Manager in our Data Center Sector- a role that will he ...


  • Aggreko Dallas, United States

    At Aggreko, we provide energy solutions so communities can thrive, and businesses can grow. We bring power, heat, and cooling to customers and communities wherever they need it. · We are immediately hiring a Business Development Manager in our Data Center Sector- a role that will ...


  • Danfoss Dallas, United States

    Job Description · Danfoss Drives is currently looking for our next Data Center Business Development Manager. North America is one of Danfoss Drives "High Growth Regions". We are THE leading manufacturer of Variable Frequency Drives (VFDs) with more than 30m Drives manufactured gl ...

  • MCKESSON

    Data Engineer

    4 days ago


    MCKESSON Dallas, United States Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...