- The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform.
- Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment.
- Technical expertise with distributed Spark or other distributed data processing technologies
- Work with large, complex data sets and high throughput data pipelines that meet business requirements.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Build data and analytics tools that utilize the data pipeline to provide actionable insights to operational efficiency and other key business performance metrics.
- Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.
- Collaborate with data scientists and architects on several projects.
- Solve various complex problems.
- Designing processes to integrate data from multiple sources to facilitate client centric advanced analytics.
- Developing efficient, scalable and repeatable processes to transform data into insight on regular basis.
- Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering
- Previous experience as a data engineer or in a similar role
- 5+ years of Python development experience is necessary.
- Hands-on experience with database technologies (e.g. SQL and NoSQL)
- Experience building high throughput data pipelines.
- Technical expertise with distributed Spark or other distributed data processing technologies
- Experience with machine learning techniques.
- Great numerical and analytical skills
- Ability to write reusable code components.
- Open-minded to the new technologies, frameworks
- Thorough business analysis skills
- Understanding Blockchain system mechanism
- Knowledge of data preparation techniques to aid statistical analysis.
- Results-oriented self-starter who is confident in defending his/her critical thinking abilities.
- Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering
- Ability to write reusable code components
- 5+ years of Python development experience
- Technical expertise with distributed Spark
- Spark Batch Processing
- Spark Stream processing
- Data warehousing in advanced NoSQL datastores
- Building high throughput data pipelines
- Machine Learning techniques
- Great numerical and analytical skills
- Knowledge of data preparation techniques to aid statistical analysis
- Understanding Blockchain system mechanism
-
Data Architect and Developer
2 weeks ago
Midas Consulting Dallas, United StatesRole: Data Architect and Developer · Location: Centennial, CO, Onsite) · Salary: $100,000 - $130,000/year · Client: Hireify · Required: Experience with a variety of SDLC tools and software development languages including Java (Spring framework), JavaScript, HTML5, CSS, Angular ...
-
Data Stage Developer
1 week ago
Vsion Technologies Inc Dallas, United StatesPosition : Data Stage Developer (Control M Exp) Location: Dallas, TX/Chicago, IL/Memphis, TN Duration : Long term Rate: $60/Hr on C2C · Required: · Having 8+ yrs. of total experience in data warehouse projects and 4-5 yrs as in Control-M · Strong understanding of job scheduling ...
-
Data Architect and Developer
2 weeks ago
Midas Consulting Dallas, United StatesRole: Data Architect and Developer · Location: Centennial, CO, Onsite) · Salary: $100,000 - $130,000/year · Client: Hireify · Required: · Experience with a variety of SDLC tools and software development languages including Java (Spring framework), JavaScript, HTML5, CSS, Angular, ...
-
Senior Big Data Developer
6 days ago
JobRialto Dallas, United States· Must have's: · Python (or maybe Scala) · SQL · Big data · Cloud (can be other cloud although AWS is nice) · Space:Multiple teams are hiring-example, surveillance algorithm team , ETL heavy team, etc. The work is similar. · Interview process: L1 (45+min: Will be technical ...
-
Lead Data Migration Developer
1 week ago
ApTask Dallas, United StatesJob Description · 15+ years of Overall experience · 6-8 years of data migration experience preferably with some Telcom data migration experience Having earlier experience as a Business Analyst on Telcom domain · Ability to present senior management with an overall status and abi ...
-
Big Data Developer Lead
3 weeks ago
NR Consulting Dallas, United StatesJob Title: Big Data Engineer Tech Lead · Duration: FTE / Permanent Hiring · Location: Dallas TX · Description: · Education: Minimum Bachelor's degree in Computer Science, Engineering, Business Information Systems, or related field. Masters in Computing related to scalable and d ...
-
Spark / Big Data Developer
3 weeks ago
Diverse Lynx Dallas, United StatesPosition: Spark/Big Data Developer · Location: Dallas, TX · Duration: Full Time (Permanent Position) · JOB DESCRIPTION: Expertise in Data Engineering . Hands-on experience in design and development of big data platform . · Deep understanding of modern data processing techn ...
-
Jr Data Warehouse Developer
2 weeks ago
American Auto Shield Dallas, United States** Jr Data Warehouse Developer** · **Job Category****:** Data Governance **Requisition Number****:** JRDAT002011 Showing 1 location **Job Details** · **Description** · **Azure. SQL Server. BI.** · If this grabbed your attention, come grow with us · American Auto Shield (AAS) ...
-
SQL Developer/Data Analyst
4 weeks ago
Saxon Global Dallas, United StatesUSC/ GC / H4ead · Buying-60 · The role is 100% remote, and is a 12 month contract to extend. The rate for this position is about $70/hr C2C. Please let me know if you have any questions, and I am looking forward to reviewing potential candidates. Thank you · Job Description: ...
-
Power BI/Data Developer
1 week ago
Syntricate Technologies Dallas, United StatesRequired Technical Skills: · Power BI, SSRS, Strong SQL, (good to have SSAS and SSIS) · Roles and Responsibilities: · Build and maintain Power BI and SSRS Reports ,Optimize SQL queries · Engineer scalable, reliable, and performant systems to manage reports · Develop, implemen ...
-
Hadoop or Big Data Developer
3 weeks ago
Unidor Consulting LLC Dallas, United States Full timeUnidor Consulting is a premier staffing and consulting company with a dedicated team of professionals ready to help clients find the right talent and job seekers find their dream jobs. With our deep industry knowledge and innovative strategies, we serve a wide range of sectors, s ...
-
Hadoop or Big Data Developer
3 weeks ago
Snaphunt Dallas, United States Full timeThe Offer · Hiring for a Reputed Company · The Job · Hadoop: · Data extraction, Data Science/modeling, someone who can mentor junior developers. 9+ years of experience on pure Hadoop. Understand concept of HDFS, map reduce, Scala, big data architecture. Working knowledge of Tabl ...
-
Product Data Development Specialist
2 weeks ago
PIH Health Dallas, United StatesDo you enjoy food service and are passionate about animals, education or conservation? This could be the perfect position for you As a Foods Team Member, your mission provides a great guest experience to our guests through all food and beverage activities. You will be responsible ...
-
Informatica cloud data integration Developer
2 weeks ago
Tekfortune Inc Dallas, United StatesTekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the ...
-
Big Data Developer and Analysis Engineer
3 weeks ago
Phaxis Dallas, United StatesBig Data Developer and Analysis Engineer · Dallas TX-Hybrd · MANDARIN SPEAKING is preferred · $85,000-110,000 Base + Great Benefits · We are seeking a Big Data Developer and Analysis Engineer to join our team based in the Dallas, TX, United States. You will be responsible for de ...
-
Data Center Director of Utility Development
2 weeks ago
CSG Talent Dallas, United StatesOur Client is a leading player in the Data Centre sector, committed to driving innovation and sustainability. · Role Overview: As the Technical Program Director (Generation), you will spearhead self-generation projects across North America, playing a pivotal role. You will be re ...
-
Business Development Manager, Data Centers
5 days ago
Aggreko Dallas, United StatesAt Aggreko, we provide energy solutions so communities can thrive, and businesses can grow. We bring power, heat, and cooling to customers and communities wherever they need it.We are immediately hiring a Business Development Manager in our Data Center Sector- a role that will he ...
-
Business Development Manager, Data Centers
5 days ago
Aggreko Dallas, United StatesAt Aggreko, we provide energy solutions so communities can thrive, and businesses can grow. We bring power, heat, and cooling to customers and communities wherever they need it. · We are immediately hiring a Business Development Manager in our Data Center Sector- a role that will ...
-
Data Center Business Development Manager
2 weeks ago
Danfoss Dallas, United StatesJob Description · Danfoss Drives is currently looking for our next Data Center Business Development Manager. North America is one of Danfoss Drives "High Growth Regions". We are THE leading manufacturer of Variable Frequency Drives (VFDs) with more than 30m Drives manufactured gl ...
-
Data Engineer
4 days ago
MCKESSON Dallas, United States Full timeMcKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...
Spark/Big Data Developer - Dallas, United States - Theron Solutions
Description
JOB DESCRIPTION:
RESPONSIBILITIES:
QUALIFICATIONS:
Must have:
Nice to have:
Equal Opportunity Employer:
Our client is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: We are committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at our client are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. We will not tolerate discrimination or harassment based on any of these characteristics.