- Develop and maintain data platforms using Python, Spark, and PySpark.
- Handle migration to PySpark on AWS.
- Design and implement data pipelines.
- Work with AWS and Big Data.
- Produce unit tests for Spark transformations and helper methods.
- Create Scala/Spark jobs for data transformation and aggregation.
- Write Scaladoc-style documentation for code.
- Optimize Spark queries for performance.
- Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
- Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
- Proficiency in Python, Scala (with a focus on functional programming), and Spark.
- Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
- Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
- Deep understanding of distributed systems.
- Experience with building or maintaining cloud-native applications.
- Familiarity with serverless approaches using AWS Lambda is a plus
-
Python Spark Developer
6 days ago
Mphasis Columbus, United StatesJob Description: · Job Title: Python Developer with Spark · Location: Columbus OH - Hybrid · Need 9+ Years of exp. · • Hands-on object-oriented programming experience using Python is required. · • Professional work experience building real-time data streams using Spark and Experi ...
-
Java Spark Lead Developer
2 weeks ago
Virtusa Columbus, United StatesRoles and Responsibilities - Lead Developer · 12+ years of technical and/or management consulting experience architecting enterprise and application solutions w.r.t designing, developing, and implementing business applications on AWS based solutions · Solid knowledge of Java/Op ...
-
Java Developer with Spark experience
1 month ago
Elite Innovative Solutions Inc Franklin Lakes, United States Part time, contractSolid hands on experience in Java 1.8 above Spring Framework. Experience in J2EE Spring iBatis Flex JBPM RESTful web services SOAP Web Services HTML5 JSON jQuery SQL PLSQL RAD7 SQL Developer Oracle 9i WebSphere8.5 Requirements gathering design and layout development plan for proj ...
-
National Account Manager
3 weeks ago
Haydon Corporation Ohio, United StatesCome Shape the Future with Haydon · At Haydon, we bring the spark that shapes tomorrow's possibilities If you thrive in environments where you are using sales skills to grow strategic accounts, our National Account Manager role might be the perfect fit for you · Responsibilities ...
-
Database Engineer
5 days ago
AllSTEM Connections Columbus, United StatesDATABASE ENGINEER · ON W2 ONLY · HYBRID REPORTING:3DAYS ONSITE · COLUMBUS,OH [local candidates preferable] · Interviews:3 rounds. [3rd Round in person] · SKILLSET NEEDED · Required qualifications, capabilities, and skills. · • 5+ YEARS OF EXPERIENCE ,strong SQL skills; SQL Serve ...
-
BD Franklin Lakes, United States Full timeDescription · We are the makers of possible · BD is one of the largest global medical technology companies in the world. Advancing the world of healthTM is our Purpose, and it's no small feat. It takes the imagination and passion of all of us—from design and engineering to the ...
-
Hybrid - Information Technology Manager 1
3 weeks ago
Ohio Department of Developmental Disabilities Columbus, United StatesPrimary Location · :United States of America-OHIO-Franklin County-Columbus Work Locations · :James A Rhodes Office Tower 3330 East Broad Street33rd FloorColumbus43215 Organization · :Mental Health & Addiction ServicesClassified Indicator:UnclassifiedBargaining Unit / Exemp ...
-
Senior Machine Learning Engineer
1 week ago
MCK McKesson Corporation Columbus, United States Full timeJob title: Senior Machine Learning Engineer · Job Description : · As a Machine Learning Engineer (MLE), you'll be part of a lean software team dedicated to productionizing machine learning applications and systems at scale. You'll participate in the detailed technical design, d ...
-
Analytics Application Designer
3 weeks ago
Gainwell Technologies LLC Ohio, United StatesBe part of a team that unleashes the power of leading-edge technologies to help improve the health and well-being of those most vulnerable in our country and communities. Working at Gainwell carries its rewards. You'll have an incredible opportunity to grow your career in a compa ...
-
Field Service Engineer HW- Columbus, OH
3 weeks ago
0006 Varian Medical Systems Inc, Corp Headquarter Columbus, United States Full timeTogether, we can beat cancer. · At Varian, a Siemens Healthineers Company, we bring together the world's best talent to realize our vision of a world without fear of cancer. Together, we work passionately to develop and deliver easy-to-use, efficient oncology solutions. · We are ...
-
Python Spark
1 week ago
Spruce Infotech Columbus, United StatesResponsibilities: · Develop and maintain data platforms using Python, Spark, and PySpark. · Handle migration to PySpark on AWS. · Design and implement data pipelines. · Work with AWS and Big Data. · Produce unit tests for Spark transformations and helper methods. · Create Scala/S ...
-
Python Spark AWS
3 days ago
Diverse Lynx Columbus, United StatesTitle: Python Developer (With Spark, AWS) · Duration: Contract /Full-Time · Location: Columbus, OH (Onsite) · Interview mode: Video Conference/IN- Person · Joining: ASAP · This is the description . · Job Responsibilities: · Develop and maintain data platforms using Python, ...
-
Data Engineer
2 weeks ago
SoftPathTechnologies Columbus, United StatesJob Description · Job DescriptionData Engineer (Java/Spark/AWS/ETL)Position ResponsibilitiesData Engineer (Java/Spark/AWS/ETL) · Work Location: Columbus, OH ( need local to OH) Hybrid (3 days onsite 2 days Remote) · Experience: looking for a junior profile Minimum 2+ years Requir ...
-
Data Engineer
6 days ago
VeeRteq Solutions Inc. Columbus, United StatesJob Description · Job DescriptionData Engineer · Columbus OH · hybrid · Must have · teradata, DBMS knowledge · - Cloud knowledge - AWS preferably- ETL knowledge- CICD and data warehouse concept- Java & SparkNice To Have- Abinitio- postgres DB knowledge- python Job responsibiliti ...
-
Java J2EE
19 hours ago
Pinnacle Group Columbus, United States"Must be able to work on W2 without sponsorship." · Job Description: Prefer 2 to 7 years of Spark on Cloud development experience · Required 4 to 7 years of strong SQL skills; Teradata is preference but experience in any other RDBMS · Required Core Java Development for 5-8 year ...
-
Databricks Tech Lead
2 weeks ago
Diverse Lynx Columbus, United StatesJob Title: Databricks Tech Lead · Duration: Full Time/ Permanent · Job Location: Columbus, OH · Job DescriptionPython, Databricks, perl, spark , Kubernetes, dockers and other cloud native tools and technologies. · Data warehousing, AWS Cloud Business, Intelligence, Informatica ...
-
Senior Data Engineer
2 days ago
g2o Columbus, United States Full timeYour future starts here · Imagine being part of a team that helps clients build better relationships with customers. When you join us, you'll help top-notch clients to execute the digital strategies of the future. Every day, we collaborate with clients and each other to provide ...
-
Big Data Engineer
1 week ago
Diverse Lynx Columbus, United StatesRole: Big Data Developer · Location: Columbus OH/ Wilmington DE Plano TX( initially Remote) · JD: · Advanced knowledge of application, data and infrastructure architecture disciplines · Experience with AWS, Redshift and Snowflake · Experience with security, isolation and multi ...
-
Data Engineer
2 weeks ago
Infinity Consulting Solutions Columbus, United StatesWe have partnered with our client in their search for a Data Engineer in Columbus, OH · Responsibilities · 4 to 7 years of Spark on Cloud development experience · •4 to 7 years of strong SQL skills; Teradata is preference but experience in any other RDBMS · •Proven experience in ...
-
General Labor
2 days ago
Spark Packaging Columbus, United StatesJob Description · Job Description · Job Title: General LaborLocation: Columbus, OH · We are looking for a Team Member to be a part of our client that is growing rapidly The position will start at $17.50 per hour and the opportunity to be a part of a growing organization with mobi ...
Apptad - Python Spark Developer - Columbus, United States - Apptad Inc
![Default job background](https://contents.bebee.com/public/img/bg-user-ex-1.jpg)
Description
Job Description
Job DescriptionJob Title: Apptad - Python Spark DeveloperJob Location: Columbus, OH (Onsite)
Job Duration: Long-TermJob Description
Job Responsibilities: