- Developing Data Pipelines: Designing and implementing scalable data pipelines using Databricks on AWS infrastructure leveraging Python and Spark.
- Data Ingestion: Managing the ingestion of structured and unstructured data from various sources into Databricks clusters on AWS, ensuring data quality and reliability.
- Data Processing: Performing data processing tasks, such as data transformation, cleansing, aggregation, and enrichment using Databricks tools and AWS services like EMR (Elastic MapReduce).
- Optimization and Performance Tuning: Optimizing Databricks jobs and clusters for performance, efficiency, and cost-effectiveness on the AWS platform.
- Integration: Integrating Databricks with other AWS services such as S3, Glue, Redshift, and Lambda to build end-to-end data solutions.
- Monitoring and Maintenance: Monitoring Databricks clusters, jobs, and workflows for performance issues, troubleshooting errors, and ensuring high availability and reliability.
- Security and Compliance: Implementing security best practices and ensuring compliance with data privacy regulations (e.g., GDPR, CCPA) in Databricks deployments on AWS.
- Collaboration: Collaborating with data engineers, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Documentation: Documenting Databricks workflows, architecture, and best practices to facilitate knowledge sharing and maintain system documentation.
- Continuous Learning: Keeping up-to-date with the latest advancements in Databricks, AWS services, and data engineering technologies to continuously improve skills and contribute to innovation in data solutions.
-
AWS Developer
5 days ago
System Soft Technologies Dallas, United StatesEssential Functions · • Understanding story requirements, creating required tasks, and implementing solutions or fixes as required. · • Production issue identification and resolution for both customer-facing and internal applications. · • Trace and remediate issues with system i ...
-
AbInitio developer with Aws
1 week ago
Pro Integrate Dallas, United StatesAbInitio developer with Aws experience required (10+) · Dallas, TX - Hybrid - (Need locals only) · Need 10+ years of experienced AbInitio developer with Aws · ...
-
Sr AWS Developer
3 weeks ago
Hitachi Data Systems Dallas, United StatesJob ID: · 1028975DS · Date Posted: · May 1, 2024 · Segment: · Digital System & Service · Business Unit: · Hitachi Services & Platforms · Company Name: · Hitachi Digital Services · Profession (Job Category): · Engineering & Science · Job Type (Experience Level): · Experienc ...
-
DataBricks Developer on AWS
3 weeks ago
Infinite Computer Solutions (ICS) Dallas, TX, United StatesDeveloping Data Pipelines: Designing and implementing scalable data pipelines using Databricks on AWS infrastructure leveraging Python and Spark. · Data Ingestion: Managing the ingestion of structured and unstructured data from various sources into Databricks clusters on AWS, ens ...
-
Java AWS Developer
1 week ago
ApTask Dallas, United StatesAbout Client: · The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT ...
-
Sr AWS Developer
2 weeks ago
Hitachi Digital Services Dallas, United StatesWe're Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world's potential. We're people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save live ...
-
Sr AWS Developer
2 weeks ago
Hitachi Dallas, TX, United StatesWe're Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world's potential. We're people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save live ...
-
Senior AWS Developer
1 week ago
Hitachi Digital Services Dallas, United StatesResponsibilities: · Analyzes production applications and services issues and determines the most efficient and economical programming solutions. · Perform change management activities such as source code management, creating activity records for production implementation, creatin ...
-
Sr AWS Developer
4 weeks ago
Hitachi Digital Services Dallas, United StatesWe're Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world's potential. We're people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save live ...
-
Java AWS Developer
2 weeks ago
ApTask Dallas, United StatesAbout Client: · The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the I ...
-
Java AWS Developer
2 days ago
ApTask Dallas, United StatesAbout Client: · The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT ...
-
Full stack Developer with AWS
1 week ago
Futran Solutions Dallas, United StatesRole: Full stack Developer with AWS · Location: Plano, T · Mandatory Skills:- AWS (EC2, ECS, S3, CloudWatch, SQS , SNS, AWS Lambda) Spring boot, Java 8/11, Microservices and Angular (If full stack) · At least 9+ years of Programming experience with Java, J2EE, XML, and Web Servic ...
-
Full stack Developer with AWS
6 days ago
Futran Solutions Dallas, United StatesRole: Full stack Developer with AWS · All candidates should make sure to read the following job description and information carefully before applying. · Location: Plano, T · Mandatory Skills:- AWS (EC2, ECS, S3, CloudWatch, SQS , SNS, AWS Lambda) Spring boot, Java 8/11, Micros ...
-
Full stack Developer with AWS
1 week ago
Futran Solutions Dallas, United StatesRole: Full stack Developer with AWS · Location: Plano, TX · Mandatory Skills:- AWS (EC2, ECS, S3, CloudWatch, SQS , SNS, AWS Lambda) Spring boot, Java 8/11, Microservices and Angular (If full stack) · At least 9+ years of Programming experience with Java, J2EE, XML, and Web Servi ...
-
AbInitio developer with Aws experience
1 week ago
Pro Integrate Dallas, United StatesHi , · Greetings from Pro Integrate Consulting · Hope you are doing well. · Job Title :AbInitio developer with Aws experience · Dallas, TX - Hybrid - (Need locals only) · Mode of hire :C2C · Need 10+ years of experienced AbInitio developer with Aws · Any visa is fine, expect op ...
-
Senior NodeJS/AWS Developer
4 days ago
JobRialto Dallas, United States: · Must Have: · Core NodeJS development · Typescript · AWS experience including the following: · Lambda, API Gateway, S3, IAM, CloudWatch, Step Functions, SNS/SQS, EventBridge, CloudFormation and ECS · Serverless Framework or AWS SAM (Serverless Application Model) for depl ...
-
AWS Full Stack Developer
2 weeks ago
System Soft Technologies Dallas, United StatesPosition Summary: · As a AWS Full Stack Developer, you will be responsible for developing and maintaining full stack solutions for both customer-facing and internal applications. The company is a startup financial services firm with $1 billion in assets under management. The co ...
-
AWS Full Stack Developer
4 weeks ago
Selby Jennings Dallas, United StatesFintech Startup | AWS Full Stack Engineer · Selby Jennings is with a Dallas-based fintech startup that provides liquidity solutions to high-networth individuals and institutional investors in alternative assets. Currently, they have over $900M in permanent equity capital and prov ...
-
Senior Java/AWS Developer
1 week ago
Vlink Dallas, United StatesJob Title:Senior Java/AWS Developer · Location:Dallas, Texas, United States · Duration:Long Term · About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our i ...
-
AWS Full Stack Developer
2 weeks ago
System Soft Technologies Dallas, United StatesPosition Summary: · As a AWS Full Stack Developer, you will be responsible for developing and maintaining full stack solutions for both customer-facing and internal applications. The company is a startup financial services firm with $1 billion in assets under management. The co ...