- As a Data Engineering Consultant specializing in Data Warehouse Migration, you will be at the forefront of our efforts to transition our data ecosystem to a more efficient and modern platform.
- Your expertise in data engineering, AWS cloud technologies, and migration strategies will be crucial in ensuring a seamless migration process. Collaborating closely with cross-functional teams, you'll design, implement, and optimize ETL pipelines, enabling the secure and accurate transfer of data to our new AWS-based data warehouse environment.
- BachelorÂÂÂs or masterÂÂÂs degree in computer science, Data Engineering, or a related field.
- Strong proficiency in Python and shell scripting, with a focus on software engineering best practices and a deep understanding of development lifecycle.
- Experience with stream processing technologies, preferably Kafka.
- Familiarity with Avro data serialization format and its usage in data engineering workflows.
- Expertise in using Databricks platform on AWS for data processing and analytics.
- Solid understanding of data warehousing concepts and experience with Delta Lake and Parquet files.
- Proficiency in SQL and experience with relational databases.
- Strong testing skills, with experience in implementing and executing unit tests, integration tests, and end-to-end tests using Python packages such as pytest.
- Familiarity with the Python ecosystem, including PyPI packages and their integration into data engineering workflows.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Strong communication skills and ability to effectively communicate complex technical concepts to non-technical stakeholders.
- Working experience with BI tools such as Power BI and Tableau
- Experience with ETLs and job orchestration tools such as AirFlow
- Working experience with cloud services such as AWS
- Experience working with Databricks
- Proficiency working with very large data sets
- Proficiency with SQL
-
Consulting Systems Engineer
1 week ago
Fortinet Boston, United StatesSupport sales activities as a strategic and high-level technical resource supporting vital pre-sales engagements and key opportunities. · Responsibilities: · Develop and maintain: · Core competency on Fortinet's enhanced tech product line and technologies · Expert-level techn ...
-
Consulting Systems Engineer
1 week ago
Fortinet Boston, United StatesSupport sales activities as a strategic and high-level technical resource supporting vital pre-sales engagements and key opportunities. · Responsibilities: · Develop and maintain: · Core competency on Fortinet's enhanced tech product line and technologies · Expert-level technica ...
-
Senior Risk Engineering Consultant
1 week ago
The Hartford Boston, United StatesSr Consultant Risk Engineering - KR08DE · Consultant II Risk Engineering - KR08ME · We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - a ...
-
Structural Engineer/Restoration Consultant
1 week ago
Walker Parking Consultants Boston, United StatesRestoration Consultant · Work Location: 1075 Main Street, Suite 410, Waltham, MA · Employment Type: Full-time regular · About This Opportunity · In this role, your time will be spent researching, analyzing, and solving structural deficiencies involving high-rises, historical buil ...
-
Consulting Engineer, Building Technology
1 week ago
Simpson Gumpertz and Heger Inc Boston, United StatesDo you want to help engineer what's next? · Simpson Gumpertz & Heger (SGH) is a national engineering firm committed to delivering holistic advice for our clients' most complex challenges. We leverage our collective and diverse experience, technical expertise, and industry knowl ...
-
Structure and Design Consulting Engineer
6 days ago
Quest Defense Systems & Solutions, Inc. Boston, United StatesQuest Defense is an organization at the forefront of innovation and one of the world's fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are part of a twenty-five-year-old company on a journe ...
-
Structure and Design Consulting Engineer
1 week ago
Quest Defense Systems & Solutions, Inc. Boston, United StatesQuest Defense is an organization at the forefront of innovation and one of the world's fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are part of a twenty-five-year-old company on a journe ...
-
Code Consultant and Fire Protection Engineer
1 week ago
Tetra Tech Boston, United StatesTetra Tech's High Performance Buildings Group brings together the expertise of talented engineers, commissioning agents, and energy analysts from around the world. We offer high-end, sustainable building consulting and MEP engineering services for blue-chip clients across every b ...
-
Code Consultant and Fire Protection Engineer
1 week ago
Tetra Tech Boston, United StatesTetra Tech's High Performance Buildings Group brings together the expertise of talented engineers, commissioning agents, and energy analysts from around the world. We offer high-end, sustainable building consulting and MEP engineering services for blue-chip clients across every b ...
-
Sr. Consulting Engineer, Building Technology
1 week ago
Simpson Gumpertz and Heger Inc Boston, United StatesDo you want to help engineer what's next? · Simpson Gumpertz & Heger (SGH) is a national engineering firm committed to delivering holistic advice for our clients' most complex challenges. We leverage our collective and diverse experience, technical expertise, and industry knowl ...
-
Sr Process Engineering Consultant I
3 days ago
Project Farma Boston, United StatesThis role can involve up to 100% Travel · Project Farma (PF) is the leading advanced therapy technical operations consulting company in the life science industry. We provide biomanufacturing strategy and execution to start up and established gene and cell therapy, pharmaceutical ...
-
Tetra Tech Boston, United StatesTetra Tech's High Performance Buildings Group brings together the expertise of talented engineers, commissioning agents, and energy analysts from around the world. We offer high-end, sustainable building consulting and MEP engineering services for blue-chip clients across every b ...
-
HATCH Boston, United StatesRequisition ID: 91881 Job Category: Infrastructure Location: Boston, MA, United States Join a company that is passionately committed to the pursuit of a better world through positive change. With more than 65 years of business and technical expertise Electrical Engineer, Operatio ...
-
Syska Hennessy Group, Inc. Boston, United StatesSenior Electrical Engineer - Critical Facilities · Watch your work come to life in landmark projects around the world when you partner with Syska Hennessy Group As a global leader in consulting, engineering, and commissioning services, we specialize in MEP, information and commun ...
-
Travel Nurse RN
2 hours ago
Planet Healthcare Boston, United StatesJob Description · Planet Healthcare is seeking a travel nurse RN Maternal - Newborn for a travel nursing job in Boston, Massachusetts. · Job Description & RequirementsSpecialty: Maternal - Newborn · Discipline: RN · Start Date: 06/09/2024 · Duration: 13 weeks · 40 hours per week ...
-
O&M Energy Consultant
6 days ago
Leidos Holdings Inc. Boston, United States· Looking for an opportunity to make an impact? · At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, and operate sustainably. Everythi ...
-
Mechanical Engineer
2 weeks ago
Fortify Technical Staffing Boston, United States· Mechanical Engineer · Boston, MA (Downtown between the Waterfront and Faneuil Hall) · Direct Hire/ Permanent Placement, Hybrid, Full Benefits, ESOP · $80k - $150k · Fortify Technical Staffing works with Architectural, Engineering, and Construction Firms and MEP Consultanci ...
-
Senior Fire Protection Engineer
1 day ago
Buro Happold Boston, United StatesFire Protection Engineering at Buro Happold has developed significantly and we now have fire engineers located across the US, with additional capabilities in the UK and the Middle East. A combination of international experience and local knowledge enables our engineers to respond ...
-
CSV Engineer
1 week ago
Trinity Consultants Boston, United StatesCSV Engineer · This is a hybrid role in the Boston area. Only candidates with Biopharmaceutical experience will be contacted. · ADVENT Engineering is an engineering and consulting firm providing expertise to the pharmaceutical and biotechnology industries. Headquartered near Sa ...
-
Senior Energy Engineer
1 week ago
Climeaction Boston, United StatesCompany Description · Climeaction is an innovative, independent firm dedicated to accelerating decarbonization through business innovation. Specializing in Energy, Carbon, and ESG solutions, we guide businesses in navigating the complexities of sustainable transformation. We hav ...
Data Engineering Consultant - Boston, United States - Ask Staffing
Description
Job Title:
Data Engineering Consultant
Duration: 5 months
Work Location:
Open to 100% Remote
Job Description:
What are the 3-5 Â nice to haveÂÂ attributes that would separate a successful candidate from their competition when interviewing?
What are the top three must-haves you will be looking for in the resumes/interviews for this role?
What business unit is this supporting?
This is for Currenex
Is it supporting a specific project or initiative? If so, which one and in what way?
This resource will be helping with Migration of Currenex BI warehouse to Databricks
What type of software skills is an absolute must have?
Python, pyspark and SQL
Who will be responsible for interviewing?
The hiring manager will perform the first round
My team members will conduct the second round - technical interview
Members of CurreneX dev team conduct the third rounds - practical programming skills test
What will the interview process entail (phone screen, face to face, meet with team, how many rounds, etc).
What will the interview look like? Is there a test in the interview the candidate should be prepared for? All interviews are phone/virtual interviews.
We ask candidates to keep their cameras open at all times. The skill test will be done over a whiteboard software over internet where candidate will be able to write code and explain the logicWill this position be remote, hybrid, or 5 days onsite?
Open to remote or hybrid.
Preference is to have the candidate where Currenex has offices (Boston, New York, San Francisco) but fully remote is also an option.
There is no need for candidate to be onsite.If the position is fully remote, do you have a preference on where the contractor is located? (State/Time zone)?
United States - can be located in any time zone
What are the working hours? What timezone?
Flexible (9-5) local time
Will this contractor need their own laptop or will client provide one for them?
Contractor will be provided with a client issued laptop
Will there be any training provided or would the need to jump right in first day?
Currenex Data Engineering will provide enough training to get the new candidate on track with existing framework and SDLC
Who will be training the new hire?
Currenex Data Engineering team
What type of background would you like this person to have?
Software development and Data Engineering
How many years experience?
5 years
What is the day to day of the person going to look like? Be specific.
Will be coding pyspark jobs to run on Databricks to prepare silver or gold delta tables for BI team
When will you be interviewing for this position? Please provide specific days/times if possible.
All interviews will be performed during PT working hours (pacific timezone)
