Jobs
>
Dallas

    Big Data Engineer - Dallas, United States - Ushitecsolutions

    Ushitecsolutions
    Ushitecsolutions Dallas, United States

    3 weeks ago

    Default job background
    Description


    The client Corporation is currently seeking an experienced Big Data Engineer Thesuccessful candidate must have Big Data engineering experience and must demonstrate an affinity forworking with others to create successful solutions.

    Join a smart, highly skilled team with a passionfor technology, where you will work on our state of the art Big Data Platforms.

    They must be a verygood communicator, both written and verbal, and have some experience working with business areas totranslate their business data needs and data questions into project requirements.

    The candidate willparticipate in all phases of the Data Engineering life cycle and will independently andcollaboratively write project requirements, architect solutions and perform data ingestiondevelopmentand support duties.


    Skills and Experience:

    Required:
    6+ years of overall IT experience
    3+ years of experience with high-velocity high-volume stream processing: Apache Kafka andSparkStreaming
    Experience with real-time data processing and streaming techniques using Spark structuredstreaming and Kafka
    Deep knowledge of troubleshooting and tuning Spark applications
    3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and differentfile formats across different platforms like JSON, XML, CSV
    3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka,Sqoop, Hive, S3, HDFS, or
    3+ years of experience building, testing, and optimizing 'Big Data' data ingestion pipelines,architectures, and data sets
    2+ years of experience with Python (and/or Scala) and PySpark/Scala-Spark
    3+ years of experience with Cloud platforms e.g. AWS, Google Cloud Platform, etc.
    3+ years of experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake orBigQuery
    2+ years of experience with NoSQL databases, including HBASE and/or Cassandra
    Experience in successfully building and deploying a new data platform on Azure/ AWS
    Experience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue
    Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series
    Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, DeltaLakewith Spark SQL, Delta Live Tables, Unity Catalog
    Knowledge of Unix/Linux platform and shell scripting is a must
    Strong analytical and problem-solving skills

    Preferred :
    Strong SQL skills with ability to write intermediate complexity queries
    Strong understanding of Relational & Dimensional modeling
    Experience with GIT code versioning software
    Experience with REST API and Web Services
    Good business analyst and requirements gathering/writing skills

    #J-18808-Ljbffr
  • Zendr

    Data Engineer

    3 weeks ago

    Zendr Dallas, United States

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division. · This opportunity is perfect for experienced data engineers looking for a more client-facing role and to widen their skillset w ...

  • Addison Group

    Data Engineer

    3 weeks ago

    Addison Group Dallas, United States

    On-site, Monday-Friday, in Dallas, TX, Remote days can and will be earned. · The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibili ...

  • Anblicks

    Data Engineer

    1 week ago

    Anblicks Dallas, United States

    Role: Data Engineer · Location : Dallas, Texas · Job Type: Hybrid · • Analyze and understand data sources & APIs · • Design and Develop methods to connect & collect data from different data sources · • Design and Develop methods to filter/cleanse the data · • Design and Develop S ...

  • Anblicks

    Data Engineer

    1 week ago

    Anblicks Dallas, United States

    Skills: · • Analyze and understand data sources & APIs · • Design and Develop methods to connect & collect data from different data sources · • Design and Develop methods to filter/cleanse the data · • Design and Develop SQL , Hive queries, APIs to extract data from the store · • ...

  • Ascendion

    Data Engineer

    1 week ago

    Ascendion Dallas, United States

    Position Details: · Company: Banking Giant · Job Title: Data Engineer · Duration: 6 to 12 Months (with possible extension) · Location: Hybrid (Dallas, TX) (3 days Onsite, 2 days remote) · Interview Times: ASAP · Roles and Responsibilities : · 8+ years' experience in data integra ...

  • Tiger Analytics

    Data Engineer

    1 week ago

    Tiger Analytics Dallas, Texas, United States Permanent

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our bus ...

  • Allied Stone Inc

    Data Engineer

    3 weeks ago

    Allied Stone Inc Dallas, United States

    Job Description · Job DescriptionSUMMARY OF POSITION AND RESPONSIBILITY: · The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. · This includes data pipelines, ensuring high data quality and accessibili ...

  • Coca-Cola Southwest Beverages

    Data Engineer

    4 weeks ago

    Coca-Cola Southwest Beverages Dallas, United States

    Req ID:188046 · General Purpose This role is responsible for designing ETL (Extract, Transform, Load) processes in the cloud with the objective of obtaining both external and internal data sources to feed the team's data repository following guidelines and best practice standard ...

  • PDS Tech Commercial, Inc.

    Data Engineer

    4 days ago

    PDS Tech Commercial, Inc. Dallas, United States

    Let's go to work . . . needing a Data Engineer in Dallas Texs. You will have: · Design, build, maintain, debug, and improve data pipelines · - Assemble large, complex data sets · - Create business intelligence dashboards · - 2+ years of experience as a Data Engineer in a simi ...

  • Apptad Inc

    Data Engineer

    3 weeks ago

    Apptad Inc Dallas, United States

    Job Description · Job DescriptionJob Title: Senior Quant Data Engineering Consultant · Job Location: Dallas, TX (3 days per week onsite) · Job Duration: Long-TermJob Description · Key Skills:Demonstrated data engineering experience, utilizing agile methods and modern SDLC process ...

  • eTek IT Services, Inc.

    Data Engineer

    3 weeks ago

    eTek IT Services, Inc. Dallas, United States

    Job Description · Job DescriptionJob Description · • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. · • Extensive Experience on BigQuery, DataProc and DataFlow plat ...

  • IT Vision Group

    Data Engineer

    3 weeks ago

    IT Vision Group Dallas, United States

    Job Description · Job DescriptionTitle : Data Engineer · Location: Remote · Duration: 12 Months+ · We are looking for an onshore Data engineer with the following requirement to start ASAP: · Must have: SQL, data profiling, data cleansing, and data modeling experience; comfortable ...

  • PDS Tech

    Data Engineer

    3 days ago

    PDS Tech Dallas, United States

    Lets go to work . . . needing a Data Engineer in Dallas Texs. You will have: · Design, build, maintain, debug, and improve data pipelines · Assemble large, complex data sets · Create business intelligence dashboards · 2+ years of experience as a Data Engineer in a similar rol ...

  • Vision It US

    Data Engineer

    3 weeks ago

    Vision It US Dallas, United States

    Job Description · Job DescriptionDescription: · Designs, develops, and implements using the skillset Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, Basics of Azure, Knowledge of Data Lake, Data Warehouse concept, Knowledge of SQLs, creates design doc ...

  • IT Vision Group

    Data Engineer

    3 weeks ago

    IT Vision Group Dallas, United States

    Job Description · Job DescriptionTitle : Data Engineer · Location: Dallas, TX · Duration: 12 Months+ · Job Description : · Architecting cloud native solutions across multiple B2B and B2B2C data domains · Develop a plan to migrate on-premise transactional and warehousing solutions ...

  • Austin Professional Svcs, Inc.

    IT Data Engineer

    2 days ago

    Austin Professional Svcs, Inc. Dallas, United States

    Austin Industries is one of the nations largest, most diversified U.S.-based construction companies. With more than 7,000 employee-owners, Austin Industries provides nearly every type of civil, commercial and industrial construction services through the expertise of our operating ...

  • Loopback Analytics

    Data Engineer

    3 weeks ago

    Loopback Analytics Dallas, United States

    Job Description · Job DescriptionSalary: · About the Job · Loopback Analytics is hiring a Data Engineer to aid with development of healthcare analytics systems. This role consists mostly of coding in Python/Pyspark, specifically to aid with Loopback's product focused on critica ...

  • Mitchell Martin Inc.

    Senior Data Engineer

    3 weeks ago

    Mitchell Martin Inc. Dallas, United States

    Senior Data Engineer · Our mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data tec ...

  • Motion Recruitment

    Sr. Data Engineer

    1 week ago

    Motion Recruitment Dallas, United States

    This is a remote role, but prefer someone in Dallas if possible. This is a 1 year contract with likely extensions every 12 months. The emphasis here is on data management systems programming and experience with both Palantir and Snowflake. Migration experience from Palantir to Sn ...

  • Sogeti

    Data Platform Engineer

    2 weeks ago

    Sogeti Dallas, United States

    This is a full-time opportunity with Sogeti. · Location - Phoenix/AZ or Dallas/TX, Onsite full-time · Onshore Platforms Administrator Lead · Lead platform administration of Azure for data engineering (majority of work) · Lead platform administration of Power BI for engineering/re ...