Data Engineer

Job Details
Posted Date:
May 22, 2024
Job ID:
Brentwood , Missouri
7 years
Job Description
  • Location: Brentwood, Missouri
  • Type: Direct Hire
  • Job #45981

Technology Partners is currently seeking a talented Data Engineer. Do you have experience shipping scalable data solutions in the Azure Cloud and proficiency in SQL for running highly-performant queries? Let us help you make your next big career move a reality!

What You Will Be Doing:

We are seeking a highly skilled and passionate Data Engineer to join our core Data Team. In this role, you will be instrumental in building foundational datasets, designing pipelines, and developing infrastructure to support data-driven decision-making processes across the company. If you are enthusiastic about analytics, data models, and solving complex data challenges, we want you on our team!

Key Responsibilities:

  • Define processes and ETL infrastructure to transform and make data readily available across the company.
  • Build core datasets to serve as unique sources of truth for various business functions, including project management, estimating, procurement, finance, operations, and engineering.
  • Collaborate with project managers, business leaders, and internal stakeholders to understand their needs and design, build, and monitor pipelines that meet current requirements while scaling with growing data sizes.
  • Implement automated workflows to reduce manual/operational costs for stakeholders, define and uphold SLAs for timely data delivery, and move the company towards data democratization and a self-serve model (query exploration, dashboards, data catalog, data discovery).

Required Skills & Experience:

  • Self-starter mentality with the ability to gather and synthesize high-impact needs from business partners, design and implement technical solutions, and effectively communicate deliverables, timelines, and trade-offs.
  • 5-7 years of experience as a data engineer building core datasets and supporting business verticals as needed.
  • Hands-on experience shipping scalable data solutions in the Azure Cloud (e.g., AWS, GCP, Azure), across multiple data stores (e.g., Snowflake, Redshift, Hive, SQL/NoSQL, columnar storage formats), and methodologies (e.g., dimensional modeling, data marts, star/snowflake schemas).
  • SQL expertise with an understanding of aggregation functions, window functions, UDFs, self-joins, partitioning, and clustering approaches to run correct and highly performant queries.
  • Proficiency in object-oriented programming paradigms (e.g., Python, Java, Scala).
  • Experience working at a fast-growing, construction company, or eagerness to contribute in such an environment (Preferred).
  • Hands-on experience designing and building highly scalable and reliable data pipelines using Big Data stack (e.g., Airflow, Azure Data Pipeline, Spark, Hive, Parquet/ORC, Protobuf/Thrift, etc.) (Preferred).

Desired Skills & Experience:

  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to prioritize tasks and manage time effectively in a fast-paced environment.
  • Commitment to delivering high-quality, reliable, and scalable data solutions.

Pay: $98,000 – $140,000 /yr.

We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.

If this position sounds like you, WE SHOULD TALK!

Your better future is ready, and we want to put the right tools in your hands to get you there. Let's go!

Keywords:  Data Engineer, ETL Infrastructure, Core Datasets, Azure Cloud, SQL, Python, Java, Scala, Big Data, Data Pipelines, Snowflake, Redshift, Hive, Data Democratization, Automated Workflows

Looking for more opportunities with Technology Partners? Check out!

All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.

Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.

Share this Job!

Apply Now!

Attach a resume file. Accepted file types are DOC, DOCX, PDF, HTML, and TXT.

We are uploading your application. It may take a few moments to read your resume. Please wait!

Know someone who you think would be a great fit for Technology Partners or one of our many clients? Send them our way!