Technology Partners is currently seeking a talented Senior Data Engineer. Do you have experience with building and maintaining data pipelines for large-scale, distributed systems? Let us help you make your next big career move a reality!
What You Will Be Doing:
Are you a passionate data engineer who thrives in a fast-paced environment tackling complex challenges? Do you have a knack for transforming massive datasets into innovative software solutions? If so, we want to hear from you!
We're seeking a talented Senior Data Engineer to join our team focused on building distributed analysis capabilities for a wide range of agricultural data sets. You'll work with top-tier talent, explore cutting-edge technologies, and have the opportunity to present your work at industry conferences.
Key Responsibilities:
- Design and develop distributed data pipelines for large-scale agricultural datasets
- Continuously improve and innovate data analysis processes
- Collaborate with engineers and scientists to solve real-world agricultural challenges
- Select and implement the best technology stack for each data set
- Develop and maintain data-intensive RESTful APIs
- Build and maintain containerized applications using Docker
- Design and manage cloud-based infrastructure on major platforms (AWS, Azure, GCP)
- Experience with data modeling for large-scale databases (relational or NoSQL)
Required Skills & Experience:
- At least 7 years of experience in software engineering with a strong focus on data engineering.
- At least 2 years of experience with Go.
- Proven experience (2 years) in building and maintaining data-intensive APIs using a RESTful approach.
- Experience with stream processing using Apache Kafka.
- Comfortable with Unit Testing and Test-Driven Development methodologies.
- Familiarity with creating and maintaining containerized application deployments using platforms like Docker.
- Proven ability to build and maintain cloud-based infrastructure on major cloud providers such as AWS, Azure, or Google Cloud Platform.
- Experience in data modeling for large-scale databases, either relational or NoSQL.
Desired Skills & Experience:
- Experience with protocol buffers and gRPC.
- Familiarity with Google Cloud Platform, Apache Beam, Google Cloud Dataflow, Google Kubernetes Engine, or Kubernetes.
- Experience working with scientific datasets or a background in applying quantitative science to business problems.
- Bioinformatics experience, particularly in large-scale storage, data mining of variant data, variant annotation, and genotype-to-phenotype correlation
Pay: $77.7 – $111 /hr.
We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.
If this position sounds like you, WE SHOULD TALK!
We realize our people are our most valuable asset, that is why we offer the following benefits:
- Health, Dental, and Vision insurance
- 401(k) retirement plan
- Long and Short-Term disability
- Life insurance
- Direct deposit
- Referral program
Your better future is ready, and we want to put the right tools in your hands to get you there. Let's go!
Keywords: Data Engineer, Software Engineering, Go, RESTful APIs, Apache Kafka, Unit Testing, Test-Driven Development, Docker, Cloud Infrastructure, AWS, Azure, Google Cloud Platform, Data Modeling, NoSQL
Looking for more opportunities with Technology Partners? Check out technologypartners.net/jobs!
Technology Partners is an Equal Opportunity Employer. Technology Partners does not discriminate on the basis of race, color, religion, sex, national origin, age, disability or any other characteristic protected by applicable state or federal civil rights laws.
All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.
Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.
