Technology Partners is currently seeking a talented Senior Data Engineer. Do you have experience maintaining data intestive APIs using RESTful approaching and working with large-scale, complex datasets? Let us help you make your next big career move a reality!
What You Will Be Doing:
As a Senior Data Engineer, you'll be a key member of a team focused on building distributed data analysis capabilities for massive agricultural datasets. You'll leverage your software development expertise and knowledge of algorithms and data structures to design and implement innovative solutions. This role offers the opportunity to work with cutting-edge technologies and solve real-world challenges that have a significant impact on global food security.
Key Responsibilities:
- Design and develop scalable data pipelines for diverse agricultural datasets (genomics, crop trials, etc.)
- Build and maintain data-intensive APIs using a RESTful approach
- Leverage cloud platforms (AWS, Azure, GCP) to build and maintain robust data infrastructure
- Explore and implement appropriate technology stacks to optimize data analysis for various datasets
- Collaborate with top talent across the organization to tackle complex and unique challenges
- Apply software development best practices, including unit testing and test-driven development (TDD)
- Contribute to the development of containerized application deployments using Docker or similar platforms
- Participate in knowledge sharing by potentially presenting at relevant technical conferences
Required Skills & Experience:
- At least 7 years of experience in software engineering
- At least 2 years of experience with Go programming language
- Proven experience (2 years) building and maintaining data-intensive APIs using a RESTful approach
- Experience with stream processing using Apache Kafka
- Familiarity with Unit Testing and Test Driven Development methodologies
- Experience with creating and maintaining containerized application deployments (e.g., Docker)
- Experience building and maintaining cloud-based infrastructure on major cloud providers (AWS, Azure, GCP)
- Experience with data modeling for large-scale databases (relational or NoSQL)
Desired Skills & Experience:
- Experience with protocol buffers and gRPC
- Experience with: Google Cloud Platform (GCP), Apache Beam/Google Cloud Dataflow, Google Kubernetes Engine (GKE)/Kubernetes
- Experience working with scientific datasets or applying quantitative science to business problems
- Bioinformatics experience (large-scale data storage/mining, variant annotation, genotype-phenotype correlation)
Pay: $75.60 – $108 /hr.
We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.
If this position sounds like you, WE SHOULD TALK!
We realize our people are our most valuable asset, that is why we offer the following benefits:
- Health, Dental, and Vision insurance
- 401(k) retirement plan
- Long and Short-Term disability
- Life insurance
- Direct deposit
- Referral program
Your better future is ready, and we want to put the right tools in your hands to get you there. Let's go!
Keywords: Data Engineering, Big Data, Cloud Computing, Software Development, Agriculture, Genomics, Machine Learning
Looking for more opportunities with Technology Partners? Check out technologypartners.net/jobs!
Technology Partners is an Equal Opportunity Employer. Technology Partners does not discriminate on the basis of race, color, religion, sex, national origin, age, disability or any other characteristic protected by applicable state or federal civil rights laws.
All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.
Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.
