Senior Data Engineer

United States - Remote

IT Labs

IT Labs was created with a sole purpose to produce the most high-performing, purpose and process-driven software development teams.

View all jobs at IT Labs

Apply now Apply later

We are seeking an experienced Senior Data Engineer to join our team and take a leadership role in designing, building, and optimizing advanced data solutions. If you’re passionate about leveraging data to drive business insights, have a strong background in cloud computing and machine learning, and thrive in solving complex data challenges, we’d love to hear from you!

Responsibilities: 

  • Analyze datasets from platform and business systems, design and implement frameworks for seamless data integration, and determine data lake requirements
  • Acquire, clean, and transform datasets to align with business needs, ensuring data quality and consistency while building, testing, and maintaining scalable and efficient data pipeline architectures
  • Develop tools, systems, and algorithms for data analysis and processing, enabling stakeholders to identify patterns, trends, and insights from raw data
  • Deploy and manage scalable data solutions on AWS, ensuring optimal performance, security, and cost-efficiency
  • Collaborate closely with ML engineers to create required datasets, feature stores, and prompts, developing new features from existing data to support machine learning initiatives
  • Provide technical leadership and mentorship to junior team members, fostering a culture of innovation and continuous improvement
  • Continuously monitor and optimize data pipelines and architectures for performance, reliability, and scalability
  • Maintain clear and comprehensive documentation of data processes, pipelines, and architectures

Requirements

  • 6+ years of experience in data engineering or a related field.
  • Proficiency in programming languages such as PythonClojureSQL, and SparkSQL.
  • Strong understanding of database systems and database design principles.
  • Hands-on experience with big data processing frameworks such as KafkaEKS, and Delta Live Tables.
  • Expertise in deploying and managing scalable data solutions on AWS Cloud computing platforms (e.g., S3, Redshift, Glue, EMR).
  • Experience working with machine learning teams to create datasets, feature stores, and prompts.
  • Strong knowledge of Enterprise Data Architecture and Data Analytics, including technology evaluations and solution design.
  • Familiarity with data best practices, compliance, and regulatory requirements.
  • Bachelor’s Degree in Computer Science, Data Engineering, or a related field. A Master’s Degree is preferred.
  • Strong problem-solving skills and the ability to lead complex technical projects.
  • Excellent communication skills to collaborate effectively with technical and non-technical stakeholders.
  • US Citizenship is required for this position.

Recruitment Process
Our recruitment process includes an initial one-way video interview, where candidates will be asked to record their responses to a set of questions. Successful candidates will then proceed to interviews with our team and the client.

Benefits

  • Choose your contract: Contract(1099) or B2B/C2C,
  • Unlimited working-from-anywhere policy,
  • Referral Bonuses,
  • Working on international projects

Our values
We are a company that seeks the best for both our employees and clients, reaching beyond expectations in turning dreams into reality. Our way of working is rooted in our core values (Integrity, Excellence, Proactivity, Innovation, and People), with an expectation that our future colleagues will make these their second nature in their everyday work and life. We don’t ask for perfection, but we do appreciate people motivated to better themselves in every conceivable aspect.

About IT Labs

Founded in 2005, IT Labs is an international software tech company, specializing in purpose and process-driven teams for high-performance, innovation, transformation, and efficiency. Our HQ is in Palm Beach Gardens, Florida, and we have teams and offices around the world - the US, the UK, the Netherlands, Argentina, Brazil, Serbia, and North Macedonia. We are constantly growing, and we would love for you to become part of our team!

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: Architecture AWS Big Data Clojure Computer Science Data analysis Data Analytics Data pipelines Data quality Engineering Kafka Machine Learning Pipelines Python Redshift Security SQL Testing

Perks/benefits: Career development

Regions: Remote/Anywhere North America
Country: United States

More jobs like this