Data Engineer

Any Marlabs Office Location, IN

Marlabs

A US-based digital transformation consulting and IT services company with 25 years of expertise. Build digital agility for your business.

View all jobs at Marlabs

Apply now Apply later

About 

Marlabs designs and develops digital solutions with data at the center. Driven by curiosity and a collaborative problem-solving mindset, we leverage our deep data expertise and cutting-edge technologies to empower businesses with actionable insights and drive improved digital outcomes. Our data-first approach intersects with AI & analytics, digital product engineering, advisory services, digital labs for rapid solution incubation and prototyping, and agile engineering to build and scale digital solutions. We work with leading organizations around the world to make operations sleeker, keep customers closer, transform data into decisions, boost legacy system performance, and seize novel opportunities in new digital revenue streams. 

Learn more about us – www.marlabs.com 

Job Title 

Data Engineer – POM – Operations 

Experience 

1-3 years 

Requirements and responsibilities 

  • Develop scalable ETL/ELT pipelines using Databricks, Spark, and Delta Lake. 

  • Implement data ingestion frameworks for batch and streaming data using Azure Data Factory, and Spark 

  • Optimize data storage, partitioning, and indexing strategies in Delta Lake. 

  • Write efficient Spark transformations and ensure performance tuning of data processing workloads. 

  • Ensure data quality, validation, and lineage tracking is available for pipelines. 

  • Work with Data Architects to design and implement data models for structured and semi-structured data. 

  • Develop monitoring and logging for ETL jobs to ensure reliability and troubleshooting capabilities. 

  • Ensure role-based access control (RBAC) and security best practices for data access and sharing. 

Marlabs is an equal opportunity employer. We are committed to creating a diverse and inclusive workplace where all employees feel valued and respected. Our hiring practices ensure that all candidates are considered based on their qualifications, without regard to race, gender, age, disability, or any other characteristic protected by law. We believe that a diverse team brings unique perspectives and ideas, driving innovation and success. 

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: Agile Azure Databricks Data quality ELT Engineering ETL Pipelines Prototyping Security Spark Streaming

Region: Asia/Pacific
Country: India

More jobs like this