Data Engineer
Any Marlabs Office Location, IN
Marlabs
A US-based digital transformation consulting and IT services company with 25 years of expertise. Build digital agility for your business.About
Marlabs designs and develops digital solutions with data at the center. Driven by curiosity and a collaborative problem-solving mindset, we leverage our deep data expertise and cutting-edge technologies to empower businesses with actionable insights and drive improved digital outcomes. Our data-first approach intersects with AI & analytics, digital product engineering, advisory services, digital labs for rapid solution incubation and prototyping, and agile engineering to build and scale digital solutions. We work with leading organizations around the world to make operations sleeker, keep customers closer, transform data into decisions, boost legacy system performance, and seize novel opportunities in new digital revenue streams.
Learn more about us – www.marlabs.com
Job Title
Data Engineer – POM – Operations
Experience
1-3 years
Requirements and responsibilities
-
Implement data ingestion frameworks for batch and streaming data using Azure Data Factory, and Spark
-
Optimize data storage, partitioning, and indexing strategies in Delta Lake.
-
Write efficient Spark transformations and ensure performance tuning of data processing workloads.
-
Ensure data quality, validation, and lineage tracking is available for pipelines.
-
Work with Data Architects to design and implement data models for structured and semi-structured data.
-
Develop monitoring and logging for ETL jobs to ensure reliability and troubleshooting capabilities.
-
Ensure role-based access control (RBAC) and security best practices for data access and sharing.
Marlabs is an equal opportunity employer. We are committed to creating a diverse and inclusive workplace where all employees feel valued and respected. Our hiring practices ensure that all candidates are considered based on their qualifications, without regard to race, gender, age, disability, or any other characteristic protected by law. We believe that a diverse team brings unique perspectives and ideas, driving innovation and success.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Azure Databricks Data quality ELT Engineering ETL Pipelines Prototyping Security Spark Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.