Associate Data Engineer
Tasks
- Build Airflow DAGs for scheduling and retries
- Build healthcare data pipelines
- Design PySpark SQL workflows in Databricks
- Develop data quality controls and alerting
- Implement metadata driven ingestion and transformations
- Integrate multi source data into Delta Spark tables
- Manage batch audit logs and run status tracking
- Optimize pipeline performance with partitioning and tuning
- Support schema evolution and production operations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Data Monitoring | Data Quality | Databricks | Delta Lake | ETL | Object storage | Partitioning | PySpark | Python | Query Tuning | SQL
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Technology
Roles
Associate | Associate Data Engineer | Data Engineer | Engineer
Related jobs
-
Technology Leader-Data Engineering-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2000K-2600KAPI | CI/CD | Java | Jira | LinuxSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeIN-MH-Pune5h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KAmazon Web Services | Azure | CI/CD | Cloud platform | ContainerizationMid-level Full TimeNoida, UP, India6h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Data Engineer - Senior INR 2000K-2800KAnomaly Detection | Apache Hive | Apache Kafka | Application Insights | AzureSenior-level Full TimePune, Maharashtra, India8h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia8h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Agile | Apache Spark | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India8h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India8h ago
-
Azure Databricks INR 2400K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksClient Customer Interactions | Health insurance | Learning aids | Meal vouchers | Unlimited growth potentialSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Research Engineer - Applied AI/ML INR 2000K-4170KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowHybrid workSenior-level Full TimeGurugram, India10h ago
-
Senior-level Full TimeHyderabad, India10h ago
-
Applied AI /ML INR 950K-1250KAlgorithms | Amazon Web Services | Azure | Computer Vision | Data MiningMid-level Full TimeHyderabad, Telangana, India10h ago
-
Lead Assistant Manager INR 2000K-3000KANSI SQL | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India11h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | CypressHybrid work modelMid-level Full TimePune, Maharashtra, India11h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India11h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India11h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 56003711h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India12h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 2000K-3500KAPI Design | AWS | Accuracy Monitoring | Agentic architecture | CI/CDSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru12h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India12h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 1800K-3200KAWS | Agent systems | CI/CD | Embeddings | FaissSenior-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior-level Full TimeBengaluru, Karnataka, India13h ago