Senior Data Engineer - Senior Manager
Tasks
- Apply data security and governance
- Build lakehouse architecture
- Design data ingestion pipelines
- Develop ETL and ELT pipelines
- Implement Apache Iceberg tables
- Implement CI/CD for data pipelines
- Optimize spark job performance
- Orchestrate data workflows
- Perform data quality checks
- Set up pipeline monitoring and alerting
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Airflow | Alerting | Apache Iceberg | CI/CD | Compaction | DBT | Data Governance | Data Quality | Data Validation | Databricks | Databricks Jobs | ELT | ETL | Git | Partitioning | PySpark | RBAC | SLA monitoring | SQL | Schema evolution | Spark | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Compute Platform Ops Engineer INR 2200K-3500KAWS | Cloud platform | Crossplane | Google Cloud | Google Cloud PlatformMid-level Full TimeIndia, Hyderabad, DVS, SEZ-1 – Orion …5h ago
-
Microsoft Fabric Data Engineer INR 1100K-2600KData Governance | Data Ingestion | Data Pipelines | Data Quality | Data SecurityMid-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimePune City, India13h ago
-
Entry-level Full TimePune, India14h ago
-
Senior AI Engineer/ Senior Associate Director, Tech SME INR 1860K-2800KAPIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimePune, Maharashtra, India R14h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Conformed Dimensions | Data LineageSenior-level Full TimeHyderabad, TS, India14h ago
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R15h ago
-
Junior Data Engineer INR 400K-700KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | Azure DataEntry-level Full TimePune City, India15h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | COMTRADESenior-level Full TimeBangalore - Karnataka - India15h ago
-
Senior-level Full TimeBangalore - Karnataka - India15h ago
-
Senior AI Engineer INR 2500K-4500KAsync Programming | Azure | CI/CD | Data Ingestion | Data Ingestion PipelineDiversity-focused workplace | Equity and inclusion | Learning opportunitiesSenior-level Full TimeBangalore - Karnataka - India15h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | Dependency managementSenior-level Full TimeBangalore - Karnataka - India15h ago
-
Senior-level Full TimeBangalore - Karnataka - India15h ago
-
Senior-level Full TimeBangalore - Karnataka - India15h ago
-
Data Engineer ( 2 to 5 Years) INR 1500K-2100KAWS CDK | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaContinuous learning | Flexible working | Hybrid working | Inclusive cultureMid-level Full TimeBangalore - Karnataka - India15h ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R15h ago
-
Data Engineer INR 1500K-2700KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Noida/ Chennai, India16h ago
-
Researcher: AI/ML enhanced Computational Engineering for Scientific AI and Optimization INR 2500K-5000KAI Agents | Bayesian optimization | Cloud Computing | Dynamical systems | Evolutionary AlgorithmsSenior-level Full Timebengaluru, India16h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India16h ago
-
Senior-level Full TimePune, Maharashtra, India17h ago
-
Mid-level Full TimePune, Maharashtra, India17h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101317h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India18h ago
-
Senior Data Engineer (Python, SQL, Snowflake, Devops, Azure/ AWS, Co-pilot, Kubernetes, Docker) INR 3200K-4131KAWS | Airflow | Automated Lineage | Azure | Azure BicepEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Mentorship | Volunteer time offSenior-level Full TimeChennai, TN, India18h ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryFlexible working | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R18h ago