Senior Data Engineer
Primary location: Bengaluru, India
INR 1500K-3500K (estimate) Senior-level Full Time
Tasks
- Automate data pipelines using DevOps practices
- Build and maintain CI/CD pipelines using GitHub Actions
- Create data pipelines for source to target mappings
- Design and develop ETL data flows
- Develop Python and SQL for data cleaning and processing
- Document architecture and design components
- Evaluate design develop and maintain Big Data solutions
- Identify and build AI powered solutions
- Ingest data from files streams and databases
- Mentor junior engineers
- Performance tune long running data jobs
- Process data with Azure Databricks Python and SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AI | Apache Airflow | Azure Databricks | CI/CD | Delta Lake | DevOps | ETL | GitHub Actions | Python | SQL | Snowflake
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeBangalore, India Office (BANGALORE)6h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India8h ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …8h ago
-
Senior-level Full TimeGurugram, India10h ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R13h ago
-
Entry-level Full TimePune, Maharashtra, India13h ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India13h ago
-
Senior Consultant - Data Engineering-Data Analysis INR 2400K-3500KAWS Redshift | Confluence | ETL | Git | NumPySenior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Lead Assistant Manager - Lead Software Engineer INR 2700K-4064KAI | Analytics | Business Analytics | Dashboards | Data AnalysisSenior-level Full TimeHaryana, India14h ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN14h ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R14h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India14h ago
-
Mid-level Full TimePune, India14h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India14h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India14h ago
-
Senior-level Full TimePune, India14h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India14h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R15h ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R15h ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 56010015h ago
-
AI Agents | Accuracy Metrics | Benchmarking | Data Delivery | Data PipelinesMid-level Full TimeMumbai, Maharashtra, India15h ago