Senior Data Engineer
Bangalore, Karnataka, IN India, 560087
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply quality gates auditability and compliance
- Build Git based CI CD pipelines
- Build end-to-end data pipelines
- Collaborate with product analytics and platform teams on data contracts and SLAs
- Design Iceberg tables and incremental processing
- Design and build scalable data products
- Diagnose data system issues and drive remediation
- Implement AWS access control and tagging with IAM
- Implement Parquet and Iceberg with schema evolution
- Implement dimensional and normalized data models
- Implement query optimization across Hive Impala Snowflake and RDBMS
- Implement transformations with SQL and dbt and PySpark
- Integrate event driven ingestion with Kafka
- Lead AWS data infrastructure across dev test prod
- Manage infrastructure as code with Terraform
- Mentor engineers and drive code quality through reviews and documentation
- Model RAW CURATED and SERVING layers
- Optimize data architectures for performance and cost
- Orchestrate workflows with Airflow and manage SLAs and SLOs
- Own batch and streaming pipeline delivery
- Use GenAI assisted development responsibly
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon S3 | Amazon SageMaker | Apache Airflow | Apache Iceberg | Apache Kafka | CI/CD | DBT | Data Modeling | Data pipeline | Data pipeline orchestration | Dimensional Modeling | Hive | Impala | Infrastructure as Code | Normalized modeling | Parquet | Performance optimization | Pipeline Orchestration | PostgreSQL | PySpark | Python | Query Optimization | SQL | Schema evolution | Snowflake | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Senior E2E Service Optimization Engineer (m/f/d) INR 2466K-3500K5G-NR | IMS | LTE | Python | QUICFlat hierarchies | Flexible working hours | Hybrid work | Modern hardware and digital workplace | Open company cultureSenior-level Full TimeAnkara (TUR), Chennai (IND), Communication Management2h ago
-
Senior - AWS Data Engineering INR 3000K-4000KAWS Glue | AWS Lambda | Amazon S3 | Amazon Web Services | Data ModelingSenior-level Full TimeBangalore, Karnataka, India2h ago
-
Software Engineering Professional - GEN AI INR 1500K-2700KAI orchestration | AIOps | APIs | Access Control | Agent FrameworksMid-level Full TimeBengaluru, IN, 5601033h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPIs | Agentic AI | Azure | Azure OpenAI | BERTMid-level Full TimeBangalore, Karnataka, India4h ago
-
Mid-level Full TimeGurgaon, HR, India5h ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 800K-1000KAccess Management | Amazon Web Services | Backup | Cloud platform | ComputingCareer pathways | Development programs | Product trainingMid-level Full TimeBangalore, India6h ago
-
Senior-level Full TimeBangalore, IN, 5600667h ago
-
Data Scientist III INR 2535K-4225KAWS | Advanced SQL | CI/CD | DBT | Data VisualizationFlexible work options | Work-life balance programsSenior-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimeIndia - Bangalore - 5th floor, …12h ago
-
Systems Administration Specialist INR 2516K-3356KAPI Connect | Ansible | C# | Grafana | HiveMQ24x7 on-call supportSenior-level Full TimeBangalore, KA, IN12h ago
-
Data Engineer INR 1500K-2000KAsync Programming | Caching | Classification | Clustering | Data PipelinesMid-level Full TimeBengaluru, India12h ago
-
IN_Manager_Data Engineer_D&A_Advisory_Nagpur INR 1500K-2000KCI/CD | Data Modeling | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | Mentorship | Support for wellbeingMid-level Full TimeNagpur, India12h ago
-
Alerting | Apache Spark | Azure | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India12h ago
-
IN_Associate_AI Engineer _GCC_Advisory_Hyderabad INR 2000K-4000KAPI Development | Async Programming | Autogen | Automation orchestration | Best practicesFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India12h ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationEqual employment opportunities | Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India12h ago
-
Agile | Angular | Bash | Cloud | Continuous integrationSenior-level Full TimeBengaluru Millenia, India12h ago
-
Technical Services Engineer INR 2500K-4144KAPI Integration | AWS | Active Directory | Authentication | AzureHybrid work modelSenior-level Full TimeBengaluru15h ago
-
Machine Learning Engineer INR 1000K-1800KAlerting | Batch Processing | Computer Vision | Data Pipelines | Deep learningHealthcare | Hybrid work | Internet/cell phone reimbursement | Learning and development stipend | Travel opportunitiesMid-level Full TimeBengaluru, India18h ago
-
Senior Software Engineer (AI Dev Productivity) INR 2500K-4500KAPI Integration | Agentic Workflows | Automated testing | Confluence | Data-Driven ExperimentationCell phone reimbursement | Healthcare | Hybrid work | Internet reimbursement | Learning and development stipendSenior-level Full TimeBengaluru, India18h ago
-
Principal Software Engineer, AI Engineering INR 2500K-4600KAWS | Cloud platform | Distributed Systems | Generative AI | Google CloudSenior-level Full TimeBengaluru, India21h ago
-
Data Warehouse Support Engineer INR 1500K-2000KAPI Integration | APIs | Data Governance | Data Lakes | Data MartsHybrid work | Remote workMid-level Full TimeBangalore R21h ago
-
Senior Data Engineer INR 2000K-3380KAmazon Web Services | Data Governance | Git | Google Cloud | Infrastructure as CodeAnnual bonus | Health insurance | Internal technical talks | Knowledge sharing | Learning and developmentSenior-level Full TimeRemote, Bangalore R21h ago
-
Data Architect INR 1500K-2400KAWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADFCareer progression | Health & wellness benefits | Hybrid working | Retirement benefits | Training budget for Databricks certificationSenior-level Full TimePune, India22h ago
-
Senior AI Engineer INR 1800K-2800KAWS | Agile | Anthropic | Azure | CI/CDAutonomy | Flexible growth opportunities | Learning and development programs | Mentorship | Open source contributionsSenior-level Full TimeBangalore; Gurgaon, India23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago