Senior Data Engineer
Bangalore, Karnataka, IN India, 560087
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply quality gates auditability and compliance
- Build Git based CI CD pipelines
- Build end-to-end data pipelines
- Collaborate with product analytics and platform teams on data contracts and SLAs
- Design Iceberg tables and incremental processing
- Design and build scalable data products
- Diagnose data system issues and drive remediation
- Implement AWS access control and tagging with IAM
- Implement Parquet and Iceberg with schema evolution
- Implement dimensional and normalized data models
- Implement query optimization across Hive Impala Snowflake and RDBMS
- Implement transformations with SQL and dbt and PySpark
- Integrate event driven ingestion with Kafka
- Lead AWS data infrastructure across dev test prod
- Manage infrastructure as code with Terraform
- Mentor engineers and drive code quality through reviews and documentation
- Model RAW CURATED and SERVING layers
- Optimize data architectures for performance and cost
- Orchestrate workflows with Airflow and manage SLAs and SLOs
- Own batch and streaming pipeline delivery
- Use GenAI assisted development responsibly
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon S3 | Amazon SageMaker | Apache Airflow | Apache Iceberg | Apache Kafka | CI/CD | DBT | Data Modeling | Data pipeline | Data pipeline orchestration | Dimensional Modeling | Hive | Impala | Infrastructure as Code | Normalized modeling | Parquet | Performance optimization | Pipeline Orchestration | PostgreSQL | PySpark | Python | Query Optimization | SQL | Schema evolution | Snowflake | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeGurgaon, HR, India4h ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 800K-1000KAccess Management | Amazon Web Services | Backup | Cloud platform | ComputingCareer pathways | Development programs | Product trainingMid-level Full TimeBangalore, India5h ago
-
Senior-level Full TimeBangalore, IN, 5600665h ago
-
Data Scientist III INR 2535K-4225KAWS | Advanced SQL | CI/CD | DBT | Data VisualizationFlexible work options | Work-life balance programsSenior-level Full TimeHyderabad, India11h ago
-
Technical Services Engineer INR 2500K-4144KAPI Integration | AWS | Active Directory | Authentication | AzureHybrid work modelSenior-level Full TimeBengaluru14h ago
-
Machine Learning Engineer INR 1000K-1800KAlerting | Batch Processing | Computer Vision | Data Pipelines | Deep learningHealthcare | Hybrid work | Internet/cell phone reimbursement | Learning and development stipend | Travel opportunitiesMid-level Full TimeBengaluru, India17h ago
-
Senior Software Engineer (AI Dev Productivity) INR 2500K-4500KAPI Integration | Agentic Workflows | Automated testing | Confluence | Data-Driven ExperimentationCell phone reimbursement | Healthcare | Hybrid work | Internet reimbursement | Learning and development stipendSenior-level Full TimeBengaluru, India17h ago
-
Principal Software Engineer, AI Engineering INR 2500K-4600KAWS | Cloud platform | Distributed Systems | Generative AI | Google CloudSenior-level Full TimeBengaluru, India20h ago
-
Data Warehouse Support Engineer INR 1500K-2000KAPI Integration | APIs | Data Governance | Data Lakes | Data MartsHybrid work | Remote workMid-level Full TimeBangalore R20h ago
-
Senior Data Engineer INR 2000K-3380KAmazon Web Services | Data Governance | Git | Google Cloud | Infrastructure as CodeAnnual bonus | Health insurance | Internal technical talks | Knowledge sharing | Learning and developmentSenior-level Full TimeRemote, Bangalore R20h ago
-
Data Architect INR 1500K-2400KAWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADFCareer progression | Health & wellness benefits | Hybrid working | Retirement benefits | Training budget for Databricks certificationSenior-level Full TimePune, India21h ago
-
Senior AI Engineer INR 1800K-2800KAWS | Agile | Anthropic | Azure | CI/CDAutonomy | Flexible growth opportunities | Learning and development programs | Mentorship | Open source contributionsSenior-level Full TimeBangalore; Gurgaon, India22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
Embedded Software Validation Engineer INR 2500K-3870KAsynchronous programming | CAN | CI/CD | Docker | EthernetCareer growth | Competitive compensation | Flexible working hours | Stock options | Work-life balanceSenior-level Full TimePune23h ago
-
Senior-level Full TimeIndia1d ago
-
Agentic AI | As-a-Service | Audit Logging | Cloud Networking | Distributed tracingConference participation | Customer facing technical collaboration | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Data and Analytics Lead, Google Cloud INR 1500K-3000KBigQuery | Cloud Migration | Data Modeling | Data Transformation | Database ManagementSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
CCB Risk Strategic Analytics – GenAI INR 1960K-2800KAgentic AI | Control processes | Credit Risk | Data Analysis | Data EngineeringSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Senior Systems Engineer, (Python, GenAI, MCP) INR 1960K-2800KATP | CI/CD | Chef | Cloud infrastructure | Compute instancesSenior-level Full TimeRemote - Bangalore, India R1d ago
-
Senior Analytics Engineer INR 2520K-3380KAmazon Redshift | BigQuery | DAG | Data Modeling | Data TransformationCommunity benefits | Family benefits | Finance benefits | Health benefits | Hybrid work environmentSenior-level Full TimeHyderabad - Main Office1d ago
-
Staff Software Engineer (AI) INR 2500K-4800KAdversarial Networks | Amazon Web Services | Apache Hadoop | Apache Spark | C++Senior-level Full TimePune, Maharashtra, India1d ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon EC2Mid-level Full TimeBangalore, Karnataka, India1d ago