Senior Data Engineer
APAC - India - Bengaluru - Sunriver
INR 3584K-4720K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Build data lake platforms
- Deliver self service analytics datasets
- Design data pipelines
- Develop data models schemas and storage
- Drive data architecture discussions and engineering standards
- Enforce data governance, security, and compliance
- Implement monitoring alerting and testing
- Integrate enterprise data
- Maintain technical documentation
- Mentor engineers through code reviews
- Optimize database warehouse and pipeline performance
- Optimize distributed data processing
- Validate data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Flink | Apache Hive | Apache Iceberg | Apache Kafka | Apache Parquet | Apache Spark | Backfills | CI/CD | Cassandra | Data Architecture | Data Modeling | Data Quality | Data Quality Testing | Data Reconciliation | Data Validation | Data Warehousing | Data quality monitoring | ELT | ETL | Git | Google BigQuery | Incremental processing | Infrastructure automation | MongoDB | MySQL | PostgreSQL | PySpark | Python | Quality monitoring | Quality testing | SQL | Shell Scripting | Snowflake | Step Functions
Education
Roles
Related jobs
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Bitbucket | CI/CD | CSS | CeleryCollaborative work environment | Onsite work 5 days a week | Training and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …2h ago
-
Software Engineer III, ML Infrastructure, Google Cloud INR 2500K-5000KBack-end | Back-end development | C++ | Cloud APIs | Data StorageSenior-level Full TimePune, Maharashtra, India4h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …4h ago
-
Senior-level Full TimeBengaluru, KA, IN6h ago
-
Sr. Data Engineer INR 3000K-4000KApache Kafka | Apache Spark | Data Modeling | Data Pipelines | Data integrationSenior-level Full TimeBangalore, Karnataka, IN6h ago
-
Senior-level Full TimeHyderabad, TS, India7h ago
-
Software Engineer III - Java, Springboot, Cloud INR 2200K-3500KAPI Gateway | Agile | Artificial Intelligence | CI/CD | CassandraSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer III - ETL Testing ,Pyspark, AWS INR 2000K-3100KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS Lambda | AWS MSKAgile team environment | Automated testing validation | Peer reviewSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Software Engineer II- ETL Testing ,Pyspark, AWS INR 2000K-3000KAWS | Agile | Apache Spark | Application Resiliency | CI/CDEntry-level Full TimeMumbai, Maharashtra, India8h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R9h ago
-
Mid-level Full TimeGurugram, HR, India9h ago
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia10h ago
-
Senior Storage Engineer INR 2000K-3500KAnsible | CMDB | Cloud Insight | Firewalls | ITILLimited travel | Mentoring opportunitySenior-level Full TimeHyderabad, India10h ago
-
Applied AI ML Associate Senior -AI Engineer INR 2000K-3000KAgentic AI | CI/CD | Cloud deployment | Code review | ContainersMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Applied AI ML Lead- AI Research Engineer INR 3000K-5500KBenchmarking | Efficient Inference | Evaluation | Fine Tuning | Hugging FaceSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
ML & AI Engineer II INR 1860K-3000KAPIs | Classification | Cloud Platforms | Computer Vision | Data PipelinesCareer growth opportunities | Continuous learning and development | Flexible work arrangements | Hybrid work arrangements | Inclusive work environmentMid-level Full TimeNavi Mumbai, India11h ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R11h ago
-
Cloud Database Platform Engineer INR 1500K-4000KAWS RDS | Amazon Aurora | Amazon CloudWatch | Amazon EC2 | Amazon IAMEducation support | Generous time-off policies | Wellness and lifestyle supportSenior-level Full TimeBangalore12h ago
-
Cloud Engineer, Specialist CDAO Data Mgmt. & Analytics Platforms INR 2000K-3000KAWS | Agile | Automation | CI/CD | Capacity PlanningFinancial wellness programs | Hybrid working model | Personal wellness resources | Physical wellness benefits | Wellness supportMid-level Full TimeHyderabad, India15h ago
-
Data Governance Engineer INR 1436K-1436KChange Management | Cloud platform | Data Governance | Data Quality | Google CloudMid-level Full TimePune, IN15h ago
-
Senior Data Engineer - (Flink/Kafka/PySpark) INR 1500K-2500KAgile | Anonymization | Apache Flink | Apache Kafka | CI/CDSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Palantir Foundry Developer INR 1300K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimePune, Maharashtra, India15h ago
-
Senior Fullstack Engineer INR 3500K-4500KCI/CD | Cloud Platforms | Distributed Systems | Docker | FastAPIMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Mid-level Full TimeBangalore, Prestige Technology Park, India15h ago
-
Sr. Data Engineer Ops Data Analytics INR 1500K-2500KAzure Data | Azure Data Factory | Data Clustering | Data Factory | Data ModelingSenior-level Full TimeGurgaon Sector 59, India15h ago