Data Engineer – Specialist
Ecospace Campus 3A, 4th Floor, Outer Ring Road, Bellandur, Bengaluru- 560103, India
INR 1628K-2040K (estimate) Senior-level Full Time
Tasks
- Build medallion raw silver gold ingestion and transformation patterns
- Champion CI CD for data pipelines and infrastructure changes
- Design and build scalable data pipelines for batch and streaming
- Develop and optimize Apache Iceberg datasets for multi engine use
- Implement IAM least privilege access controls and governed data access
- Implement data quality checks and automated validation
- Implement observability with metrics logs and alerts
- Instrument pipelines to emit lineage metadata using OpenLineage
- Mentor junior engineers and define lakehouse engineering standards
- Register datasets in enterprise catalog for discoverability
Perks/Benefits
- Employee assistance programme
- Flexible schedules
- Health insurance
- Holiday purchase scheme
- Parental leave
- Professional development
- Retirement savings plan
Skills/Tech-stack
AWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Iceberg | CI/CD | Data Lineage | Data Quality | Data Validation | Databricks | IAM | Metadata Management | Observability | OpenLineage | Python | SQL | Snowflake | Trino
Education
N/A
Roles
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R6h ago
-
Principal Engineer - Generative AI Infra Capabilities INR 2000K-4600KApigee | Arize | Avi | CI/CD | CUDASenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R1d ago
-
Senior AI Engineer INR 2000K-3800KAWS | Agent Orchestration | Amazon Bedrock | Artificial Intelligence | Confidence scoringComprehensive health benefits | Flexible work environment | Generous time off | Global days of service | Hybrid work modelSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India1d ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India1d ago
-
Manager - Fraud Analytics & Monitoring (Detection) INR 618K-618KAnomaly Detection | Artificial Intelligence | Behavioral analytics | Decisioning systems | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive and diverse team cultureMid-level Full TimeMumbai, India1d ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru1d ago
-
AI/ML enhanced control engineering INR 2500K-3000KDecision Trees | Deep learning | Differential Equations | Finite Difference Method | Finite Volume MethodSenior-level Full Timebengaluru, India1d ago
-
Agentic / GEN AI INR 2500K-4000KAI Foundry | AI Services | Agentic AI | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior-level Full TimeIndia1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore1d ago
-
Senior Manager INR 2000K-3000KBureau data | Credit Risk | Credit risk modeling | Data Analysis | Data ProcessingSenior-level Full TimeGurugram, Haryana, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Staff Software Engineer, Machine Learning INR 2500K-3285KAgentic AI | C++ | Data Pipelines | Deep learning | Generative AIHealth and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India1d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India1d ago
-
Database Engineer I INR 800K-1200KAgile | Amazon Web Services | Automation | Data Modeling | Database AdministrationSenior-level Full TimeIndia1d ago
-
Database Engineer II INR 1000K-1330KAmazon Web Services | Automation | Data Modeling | Database Administration | Database DesignSenior-level Full TimeIndia1d ago
-
Associate Data Scientist - AI/ML 1 Job INR 1500K-2000KData Modeling | Data Preprocessing | Data Visualization | Data cleaning | ExcelContinuous learning opportunities | Flexible work arrangements | Inclusive workplace | Stable employmentMid-level Full TimeHyderabad, IN1d ago