Data Engineer - Specialist
Ecospace Campus 3A, 4th Floor, Outer Ring Road, Bellandur, Bengaluru- 560103, India
INR 1500K-2146K (estimate) Senior-level Full Time
Tasks
- Apply open table formats for interoperability
- Build lakehouse datasets on AWS
- Collaborate on IAM least privilege access controls
- Create metadata and governance integration
- Design data pipelines for batch and streaming
- Develop and optimize Apache Iceberg datasets
- Implement CI/CD for data pipelines
- Implement automated data quality checks
- Implement medallion ingestion and transformation
- Mentor engineers and define data engineering standards
- Produce OpenLineage lineage events
- Register assets in enterprise data catalog
- Set up observability and alerting for pipelines
Perks/Benefits
- Employee assistance programme
- Flexible schedule
- Health insurance
- Parental leave
- Professional development opportunities
- Retirement savings plan
Skills/Tech-stack
AWS | AWS Glue | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache Iceberg | CI/CD | Data Catalog | Data Governance | Data Quality | Data Validation | IAM | Observability | OpenLineage
Education
Roles
Related jobs
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Adobe Analytics Developer INR 2040K-3356KAdobe Analytics | Adobe Client Data Layer | Adobe Experience | Adobe Experience Platform | Adobe Experience Platform Data collectionSenior-level Full TimeIN-MH-Pune5h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai5h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Assistant Vice President - AI Runtime Security INR 1500K-6000KAI Governance | AI RMF | Access Control | Amazon CloudWatch | Anomaly DetectionExecutive-level Full TimeIndia6h ago
-
Lead ML Engineer INR 2000K-3800KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, TN, India6h ago
-
Forward Deployed Engineer, GenAI, Google Cloud INR 1800K-2500KAPI Integration | Agent systems | CrewAI | Data Pipelines | Deep learningMid-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India7h ago
-
Software Engineer III, Google Cloud Bigtable INR 1500K-3000KAgile | Algorithms | Automated testing | C++ | CI/CDSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN7h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R8h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Amazon OpenSearch | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R8h ago
-
Junior GenAI Developer INR 600K-900KAWS | Agentic Workflows | Chroma | Embeddings | FaissCompany events | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R8h ago
-
Senior-level Full Timehosur road bangalore, India8h ago
-
Senior-level Full Timehosur road bangalore, India8h ago
-
AI Engineer - Acon - BLR INR 2500K-4500KAI Search | AI Studio | Agentic Workflows | Application Security | Arize PhoenixSenior-level Full TimeIndia8h ago
-
AI Engineer INR 1500K-2400KAgentic AI | Agile | Apache Spark | Artificial Intelligence | AutomationAccidental insurance | Life insurance | Meal arrangements | Medical insurance | Professional development opportunitiesMid-level Full TimeGurugram, HR, IN8h ago
-
Data Engineer with AI developer INR 2000K-2800KAPIs | AWS SageMaker | Azure Data | Azure Data Factory | Azure Machine LearningSenior-level Full Timebangalore, India10h ago
-
Member of Technical Staff INR 2500K-4500KAutomated testing | Batching | CI/CD | Caching | Cloud infrastructureSenior-level Full TimeBengaluru, KA, IN10h ago
-
Senior - Data and App Modernization INR 2500K-3500KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationSenior-level Full TimeGurgaon, Haryana, India10h ago
-
Data Engineer INR 1500K-2000KAWS | Ab Initio | Apache Flink | Apache Spark | Apache Spark StreamingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
DE&A - Snowflake - Specialist INR 1000K-2000KAgile | Amazon S3 | CI/CD | Data Migration | Data ModelingMid-level Full TimeBengaluru South, Karnataka, India12h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India12h ago
-
AI Engineer (India) INR 800K-1000KAzure Cognitive | Azure Cognitive Search | Azure DevOps | Azure OpenAI | CI/CDBuddy program participation | Employee referral program | Flexible working hours | Internal growth opportunities | Leadership mentoring opportunitiesMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Storage & Backup Architect INR 2486K-3500KAnsible | Bash | CI/CD | Commvault | Dell EMCHybrid work | On-call rotationSenior-level Full TimeBengaluru, India18h ago