Data Engineer, AI (Hybrid)
KAP Bangalore IND, India
R
INR 2000K-2700K (estimate) Mid-level Full Time
Tasks
- Apply reusable Spark SQL and Python patterns in Databricks
- Build and maintain Databricks workflows notebooks and jobs
- Build data quality controls and automated checks
- Contribute to lakehouse design decisions data layout and medallion architecture
- Curate and maintain governed feature and training datasets
- Design build and operate ELT ETL pipelines
- Implement and evolve Databricks lakehouse transformation layer
- Implement data models with semantic definitions
- Implement governance data classification retention lineage and access controls
- Implement observability monitoring alerting and SLAs
- Implement security by design for ingestion and transformation
- Optimize Spark SQL compute for performance and cost
- Support AI ML initiatives with data preparation pipelines and production integration
- Support GenAI prompt evaluation with telemetry metrics and test cases
- Support audits and assurance by providing evidence of controls and data handling
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Alerting | Confluence | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | Embeddings | Environment Separation | Incremental processing | Jira | Medallion Architecture | Microsoft 365 | Monitoring | Observability | PII | Partitioning | Python | RAG | Retrieval-Augmented Generation | SQL | Secrets management | Spark | Vector Search
Education
N/A
Roles
Related jobs
-
AI & Automation Engineer INR 3264K-5876KAPIs | Data Pipelines | Data Warehousing | Data models | EvaluationCareer development | Flexible vacation | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Bengaluru, Karnataka R20h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R20h ago
-
AI And A - Machine Learning Engineer - VG - W4 - CDAO0230 INR 3799K-5876KData Engineering | Data Mining | Data Pipelines | Data Quality | Data discoveryCareer development | Coaching and feedback | Discounts and offers | Flexible working | Health and well-being supportSenior-level Full TimeHyderabad, TG, IN, 500081 R20h ago
-
Vice President, Data Quality Lead Engineer INR 4000K-5000KAPI Design | Anomaly Detection | Audit trails | CD | CIComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R20h ago
-
Senior AI Engineer - Remote INR 3375K-5000KAWS CloudFormation | Apache Tomcat | CI/CD | CircleCI | Data PipelinesDistributed team collaboration | Remote workSenior-level Full TimeHyderabad, TS, India R23h ago
-
Senior AI Engineer - Remote INR 3375K-5000KApache | Apache Tomcat | CI/CD | CircleCI | CloudFormationRemote workSenior-level Full TimeGurugram, HR, India R23h ago
-
Senior AI Engineer - Remote INR 3375K-5000KAWS DocumentDB | Apache Tomcat | CI/CD | CircleCI | CloudFormationFlexible distributed team | Remote workSenior-level Full TimeBengaluru, KA, India R23h ago
-
Senior AI Engineer - Remote INR 3375K-5000KApache Avro | Apache Tomcat | CI/CD | CircleCI | CloudFormationGrowth mentoring | Mission-driven work | Remote workSenior-level Full TimeNew Delhi, DL, India R23h ago
-
Azure Cloud/DevOps Specialist Consultant INR 2000K-3500KAWS | Ansible | Application Gateway | Azure | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior Software Engineer, (Python, GenAI, MCP) INR 2940K-4170KAI Automation | CI/CD | Data Storage | Data Streaming | GitSenior-level Full TimeRemote - Bangalore, India R1d ago
-
Senior Consultant Specialist INR 3000K-5500KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Lead Data Engineer INR 2000K-3200KApplication Insights | Azure Data | Azure Data Factory | Azure RBAC | DAXRemote work | Video screen with recruiting teamSenior-level Full TimeIndia, India R1d ago
-
Software Engineer I- Eng INR 300K-350KAWS | Agile | Automation | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Mentorship | Paid time offEntry-level Full TimeNoida,UP,India R1d ago
-
AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMakerFlexible shifts | Long-term career growth | Mentorship and community | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
Senior Machine Learning Operations Engineer INR 2500K-3500KAWS | AWS Glue | AWS Lambda | Amazon SageMaker | AzureSenior-level Full TimeBangalore, INDIA R1d ago
-
Principal Engineer, SQL DBA INR 1500K-2700KADO.NET | Audit Logging | Azure | CI/CD | Change ManagementSenior-level Full TimeRemote, India R1d ago
-
Lead Consultant - AI Architect INR 3000K-5000KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R1d ago
-
Data Engineer INR 1500K-2500KAgile | Apache Spark | CI/CD | Data Management | Data ModelingHybrid work model | Remote flexibilitySenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Azure IoT | Azure IoT Edge | Azure IoT Hub | C# | C++Hybrid work model | Remote work up to 2 days per weekSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Automation Prompt Engineer INR 3264K-3880KAI | Automation platforms | Classification | Data Delivery | Data QualityHybrid work environmentSenior-level Full TimeIndia - Remote R1d ago
-
Data Engineer INR 1500K-2000KAPI Integration | AWS | ETL | NumPy | PandasHybrid work | Remote workMid-level Full TimeGreater Delhi Area R2d ago
-
APIs | Agile | CI/CD | Cloud infrastructure | Continuous DeliveryAnnual company retreat | Conference sponsorship | Employee friendly leave policies | Flexible scheduling | Fully remote-firstMid-level Full TimeIndia R2d ago