Expert Data Engineer (Databricks)
Maharashtra, Pune, India
INR 1500K-2400K (estimate) Senior-level Full Time
Tasks
- Build BI dashboards
- Build ETL and ELT pipelines
- Build inference pipelines
- Design data pipelines
- Design schemas and tables
- Implement CI/CD pipelines
- Implement data governance and lineage
- Implement data validation and monitoring
- Implement model versioning
- Manage enterprise data catalog
- Manage model deployment lifecycle
- Optimize compute and storage cost
- Orchestrate workflows
- Productionize machine learning models
- Set up alerting and automated recovery
- Use infrastructure as code
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | API Key | AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS VPC | Alerting | Apache Spark | Authentication | Authorization | CI/CD | Data Lakehouse | Databricks | Databricks Workflows | Delta Lake | FastAPI | Flask | Infrastructure as Code | MLOps | Machine Learning | Monitoring | OAuth | PySpark | Python | Query Optimization | REST API | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Senior-level Full TimePune, India7h ago
-
AWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFree games | Hybrid work | Learning and growth opportunities | Medical insurance | Mental health supportEntry-level Full Time地点：Hyderabad, Telangana, India10h ago
-
Senior-level Full TimeIN-AP-Hyderabad10h ago
-
Senior-level Full TimeIN-MH-Pune10h ago
-
Mid-level Full TimeLocations: Hyderabad, Telangana, India11h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowCareer growth opportunities | Complimentary games | Family leave | Healthcare coverage | Mental wellbeing supportEntry-level Full TimeLocations: Hyderabad, Telangana, India11h ago
-
GBM - Public Dept-Bengaluru-Associate-Quantitative Engineering INR 1200K-2200KAutomation | C++ | Derivatives pricing | Equity Derivatives | Equity swapsMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Senior Staff Software Engineer, Google Cloud Storage INR 3200K-4000KArtificial Intelligence | Benchmarking | C++ | Cloud Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India12h ago
-
AI Customer Engineer, Public Sector, Google Cloud INR 2500K-5000KAPI Gateway | Audit Logging | Business automation | Cloud Networking | Distributed tracingConference participation | Travel opportunitiesSenior-level Full TimeGurugram, Haryana, India12h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQuerySenior-level Full TimeHyderabad, Telangana, India R12h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQueryFlexible working | Opportunities for professional developmentSenior-level Full TimePune, Maharashtra, India R13h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior Software Engineer INR 2475K-5000K.NET | Agile | Artificial Intelligence | Azure Functions | Cloud servicesSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad13h ago
-
Senior Engineer - Operational Excellence (AI Solutions) INR 2500K-5000KAI Agent | AI Foundry | AI agent workflows | AI guardrails | APIsSenior-level Full TimePune, Maharashtra, IND, 41101314h ago
-
Senior-level Full TimeHyderabad, TS, India14h ago
-
Software Engineer III - Python, AI ML, Cloud INR 3500K-5500KAgentic Frameworks | Amazon Web Services | Apache Airflow | Automated testing | AzureSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Senior-level Full TimeHyderabad, Telangana, India14h ago
-
Mid-level Full TimeGurgaon, Haryana, India15h ago
-
Software Engineer II - UI + Python Developer + AI / ML INR 2500K-4000KAWS | Agile | CI/CD | CSS | HTMLMid-level Full TimeMumbai, Maharashtra, India15h ago
-
AI Engineer INR 2475K-4200KAgentic Systems | Azure OpenAI | Azure OpenAI APIs | Azure OpenAI SDK | Cloud IntegrationEntry-level Full TimeBengaluru, KA, IN16h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN16h ago
-
AI/ML Expert INR 2500K-5000KARIMA | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data AnalysisSenior-level Full Timecoimbatore, India17h ago
-
AI/ML Expert INR 2500K-5000KARIMA | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data AnalysisSenior-level Full Timecoimbatore, India17h ago
-
AI/ML Expert INR 2500K-5000KARIMA | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data AnalysisSenior-level Full Timecoimbatore, India17h ago