26-2292: Databricks Engineer- India, Hyderabad
Tasks
- Apply schema evolution and data versioning
- Architect and manage data lakes on Azure Data Lake Storage or Amazon S3
- Build data marts and warehousing solutions
- Conduct code reviews and promote reusable patterns
- Create feature rich datasets for model training and inference
- Design end to end data pipelines on Databricks
- Develop data quality checks validation and anomaly detection
- Enforce row level security encryption and fine grained access control
- Implement ETL ELT pipelines with Apache Spark and Delta Lake
- Implement MLOps workflows with MLflow
- Implement Unity Catalog for metadata lineage and governance
- Implement data masking tokenization and anonymization
- Implement standardized ingestion with error handling retries and alerting
- Ingest data from PeopleSoft D2L and Salesforce using APIs and JDBC
- Maintain technical documentation architecture diagrams and runbooks
- Optimize storage and access patterns for performance and cost
- Orchestrate Databricks workflows for dependency management and automation
- Set up monitoring and observability for ETL performance and failures
- Support code reviews and deliver progress reports against roadmap
- Support compliance audits with security teams
Perks/Benefits
- N/A
Skills/Tech-stack
AIOps | Access Control | Amazon S3 | Anonymization | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Data Governance | Data Lake Storage | Data Lakes | Data Lineage | Data Versioning | Data Warehousing | Data masking | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Encryption | Grafana | JDBC | MLOps | MLflow | Metadata Management | Python | REST APIs | Row Level Security | SQL | Scala | Schema evolution | Snowflake Schema | Star Schema | Tokenization | Unity Catalog
Education
N/A
Roles
Big Data Engineer | Data Engineer | Databricks Engineer | Engineer
Regions
Countries
States
Related jobs
-
AI Agents | AI Governance | API Security | Auditability | Cloud SecurityHybrid work | Onsite supportMid-level Full TimeBengaluru, Karnataka, India R22h ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)22h ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …22h ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru1d ago
-
Principal Engineer, AI Architect INR 2000K-5000KAI Practices | API Integration | AWS | Agent Orchestration | AzureSenior-level Full TimeBengaluru, India1d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R1d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior II Data Engineer INR 3600K-4995KData Intelligence | Data Modeling | Fusion Data Intelligence | Oracle Cloud | Oracle DatabaseFlexible workingSenior-level Full TimeIndia1d ago
-
SW Architect - AI Engineering INR 2500K-5000KAPI Development | AWS | Azure | Cloud platform | Cost OptimizationContinuous learning opportunities | Hybrid work opportunities | Supportive, inclusive work environment | Training programsSenior-level Full TimePune - Maharashtra - India1d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India1d ago
-
Senior Software Engineer, Google Cloud INR 2000K-3300KAgentic AI | CI/CD | Cloud Computing | Code review | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Mid-level Full TimeIndia1d ago
-
Lead Software Engineer - (SRE principles , AI tools, AWS) INR 3000K-6000KAIOps | API Gateway | AWS ECS | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Analytics Engineer INR 2800K-4200KCI/CD | DBT | Dashboards | Data Quality | DatabricksHealth insurance | Hybrid work model | Mental health support | Paid time off | Transport allowanceSenior-level Full TimeBangalore (Hybrid) R1d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
AI Engineer INR 2500K-4800KCloud Computing | Generative AI | Language Models | Large Language Models | MLOpsMid-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Platform Engineer INR 1500K-3900KADLS Gen2 | Azure | Azure Databricks | Azure Networking | Azure StorageSenior-level Full TimeChennai, Tamil Nadu, India1d ago