IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_Gurgaon
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Collaborate on AI/ML workloads
- Curate datasets
- Design data pipelines
- Develop Databricks notebooks
- Develop batch data processing
- Develop incremental data processing
- Document data flows
- Document runbooks
- Document technical designs
- Ensure Data reliability
- Ensure data governance
- Ensure data quality
- Implement Delta Lake transformations
- Ingest datasets
- Maintain data pipelines
- Mentor junior engineers
- Optimize Databricks jobs
- Provide production support
- Transform datasets
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Amazon Web Services | Apache Airflow | Apache Hadoop | Apache Spark | Auto Loader | Azure | Azure Data | Azure Data Factory | CI/CD | Cloud platform | Data Architecture | Data Factory | Data Governance | Data Modeling | Data Warehousing | Data integration | Data pipeline | Databricks | Delta Lake | Distributed Computing | ELT | ETL | Google Cloud | Google Cloud Platform | Lakehouse | PySpark | Python | SQL | Spark SQL | Streaming | Unity Catalog | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R1h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia15h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN16h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India16h ago
-
Senior-level Full TimeMaharashtra, Pune, India17h ago
-
Mid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Senior-level Full TimeIN-HR-Gurgaon17h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Staff Engineer_SAP Analytics Data Management INR 1500K-2700KABAP | ADSO | Analytics Cloud | CompositeProvider | Data ModelingOnsite 5 days per week | Production rollout support | UAT supportSenior-level Full TimeNoida, India18h ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Power BI Fabric Engineer INR 2000K-2700KAzure Data | Azure Data Factory | CI/CD | DAX | Data FactoryAnnual excellence awards | Bike to work | Career mentorship | Educational assistance | Employee assistance programmeMid-level Full TimeBengaluru, KA, India19h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia19h ago
-
Big Data Lead INR 1500K-2500KData Architecture | Data Governance | Data Management | Data Management Cloud | Data WarehouseSenior-level Full TimeIndia20h ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
LAM-MTS-AWS+PySparks INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh, India20h ago
-
Senior-level Full TimeBengaluru, KA, India20h ago
-
Senior-level Full TimeBengaluru, KA, India20h ago