Data Engineer
Tasks
- Build data pipelines
- Design data pipelines
- Ensure data quality
- Ensure data security
- Implement data governance
- Ingest data
- Integrate Databricks with Azure services
- Maintain data pipelines
- Monitor pipeline performance
- Optimize Spark configurations
- Process large datasets
- Track compute costs
- Transform data
- Troubleshoot pipeline issues
- Tune Databricks jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Machine Learning | Data Governance | Data Lake Storage | Data Security | Databricks | Databricks Runtime | Databricks SQL | Databricks Workflows | Delta Lake | ELT | ETL | Gold Medallion | MLflow | Machine Learning | MuleSoft | PySpark | Python | SQL | Scala
Education
N/A
Roles
Related jobs
-
Senior Applied Scientist INR 2516K-3500KContent Moderation | Data Analysis | Distributed Training | Experiment design | Fraud DetectionSenior-level Full TimeBengaluru, KA, IN2h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2000KAI | Automation | C++ | Data Analysis | Data ModelingMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Mid-level Full TimeGurugram, Haryana, India3h ago
-
Software Engineer II - Java Fullstack + React + Python(AI/ML) INR 1000K-2200KAWS | AWS CodeDeploy | Agile | CI/CD | CucumberMid-level Full TimeHyderabad, Telangana, India4h ago
-
Analytics & BI Consultant – Metabase INR 800K-1200KAgile | Business Intelligence | Common table expressions | Dashboards | Data ReconciliationSenior-level Full TimeGurugram, Haryana, India5h ago
-
Data Quality Engineer-Azure Data Platform Testing INR 1200K-1500KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeHyderabad, IN7h ago
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R7h ago
-
AI Engineer INR 950K-1050KAWS | Airflow | Algorithms | Apache Spark | Data StructuresGlobal team collaboration | Hybrid workMid-level Full TimeBengaluru, INDIA, India8h ago
-
Associate Data Engineer INR 1000K-1250KApache Airflow | Apache Flink | Apache Spark | Autogen | DagsterEducation reimbursement | Health plans | Hybrid work | In-office perks | Parental leaveMid-level Full TimeBangalore, IND; Mohali, IND; Pune, IND8h ago
-
Data Engineer III - Scala , Spark , Databricks INR 2000K-2300KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Product Development Lead INR 2200K-3500KAWS | Artificial Intelligence | Best practices | Cloud Computing | Cloud platformSenior-level Full TimeIndia8h ago
-
Applied AI ML Associate Senior INR 950K-1200KAWS | Agentic AI | Agile methodologies | Application Resiliency | CI/CDMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AWS | Apache Airflow | Azure | Azure DevOps | CI/CDSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Mid-level Full TimeRemote, India R10h ago
-
Sr ML & AI Engineer INR 2940K-4500KAPIs | Amazon Web Services | Data Preprocessing | Deep learning | Distributed ComputingContinuous learning and professional growth | Flexible working arrangementsSenior-level Full TimeMumbai, India10h ago
-
Sr Software Engineer INR 3050K-4350KAWS | Amazon Web Services | Best practices | Cloud Computing | DebuggingCross-functional team projects | Learning and development | Online learning campus | Training coursesSenior-level Full TimeMumbai, India10h ago
-
Applied AI ML Lead - Global Banking INR 2500K-3500KAPI Design | AWS | Authentication | Authorization | CI/CDSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Applied AI ML Lead INR 2500K-4000KAWS Lambda | AWS S3 | AWS Step Functions | Agentic AI | Amazon AthenaSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Engineer II, Quality Engineering INR 1340K-1890KAPI Testing | AWS | Amazon Redshift | BigQuery | CI/CDContinuous learning | Family-friendly perks | Financial wellness programs | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …14h ago
-
Data Engineer INR 400K-700KAI | API Integration | Alteryx | Automated testing | CI/CDCareer development | ESG initiatives | Employee incentive programs | Employee wellbeing resources | Flexible vacationEntry-level Full TimeIndia, Bengaluru, Karnataka R14h ago
-
Software Engineer, Data Platform INR 800K-1200KAPI | API Gateway | AWS | Agile | CI/CDCareer development | Headspace access | Hybrid work model | Mental health days | Paid volunteer daysMid-level Full TimeIndia, Bengaluru, Karnataka R14h ago
-
Advanced Data Scientist INR 2040K-2600KBayesian Inference | CI/CD | Causal Inference | Computer Vision | Data QualitySenior-level Full TimeBangalore, KA, IN, 56006614h ago
-
Senior Application Developer, AI INR 2500K-3500KAI Foundry | AI Studio | AWS | Authentication | AzureSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Lead Data Scientist- Content Creation INR 2516K-3356KApache Spark | CI/CD | Computer Vision | Deep learning | Diffusion ModelsSenior-level Full TimeBangalore,India14h ago