Enterprise Data & Analytics Engineer
IN025 Embassy Manyata Business Park, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build ETL ELT pipelines using Azure Databricks
- Configure Unity Catalog for governance and security
- Create analytics ready data sets using medallion architecture
- Develop automated data quality checks using Delta Live Tables
- Implement data access controls
- Ingest data into Azure Data Lake Storage ADLS
- Orchestrate data workflows and monitor job runs
- Transform data using Pyspark and Spark SQL
- Tune Spark jobs by optimizing joins
Perks/Benefits
- Employee resource groups
- Learning and development opportunities
- Paid Company Holidays
- Paid vacation
- Volunteer time
Skills/Tech-stack
ADLS Gen2 | Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CD | Cloud Architecture | Data Factory | Data Lake Storage | Databricks Notebooks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Git | Key Vault | Medallion Architecture | PySpark | Python | SQL | Spark SQL | Unity Catalog
Education
Related jobs
-
Senior Software Engineer, Cloud Bigtable INR 2000K-3500KBigtable | C++ | CI/CD | Cassandra | Column-storesSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Software Engineer, Cloud Infrastructure Engineering INR 1000K-1500KAPIs | Capacity Planning | Compute Technologies | Data Structures | Data Structures and AlgorithmsMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Quant Analytics Associate Senior INR 500K-1039KAgile | Alteryx | Data Mapping | Data Modeling | Data ReconciliationMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Senior PostgreSQL DBA / Database Platform Engineer INR 1500K-3440KAWS | Ansible | Automation | Azure | Azure MonitorSenior-level Full TimeChennai, IN5h ago
-
Data Engineering Specialist INR 1800K-2500KAlgorithm Design | Artificial Intelligence | Data Analysis | Data Ethics | Data ModelingContinuous learning | Inclusive leadership | Knowledge sharing | Mentoring opportunitiesMid-level Full TimeKolkata, IN, 7001566h ago
-
Lead Software Engineer Java FSD + AWS INR 2000K-4000KAPI Design | Agile | Airflow | Alerting | Apache SparkSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior-level Full TimeBengaluru, Karnataka, India9h ago
-
Applied AI ML Associate Senior- Python/Java , AWS INR 700K-800KAPI | AWS | AWS Lambda | AWS Step Functions | Amazon AuroraMid-level Full TimeBengaluru, Karnataka, India9h ago
-
AI/ML Developer INR 1000K-1250KArtificial Intelligence | Batch Processing | Data Science | Distributed Computing | LLMMid-level Full TimeBangalore, KA, IN14h ago
-
Sr Developer, MLOPs INR 2229K-3500KAngular | CI/CD | Distributed Systems | Docker | FeastHybrid work schedule | In-person office days | Virtual workSenior-level Full TimeBengaluru, India14h ago
-
Algorithm Developer INR 1000K-1250KC plus plus | C# | CUDA | Computer Vision | Deep learningHealth and wellbeing programs | Professional growth programs | Supportive work cultureMid-level Full TimeBangalore,IND, India14h ago
-
Senior ML Engineer INR 2500K-4500KA B Testing Metrics | A/B | A/B Testing | AWS | Amazon SageMakerHybrid work model | Periodic travel as needed | Remote work optionSenior-level Full TimeAPAC - India - Bengaluru - … R14h ago
-
Senior Engineer Automation Quality INR 1524K-2541KAPI Testing | AWS | Automation Testing | Automation frameworks | CI/CDSenior-level Full TimeKA Bangalore, India14h ago
-
Software Engineer - Entry INR 1300K-1505KAWS | Agile | Azure | CI/CD | ConfluenceGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Organizational growth potentialMid-level Full TimeIND-Trivandrum-Equifax Analytics-PTEC, India14h ago
-
AI Engineer INR 1800K-2500KAPI Integration | Agent memory | Anthropic API | Autogen | Automation AnywhereMid-level Full TimeIN Vadodara, India14h ago
-
Sr. AI Engineer INR 2500K-4800KAPI Integration | Agent memory | Anthropic API | Autogen | Automation AnywhereSenior-level Full TimeIN Mumbai Remote, India R14h ago
-
IND Lead Engineer, Infrastructure INR 1500K-3000KAmazon Web Services | Ansible | CI/CD | Capacity Planning | Cloud platformSenior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Data Engineer INR 1500K-2000KAgile | Analysis Services | Apache Airflow | Apache Spark | AzureAgile team delivery | Career development | Inclusive collaborative teamMid-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …14h ago
-
AWS Data Engineer INR 1200K-2000KAWS Glue | AWS Lake Formation | AWS Lambda | AWS Step Functions | AlationMid-level Full TimePune, Gera Commerzone SEZ, India14h ago
-
Enterprise Data & Analytics Engineering INR 1500K-2500KAWS | Agile | Airbyte | Airflow | Apache KafkaEmployee resource groups | Learning and development | Paid Company Holidays | Paid vacation | Volunteer timeMid-level Full TimeIN025 Embassy Manyata Business Park, India14h ago
-
Associate Software Engineer- (Python) INR 800K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Beautiful SoupInnovation | Integrity | Ownership | Remote work flexibility | Work-life balanceMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India20h ago
-
Software Engineer- (Python) INR 800K-1200KAlgorithms | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksLearning and teaching culture | Remote-friendly work | Work-life balance supportMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India20h ago
-
Senior-level Full TimeHyderabad, IND-TG, India21h ago
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai1d ago