Engineer Senior - Data Engineering
Tasks
- Build CI CD automation and deployment with Databricks Asset Bundles
- Collaborate to evolve products and internal processes
- Design layered lakehouse structures bronze silver gold
- Develop data technologies using Databricks Azure Data Factory Python and T-SQL
- Evolve data lakehouse using medallion architecture
- Implement data governance for standards security and quality
- Lead consensus building for recommended solutions
- Maintain proficiency in required data engineering skills
- Manage project lifecycle using Azure DevOps and scrum processes
- Mentor engineers and IT associates
- Orchestrate ETL workflows with Azure Data Factory
- Perform after-hours on-call support
- Provision and manage cloud resources with Terraform
- Translate requirements into data models for analytics and AI ML
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Call Support | Data Factory | Data Governance | Data Lakehouse | Data Modeling | Databricks | Delta Lake | ETL | Infrastructure as Code | Medallion Architecture | On-Call | On-call support | Python | Query Optimization | SQL | Spark SQL | Stored Procedures | T-SQL | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeGurugram, India3h ago
-
Data Operation Engineer INR 2040K-3000KAsset bundles | Azure | Cloud platform | Confluence | DBTHybrid work arrangementMid-level Full TimeChennai, Tamil Nadu, India5h ago
-
AWS | Azure | Cloud platform | Deep learning | Generative AIContinuous learning and growth | Fully remote work | Technical excellence and experimentation cultureSenior-level Full TimeIndia R5h ago
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India5h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia5h ago
-
AI/ML Expert INR 2500K-4800KARIMA | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data AnalysisSenior-level Full Timecoimbatore, India5h ago
-
Senior-level Full TimeAnywhere in India R5h ago
-
Mid-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior Software Engineer (Python, Pyspark, Databricks, AWS, SQL) INR 2475K-2829KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon S3Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India6h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Staff Software Engineer - Data Platform INR 2755K-3465KAmazon Kinesis | Apache Beam | Apache Flink | Apache Hadoop | Apache KafkaSenior-level Full TimeBengaluru, India9h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Forward Deployed Engineer INR 2000K-3500KAI | APIs | Agent Orchestration | Agent-based | Agent-based AISenior-level Full TimeHyderabad, India9h ago
-
Senior AI Engineer (Agents) INR 2000K-3500KA/B | A/B Testing | Agent Assist | Anthropic | B testingEmployee benefits | Flexible culture | Remote work flexibilitySenior-level Full TimeHyderabad, India9h ago
-
Senior AI Engineer (Search/Retrieval) INR 2000K-3465KAWS | Azure | BM25 | CI/CD | Citation AccuracySenior-level Full TimeHyderabad, India9h ago
-
Computer Scientist ( Java Backend ) INR 2500K-3500KApache Kafka | CI/CD | Docker | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, India R11h ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R11h ago
-
Computer Scientist - II ( Data Engineering ) INR 1500K-2000KAWS | Apache Spark | Azure | CI/CD | Data ModelingMid-level Full TimeNoida, India R11h ago
-
Senior Data Engineer INR 3000K-4200KAWS | Automated testing | CI/CD | DBT | Data GovernanceEducational assistance | Employee assistance program | Flexible time off | Free Cab Transport Facility | Hybrid work modelSenior-level Full TimeIND - NonGBS-Pune-Kharadi, India11h ago
-
Senior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …11h ago
-
Data Platform Architect/Lead INR 1500K-2800KAccess Control | CI/CD | DBT | Data Architecture | Data LakehouseSenior-level Full TimeHyderabad, India11h ago
-
Engineer III - Data Platform (Hybrid, IND) INR 2500K-3500KAWS | Airflow | Azure | CI/CD | ContainerizationCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid parental and adoption leave | Paid time offSenior-level Full TimeBangalore, India R11h ago
-
AI Assisted Development | AI code review | Agile | Automation Testing | BDDMid-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …11h ago