Data Engineer
Tasks
- Apply medallion architecture transformations
- Apply security controls with RBAC encryption and data classification
- Build and manage data workflows and orchestration
- Build ingestion pipelines across AWS Azure GCP
- Document pipelines data models and operational procedures
- Implement CDC and SCD type 1 and 2
- Implement batch and streaming data pipelines
- Implement data governance quality validation and monitoring
- Implement metadata lineage and cataloging
- Manage Delta Lake tables partitions and performance
- Support CI CD pipelines troubleshooting and recovery
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Pipelines | CDC | CI/CD | Cloud Storage | Cloud platform | Data Factory | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Encryption | Git | Google Cloud | Google Cloud Platform | Lakehouse | Metadata Management | Microsoft Purview | Power BI | PySpark | RBAC | SCD Type 1 | SCD Type-2 | SQL | Schema evolution | Type 1 | Type 2) | Unity Catalog
Education
Roles
Related jobs
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R6h ago
-
AI | APIs | Airtable | Automation | Data EngineeringComprehensive healthcare | Flexible time off | Retirement plan | Tuition reimbursementMid-level Full TimeHA4 - DLF Building Tower B, … R20h ago
-
Data Science | Machine Learning | NumPy | Pandas | PythonHybrid work | Onsite collaboration | Professional development | Remote work flexibilityExecutive-level Full TimeMumbai - Hiranandani, India R20h ago
-
API Integration | Backend Development | Frontend Frameworks | Generative AI | Google CloudFast paced product culture | Fully remote work | High ownership | Shift-based scheduleSenior-level Full TimeIndia R1d ago
-
Manager, Data And Analytics INR 700K-1200KAWS Redshift | Anomaly Detection | Azure | BigQuery | Business IntelligenceMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Machine Learning Engineer INR 1000K-1800KAPI Development | AWS | Amazon Bedrock | Amazon EKS | Amazon SageMakerMid-level Full TimeBangalore,Karnataka,India R1d ago
-
Financial analytics | Java | Project Management | Python | RFlexible time off | Healthcare | Retirement plan | Support for working parents | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Senior QA Engineer INR 1500K-2500KAPI Testing | Apache Avro | Apache Kafka | CI/CD | Contract testingRemote workSenior-level Full TimeIndia - Remote R1d ago
-
Data Governance Engineer INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeIN - Hyderabad, India R1d ago
-
Analytics Operations Analyst INR 700K-860KAlerting | Cause analysis | Cloud Computing | Dashboarding | Data AnalysisFlexible working hours | Hybrid work model | Professional development opportunities | Remote work options | Work-life balanceMid-level Full TimeNoida, India R1d ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 2500K-3380KAWS | Access Control | Apache Spark | Audit Logging | CI/CDSenior-level Full TimeHIH - Hyderabad, India R1d ago
-
AI Data Engineer INR 3000K-3880KAPIs | AWS | Agile | Customer Data | Customer Data PlatformEmployee incentive programs | Flexible work policies | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Software development engineer 2 INR 1000K-2200KAgile methodology | Apache Spark | CI/CD | Data pipeline | Data pipeline designHybrid work modelMid-level Full TimeBangalore, India R1d ago
-
Senior QA Engineer (Automation + Data + Kafka) INR 1600K-2800KAPI Testing | Amazon Redshift | Avro | BigQuery | CI/CDRemote workSenior-level Full TimeIndia - Remote R1d ago
-
.NET | API Management | Agile | Angular | AuthenticationCollaborative cross-functional team | Fully remote within India | Hands on GenAI projects | Innovation-focused environmentSenior-level Full TimeIndia R4d ago
-
Agile | Airflow | Azure | Azure Data | Azure Data FactoryCareer development | Fully remote | Inclusive collaborative environment | Long-term contract | MentorshipSenior-level Full TimeIndia R4d ago
-
Senior-level Full TimeHyderabad, Telangana, India - Remote R4d ago
-
Mid-level Full TimeHyderabad, Telangana, India - Remote R4d ago
-
Airflow | Apache Superset | Business Intelligence | Cloud platform | Complex joinsAnnual vacation | Conference support | English learning discounts | Fully remote | Health reimbursementSenior-level Full TimeIndia R4d ago
-
AWS | Azure | CI/CD | CircleCI | CloudFormationCareer growth | Collaborative innovation driven engineering culture | Continuous learning | Fully remote friendly work environment | MentorshipSenior-level Full TimeIndia R4d ago
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R4d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R4d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R4d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R4d ago
-
Data Engineering Operations Lead INR 3000K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | BigQueryAnnual leave | Away from keyboard time | Contributory pension scheme | Diversity forums and networking groups | Fitness Wellbeing ProgrammesSenior-level Full TimePune, India R4d ago