Data Senior Engineer
Tasks
- Build data ingestion cleansing transformation and aggregation
- Collaborate with analysts architects QA and governance teams
- Create master stitched data file
- Design Azure ETL pipelines
- Develop reusable parameterized data pipelines
- Develop rules engine components
- Ensure audit traceability and business continuity
- Externalize business logic into rules engine
- Implement data quality checks profiling reconciliation and alerting
- Implement rules versioning governance and validation
- Integrate MDM sources and unify regional variations
- Maintain data pipeline monitoring orchestration and error handling
- Model optimized physical data models for analytics
- Optimize pipeline performance for large datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage | Data Modeling | Data Quality | Data orchestration | Data pipeline | Data profiling | Drools | ELT | ETL | Error Handling | MDM | Monitoring | ODM | Performance Tuning | Python | Reconciliation | SQL | Scrum | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India1h ago
-
Senior Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India12h ago
-
Junior Professional AE Engineer INR 180K-180KAzure Cloud | Copilot Studio | Docker | Git | KubernetesEntry-level Full TimeMorinda, India12h ago
-
Backend Engineer, Analytics Instrumentation (Golang) INR 3375K-4590KAPI | Data Quality | GRPC | Go | InstrumentationEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Home office supportSenior-level Full TimeRemote, India R15h ago
-
Backend Engineer, Analytics Instrumentation (Golang) INR 3375K-4590KAPI Design | Analytics | Data Quality | Distributed Systems | GRPCEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Home office supportSenior-level Full TimeRemote, India R15h ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R15h ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R15h ago
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India20h ago
-
Staff Machine Learning Engineer INR 2600K-5000KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Bias detectionSenior-level Full TimeBangalore20h ago
-
Staff Data Engineer INR 3200K-4600KAgentic Workflows | Airflow | Argo | Data Modeling | Data QualitySenior-level Full TimeBangalore20h ago
-
Senior Machine Learning Engineer INR 3100K-4500KA/B | A/B Testing | B testing | Cloud Computing | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India20h ago
-
Senior Analytics Engineer INR 2940K-4170KAmazon Redshift | BigQuery | Data Modeling | Data Transformation | Data WarehousingCommunity benefits | Family benefits | Finance benefits | Health benefits | Relocation supportSenior-level Full TimeHyderabad - Main Office21h ago
-
Consultant Machine Learning Engineer INR 3380K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsMid-level Full TimeBangalore, India R22h ago
-
Business Intelligence Data Engineer INR 1524K-3000KAWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon RedshiftMid-level Full TimeHyderabad India23h ago
-
Senior-level Full TimePune, MH, India23h ago
-
Entry-level Full TimeBangalore North, India23h ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore23h ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
AI Solutions Specialist INR 1200K-1800KData Monitoring | Data Pipelines | Data Preparation | Experimentation | Language ModelsCellphone reimbursement | Corporate wellness programs | Daycare/Creche facility | Great Place to Work certification | Headspace reimbursementMid-level Full TimePune, Maharashtra, India1d ago
-
Azure Data Engineer - Analyst INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeGurugram, India1d ago
-
Azure Data Engineer - Analyst INR 1500K-2500KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeGurugram, India1d ago
-
Entry-level Full TimeHyderabad, Telangana, India1d ago
-
Senior AI Engineer (Agents) INR 2500K-4500KA/B | A/B Testing | API Integration | Agent Assist | B testingEmployee benefits | Flexible work environment | Remote work option | Self-care supportSenior-level Full TimeChennai, India1d ago
-
Associate - Data Engineer INR 1500K-2345KData Analysis | Data Engineering | Data Management | Data Pipelines | Data ProcessingMid-level Full TimeIndia1d ago