Data Senior Engineer
Tasks
- Build data ingestion cleansing transformation and aggregation
- Collaborate with analysts architects QA and governance teams
- Create master stitched data file
- Design Azure ETL pipelines
- Develop reusable parameterized data pipelines
- Develop rules engine components
- Ensure audit traceability and business continuity
- Externalize business logic into rules engine
- Implement data quality checks profiling reconciliation and alerting
- Implement rules versioning governance and validation
- Integrate MDM sources and unify regional variations
- Maintain data pipeline monitoring orchestration and error handling
- Model optimized physical data models for analytics
- Optimize pipeline performance for large datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage | Data Modeling | Data Quality | Data orchestration | Data pipeline | Data profiling | Drools | ELT | ETL | Error Handling | MDM | Monitoring | ODM | Performance Tuning | Python | Reconciliation | SQL | Scrum | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Senior Customer and Product Solutions Engineer, Google AI INR 2500K-5000KAI Studio | C++ | CSS | Cloud platform | Data AnalysisSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India3h ago
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Senior Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India14h ago
-
Junior Professional AE Engineer INR 180K-180KAzure Cloud | Copilot Studio | Docker | Git | KubernetesEntry-level Full TimeMorinda, India14h ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 3200K-4725KAWS | Angular | CI/CD | CSS | Deep learningSenior-level Full TimeHIH - Hyderabad, India14h ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 2535K-3500KAWS | Agile | Amazon SageMaker | Angular | CI/CDFull-time position | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India14h ago
-
Backend Engineer, Analytics Instrumentation (Golang) INR 3375K-4590KAPI | Data Quality | GRPC | Go | InstrumentationEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Home office supportSenior-level Full TimeRemote, India R16h ago
-
Backend Engineer, Analytics Instrumentation (Golang) INR 3375K-4590KAPI Design | Analytics | Data Quality | Distributed Systems | GRPCEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Home office supportSenior-level Full TimeRemote, India R16h ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R16h ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R17h ago
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India21h ago
-
Staff Machine Learning Engineer INR 2600K-5000KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Bias detectionSenior-level Full TimeBangalore21h ago
-
Staff Data Engineer INR 3200K-4600KAgentic Workflows | Airflow | Argo | Data Modeling | Data QualitySenior-level Full TimeBangalore21h ago
-
Senior Machine Learning Engineer INR 3100K-4500KA/B | A/B Testing | B testing | Cloud Computing | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India22h ago
-
Senior Analytics Engineer INR 2940K-4170KAmazon Redshift | BigQuery | Data Modeling | Data Transformation | Data WarehousingCommunity benefits | Family benefits | Finance benefits | Health benefits | Relocation supportSenior-level Full TimeHyderabad - Main Office22h ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
Consultant Machine Learning Engineer INR 3380K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsMid-level Full TimeBangalore, India R1d ago
-
Business Intelligence Data Engineer INR 1524K-3000KAWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon RedshiftMid-level Full TimeHyderabad India1d ago
-
Applied AI ML Lead INR 2500K-3307KAWS | Algorithms | Amazon SageMaker | Apache Spark | Computer VisionSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimePune, MH, India1d ago
-
Entry-level Full TimeBangalore North, India1d ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Mid-level Full TimeChennai, TN, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago