Senior Data Engineer
Tasks
- Analyze source and target systems
- Assess data governance policies and standards
- Conduct current state assessments
- Conduct data discovery
- Define data migration requirements
- Define target state governance frameworks
- Define transformation logic
- Design and implement ETL pipelines
- Design governance artifacts controls and KCIs
- Design reconciliation checks
- Drive stakeholder alignment and approvals
- Establish data ownership stewardship and accountability
- Implement data validation controls
- Ingest and transform data using ETL
- Manage change including training and communication
- Participate in governance forums and workshops
- Perform data lineage analysis
- Perform data mapping
- Perform gap analysis
- Perform post-migration validation
- Perform risk and control assessments
- Perform root cause analysis of data discrepancies
- Plan and execute data migration
- Plan cutover and migration rehearsals
- Resolve data quality issues
- Track data governance initiatives and deliverables
- Validate and reconcile migrated data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Ab Initio | Alation | Cause analysis | Change Management | Cloud platform | Collibra | Control Assessment | Data Controls | Data Engineering | Data Governance | Data Lineage | Data Management | Data Mapping | Data Migration | Data Quality | Data Reconciliation | Data Stewardship | Data Transformation | Data Validation | Data discovery | Data governance frameworks | Data ownership | Databricks | ETL | Google Cloud | Google Cloud Platform | Governance frameworks | Informatica | Integration Services | KCI | Microsoft Azure | RCSA | Risk and Control | Risk and control assessment | Root Cause Analysis | Root cause | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | Server Integration Services | Snowflake | Stakeholder management | Talend
Related jobs
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India7h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India7h ago
-
Sr. Data Engineer I INR 2400K-4000KAWS | AWS Glue | Amazon EMR | Apache Kafka | Cloud MigrationContinuous learning | International travel | Mentorship | Professional growthSenior-level Full TimeBangalore, India7h ago
-
Senior Manager – Data Scientist INR 2520K-3500KAWS | AWS SageMaker | Agent systems | Agentic AI | AzureCareer growth | Continuous learning opportunities | Mentorship | Mentorship and coachingSenior-level Full TimeIndia-Gurugram7h ago
-
DBT Data Engineer INR 400K-1200KAPI Development | AWS Glue | AWS S3 | Amazon Redshift | Apache AirflowSenior-level Full TimeIN-AP-Hyderabad7h ago
-
Data Engineer INR 1500K-2000KAPI Development | AWS SQS | Amazon Aurora | Amazon Redshift | Amazon S3Senior-level Full TimeIN-AP-Hyderabad7h ago
-
Database Developer INR 1200K-2200KAWS Aurora | AWS Aurora PostgreSQL | AWS Cloud | AWS Cloud Database Services | AWS DMSSenior-level Full TimeIN-KA-Bangalore7h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India8h ago
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India9h ago
-
Tools and Automation Engineer INR 1000K-1400KAIOps | Active Directory | Ansible | Automation Anywhere | CopilotMid-level Full TimeAhmedabad, Gujarat, India9h ago
-
Senior-level Full TimeGurgaon, Haryana, India10h ago
-
Python , web scrapping data conversion VBA INR 1500K-2156KAPI | Alerting | BeautifulSoup | Data Automation | Data EngineeringHybrid working | UK time zoneSenior-level Full TimeGurgaon, HR, India10h ago
-
Deputy Manager-Data Engineering INR 1500K-2000KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeGurgaon, HR, India11h ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India11h ago
-
Principal Engineer, Data Analytics Engineering 9+ years (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | Airflow | Amazon Bedrock | Anthropic API | CI/CDSenior-level Full TimeBengaluru, KA, India11h ago
-
GCP Cloud Engineer INR 2500K-4500KAI Pipelines | BigQuery | Blue-Green Deployment | Blue/green | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
Mid-level Full TimeBengaluru, IN, 56010312h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Consultant - Capital Projects - Analytics INR 1500K-3000KAlteryx | Artificial Intelligence | BIM | Business Process | Business Process ReengineeringMid-level Full TimeGurgaon, Haryana, India13h ago
-
Mid-level Full TimeGurugram, Haryana, India14h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-3300KAWS | AWS CDK | Agile | Airflow | BackfillSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Senior Data Engineer, Payments INR 2940K-4170KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache HBaseSenior-level Full TimeBangalore, India15h ago
-
Software Engineer 2 - AI/ML- Bangalore INR 1294K-2157KAWS | AWS Bedrock | Azure | Git | Google CloudMid-level Full TimeIndia15h ago
-
Executive - Azure Data Engineering INR 400K-500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsExecutive-level Full TimeBangalore, Karnataka, India15h ago
-
Cloud Data Platform Engineer-Senior INR 2000K-2400KAWS RDS | Azure SQL | Backup and Recovery | Bash | CI/CDSenior-level Full TimeBengaluru, KA, IN, 56001620h ago