Senior Data Engineering Manager - T&T
Tasks
- Automate manual processes
- Build data models for AI consumption
- Clean large volumes of data
- Collaborate with data scientists and AI engineers
- Design and implement ELT pipelines
- Develop data solutions with cross-functional teams
- Ensure performance security and data integrity
- Implement CI CD using Azure DevOps and Git
- Implement process improvements and automation
- Improve scalability
- Ingest harmonize transform data
- Manage agile delivery using Azure DevOps
- Optimize ingestion tuning and caching
- Perform data quality monitoring
- Provide guidance to data teams
- Support data pipelines and resolve data errors
- Tune parquet delta files and SQL databases
- Write data transformation code
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Storage | Azure Storage Accounts | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Ingestion | Data Modeling | Data Warehousing | Delta Lake | Git | Key Vault | Microsoft Fabric | Parquet | Power BI | PySpark | Python | SAP | SAP BW | SQL | Storage Accounts | Synapse Analytics | T-SQL
Education
Related jobs
-
SATIC - Data Governance Manager ZAR 600K-720KAI Governance | Access Entitlements | BI | Control Design | Data CatalogSenior-level Full TimeJohannesburg, South Africa4h ago
-
Manager Data Analytics USD 110K-125KA/B | A/B Testing | Adobe Analytics | Amazon Athena | Amazon QuickSightMid-level Full TimeEl Segundo, CALIFORNIA, United States7h ago
-
Data Science Lead MXN 1040K-1300KAWS | Cloud infrastructure | Cloud platform | Data Engineering | Data PipelinesCareer development plans | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeGuadalajara, Jal., Mexico8h ago
-
Data & Analytics Manager LATAM COP 54000K-72000KAmazon Web Services | Apache Spark | Azure | Cloud Computing | Cloud platformMid-level Full TimeBogotá, Bogotá, Colombia8h ago
-
Data Ops Sénior – Data Platform EUR 44K-52KAccess Control | Access Control Lists | Agile | Apache Kafka | BashCareer mobility | Events for wellbeing and performance | Internal mobility | Training opportunitiesSenior-level Full TimeRabat, Rabat-Salé-Kénitra, Morocco12h ago
-
AI | AWS | Agile | Architecture Design | CI/CDHybrid work | Onsite 3 days per week | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R12h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States14h ago
-
Apache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data PlatformsFully remote work | Training and professional development initiativesSenior-level Full TimeRemote R15h ago
-
Senior Product Manager - Data Platforms GBP 70K-87KBusiness Analysis | Change Management | Data Product Management | Data Warehousing | Data meshAnnual holiday | Life insurance | Pension scheme | Private medical insurance | Training optionsSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom15h ago
-
AI Governance | Agile | Artificial Intelligence | Azure DevOps | ComplianceSenior-level Full TimeUnited Arab Emirates15h ago
-
AI | Ab Initio | Alation | Collibra | Data CatalogDiversity and inclusion | Employee resource groups | Health and safety support | Work-life balanceSenior-level Full Time500 Woodward Avenue, MI, 601 S. … R15h ago
-
Ad Manager | Adobe Analytics | BigQuery | Data Governance | Data PrivacyFamily support programs | Healthcare coverageSenior-level Full TimeSingapore15h ago
-
Senior-level Full TimeDallas, Texas, United States15h ago
-
Lead Analyst - N360 Supplier Analytics GBP 43K-54KBusiness Intelligence | Classification | Clean rooms | Clustering | Data Clean RoomsAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeLondon, London, United Kingdom16h ago
-
Data Governance Manager EUR 45K-50KAI tools | Access Management | DBT | Data Access Management | Data CatalogCross-functional exposure | Dynamic innovative work environment | Global scope | High visibility with senior leadershipMid-level Full TimeAnnecy, France16h ago
-
Site Manager, Robotics Teleoperation USD 139K-200KBash | Data Curation | Data Pipelines | Data Quality | Fleet ManagementMid-level Full TimeBurlingame, CA16h ago
-
Business Strategy | Data Analysis | Data Visualization | Data analytics | Executive CommunicationMid-level Full TimeSingapore17h ago
-
Data Engineering | DataStage | ETL | IBM DataStage | PythonElectric bikes | Green transportation budget | Hybrid work policy | Inclusive culture | Lactation RoomSenior-level Full TimeLisbon, Lisbon, Portugal17h ago
-
Mid-level Full TimeMumbai, Maharashtra, India17h ago
-
Global Manager – Customer Platform (Track & Analytics) AED 120K-120KA/B | A/B Testing | API Development | Acceptance Testing | Acceptance criteriaMid-level Full TimeDubai, United Arab Emirates17h ago
-
Lead-Data Analytics AED 150K-162KAnomaly Detection | Apache Airflow | Azure Data | Azure Data Factory | Benfords LawSenior-level Full TimeUnited Arab Emirates17h ago
-
Marketing Analytics Lead SEK 686K-804KApp Store | App analytics | App store optimization | Conversion attribution | Conversion funnelSenior-level Full TimeStockholm, Sweden18h ago
-
Senior Data Engineer - Paris - H/F EUR 45K-55KAirflow | Batch data | CI/CD | ClickHouse | Data CatalogMeal allowance | Profit sharing | Remote work | Restaurant voucherSenior-level Full TimeParis, IDF, France R19h ago
-
Technical Programme Manager - Data Science Team EUR 54K-70KAgile | Capacity Management | Confluence | Development Lifecycle | JiraContinuous learning | Hybrid work arrangement | Innovation culture | Shuttle busSenior-level Full TimeMarbella, Spain20h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India20h ago