Senior Data Engineering Manager - T&T
Tasks
- Automate manual processes
- Build data models for AI consumption
- Clean large volumes of data
- Collaborate with data scientists and AI engineers
- Design and implement ELT pipelines
- Develop data solutions with cross-functional teams
- Ensure performance security and data integrity
- Implement CI CD using Azure DevOps and Git
- Implement process improvements and automation
- Improve scalability
- Ingest harmonize transform data
- Manage agile delivery using Azure DevOps
- Optimize ingestion tuning and caching
- Perform data quality monitoring
- Provide guidance to data teams
- Support data pipelines and resolve data errors
- Tune parquet delta files and SQL databases
- Write data transformation code
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Storage | Azure Storage Accounts | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Ingestion | Data Modeling | Data Warehousing | Delta Lake | Git | Key Vault | Microsoft Fabric | Parquet | Power BI | PySpark | Python | SAP | SAP BW | SQL | Storage Accounts | Synapse Analytics | T-SQL
Education
Related jobs
-
Lead Applied Scientist USD 150K-170KAgentic AI | Autogen | CrewAI | Data Quality | Deep learning401k match | Dental insurance | Employee assistance program | Employee recognition | Employee stock purchase planSenior-level Full TimeWork From Home, United States R3h ago
-
Senior-level Full TimeHyderabad, India5h ago
-
AWS | Accuracy testing | Auditability | Azure | ComplianceClient stakeholder engagement | Remote workSenior-level Full TimeRemote R5h ago
-
AWS | Alerting | Azure | Cause analysis | Change ManagementRemote workSenior-level Full TimeRemote R5h ago
-
AI/ML | AI/ML validation | API Testing | AWS | AzureRemote workSenior-level Full TimeRemote R5h ago
-
Database Operations Lead PO PLN 220K-353KAlerting | AlwaysOn | Amazon Web Services | Audit compliance | AzureSenior-level Full TimeWarsaw, Poland6h ago
-
Senior-level Full TimeBudapest, Hungary6h ago
-
Senior-level Full TimeManila, Philippines6h ago
-
Senior-level Full TimePune City, India6h ago
-
Embedded Risk Associate Director GBP 53K-67KAudit management | Cause analysis | Control Testing | Incident Management | Issue managementFlexible hybrid work model | Health and life insurance | Paid leave for personal and family care | Paid time off | PensionMid-level Full TimeLONDON, United Kingdom R7h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States7h ago
-
Lead Data Architect USD 173K-276KAI metadata | Cloud Platforms | Data Architecture | Data Governance | Data Lakes401k | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeFoster City, CA, United States7h ago
-
Team Leader (ML, AdTech) PLN 216K-276KA/B | A/B Testing | B testing | BigQuery | Cloud StorageHealth and sport benefits | Internal team competitions | Speed coaching | Sports trainingSenior-level Full TimeWarszawa, Poland7h ago
-
Senior-level Full TimeGurugram, Haryana, India8h ago
-
Software Engineering Manager, AlloyDB Database Internals INR 400K-700KC# | C++ | Cloud Computing | Compilers | ConcurrencyEntry-level Full TimePune, Maharashtra, India8h ago
-
Product Lead, Applied AI, Data and Analytics Platform USD 192K-278KAccess Control | Analytics | Artificial Intelligence | BigQuery | Data LineageSenior-level Full TimeMountain View, CA, USA8h ago
-
Senior Technical Program Manager, AI/ML, Finance USD 192K-278KArtificial Intelligence | Business Intelligence | Data Architecture | Data Governance | Data WarehousingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Lead Analyst, Data Science INR 2500K-4170KA/B | A/B Testing | AWS SageMaker | B testing | Bayesian ModelingSenior-level Full TimeHyderabad, TS, India8h ago
-
Adobe Analytics | Chatbots | Classification | Clickstream analytics | ClusteringMid-level Full TimePakistan9h ago
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India9h ago
-
Staff Engineer, Data Analytics Engineering INR 3000K-3380KAI Engineering | AWS | Azure | Azure Data | Azure Data LakeSenior-level Full TimeBengaluru, KA, India10h ago
-
Manager, IT AI Engineering - Agent Engineering USD 96K-131KA/B | A/B Testing | API Design | Access Control | Agent architecture401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsMid-level Full TimeFort Worth, TX, US11h ago
-
Senior Manager SAP Reporting Analytics EUR 74K-106KAnalytics Cloud | Business Data Cloud | Business Intelligence | Data Governance | Data Integrity30 vacation days | Courses for professional growth | Discounted gym memberships | Expense allowance | Health and vitality programsSenior-level Full TimeAmstelveen, NH, Netherlands12h ago
-
Data quality manager F/H - Alternance EUR 32K-32KAnomaly Detection | Artificial Intelligence | Business Intelligence | Data Catalog | Data GovernanceCompany restaurant | Employee discounts | Exam leave | Flexible mobility support | Hybrid workEntry-level Apprenticeship Full TimeParis, Île-de-France, France R12h ago
-
Afdelingsleder til SDU Analytics DKK 433K-433KAnalytics methodology | Bibliometrics | Data Governance | Data Quality | RDistance workEntry-level Full TimeOdense M, Danmark13h ago