Data Platform Lead - IT Transformation
Tasks
- Build governed lakehouse
- Design ingestion and transformation pipelines
- Discover data use cases
- Ensure pipeline reliability
- Implement data governance
- Integrate source systems
- Manage ownership models and access controls
- Monitor and alert on pipeline failures
- Set data quality standards
- Translate business requirements into pipeline specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Active Directory | Airflow | Apache Spark | Azure Active Directory | Azure Data | Azure Data Lake | Azure Data Lake Storage | DAX | Data Catalog | Data Governance | Data Lake Storage | Data Lineage | Data Quality | Databricks | Databricks Workflows | Incremental Merge | Partitioning | Power BI | Python | Role-Based Access | Role-Based Access Control | SQL | Schema evolution | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Engineering | Bachelor of Science in Information Systems
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)25d ago
-
Senior Manager, Data Engineering USD 240K-310KAWS | Amazon Redshift | Apache Airflow | CI/CD | CloudFormationCasual environment | Company retreats | Great benefits | Wellness programSenior-level Full TimeNew York, New York9h ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data Governance401k plan | Basic life insurance | Health savings account | Paid Holidays | Parental leaveSenior-level Full TimeEl Segundo, CA10h ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R11h ago
-
Engineer II, Analytics USD 109K-180KCloud Data | Cloud Data Warehouse | Data Analysis | Data Governance | Data ModelingMid-level Full TimeKnoxville, TN, United States13h ago
-
Machine Learning Engineer, PhD Intern (Fall) USD 100K-125KAlgorithms | Data Management | Distillation | Feedback learning | Generative AIRemote work flexibilityEntry-level InternshipUnited States - Remote R14h ago
-
Machine Learning PhD Intern, Economics (Fall) USD 100K-125KApplied Econometrics | Causal Inference | Experimental data | Keras | Observational dataFlexible work location | In-person events | Remote workEntry-level InternshipUnited States - Remote R14h ago
-
Engineer, Data III USD 113K-140KDatabase performance | Database performance tuning | ETL | Performance Tuning | SQLTelecommuting permittedSenior-level Full TimeMcLean, VA, United States14h ago
-
Data Engineer - Journeyman USD 100K-135KCybersecurity | Data Ingestion | Data Normalization | Data Parsing | Data QualityMid-level Full TimeFAIRFAX, VA, United States14h ago
-
Global Data Governance Director - GRS USD 140K-175KAccess Controls | Critical Data Elements | Data Elements | Data Governance | Data LineageEmployee resource groups | Professional development | Workplace flexibilityExecutive-level Full TimeBoston, Massachusetts, United States15h ago
-
Senior-level ContractAustin, United States17h ago
-
AI Search | Agile | Angular | Azure AI | Azure AI Search100 percent onsite | Public trust clearance requiredSenior-level ContractWoodlawn, United States17h ago
-
Senior Applied AI Engineer USD 160K-210KAPI Design | AWS | CI/CD | Circuit Breakers | DockerDynamic work environment | Flexible working hoursSenior-level Full TimeUS - Remote, Canada - Remote R17h ago
-
Senior Software Engineer - DevOps & Data Engineering USD 140K-190KAgentic Workflows | Automation | CI/CD | Claude | Cloud infrastructureSenior-level ContractChandler, United States17h ago
-
AI APIs | Backend Development | Data Engineering | Data Pipelines | Frontend DevelopmentMid-level ContractChandler, United States17h ago
-
Azure Databricks Developer USD 125K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States18h ago
-
Entry-level Full TimeUS-Kansas-Wichita18h ago
-
AI Governance and Testing Support USD 93K-163KAI Evaluation | AI Governance | AI Testing | Change Management | CoderOnsite work schedule | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States18h ago
-
Mid-level Full TimeUS-Kansas-Wichita18h ago
-
Data Engineer II USD 101K-176KAWS | Agile | Airflow | Azure | Azure DevOps401k matching | Health & dental insurance | Onsite fitness center | Time off | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence18h ago
-
C++ | Cloud Native | Container Orchestration | Deep learning | Distributed SystemsCareer growth | Open Source contribution | World Class CollaborationEntry-level Full TimeSan Jose, California, United States18h ago
-
Senior Algorithm Engineer, Performance Advertising USD 174K-252KA/B | A/B Testing | Ad Ranking | Auction optimization | B testingCollaborative team environment | Continuous learning | Flat organizational structure | Ownership and empowermentSenior-level Full TimeSan Francisco, United States19h ago
-
Linguistic Engineer USD 103K-156KBias Mitigation | Ethical AI | Hack | Knowledge graphs | Machine LearningMid-level Full TimeRedmond, WA19h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Azure | Bias Mitigation | C++Senior-level Full TimeMenlo Park, CA19h ago
-
Senior Software Developer, Computer Vision, XR USD 100K-253KAr | Augmented Reality | C++ | Computer Vision | Data ProcessingSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …19h ago