Data Platform Architect
Tasks
- Advise on cross platform data architectures
- Build and support enterprise system integrations
- Collaborate across engineering data science BI and security teams
- Conduct technical reviews and scalability assessments
- Define data definitions business logic and compliance handling
- Define integration patterns for data sources and schema evolution
- Design data models for BI analytics and ML
- Design scalable ML inference and model monitoring
- Develop reusable templates and reference architectures
- Enable self service ML deployment
- Establish data quality standards and automated testing
- Establish technical standards for data and code organization
- Guide platform capability selection and implementation
- Implement CI CD for jobs and pipelines
- Implement secure access controls and data governance
- Maintain technical documentation for implementation and handoff
- Operationalize MLOps workflows with MLflow
- Optimize Spark performance and workload design
- Promote medallion architecture and governed publishing
- Provide architectural guidance for data pipelines
- Set deployment monitoring alerting and release practices
- Transition prototypes to production workflows
- Troubleshoot production architecture integration and reliability issues
Perks/Benefits
- 401k matching
- Commuter benefits plan
- Education reimbursement
- Generous PTO
- Life insurance
- Onsite gym access
- PPO and HDHP medical dental and vision insurance
Skills/Tech-stack
Access Control | CI/CD | Compliance | Data Lineage | Data Quality | DataOps | Databricks | Databricks Workflows | Delta | Delta Lake | DevOps | Git | Governance | Lineage | MLOps | MLflow | Metadata Management | Monitoring | Observability | Palantir Foundry | Power BI | PySpark | Python | Qlik Sense | SQL | Security | Spark SQL | Streaming | Tableau | Unity Catalog
Education
N/A
Related jobs
-
A/AI Machine Learning Engineering Stf - E4 USD 135K-251KAI | AI RMF | Adversarial Machine Learning | Automation Testing | C#401k match | Dental insurance | EAP | Education assistance | Employee assistance programSenior-level Full TimeShelton, CT, US4h ago
-
Embedded Staff Software Engineer / Embedded / C++ USD 120K-224KAgile | Algorithm Implementation | C++ | Confluence | Critical software401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeOrlando, FL, US4h ago
-
Sniper Embedded Software Engineer Stf - E4 USD 120K-224KAgile | Algorithm Implementation | C++ | Confluence | Critical software401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeOrlando, FL, US4h ago
-
PIIM Data Engineer USD 119K-182KAPI Integration | APIs | Azure Databricks | Data Governance | Data LakeFull Time Office Project Telework | Relocation assistanceMid-level Full TimeNew Albany, OH, US4h ago
-
Software Engineer, Data Platform Team USD 152K-179KApache Airflow | Data APIs | Data Catalog | Data Lineage | Data Modeling401k matching | Medical, dental, and vision | Quarterly in person surges | Remote-first work environmentMid-level Full TimeRemote - USA R4h ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | APIs | Airflow | Algorithm Development | Amazon S3Disability benefits | Health insurance | Life insurance | Paid Equity Awards | Paid time offSenior-level Full TimeNew York, New York R5h ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowCommuter benefits | Disability benefits | Equity awards | Financial wellness support | Health insuranceSenior-level Full TimeSan Jose, California R5h ago
-
Senior AI Engineer – AI Platform USD 140K-175KAWS | Drift Detection | Embeddings | Evaluation Pipelines | Function CallingDaily group classes | Dry cleaning | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R5h ago
-
AI Engineer USD 220K-260KAPI Development | Agent Orchestration | Data Generation | Debugging | Fine Tuning401k matching | Dental insurance | Fertility and family building stipend | Flexible PTO | Health insuranceMid-level Full TimeSan Francisco R7h ago
-
Solutions Architect - Strategic High Tech USD 180K-247KAWS | Azure | Big Data | Cloud platform | Data EngineeringSenior-level Full TimeRemote - California; San Francisco, California R7h ago
-
Staff Machine Learning Engineer - Ads USD 164K-282KAWS | Airflow | Apache Spark | BigQuery | Cloud Computing401k plan with company match | AD&D insurance | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA8h ago
-
Agents | Golang | Information Retrieval | Language Models | Language Processing401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States R8h ago
-
ASIC | Agile | Automation frameworks | BDD | C#Senior-level Full TimeCupertino, California, USA9h ago
-
Staff Machine Learning Engineer USD 176K-308KAlgorithms | Code Tuning | Design Patterns | High Performance | High-Performance Computing401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R9h ago
-
GTM AI Engineer USD 112K-140KAPI | Chunking | Compute cost management | Context windows | Cost Management401k matching | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeUnited States - Remote R10h ago
-
Principal Machine Learning Engineer - League of Legends USD 292K-437KAI | API Development | Auto-remediation | Automation | Cloud Native401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA10h ago
-
AI/ML Software Engineer USD 80K-80KAWS | Angular | Azure | CI/CD | Data Pipelines401k matching | Flexible PTO | Life insurance | Medical/Dental/Vision insurance | Paid parental leaveMid-level Full TimeCharlotte, NC11h ago
-
Sr Engineer, Data Engineering USD 32K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeKnoxville, TN, United States12h ago
-
Data Architect USD 140K-202KAPIs | Access Control | Audit Logging | Change Data Capture | Cloud DataSenior-level Full TimeUnited States - Remote R12h ago
-
Senior Applied AI Engineer USD 197K-266KAlgorithms | Artificial Intelligence | Data Analysis | Data Structures | Deep learningFlexible time off | Mental health support | Paid parental leave | Private health insurance | Work from homeSenior-level Full TimeSan Francisco, CA R12h ago
-
Embedded Software Engineer USD 85K-128KARM | Automated testing | C# | C++ | CAN401k matching | Hands-on training | Mentoring program | Relocation assistance not providedSenior-level Full TimeWaltham, MA, United States13h ago
-
Staff Analyst, Finance Analytics & AI USD 150K-200KArtificial Intelligence | Coding Assistant | DBT | Data Modeling | EmbeddingsSenior-level Full TimeUS-CA-Menlo Park13h ago
-
Senior Data Engineer USD 70K-75KAmazon SageMaker | Apache Airflow | Azure | Azure Compute | Azure Compute VMs401k match | Career development support | Dental insurance | Life and disability insurance | Medical coverageSenior-level Full TimeStafford, TX, United States13h ago
-
Senior-level Full TimeIrvine, CA13h ago
-
Practice Architect AI/ML USD 136K-204KAI RMF | AWS | Agent Orchestration | Agentic Workflows | Autogen401k | Health insurance | Paid time off | Remote workSenior-level Full TimeDallas, Texas, USA R13h ago