Data Architect SME - FDA
USA FL Home Office (FLHOME), United States
USD 170K-230K Senior-level Full Time
Tasks
- Architect and optimize Delta Lake solutions
- Build feature pipelines and model training datasets
- Debug data pipeline performance bottlenecks and anomalies
- Define Databricks platform strategy
- Design AI/ML-ready data architectures
- Establish data modeling data quality lineage and observability best practices
- Implement Databricks SQL and MLflow patterns
- Implement Unity Catalog governance
- Lead and mentor data engineering and analyst teams
- Lead enterprise data migration execution
- Manage batch loads and CDC integration workflows
- Manage migration deliverables timelines risks and dependencies
- Optimize migration performance and triage defects
- Oversee data extraction transformation mapping and profiling
- Provide Databricks architecture governance
- Validate reconcile and synchronize data across systems
- Write and optimize SQL for validation and transformation
Perks/Benefits
- 401k matching
- Dental insurance
- Flex work weeks
- Health insurance
- Paid parental leave
- Paid time off
- Vision insurance
Skills/Tech-stack
Agile | Apache Spark | CDC | Data Architecture | Data Governance | Data Lineage | Data Migration | Data Modeling | Data Quality | Databricks | Databricks SQL | Delta Lake | ELT | ETL | MLflow | Observability | PySpark | SQL | Security | Unity Catalog
Education
Roles
Related jobs
-
Mid-level Full TimeFAIRFAX, VA, United States6h ago
-
Senior Palantir AI and Data Science Engineer USD 97K-174KAnalytics | Cloud technologies | Data Architecture | Data Engineering | Data PipelinesMentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States11h ago
-
Palantir AI and Data Science Engineer USD 95K-127KAnalytics products | Cloud Computing | Data Architecture | Data Engineering | Data PipelinesEntry-level Full TimeArlington/Rosslyn, Virginia, United States11h ago
-
Deloitte Technology-US Associate GenAI Engineer USD 70K-86K.Net Core | AWS | Agile | Algorithms | AngularMid-level Full TimeHermitage, Tennessee, United States11h ago
-
Databricks Engineering Consultant USD 93K-155KAmazon Web Services | Apache Spark | Auto Loader | Cloud platform | Data ModelingMentorship | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …11h ago
-
Data Engineer II USD 97K-171KAgile | Amazon Web Services | Atlassian | Confluence | Data GovernanceMid-level Full TimeArlington/Rosslyn, Virginia, United States11h ago
-
Consultant - Data Science / Data Lake USD 107K-188KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Apache StormEntry-level Full TimeChicago, Illinois, United States11h ago
-
Agile | Amazon Web Services | Cloud Platforms | Cloud platform | Data EngineeringMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …11h ago
-
Anthropic Forward Deployed Engineer - GPS USD 97K-171KAPI Integration | AWS | Airflow | Anthropic Claude | Anthropic Claude APIMentorship | Professional development opportunities | Reasonable accommodations | Travel 50% | US government security clearance supportMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …11h ago
-
Lead Forward Deployed Engineer - AWS USD 189K-372KAPI Integration | AWS | Airflow | Amazon Bedrock | Bedrock AgentsMentorship | Professional developmentSenior-level Full TimeSan Jose, California, United States11h ago
-
Software engineer - AI Agent Infra USD 212K-450KAI Agent | AI Agent Frameworks | API Development | Access Control | Agent FrameworksEntry-level Full TimeSan Jose, California, United States11h ago
-
Staff Software Engineer, Gemini Evals, GenAI, DeepMind USD 207K-300KAgent evaluation | Automated Retry | Distributed Systems | Error classification | InferenceSenior-level Full TimeMountain View, CA, USA; New York, …12h ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIEmployee discounts | Health insurance | Paid time off | Retirement plansMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-252KAPIs | Agent systems | Cloud platform | Conversational AI | DebuggingTravel opportunitiesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Mechanical Engineer, Data Center Technology Systems USD 171K-248KASME B31 | C++ | Fire Protection | Fuel Systems | HVACSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Forward Deployed Engineer II, Applied AI, Google Cloud USD 147K-211KAPI Integration | APIs | Agent systems | Cloud platform | Evaluation PipelinesTravel opportunitiesMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Senior Software Engineer, BigQuery Managed Storage USD 174K-252KBigQuery | C++ | Change Data Capture | Cloud platform | Data CaptureSenior-level Full TimeKirkland, WA, USA12h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R18h ago
-
Software Engineer (Computer Vision) TS/SCI with Poly) USD 170K-175KAgile | CSS | Computer Vision | Dash | Git401k | Dental insurance | Employee discount program | Employee referral bonuses | Flexible spending accountSenior-level Full TimeFORT MEADE, MD, US20h ago
-
Senior-level Full TimeLos Angeles, CA22h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA22h ago
-
AWS | Data Governance | Data Lineage | Data Modeling | Data PipelinesMid-level Full TimeHawthorne, California, USA23h ago
-
Agentic Workflows | Caching Strategies | ES6 | Evaluation Pipelines | Hallucination detectionSenior-level Full TimeSan Francisco, United States R23h ago
-
Senior Data Engineer - Remote - Multiple Levels USD 85K-141KAWS Data | AWS Data Migration | AWS Data Migration Service | AWS Lambda | Airflow401k retirement plan | Dental insurance | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeHome Office: Tysons, VA, United States R23h ago
-
Mid-level Full TimeInnovation Point, United States23h ago