Data Platform Engineer, VP II - State Street Investment Management
Tasks
- Build data CI CD automation
- Create semantic layer models serving marts
- Define modernization strategy
- Design Iceberg table partitioning compaction metadata
- Design data ingestion transformation storage governance
- Develop data semantics and data product contracts
- Enable data observability and security
- Establish data quality controls and testing
- Evaluate agentic AI frameworks for SDLC
- Execute data platform engineering delivery
- Expose BI endpoints and consumption APIs
- Implement Infrastructure as Code with Terraform or CloudFormation
- Implement lakehouse pipelines
- Lead Data platform architecture
- Manage technology roadmap
- Optimize Spark batch and streaming performance
- Optimize pipeline and query performance with caching archiving retention
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alation | Apache Spark | Azure | CI/CD | Catalog federation | Claude Code | CloudFormation | Collibra | Data Governance | Data Sharing | Data Virtualization Platforms | Data virtualization | Databricks | Distributed Computing | GCP | GitHub Copilot | Iceberg | Infrastructure as Code | Java | Lakehouse | Lakehouse Architecture | Metadata catalog | OLAP | OLTP | Python | SQL | Scala | Snowflake | Terraform | Unity Catalog | Virtualization Platforms | Zero Copy Data | Zero Copy Data Sharing | Zero copy | “as-code”
Education
Roles
Data Platform | Data Platform Engineer | Engineer | Lead | Platform Engineer | Technology Lead
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R26d ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States4h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Company wellness day off | Continued education benefitSenior-level Full TimeLos Angeles, California, United States4h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeSan Francisco, California, United States4h ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R4h ago
-
Applied AI Engineer USD 80K-120KAPIs | Agent Orchestration | Data Pipelines | Evaluation | FedRAMPDental insurance | Equity compensation | Health insurance | Travel benefits | Vision insuranceMid-level Full TimeSF Bay Area, CA, USA5h ago
-
AWQ | Benchmarking | CUDA | CUDA kernels | Chunked prefill401k match | Career growth | Collaborative culture | Disability insurance | FlexibilitySenior-level Full TimePalo Alto, California, United States11h ago
-
AI Engineer USD 230K-315KAPI Design | Caching | Concurrent programming | Context Window Pruning | Context caching401k matching | Comprehensive medical/dental/vision coverage | Fertility benefits | Flexible PTO | Lunch CreditSenior-level Full TimeSan Francisco, CA11h ago
-
Senior-level Full TimeColumbia, MD11h ago
-
C++ | Computer Vision | Data pipeline | Deep learning | EvaluationSenior-level Full TimeMountain View, California (HQ)12h ago
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R12h ago
-
Applied AI Lead USD 130K-150KAI Agents | AWS | AWS Bedrock | Anthropic Claude | Azure401k match | Dental insurance | EAP | Life and ADandD insurance | Medical insuranceSenior-level Full TimeHouston, TX, United States12h ago
-
Power Platform Analytics Engineer USD 100K-203KAI Builder | AI Search | Azure AI | Azure AI Search | Azure DataSenior-level Full TimeWashington, DC12h ago
-
Senior Data Engineer - Modern Data & AI Platforms USD 156K-204KAWS | DBT | Data Governance | Data Ingestion | Data ModelingRemote workSenior-level Full TimeKansas City, MO, United States13h ago
-
Production AI Engineer USD 145K-165KAWS | AWS CloudFormation | Automation | CI/CD | Cloud Orchestration401k plan | Basic life insurance | Company match | Employee stock purchasing plan | Healthcare benefitsMid-level Full TimeAtlanta, GA, United States13h ago
-
Data Analyst, Financial Data Engineering USD 161K-242KAirflow | Alerting | Apache Spark | Code review | Data Modeling401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeNew York16h ago
-
Senior AI Engineer (m/f/d) USD 100K-140K.NET | AI Search | AIOps | API Integration | AWS100 percent salary during sick leave | 4 weeks remote work per year | Childcare support | Coursera access | Experience daysSenior-level Full TimeMadrid, MD, Spain R17h ago
-
Intelligent Systems Engineer II USD 92K-151KAPIs | AWS | Artificial Intelligence | Automation | Backend Development401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/VisionMid-level Full TimeWest Chester, OH, United States17h ago
-
Lead Analyst, Player Analytics USD 100K-140KA/B | A/B Testing | Artificial Intelligence | B testing | CTE401k match | Annual company bonus | Comprehensive medical coverage | Dental insurance | Employee assistance programSenior-level Full TimeUSA - Remote R18h ago
-
Data Engineer USD 105K-140KAPIs | AWS | Apache Airflow | Apache Iceberg | Apache Kafka401k plan with company match | Annual bonus | Company equipment provided | Company events and team outings | Company medical dental and vision plansMid-level Full TimeAtlanta, GA preferred, Remote R18h ago
-
Access Control | Approval Workflows | Audit Readiness | Azure | ComplianceHybrid scheduleSenior-level Full TimeHorsham, PA, United States R18h ago
-
Azure DevOps | Data Modeling | Data integration | ETL | GitHubSenior-level ContractSaint Paul, United States19h ago
-
Senior Machine Learning Engineer USD 150K-200KAPI Development | AWS SageMaker | Data Pipelines | FastAPI | Feature EngineeringSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL19h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarking | Cloud Computing | Computer Vision | Data Annotation | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsEntry-level Full TimeAddison, United States19h ago