Lead Data Engineer - Python/PySpark/Databricks/AWS/AI
Tasks
- Build data pipelines
- Deliver data platform solutions
- Design data models
- Evaluate data access control processes
- Handle data sensitivity and security
- Implement data archiving
- Implement database backup and recovery
- Maintain data pipelines
- Support auditability and traceability
- Validate AI assisted outputs
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AI | AWS | Access Control | Data Modeling | Data lifecycle | Database Backup | Databricks | Disaster Recovery | Dynatrace | Geometrical Algorithms | Kafka | Linear Algebra | NoSQL Databases | PySpark | Python | Relational databases | Snowflake | Splunk | Statistics
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
Data Engineer, gUP Engineering USD 106K-151KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ModelingMid-level Full TimeBoulder, CO, USA3h ago
-
Data Engineer, GCS Data Science USD 106K-151KBig Data | C plus plus | Data Documentation | Data Modeling | Data ValidationEntry-level Full TimeNew York, NY, USA; Mountain View, …3h ago
-
Agent Engine | Agentic Development Kit | Agentic development | Cloud platform | Computer VisionSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-253KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States8h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Company wellness day off | Continued education benefitSenior-level Full TimeLos Angeles, California, United States8h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeSan Francisco, California, United States8h ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R9h ago
-
Applied AI Engineer USD 80K-120KAPIs | Agent Orchestration | Data Pipelines | Evaluation | FedRAMPDental insurance | Equity compensation | Health insurance | Travel benefits | Vision insuranceMid-level Full TimeSF Bay Area, CA, USA9h ago
-
Azure Data Engineer USD 119K-219KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Autonomy | Career growth | Collaborative team | Community | Supportive cultureMid-level Full TimeIndianapolis, IN, US12h ago
-
Principal Technical Lead, Software Engineering (Data Infrastructure) - North America Software Center USD 166K-241KAmazon S3 | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg12 holidays per year | 401k match | Dental insurance | Fitness Center | Game roomSenior-level Full TimeVancouver, WA, US, 9868314h ago
-
Senior Data Science Engineer USD 116K-198KApache Airflow | CI/CD | DBT | Databricks | Databricks AutoloaderFlexible work optionsSenior-level Full TimeRemote (United States) R14h ago
-
ML Data - Research Scientist USD 143K-264KAudio signal processing | Computer Vision | Data Annotation | Experiment design | Inter-rater reliabilityMid-level Full TimeCupertino15h ago
-
AWQ | Benchmarking | CUDA | CUDA kernels | Chunked prefill401k match | Career growth | Collaborative culture | Disability insurance | FlexibilitySenior-level Full TimePalo Alto, California, United States15h ago
-
CUDA | Checkpointing | DTensor | Data parallelism | DeepSpeed401k plan | Career growth and learning opportunities | Collaborative culture | Disability insurance | Flexibility and ownershipSenior-level Full TimePalo Alto, California, United States15h ago
-
APIs | Behavior Trees | C++ | Dashboards | Data PipelinesSenior-level Full TimeIrvine, CA15h ago
-
Machine Learning Engineer, Local Search & Marketplace USD 190K-300KA/B | A/B Testing | Apache Spark | B testing | C++Senior-level Full TimeMountain View, California, United States15h ago
-
Machine Learning Engineer, Local Search & Marketplace USD 190K-300KA/B | A/B Testing | Algorithms | B testing | C++Senior-level Full TimeMountain View, California, United States15h ago
-
AI Engineer USD 230K-315KAPI Design | Caching | Concurrent programming | Context Window Pruning | Context caching401k matching | Comprehensive medical/dental/vision coverage | Fertility benefits | Flexible PTO | Lunch CreditSenior-level Full TimeSan Francisco, CA15h ago
-
Member of Technical Staff, Applied AI Research USD 203K-299KAgentic technology | Apache Cassandra | Apache Kafka | Caching | Capacity PlanningSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA15h ago
-
Data Engineering Lead USD 190K-220KAmazon Redshift | Apache Airflow | Apache Kafka | CI/CD | Data Modeling401k matching | Catered lunches | Commuter benefits | Dental insurance | Flexible PTOSenior-level Full TimeChicago, IL15h ago
-
Senior-level Full TimeColumbia, MD16h ago
-
AI Data Engineer USD 133K-258KAWS | Agile | Apache Kafka | Apache Spark | AzureAnnual bonus eligibility | Health and wellness benefits | Hybrid work schedule | Paid time off | Retirement planSenior-level Full TimeBaltimore, Maryland, United States16h ago