Principal Data Engineer
Tasks
- Architect enterprise scale data pipelines
- Build and evolve batch and real time data pipelines
- Create architecture diagrams runbooks and operational standards
- Design highly available fault tolerant multi account architectures
- Design security first data solutions with RBAC encryption PHI handling auditability
- Develop ingestion and transformation frameworks
- Establish engineering standards for CI CD code quality testing orchestration monitoring logging observability
- Integrate Databricks Snowflake AWS services and external APIs
- Mentor engineers and conduct design and code reviews
- Profile and tune compute workloads for performance and cost
- Translate business and regulatory requirements into technical designs
Perks/Benefits
- Cell phone allowance
- Comprehensive health coverage
- Equity grants
- Home office setup allowance
- Performance bonuses
- Unlimited paid time off
- Work from anywhere
Skills/Tech-stack
AWS | Airflow | Auditability | CI/CD | DBT | Data Lineage | Databricks | Databricks Workflows | Delta Lake | Distributed Systems | ELT | ETL | Encryption | HIPAA | IAM | Kafka | Lambda | Logging | Monitoring | Observability | Orchestration | Performance Tuning | PySpark | Python | RBAC | S3 | SOC 2 | SQL | SQS | Schema evolution | Snowflake | Spark SQL | Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Senior Data Scientist, Creator Platform USD 263K-322KAI Evaluation | Agentic AI | Anti Abuse Modeling | Anti-abuse | Causal InferenceEquity compensation | Health insurance | Onsite work scheduleSenior-level Full TimeSan Mateo, CA, United States R4h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R12h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R13h ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R14h ago
-
Senior Analytics Engineer USD 126K-180KAutomation | BI reporting | DBT | Data Modeling | Data Quality401k with company matching | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R14h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R14h ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent Harness | Agent SDK | Back-end | Back-end development401k contribution | Company retreats | Dental insurance | Employee referral program | EquitySenior-level Full TimeRemote R16h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R18h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R18h ago
-
Staff Analytics Engineer USD 145K-190KCI/CD | Cloud Data | Cloud Data Warehouse | DBT | Data Contracts401k | Dental insurance | Equity | Fertility treatment benefit | Health insuranceSenior-level Full TimeRemote - United States R18h ago
-
Senior WEM AQM Prompt Engineer USD 88K-247KA/B | A/B Testing | API Integration | B testing | CalibrationInclusive environment | Remote work | Team-first cultureSenior-level Full TimeUnited States (Remote) R18h ago
-
Analytics Engineer USD 195K-264KAirflow | Cloud Data | Cloud Data Warehouse | DBT | Data ModelingCommuter stipend | Dental coverage | Flexible PTO | Lunch and dinner stipends | Medical coverageSenior-level Full TimeSan Francisco, CA & New York, … R18h ago
-
Staff Backend Engineer, AI Systems USD 181K-226KAPIs | Asynchronous processing | Azure OpenAI | Context retrieval | Distributed SystemsBenefits | Remote-first workSenior-level Full TimeUnited States Remote R18h ago
-
Cloud DevOps Engineer, Data & Analytics USD 195K-250KAWS | Azure | Bash | CI/CD | Disaster RecoveryHybrid work | Remote 2 days per week | Supportive collaborative environmentMid-level Full TimeAtlanta; Boston; Charlotte; Chicago; Dallas; Los … R19h ago
-
Staff Designated Support Engineer USD 122K-160KAI workflows | AWS | As-a-Service | Azure | Cloud DataSenior-level Full TimeUS-TX-Remote R20h ago
-
Senior, Machine Learning Engineer - 3D Perception USD 177K-212K3D Perception | Camera-based perception | Cloud processing | Computer Vision | Data Preparation401k employer match | Accidental death and dismemberment insurance | Flexible schedule | Holiday office closures | Life insuranceSenior-level Full TimeRemote, U.S, Ann Arbor, MI, Fort … R22h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R22h ago
-
Azure ML | Batch Processing | Cloud Machine Learning | Data Pipelines | Data Versioning401k employer match | Discretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programsMid-level Full TimeScottsdale, Arizona, United States R22h ago
-
Senior Software Engineer II (TASER Data Science) USD 148K-237KAzure ML | Batch Processing | Data Engineering | Data Pipelines | Databricks401k employer match | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsMid-level Full TimeWashington, United States R22h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R23h ago
-
Storage Operations Engineer - Multiple Openings USD 80K-110KAnsible | Bash | Ceph | Chef | Collectd401k match | Dental insurance | Gym reimbursement | Health insurance | Holiday payMid-level Full TimeRemote - United States R1d ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R1d ago
-
AWS Devops Cloud Engineer USD 105K-151KAWS CDK | AWS CloudFormation | AWS EKS | AWS IAM | AWS LambdaHybrid workMid-level Full TimeIndianapolis, IN - Remote/Hybrid R1d ago