Senior Engineer, Big Data
Tasks
- Define data and analytics architecture standards
- Deliver CI CD for production deployments
- Design modern data platforms
- Develop automation for Databricks reliability
- Ensure data security and compliance
- Implement Data Governance and Data Quality
- Implement Databricks lakehouse capabilities
- Lead solution lifecycle architecture reviews
- Mentor engineering teams and share best practices
- Optimize data processing performance and cloud costs
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Web Services | Apache Spark | Automated testing | Azure | CI/CD | Cloud Cost Optimization | Cloud platform | Cost Optimization | Data Governance | Data Quality | Data Security | Databricks | Delta Lake | Distributed Systems | Google Cloud | Google Cloud Platform | Infrastructure as Code | Infrastructure automation | Lakehouse | Metadata Management | PySpark | Python | SQL | Web Services | “as-code”
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
Research Engineer, Computer Vision USD 147K-208KAR/VR | Algorithm Development | Artificial Intelligence | C++ | Computer VisionSenior-level Full TimeSunnyvale, CA3h ago
-
Data Engineer, Product Analytics (University Grad) USD 173K-196KCompliance | Data Modeling | Data Quality | Data Security | Data TransformationCareer growth | Skill developmentNone Full TimeMenlo Park, CA | New York, …3h ago
-
Software Engineer, AI/ML, Google Search Ads USD 147K-210KAlgorithms | C++ | Code review | Data Processing | Data StorageMid-level Full TimeMountain View, CA, USA3h ago
-
Senior Staff Software Engineer, AI/ML, Google Ads USD 262K-364KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA3h ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA3h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-300KCompute | Data Storage | Deployment | Distributed Systems | InfrastructureSenior-level Full TimeSunnyvale, CA, USA3h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | Data durabilitySenior-level Full TimeKirkland, WA, USA3h ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | Application Performance Tuning | Application performance | C++ | CI/CDSenior-level Full TimeMountain View, CA, USA; New York, …3h ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States6h ago
-
AWS | Apache Hadoop | Apache Kafka | Apache Spark | AuditingRemote work | Travel up to 30 percentSenior-level Full TimeUnited States13h ago
-
Software Engineer, Data Engineering USD 70K-200KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeIrvine, CA13h ago
-
Senior-level Full TimeHouston, TX, US14h ago
-
Staff Software Engineer - Streaming USD 182K-247KApache Spark | Data Storage | Database systems | Distributed Systems | Latency optimizationSenior-level Full TimeSeattle, Washington15h ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …15h ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …15h ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …15h ago
-
Finance & Analytics USD 100K-155KBudgeting | Business Intelligence | Chart of Accounts | Data Modeling | Data QualityFeedback Focused Environment | Growth mindset | In-person work culture | Owner mentality | Startup flexibilitySenior-level Full TimeAustin, TX15h ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco15h ago
-
AWS Glue | AWS Glue Catalog | AWS S3 | Apache Atlas | Apache FlinkSenior-level Full TimeCupertino16h ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeCupertino16h ago
-
Senior AI Engineer - Services Special Projects USD 150K-260KAdversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content ModerationSenior-level Full TimeSan Francisco Bay Area16h ago
-
Manager, BI + Analytics Engineer USD 150K-180KAirflow | BigQuery | DBT | Dashboards | Data ModelingMid-level Full TimeSan Francisco, CA16h ago
-
Computer Vision Engineer USD 140K-260KC++ | CUDA | Cloud processing | Computer Vision | Deep learningSenior-level Full TimeSan Jose, California, United States16h ago