Senior Lead Software Engineer - Databricks/Spark/AWS
Jersey City, NJ, United States
USD 177K-200K (estimate) Senior-level Full Time
Tasks
- Configure Databricks clusters and workflows
- Design secure data ingestion and transformation frameworks
- Develop reusable libraries and APIs
- Enforce data quality and governance
- Implement CI/CD pipelines
- Implement data lakehouse patterns
- Lead data pipeline architecture and delivery
- Lead incident response and root cause analysis
- Mentor engineers and contribute to roadmaps
- Optimize spark performance
- Partner with security and networking teams
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site wellness
- Retirement plan
- Tuition reimbursement
Skills/Tech-stack
AWS | Apache Spark | CloudWatch | Data Modeling | Databricks | Delta Lake | ELT | ETL | Encryption | Glue | IAM | Java | Kinesis | MSK | Networking | Performance Tuning | Python | S3 | SQL | Security | Spark | Terraform | Unity Catalog
Education
Roles
Data Engineer | Data Scientist | Engineer | Scientist | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Robotics Test & Data Engineer, Mapping USD 70K-300K3D Point Cloud Processing | 3D point cloud | Bash | Cloud processing | Cloud validationMid-level Full TimeIrvine, CA4h ago
-
Junior Data Scientist USD 87K-101KA/B | A/B Testing | B testing | Classification | Data Analysis401k employer match | Childcare reimbursement | Company events | Company-paid parking | Comprehensive health coverageEntry-level Full TimeSan Diego, CA, United States7h ago
-
Senior AI Software Engineer USD 160K-198KA2A | ADK | API | Containers | EnvoyNo visa sponsorship | Remote workSenior-level Full TimeRemote US R9h ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States10h ago
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States11h ago
-
Technical Support Engineer USD 90K-125KBusiness Intelligence | CTE | Data Modeling | Data Visualization | Database401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA11h ago
-
Technical Support Engineer USD 90K-125KAWS | Amazon Redshift | Business Intelligence | CTE | Cloud Computing401k | Annual bonus | Commuter benefits | Dog-friendly office | EquitySenior-level Full TimeNew York City, NY11h ago
-
AI Research Engineer USD 190K-280KAgentic AI | Clinical data | Data Pipelines | Data integration | Deep learningDiversity and inclusion initiatives | Flexible work environment | Friendly work environment | Professional developmentMid-level Full TimeSeattle, Washington, United States; South San …12h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States12h ago
-
Generative AI Inference Engineer USD 152K-287KAWS | CUDA | Cloud platform | Diffusion Models | DockerSenior-level Full TimeUnited States13h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States13h ago
-
Senior Computational Biologist – Target ID USD 151K-230KAgentic Workflows | Causal Inference | Cloud Computing | Data integration | EHRBonus | Comprehensive benefits package | Equity compensationSenior-level Full TimeNew York, New York; Salt Lake …13h ago
-
Senior-level Full TimeMorristown, NJ, United States13h ago
-
Staff AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA14h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY14h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud Computing | Cloud platform | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeNew York City, NY14h ago
-
Senior AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA14h ago
-
Staff Data Engineer - Information Security USD 152K-248KAzure | Big Data | C# | C++ | Data PipelinesHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R15h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R15h ago
-
Machine Learning Engineer USD 155K-228KAirflow | Amazon SageMaker | Apache Spark | Argo CD | Artificial IntelligenceHealthcare insurance | Paid parental leave | Paid personal time off | Paid sick time | Paid time offMid-level Full TimeRemote - US R17h ago
-
Business Analytics Intern – Sales & CX USD 40K-50KDashboarding | Data Cleansing | Data Preparation | Data Processing | Data TransformationEntry-level Full Time InternshipCarlisle, PA, United States17h ago
-
Communication optimization | Data parallelism | Deep learning | Distributed Training | GPU AccelerationMid-level Full TimeSeattle, Washington, United States18h ago