Senior Data Engineer/Architect (Databricks Pro Certified)
Tasks
- Build and optimize Spark applications
- Design data architectures on Databricks
- Develop Databricks solutions on AWS and Azure
- Ensure data security
- Implement ETL processes
- Implement data governance
- Maintain data quality and integrity
- Optimize data storage and retrieval
- Provide technical guidance and mentorship
- Translate business requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon Redshift | Apache Spark | Data Governance | Data Modeling | Data Security | Data Warehousing | Databricks | ETL | Hadoop | SQL | Unity Catalog
Education
Roles
Architect | Data Architect | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R17d ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Platforms401k match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeEdwards AFB, CA, United States1d ago
-
Senior-level Full TimeOrlando, FL, United States1d ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R1d ago
-
AWS CLI | AWS RDS | Amazon Aurora | Amazon DynamoDB | Amazon EMROn site work 5 days per week | Public trust clearance required | Willingness to work on site requiredSenior-level ContractWoodlawn, United States1d ago
-
Senior-level Full TimeAtlanta, Georgia1d ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …1d ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …1d ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23551d ago
-
Staff Platform Architect, Data & AI (Remote) USD 160K-233KAI Agents | API Design | Access Control | Audit Logging | Cloud infrastructure401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R2d ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego2d ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego2d ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco2d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Data Solutions Architect USD 100K-150KAWS | Access Management | Apache Flink | Apache Kafka | AzureCareer growth | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Staff Software Engineer - Infrastructure, Data Platform USD 260K-350KApache Kafka | Apache Spark | Cloud infrastructure | Data Processing | Data Streaming401k matching | Collaborative work environment | Employee stock purchase plan | Hybrid work schedule | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, California, United States2d ago
-
Amazon Web Services | Cloud Computing | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeNortheast - United States2d ago
-
Data Engineer USD 112K-160KAWS | Airflow | Azure | CI Pipeline | CI/CD401k match | Family leave | Legal insurance | Life insurance | Medical, dental, vision plansMid-level Full TimeSanta Monica, CA, United States2d ago
-
Software Engineer, Product USD 150K-250KAPI Development | APIs | AWS S3 | Application development | Backend Services401k match | Catered meals | Commuter benefit | Dental insurance | Flexible PTOSenior-level Full TimeSan Francisco2d ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R2d ago
-
Senior Data Science Engineer I, Claims USD 170K-190KAWS | Apache Airflow | Automated testing | ClickHouse | Data Modeling401k matching | Disability and life insurance | Flexible working hours | Fully remote work | HSA & FSA optionsSenior-level Full TimeRemote R2d ago
-
Data Engineer USD 95K-129KApache Spark | Business Intelligence | Data Bricks | Data Governance | Data Modeling401k company match | Dental insurance | Employee merchandise discount | Hybrid work environment | Life insuranceMid-level Full TimePlano, TX, United States2d ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R2d ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R2d ago