Senior Data Engineer/Architect (Databricks Pro Certified)
Tasks
- Build and optimize Spark applications
- Design data architectures on Databricks
- Develop Databricks solutions on AWS and Azure
- Ensure data security
- Implement ETL processes
- Implement data governance
- Maintain data quality and integrity
- Optimize data storage and retrieval
- Provide technical guidance and mentorship
- Translate business requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon Redshift | Apache Spark | Data Governance | Data Modeling | Data Security | Data Warehousing | Databricks | ETL | Hadoop | SQL | Unity Catalog
Education
Roles
Architect | Data Architect | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
AI Governance | Agile | Cloud Architecture | Data Governance | Enterprise IntegrationDental insurance | Health insurance | Vision insuranceSenior-level Full TimeAshburn, VA, United States7h ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R9h ago
-
Data Architect-1994 USD 135K-190KAI Search | Access Control | Azure AI | Azure AI Search | Azure DataSenior-level Full TimeLatham, NY, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Visualization | Experiment design | Machine Learning | Model DeploymentSenior-level Full TimeSan Jose, California, United States10h ago
-
A/B | A/B Testing | B testing | Data Mining | Distributed ComputingMid-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KA/B | A/B Testing | B testing | Data Visualization | Deep learningSenior-level Full TimeSeattle, Washington, United States10h ago
-
Mid-level Full TimeSan Jose, California, United States10h ago
-
Data Engineer, Global Live USD 145K-250KData Modeling | Data Warehousing | Data discovery | Data integration | Data pipelineMid-level Full TimeSan Jose, California, United States10h ago
-
Big Data | Click Through Rate | Click Through Rate Optimization | Conversion Rate | Conversion rate optimizationSenior-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Pipelines | Data Visualization | Deep learning | Experiment designSenior-level Full TimeSeattle, Washington, United States10h ago
-
Applied Scientist, Search, E-Commerce Alliance USD 136K-205KData Analysis | Language Processing | Machine Learning | Model Deployment | Natural LanguageMid-level Full TimeSan Jose, California, United States10h ago
-
Behavior Modeling | Data Analysis | Information Retrieval | Language Processing | Machine LearningMid-level Full TimeSeattle, Washington, United States10h ago
-
Senior Data Engineer USD 115K-150KAWS | AWS Glue | Airflow | Amazon Redshift | Amazon S3401k contribution | Health insurance | Life insuranceSenior-level Full TimeWashington, DC17h ago
-
Business Analysis | Customer Requirements | Data Modeling | Language Models | Language ProcessingHealth insurance | Mentorship | Paid time offMid-level Full TimeNew York, US, New York19h ago
-
Cost of ownership | Customer Success | Data Modeling | Data analytics | LLMCoaching | Flexible-hybrid work | Mental health counseling | Mentorship | Paid volunteer time offMid-level Full TimeRaleigh, US, North Carolina20h ago
-
Analytics engineering | Cloud Data | Cloud Data Platforms | Data Architecture | Data GovernancePaid time offSenior-level Full TimePrinceton Pike - NJ, United States22h ago
-
Analytics | Cloud infrastructure | Data Architecture | Data Governance | Data ManagementDisability insurance | Employee assistance program | Flexible time off | Global shutdown | Paid time offSenior-level Full TimePrinceton LVL - NJ, United States22h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R22h ago
-
Mid-level Full TimeUnited States - Remote R22h ago
-
Senior Machine Learning Engineer USD 112K-183KAWS | Data Ingestion | Data Modeling | Data Quality | Data Visualization401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeMossville, Illinois, United States22h ago
-
Principal Analytics Engineer P4 (Onsite) USD 107K-204KAgile | Data analytics | Python | SQL | Web Applications401k match | Dental insurance | Eligible for relocation | Employee assistance program | Employee scholar programSenior-level Full TimeUS-CT-EAST HARTFORD-ETC ~ 400 Main St …22h ago
-
Mid-level Full TimeChildren's Healthcare of Atlanta Support Center, …22h ago
-
Lead, Financial Crime Data Science & Data Engineering USD 108K-171KAML Compliance | BSA/AML | Batch Processing | Credit Risk | Data LineageSenior-level Full TimeUS GA ATL 201, United States22h ago
-
Applied AI Engineer USD 85K-100KAnomaly Detection | CI/CD | Classification | Data Drift | DatabricksDental insurance | Disability insurance | Flexible spending accounts | Health insurance | Health savings accountsSenior-level Full TimeChicago, Illinois, USA, United States22h ago
-
Principal AI Engineer - AI Transformation USD 96K-207KAWS | Agile | Amazon Bedrock | Amazon SageMaker | Bias detectionSenior-level Full TimeFifth Third Center Cincinnati, United States22h ago